-- Logs begin at Wed 2022-05-04 06:41:37 UTC, end at Wed 2022-05-04 07:48:35 UTC. -- May 04 07:09:16.161323 dv-cinder-790535-38-iscsi systemd[1]: Starting Devstack devstack@keystone.service... May 04 07:09:16.168519 dv-cinder-790535-38-iscsi devstack@keystone.service[79729]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini May 04 07:09:16.171125 dv-cinder-790535-38-iscsi devstack@keystone.service[79729]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed May 4 07:09:16 2022] *** May 04 07:09:16.171125 dv-cinder-790535-38-iscsi devstack@keystone.service[79729]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 May 04 07:09:16.171125 dv-cinder-790535-38-iscsi devstack@keystone.service[79729]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 May 04 07:09:16.171125 dv-cinder-790535-38-iscsi devstack@keystone.service[79729]: nodename: dv-cinder-790535-38-iscsi May 04 07:09:16.171125 dv-cinder-790535-38-iscsi devstack@keystone.service[79729]: machine: x86_64 May 04 07:09:16.171125 dv-cinder-790535-38-iscsi devstack@keystone.service[79729]: clock source: unix May 04 07:09:16.171500 dv-cinder-790535-38-iscsi devstack@keystone.service[79729]: pcre jit disabled May 04 07:09:16.173722 dv-cinder-790535-38-iscsi devstack@keystone.service[79729]: detected number of CPU cores: 4 May 04 07:09:16.173722 dv-cinder-790535-38-iscsi devstack@keystone.service[79729]: current working directory: / May 04 07:09:16.173722 dv-cinder-790535-38-iscsi devstack@keystone.service[79729]: detected binary path: /usr/bin/uwsgi-core May 04 07:09:16.173722 dv-cinder-790535-38-iscsi devstack@keystone.service[79729]: your processes number limit is 47680 May 04 07:09:16.173722 dv-cinder-790535-38-iscsi devstack@keystone.service[79729]: your memory page size is 4096 bytes May 04 07:09:16.173722 dv-cinder-790535-38-iscsi devstack@keystone.service[79729]: detected max file descriptor number: 2048 May 04 07:09:16.173722 dv-cinder-790535-38-iscsi devstack@keystone.service[79729]: lock engine: pthread robust mutexes May 04 07:09:16.173722 dv-cinder-790535-38-iscsi devstack@keystone.service[79729]: thunder lock: enabled May 04 07:09:16.173722 dv-cinder-790535-38-iscsi devstack@keystone.service[79729]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 May 04 07:09:16.173722 dv-cinder-790535-38-iscsi devstack@keystone.service[79729]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] May 04 07:09:16.217665 dv-cinder-790535-38-iscsi devstack@keystone.service[79729]: Python main interpreter initialized at 0x55c0f6f029c0 May 04 07:09:16.217665 dv-cinder-790535-38-iscsi devstack@keystone.service[79729]: python threads support enabled May 04 07:09:16.217665 dv-cinder-790535-38-iscsi devstack@keystone.service[79729]: your server socket listen backlog is limited to 100 connections May 04 07:09:16.217665 dv-cinder-790535-38-iscsi devstack@keystone.service[79729]: your mercy for graceful operations on workers is 90 seconds May 04 07:09:16.218046 dv-cinder-790535-38-iscsi devstack@keystone.service[79729]: mapped 403077 bytes (393 KB) for 2 cores May 04 07:09:16.218123 dv-cinder-790535-38-iscsi devstack@keystone.service[79729]: *** Operational MODE: preforking *** May 04 07:09:16.218364 dv-cinder-790535-38-iscsi devstack@keystone.service[79729]: *** uWSGI is running in multiple interpreter mode *** May 04 07:09:16.218364 dv-cinder-790535-38-iscsi devstack@keystone.service[79729]: spawned uWSGI master process (pid: 79729) May 04 07:09:16.218578 dv-cinder-790535-38-iscsi systemd[1]: Started Devstack devstack@keystone.service. May 04 07:09:16.219219 dv-cinder-790535-38-iscsi devstack@keystone.service[79729]: spawned uWSGI worker 1 (pid: 79744, cores: 1) May 04 07:09:16.219479 dv-cinder-790535-38-iscsi devstack@keystone.service[79729]: spawned uWSGI worker 2 (pid: 79745, cores: 1) May 04 07:09:16.219728 dv-cinder-790535-38-iscsi devstack@keystone.service[79729]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... May 04 07:09:22.037724 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 04 07:09:22.037724 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: from cryptography.utils import int_from_bytes May 04 07:09:22.038497 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 04 07:09:22.038497 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: from cryptography.utils import int_from_bytes May 04 07:09:22.087870 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=79744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 04 07:09:22.088047 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=79744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 04 07:09:22.088274 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG uwsgi [-] command line args: [] {{(pid=79744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 04 07:09:22.088495 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=79744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 04 07:09:22.088669 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG uwsgi [-] ================================================================================ {{(pid=79744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 04 07:09:22.088919 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG uwsgi [-] admin_token = **** {{(pid=79744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 07:09:22.089160 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG uwsgi [-] config_dir = [] {{(pid=79744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 07:09:22.089342 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=79744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 07:09:22.089520 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG uwsgi [-] config_source = [] {{(pid=79744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 07:09:22.089697 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG uwsgi [-] debug = True {{(pid=79744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 07:09:22.089890 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=79744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 07:09:22.092738 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=79744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 07:09:22.092738 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG uwsgi [-] insecure_debug = False {{(pid=79744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 07:09:22.092738 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=79744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 07:09:22.092738 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=79744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 07:09:22.092738 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG uwsgi [-] list_limit = None {{(pid=79744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 07:09:22.092738 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG uwsgi [-] log_config_append = None {{(pid=79744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 07:09:22.092738 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=79744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 07:09:22.092738 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG uwsgi [-] log_dir = None {{(pid=79744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 07:09:22.092738 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG uwsgi [-] log_file = None {{(pid=79744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 07:09:22.093261 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=79744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 07:09:22.093261 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=79744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 07:09:22.093261 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=79744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 07:09:22.093421 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=79744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 07:09:22.093734 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=79744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 07:09:22.093734 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=79744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 07:09:22.094002 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=79744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 07:09:22.094178 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=79744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 07:09:22.094407 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=79744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 07:09:22.094637 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=79744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 07:09:22.094867 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=79744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 07:09:22.095094 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=79744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 07:09:22.095361 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=79744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 07:09:22.095598 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG uwsgi [-] notification_format = cadf {{(pid=79744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 07:09:22.095878 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=79744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 07:09:22.096346 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.21/identity {{(pid=79744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 07:09:22.096550 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG uwsgi [-] publish_errors = False {{(pid=79744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 07:09:22.096758 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=79744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 07:09:22.096962 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=79744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 07:09:22.097128 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=79744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 07:09:22.097356 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=79744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 07:09:22.097578 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=79744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 07:09:22.097810 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG uwsgi [-] standard_threads = False {{(pid=79744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 07:09:22.098036 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG uwsgi [-] strict_password_check = False {{(pid=79744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 07:09:22.098273 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=79744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 07:09:22.098466 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG uwsgi [-] use_eventlog = False {{(pid=79744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 07:09:22.098700 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG uwsgi [-] use_journal = False {{(pid=79744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 07:09:22.098865 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG uwsgi [-] use_json = False {{(pid=79744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 07:09:22.099053 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG uwsgi [-] use_stderr = False {{(pid=79744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 07:09:22.099053 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG uwsgi [-] use_syslog = False {{(pid=79744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 07:09:22.099443 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG uwsgi [-] watch_log_file = False {{(pid=79744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 07:09:22.099604 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=79744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.099782 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=79744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.100061 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=79744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.100267 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=79744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.100512 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=79744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.100745 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=79744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.100986 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=79744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.101218 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=79744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.101459 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=79744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.101702 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=79744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.101954 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=79744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.102186 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=79744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.102429 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=79744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.102661 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=79744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.102904 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=79744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.103171 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=79744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.103401 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=79744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.103655 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=79744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.103909 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=79744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.104155 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=79744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.104387 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=79744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.104637 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=79744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.104895 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=79744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.105146 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=79744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.105390 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=79744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.105617 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=79744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.105843 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=79744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.106069 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=79744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.106301 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=79744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.106545 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=79744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.106787 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=79744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.107011 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=79744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.108231 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=79744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.110293 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=79744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.110568 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=79744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.110821 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=79744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.111082 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=79744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.111351 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=79744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.111593 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=79744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.111836 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=79744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.112070 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=79744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.112304 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=79744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.112536 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=79744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.112766 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=79744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.113004 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=79744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.113253 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=79744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.113482 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=79744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.113717 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=79744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.113945 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=79744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.114181 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=79744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.114420 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=79744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.114667 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=79744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.114897 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=79744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.115134 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=79744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.115393 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=79744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.115628 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=79744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.115865 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=79744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.116099 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=79744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.116327 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=79744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.116575 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=79744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.116808 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=79744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.117041 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=79744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.117269 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=79744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.117526 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=79744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.117759 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=79744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.117969 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=79744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.118206 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=79744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.118438 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=79744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.118708 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=79744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.118943 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=79744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.119209 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=79744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.119451 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=79744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.119683 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=79744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.119913 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=79744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.120143 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=79744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.120385 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG uwsgi [-] cache.enabled = True {{(pid=79744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.120618 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=79744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.120850 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=79744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.121088 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=79744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.121321 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=79744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.121554 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=79744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.121785 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=79744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.122017 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=79744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.122250 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=79744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.122507 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=79744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.122741 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=79744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.123251 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=79744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.123501 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=79744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.123741 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=79744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.123977 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=79744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.124212 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=79744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.124448 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=79744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.124675 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=79744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.124901 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=79744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.125042 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 04 07:09:22.125042 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: from cryptography.utils import int_from_bytes May 04 07:09:22.125648 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=79744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.125777 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 04 07:09:22.125777 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: from cryptography.utils import int_from_bytes May 04 07:09:22.126019 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=79744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.126019 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=79744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.126019 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=79744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.126019 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=79744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.126532 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=79744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.126532 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=79744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.126817 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=79744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.127102 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=79744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.127312 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=79744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.127546 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG uwsgi [-] auth.external = None {{(pid=79744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.127774 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG uwsgi [-] auth.mapped = None {{(pid=79744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.128068 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=79744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.128299 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=79744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.128527 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG uwsgi [-] auth.password = None {{(pid=79744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.128754 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG uwsgi [-] auth.token = None {{(pid=79744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.128991 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=79744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.129222 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG uwsgi [-] catalog.caching = True {{(pid=79744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.129464 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=79744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.129693 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=79744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.129939 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=79744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.130184 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=79744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.130411 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=79744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.130644 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG uwsgi [-] credential.caching = True {{(pid=79744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.130886 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG uwsgi [-] credential.driver = sql {{(pid=79744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.131132 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=79744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.131649 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=79744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.131882 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=79744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.132125 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=79744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.132356 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=79744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.132618 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=79744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.132868 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=79744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.133101 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=79744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.133351 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=79744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.133636 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=79744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.133879 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=79744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.134136 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=79744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.134376 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=79744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.134634 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=79744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.134864 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG uwsgi [-] federation.caching = True {{(pid=79744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.135097 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=79744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.135362 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG uwsgi [-] federation.driver = sql {{(pid=79744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.135605 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=79744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.135831 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=79744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.136073 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=79744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.136304 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=79744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.136556 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=79744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.136789 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=79744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.138203 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=79744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.138203 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=79744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.138203 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=79744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.138203 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG uwsgi [-] identity.caching = True {{(pid=79744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.138203 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=79744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.138203 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=79744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.139520 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=79744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.139520 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=79744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.139520 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG uwsgi [-] identity.driver = sql {{(pid=79744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.139520 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=79744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.139520 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=79744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.140539 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=79744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.140539 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=79744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.140539 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=79744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.140539 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=79744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.140539 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=79744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.141498 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=79744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.141498 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=79744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.141498 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=79744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.141498 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=79744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.142190 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=79744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.142190 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=79744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.142190 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=79744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.142737 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=79744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.142737 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=79744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.142737 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=79744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.143233 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=79744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.143233 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=79744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.143551 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=79744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.143680 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=79744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.143877 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=79744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.144105 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=79744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.144350 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=79744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.144597 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=79744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.144829 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=79744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.145070 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=79744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.145313 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=79744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.145539 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=79744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.145773 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=79744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.145996 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG uwsgi [-] ldap.password = **** {{(pid=79744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.146230 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=79744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.146461 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=79744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.146700 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=79744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.146931 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=79744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.147184 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=79744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.147428 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=79744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.147674 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=79744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.147899 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=79744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.148123 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=79744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.148367 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=79744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.148611 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=79744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.148842 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=79744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.149073 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=79744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.149302 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=79744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.149528 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG uwsgi [-] ldap.user = None {{(pid=79744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.149764 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=79744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.150019 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=79744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.150245 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=79744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.150488 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=79744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.150729 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=79744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.150970 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=79744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.151220 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=79744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.151448 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=79744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.151679 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=79744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.151910 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=79744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.152141 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=79744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.152365 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=79744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.152605 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=79744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.152845 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=79744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.153086 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=79744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.153326 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=79744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.153565 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=79744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.153790 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=79744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.154034 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=79744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.155756 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=79744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.156014 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=79744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.156262 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=79744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.156502 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=79744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.156756 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=79744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.157009 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=79744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.157252 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=79744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.157509 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG uwsgi [-] policy.driver = sql {{(pid=79744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.157740 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=79744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.157988 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=79744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.158228 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=79744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.158462 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG uwsgi [-] receipt.caching = True {{(pid=79744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.158697 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=79744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.158941 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=79744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.159220 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=79744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.159436 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=79744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.159672 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=79744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.159911 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG uwsgi [-] resource.caching = True {{(pid=79744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.160159 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=79744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.160406 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG uwsgi [-] resource.driver = sql {{(pid=79744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.160641 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=79744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.160890 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=79744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.161139 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=79744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.161371 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG uwsgi [-] revoke.caching = True {{(pid=79744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.161614 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=79744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.161848 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=79744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.162084 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG uwsgi [-] role.cache_time = None {{(pid=79744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.162447 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG uwsgi [-] role.caching = True {{(pid=79744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.162876 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG uwsgi [-] role.driver = sql {{(pid=79744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.163317 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG uwsgi [-] role.list_limit = None {{(pid=79744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.163756 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=79744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.164194 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=79744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.164630 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=79744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.165059 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=79744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.165497 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=79744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.165929 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=79744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.166364 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=79744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.166797 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=79744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.167237 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=79744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.167671 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=79744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.168104 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=79744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.168531 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=79744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.168959 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=79744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.169683 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=79744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.170744 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=79744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.171193 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=79744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.171647 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=79744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.172099 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=79744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.172478 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=79744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.172850 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=79744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.173292 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=79744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.173766 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=79744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.174011 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=79744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.174246 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=79744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.174479 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=79744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.174660 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=79745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 04 07:09:22.174801 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=79744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.174931 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=79745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 04 07:09:22.175062 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=79744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.175334 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG uwsgi [-] command line args: [] {{(pid=79745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 04 07:09:22.175494 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=79744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.175642 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=79745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 04 07:09:22.175642 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG uwsgi [-] ================================================================================ {{(pid=79745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 04 07:09:22.175888 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=79744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.176017 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG uwsgi [-] admin_token = **** {{(pid=79745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 07:09:22.176155 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=79744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.176292 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG uwsgi [-] config_dir = [] {{(pid=79745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 07:09:22.176422 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=79744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.176550 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=79745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 07:09:22.176687 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG uwsgi [-] token.cache_time = None {{(pid=79744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.176818 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG uwsgi [-] config_source = [] {{(pid=79745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 07:09:22.176956 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG uwsgi [-] token.caching = True {{(pid=79744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.177086 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG uwsgi [-] debug = True {{(pid=79745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 07:09:22.177224 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=79744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.177356 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=79745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 07:09:22.177542 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG uwsgi [-] token.provider = fernet {{(pid=79744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.177675 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=79745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 07:09:22.177675 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG uwsgi [-] insecure_debug = False {{(pid=79745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 07:09:22.177922 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=79744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.178051 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=79745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 07:09:22.178181 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=79744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.178319 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=79745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 07:09:22.178450 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=79744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.178579 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG uwsgi [-] list_limit = None {{(pid=79745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 07:09:22.178708 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=79744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.178839 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG uwsgi [-] log_config_append = None {{(pid=79745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 07:09:22.178968 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=79744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.179116 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=79745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 07:09:22.179116 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG uwsgi [-] log_dir = None {{(pid=79745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 07:09:22.179411 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=79744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.179541 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG uwsgi [-] log_file = None {{(pid=79745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 07:09:22.179669 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG uwsgi [-] trust.driver = sql {{(pid=79744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.179799 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=79745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 07:09:22.179940 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=79744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.180072 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=79745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 07:09:22.180201 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=79744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.180330 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=79745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 07:09:22.180460 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=79744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.180589 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=79745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 07:09:22.180734 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=79744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.180877 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=79745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 07:09:22.180877 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=79745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 07:09:22.181133 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=79744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.181262 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=79745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 07:09:22.181391 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=79744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.181531 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=79745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 07:09:22.181664 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=79744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.181793 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=79745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 07:09:22.181923 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=79744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.182053 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=79745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 07:09:22.182182 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG uwsgi [-] database.connection = **** {{(pid=79744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.182397 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=79745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 07:09:22.182542 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=79744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.182684 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=79745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 07:09:22.182815 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=79744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.182945 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=79745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 07:09:22.183074 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=79744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.183224 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG uwsgi [-] notification_format = cadf {{(pid=79745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 07:09:22.183367 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=79744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.183498 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=79745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 07:09:22.183636 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=79744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.183636 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=79744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.183888 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.21/identity {{(pid=79745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 07:09:22.184032 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=79744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.184163 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG uwsgi [-] publish_errors = False {{(pid=79745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 07:09:22.184292 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=79744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.184436 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=79745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 07:09:22.184566 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=79744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.184705 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=79745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 07:09:22.184836 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=79744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.184967 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=79745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 07:09:22.185097 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=79744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.185236 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=79745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 07:09:22.185367 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=79744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.185577 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=79745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 07:09:22.185577 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG uwsgi [-] standard_threads = False {{(pid=79745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 07:09:22.185829 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=79744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.185959 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG uwsgi [-] strict_password_check = False {{(pid=79745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 07:09:22.186089 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=79744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.186225 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=79745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 07:09:22.186374 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=79744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.186506 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG uwsgi [-] use_eventlog = False {{(pid=79745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 07:09:22.186635 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=79744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.186764 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG uwsgi [-] use_journal = False {{(pid=79745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 07:09:22.186892 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=79744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.187028 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG uwsgi [-] use_json = False {{(pid=79745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 07:09:22.187028 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG uwsgi [-] use_stderr = False {{(pid=79745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 07:09:22.187308 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=79744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.187438 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG uwsgi [-] use_syslog = False {{(pid=79745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 07:09:22.187657 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=79744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 04 07:09:22.187822 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG uwsgi [-] watch_log_file = False {{(pid=79745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 07:09:22.187822 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=79745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.187822 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=79745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.187822 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=79745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.187822 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=79745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.187822 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=79745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.187822 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=79745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.187822 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=79745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.187822 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=79745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.188938 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=79745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.188938 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=79745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.188938 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=79745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.188938 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=79745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.188938 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=79745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.188938 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=79745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.188938 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=79745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.188938 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=79745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.188938 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=79745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.189998 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=79745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.189998 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=79745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.189998 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=79745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.189998 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=79745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.189998 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=79745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.190587 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=79745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.190587 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=79745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.190587 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=79745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.190950 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=79745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.191078 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=79745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.191290 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=79745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.191509 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=79745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.191754 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=79745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.191999 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=79745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.192226 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=79745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.192452 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=79745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.192695 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=79745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.192937 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=79745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.193171 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=79745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.193415 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=79745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.193642 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=79745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.193872 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=79745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.194101 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=79745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.194326 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=79745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.194549 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=79745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.194772 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=79745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.194996 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=79745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.195251 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=79745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.195496 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=79745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.195727 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=79745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.195959 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=79745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.196183 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=79745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.196416 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=79745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.196648 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=79745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.196890 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=79745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.197115 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=79745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.197347 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=79745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.197579 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=79745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.197811 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=79745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.198042 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=79745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.198281 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=79745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.198507 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=79745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.198752 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=79745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.198981 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=79745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.199231 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=79745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.199460 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=79745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.199716 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=79745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.199949 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=79745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.200174 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=79745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.200405 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=79745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.200644 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=79745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.200910 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=79745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.201169 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=79745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.201414 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=79745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.201656 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=79745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.201890 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=79745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.202123 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=79745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.202354 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=79745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.202597 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG uwsgi [-] cache.enabled = True {{(pid=79745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.202830 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=79745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.203064 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=79745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.203344 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=79745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.203577 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=79745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.203810 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=79745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.204040 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=79745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.204272 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=79745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.204502 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=79745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.204758 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=79745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.204994 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=79745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.205229 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=79745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.205463 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=79745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.205702 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=79745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.205933 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=79745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.206165 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=79745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.207129 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=79745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.207129 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=79745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.207129 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=79745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.207382 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=79745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.207610 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=79745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.207837 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=79745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.208077 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=79745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.208309 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=79745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.208554 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=79745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.208786 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=79745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.209039 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=79745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.209293 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=79745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.209530 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=79745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.209755 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG uwsgi [-] auth.external = None {{(pid=79745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.209978 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG uwsgi [-] auth.mapped = None {{(pid=79745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.210393 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=79745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.210622 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=79745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.210849 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG uwsgi [-] auth.password = None {{(pid=79745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.211074 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG uwsgi [-] auth.token = None {{(pid=79745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.211408 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=79745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.211550 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG uwsgi [-] catalog.caching = True {{(pid=79745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.211795 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=79745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.212021 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=79745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.212265 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=79745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.212521 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=79745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.212749 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=79745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.212983 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG uwsgi [-] credential.caching = True {{(pid=79745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.213226 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG uwsgi [-] credential.driver = sql {{(pid=79745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.213471 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=79745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.213715 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=79745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.213947 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=79745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.214190 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=79745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.214420 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=79745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.214678 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=79745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.214927 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=79745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.215218 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=79745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.215436 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=79745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.215572 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=79744) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 07:09:22.215709 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=79745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.215839 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=79744) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 07:09:22.216037 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=79745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.216170 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=79744) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 07:09:22.216304 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=79745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.216436 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=79745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.217157 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=79745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.217785 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG uwsgi [-] federation.caching = True {{(pid=79745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.218024 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=79745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.218268 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG uwsgi [-] federation.driver = sql {{(pid=79745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.218514 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=79745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.218742 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=79745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.218988 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=79745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.219241 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=79745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.219496 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=79745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.219741 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=79745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.219995 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=79745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.220231 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=79745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.220478 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=79745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.220712 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG uwsgi [-] identity.caching = True {{(pid=79745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.220959 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=79745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.221203 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=79745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.221436 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=79745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.221668 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=79745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.221912 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG uwsgi [-] identity.driver = sql {{(pid=79745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.222138 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=79745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.222374 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=79745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.222619 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=79745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.222866 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=79745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.223091 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=79745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.223346 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=79745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.223572 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=79745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.223813 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=79745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.224055 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=79745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.224297 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=79745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.224549 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=79745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.224791 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=79745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.225058 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=79745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.225291 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=79745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.225426 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=79744) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 07:09:22.225565 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=79745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.225743 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=79745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.225976 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=79745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.226200 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=79745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.226429 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=79745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.226665 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=79745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.226993 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=79745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.227203 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=79745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.227395 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=79745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.227639 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=79745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.227881 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=79745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.228110 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=79745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.228350 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=79745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.228592 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=79745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.228816 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=79745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.229049 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=79745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.229273 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG uwsgi [-] ldap.password = **** {{(pid=79745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.229504 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=79745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.229734 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=79745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.229973 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=79745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.230203 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=79745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.230434 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=79745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.230676 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=79745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.230916 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=79745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.231141 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=79745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.231385 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=79745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.231629 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=79745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.231872 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=79745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.232111 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=79745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.233106 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=79745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.233340 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=79745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.233629 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG uwsgi [-] ldap.user = None {{(pid=79745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.233804 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=79745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.234065 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=79745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.234380 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=79745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.234570 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=79745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.234772 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=79745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.235013 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=79745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.235281 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=79745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.235511 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=79745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.235743 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=79745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.235976 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=79745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.236208 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=79745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.236440 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=79745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.236682 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=79745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.236925 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=79745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.237165 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=79745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.237405 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=79745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.237646 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=79745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.237872 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=79745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.238114 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=79745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.238349 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=79745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.238580 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=79745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.238885 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=79745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.239116 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=79745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.239292 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=79745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.239543 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=79745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.239776 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=79745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.240066 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG uwsgi [-] policy.driver = sql {{(pid=79745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.240247 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=79745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.240477 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=79745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.240707 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=79745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.240937 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG uwsgi [-] receipt.caching = True {{(pid=79745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.241168 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=79745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.241407 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=79745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.241645 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=79745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.241872 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=79745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.242102 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=79745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.242334 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG uwsgi [-] resource.caching = True {{(pid=79745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.242576 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=79745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.242818 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG uwsgi [-] resource.driver = sql {{(pid=79745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.243347 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=79745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.243599 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=79745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.243847 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=79745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.244077 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG uwsgi [-] revoke.caching = True {{(pid=79745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.244318 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=79745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.244549 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=79745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.244783 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG uwsgi [-] role.cache_time = None {{(pid=79745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.245013 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG uwsgi [-] role.caching = True {{(pid=79745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.245254 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG uwsgi [-] role.driver = sql {{(pid=79745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.245479 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG uwsgi [-] role.list_limit = None {{(pid=79745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.245725 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=79745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.245968 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=79745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.246216 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=79745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.246480 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=79745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.246721 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=79745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.246964 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=79745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.247234 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=79745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.247482 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=79745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.247710 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=79745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.248048 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=79745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.248330 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=79745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.248605 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=79745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.248750 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=79745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.249168 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=79745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.249399 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=79745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.249643 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=79745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.249888 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=79745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.250130 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=79745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.250374 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=79745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.250603 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=79745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.250852 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=79745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.251099 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=79745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.251356 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=79745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.251582 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=79745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.251808 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=79745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.252033 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=79745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.252279 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=79745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.252528 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=79745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.252771 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=79745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.253000 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=79745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.253229 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=79745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.253453 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG uwsgi [-] token.cache_time = None {{(pid=79745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.253681 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG uwsgi [-] token.caching = True {{(pid=79745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.253910 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=79745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.254151 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG uwsgi [-] token.provider = fernet {{(pid=79745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.254382 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=79745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.254632 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=79745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.254873 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=79745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.255015 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=79744) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 07:09:22.255191 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=79745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.255341 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=79744) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 07:09:22.255492 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=79745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.255630 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=79745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.255810 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG uwsgi [-] trust.driver = sql {{(pid=79745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.256039 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=79745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.256529 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=79745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.256757 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=79745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.256997 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=79745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.257238 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=79745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.257461 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=79745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.257698 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=79745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.257985 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=79745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.258238 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG uwsgi [-] database.connection = **** {{(pid=79745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.258476 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=79745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.258699 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=79745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.258934 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=79745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.259193 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=79745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.259416 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=79745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.259656 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=79745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.259886 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=79745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.260115 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=79745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.260356 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=79745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.260588 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=79745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.260829 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=79745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.261059 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=79745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.261300 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=79745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.261530 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=79745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.261768 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=79745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.261991 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=79745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.262224 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=79745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.262453 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=79745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 07:09:22.262618 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=79745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 04 07:09:22.289743 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=79745) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 07:09:22.289991 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=79745) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 07:09:22.290134 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=79745) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 07:09:22.299428 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=79745) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 07:09:22.309246 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=79744) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 07:09:22.317989 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=79745) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 07:09:22.318220 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=79745) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 07:09:22.361886 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=79745) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 07:09:22.364592 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=79744) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 07:09:22.364831 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=79744) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 07:09:22.399948 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=79745) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 07:09:22.400230 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=79745) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 07:09:22.432172 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79744) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 07:09:22.432430 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=79744) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 07:09:22.432606 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=79744) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 07:09:22.432826 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=79744) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 07:09:22.433044 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=79744) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 07:09:22.433255 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=79744) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 07:09:22.442976 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79745) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 07:09:22.452280 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=79745) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 07:09:22.452280 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=79745) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 07:09:22.452280 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=79745) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 07:09:22.452280 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=79745) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 07:09:22.452280 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=79745) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 07:09:22.457643 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79744) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 07:09:22.457915 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=79744) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 07:09:22.458062 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79745) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 07:09:22.458207 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=79744) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 07:09:22.458347 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=79745) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 07:09:22.458487 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=79744) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 07:09:22.458625 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=79745) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 07:09:22.458775 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=79744) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 07:09:22.458916 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=79745) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 07:09:22.459068 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=79744) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 07:09:22.459251 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=79745) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 07:09:22.459394 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=79744) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 07:09:22.459546 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=79745) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 07:09:22.459546 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=79745) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 07:09:22.471004 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=79744) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 07:09:22.471530 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=79745) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 07:09:22.486371 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79744) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 07:09:22.486622 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=79744) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 07:09:22.486912 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79745) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 07:09:22.487119 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=79744) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 07:09:22.487119 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=79744) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 07:09:22.487443 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=79745) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 07:09:22.487582 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=79744) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 07:09:22.487734 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=79745) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 07:09:22.487874 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=79744) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 07:09:22.488011 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=79745) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 07:09:22.488151 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=79744) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 07:09:22.488288 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=79745) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 07:09:22.488288 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=79745) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 07:09:22.488288 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=79745) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 07:09:22.505021 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=79744) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 07:09:22.505236 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=79744) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 04 07:09:22.505496 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=79745) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 07:09:22.505660 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=79744) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 07:09:22.505801 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=79745) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 04 07:09:22.505941 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=79744) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 04 07:09:22.506079 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=79744) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 07:09:22.506463 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=79745) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 07:09:22.506463 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=79745) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 04 07:09:22.506739 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=79744) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 07:09:22.506739 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=79744) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 07:09:22.507003 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=79745) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 07:09:22.507178 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=79744) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 07:09:22.507326 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=79745) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 07:09:22.507326 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=79745) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 07:09:22.507602 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=79745) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 07:09:22.518374 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=79744) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 07:09:22.518640 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=79744) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 07:09:22.518901 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=79744) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 07:09:22.519047 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=79745) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 07:09:22.519232 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=79744) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 07:09:22.519381 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=79745) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 07:09:22.519557 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=79745) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 07:09:22.519833 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=79745) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 07:09:22.527279 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=79744) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 04 07:09:22.527917 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=79745) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 04 07:09:22.530617 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=79744) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 04 07:09:22.530885 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=79744) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 07:09:22.531172 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=79744) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 07:09:22.531561 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=79744) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 07:09:22.531721 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=79745) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 04 07:09:22.531862 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=79744) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 07:09:22.532000 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=79745) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 07:09:22.532139 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=79744) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 07:09:22.532289 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=79745) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 07:09:22.532427 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=79744) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 07:09:22.532573 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=79745) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 07:09:22.532714 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=79744) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 07:09:22.532852 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=79745) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 07:09:22.532989 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=79744) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 07:09:22.533127 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=79745) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 07:09:22.533311 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=79744) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 07:09:22.533457 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=79745) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 07:09:22.533596 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=79744) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 07:09:22.533733 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=79745) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 07:09:22.533733 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=79745) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 07:09:22.534016 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=79745) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 07:09:22.534244 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=79745) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 07:09:22.561514 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=79744) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 07:09:22.562376 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=79745) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 07:09:22.563054 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=79744) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 04 07:09:22.563354 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=79744) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 07:09:22.564029 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=79745) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 04 07:09:22.564303 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=79745) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 07:09:22.568581 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=79744) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 04 07:09:22.568854 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=79744) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 07:09:22.569126 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=79744) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 07:09:22.569622 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=79745) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 04 07:09:22.569895 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=79745) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 07:09:22.570168 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=79745) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 07:09:22.576432 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=79744) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 04 07:09:22.576707 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=79744) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 07:09:22.577537 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=79745) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 04 07:09:22.577812 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=79745) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 07:09:22.581292 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=79744) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 04 07:09:22.581573 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=79744) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 07:09:22.581846 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=79744) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 07:09:22.582118 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=79744) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 07:09:22.582381 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=79744) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 07:09:22.582529 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=79745) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 04 07:09:22.582669 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=79744) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 07:09:22.582817 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=79745) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 07:09:22.582957 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=79744) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 07:09:22.583103 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=79745) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 07:09:22.583282 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=79744) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 07:09:22.583423 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=79745) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 07:09:22.583562 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=79745) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 07:09:22.583772 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=79745) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 07:09:22.584036 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=79745) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 07:09:22.584297 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=79745) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 07:09:22.602863 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=79745) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 07:09:22.603135 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=79745) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 07:09:22.606103 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=79744) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 07:09:22.606395 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=79744) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 07:09:22.608344 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=79745) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 04 07:09:22.611505 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=79744) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 04 07:09:22.611947 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=79745) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 07:09:22.612235 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=79745) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 07:09:22.615112 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=79744) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 07:09:22.615429 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=79744) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 07:09:22.617170 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=79745) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 04 07:09:22.620422 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=79744) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 04 07:09:22.620748 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=79745) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 04 07:09:22.624585 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=79744) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 04 07:09:22.625150 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=79745) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 07:09:22.625442 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=79745) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 07:09:22.625717 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=79745) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 07:09:22.625994 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=79745) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 07:09:22.626264 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=79745) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 07:09:22.626537 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=79745) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 07:09:22.628353 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=79744) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 07:09:22.628651 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=79744) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 07:09:22.628936 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=79744) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 07:09:22.629220 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=79744) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 07:09:22.629499 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=79744) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 07:09:22.629779 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=79744) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 07:09:22.645987 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=79745) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 04 07:09:22.646360 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=79745) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 07:09:22.646625 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=79745) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 07:09:22.646884 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=79745) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 07:09:22.649158 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=79744) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 04 07:09:22.649544 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=79744) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 07:09:22.649815 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=79744) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 07:09:22.650081 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=79744) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 07:09:22.655576 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=79745) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 07:09:22.657297 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=79745) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 07:09:22.657565 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=79745) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 07:09:22.658212 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=79744) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 07:09:22.659943 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=79744) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 07:09:22.660218 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=79744) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 07:09:22.660615 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=79745) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 04 07:09:22.660889 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=79745) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 07:09:22.661189 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=79745) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 07:09:22.661464 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=79745) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 07:09:22.661734 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=79745) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 07:09:22.663293 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=79744) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 04 07:09:22.663573 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=79744) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 07:09:22.663872 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=79744) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 07:09:22.664153 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=79744) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 07:09:22.664429 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=79744) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 07:09:22.675664 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=79745) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 04 07:09:22.675931 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=79745) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 07:09:22.676196 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=79745) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 07:09:22.676467 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=79745) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 07:09:22.676740 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=79745) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 07:09:22.677006 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=79745) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 07:09:22.677278 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=79745) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 07:09:22.678546 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=79744) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 04 07:09:22.678974 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=79744) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 07:09:22.679423 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=79744) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 07:09:22.679707 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=79744) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 07:09:22.680134 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=79744) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 07:09:22.680411 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=79744) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 07:09:22.680695 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=79744) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 07:09:22.695672 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=79745) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 04 07:09:22.698932 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=79745) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 04 07:09:22.699236 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=79744) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 04 07:09:22.702841 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=79745) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 07:09:22.703245 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=79744) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 04 07:09:22.704461 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=79745) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 07:09:22.706084 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=79745) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 04 07:09:22.706362 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=79745) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 07:09:22.706562 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=79744) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 07:09:22.706649 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=79745) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 07:09:22.708196 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=79744) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 07:09:22.709826 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=79744) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 04 07:09:22.710102 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=79744) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 07:09:22.710391 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=79744) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 07:09:22.714067 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=79745) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 07:09:22.715692 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=79745) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 04 07:09:22.718662 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=79744) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 07:09:22.719470 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=79745) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 07:09:22.719755 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=79745) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 07:09:22.720034 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=79745) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 07:09:22.720300 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=79745) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 07:09:22.720386 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=79744) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 04 07:09:22.723537 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=79744) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 07:09:22.723826 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=79744) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 07:09:22.724112 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=79744) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 07:09:22.724387 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=79744) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 07:09:22.729483 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=79745) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 04 07:09:22.729779 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=79745) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 07:09:22.730051 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=79745) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 07:09:22.733783 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=79744) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 04 07:09:22.734073 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=79744) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 07:09:22.734349 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=79744) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 07:09:22.738348 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=79745) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 04 07:09:22.738646 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=79745) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 07:09:22.738996 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=79745) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 07:09:22.739329 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=79745) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 07:09:22.739600 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=79745) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 07:09:22.739865 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=79745) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 07:09:22.740138 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=79745) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 07:09:22.740397 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=79745) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 07:09:22.740666 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=79745) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 07:09:22.740941 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=79745) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 07:09:22.741202 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=79745) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 07:09:22.741452 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=79745) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 07:09:22.741706 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=79745) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 07:09:22.741971 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=79745) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 07:09:22.742475 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=79744) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 04 07:09:22.742753 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=79744) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 07:09:22.743031 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=79744) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 07:09:22.743337 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=79744) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 07:09:22.743609 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=79744) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 07:09:22.743885 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=79744) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 07:09:22.744165 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=79744) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 07:09:22.744441 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=79744) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 07:09:22.744718 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=79744) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 07:09:22.744985 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=79744) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 07:09:22.745261 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=79744) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 07:09:22.745519 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=79744) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 07:09:22.745791 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=79744) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 07:09:22.746058 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=79744) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 07:09:22.783583 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55c0f6f029c0 pid: 79745 (default app) May 04 07:09:22.787065 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385f3972-5849-4fe7-b16e-d49e58a6b6be None None] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:09:22.787387 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385f3972-5849-4fe7-b16e-d49e58a6b6be None None] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:09:22.787664 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385f3972-5849-4fe7-b16e-d49e58a6b6be None None] PATH_INFO: `/v3` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:09:22.787774 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55c0f6f029c0 pid: 79744 (default app) May 04 07:09:22.791812 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 1/1] 10.222.0.21 () {50 vars in 791 bytes} [Wed May 4 07:09:22 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 07:09:30.921282 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168362f9-1699-477f-9bd6-9c4ae345c889 None None] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:09:30.921848 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168362f9-1699-477f-9bd6-9c4ae345c889 None None] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:09:30.921848 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168362f9-1699-477f-9bd6-9c4ae345c889 None None] PATH_INFO: `/` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:09:30.926109 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 1/2] 10.222.0.21 () {54 vars in 926 bytes} [Wed May 4 07:09:30 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 04 07:09:30.931134 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04053c6-a328-4d79-96cc-d4f0a8a9b490 None None] REQUEST_METHOD: `POST` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:09:30.931578 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04053c6-a328-4d79-96cc-d4f0a8a9b490 None None] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:09:30.931830 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04053c6-a328-4d79-96cc-d4f0a8a9b490 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:09:30.962353 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG oslo_db.sqlalchemy.engines [None req-a04053c6-a328-4d79-96cc-d4f0a8a9b490 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=79745) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 04 07:09:31.158130 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG passlib.handlers.bcrypt [None req-a04053c6-a328-4d79-96cc-d4f0a8a9b490 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=79745) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} May 04 07:09:31.158551 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG passlib.handlers.bcrypt [None req-a04053c6-a328-4d79-96cc-d4f0a8a9b490 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=79745) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} May 04 07:09:31.214365 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.auth.core [None req-a04053c6-a328-4d79-96cc-d4f0a8a9b490 None None] MFA Rules not processed for user `83c5e0dcb991496ea6dee38384514508`. Rule list: `[]` (Enabled: `True`). {{(pid=79745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:09:31.215937 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.fernet_utils [None req-a04053c6-a328-4d79-96cc-d4f0a8a9b490 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:09:31.338605 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 2/3] 10.222.0.21 () {58 vars in 1023 bytes} [Wed May 4 07:09:30 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 408 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) May 04 07:09:31.467351 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168362f9-1699-477f-9bd6-9c4ae345c889 None None] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:09:31.501721 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG oslo_db.sqlalchemy.engines [None req-168362f9-1699-477f-9bd6-9c4ae345c889 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=79744) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 04 07:09:31.627166 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168362f9-1699-477f-9bd6-9c4ae345c889 None None] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:09:31.631616 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624e7904-51d9-441f-8895-13535bea5b24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:09:31.632272 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624e7904-51d9-441f-8895-13535bea5b24 admin admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:09:31.632554 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624e7904-51d9-441f-8895-13535bea5b24 admin admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:09:31.632830 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624e7904-51d9-441f-8895-13535bea5b24 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:09:31.641264 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624e7904-51d9-441f-8895-13535bea5b24 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:09:31.693319 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: WARNING keystone.common.rbac_enforcer.enforcer [None req-624e7904-51d9-441f-8895-13535bea5b24 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. May 04 07:09:31.693661 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624e7904-51d9-441f-8895-13535bea5b24 admin admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:09:31.703895 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 2/4] 10.222.0.21 () {58 vars in 1324 bytes} [Wed May 4 07:09:31 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 237 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 04 07:09:31.709757 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04053c6-a328-4d79-96cc-d4f0a8a9b490 None None] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:09:31.724221 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04053c6-a328-4d79-96cc-d4f0a8a9b490 None None] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:09:31.728541 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e12c263-44c5-4e10-a078-0b1ff5722640 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:09:31.729680 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e12c263-44c5-4e10-a078-0b1ff5722640 admin admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:09:31.729962 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e12c263-44c5-4e10-a078-0b1ff5722640 admin admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:09:31.730235 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e12c263-44c5-4e10-a078-0b1ff5722640 admin admin] PATH_INFO: `/v3/projects/42382f8dc1ee4162906b55d85040da7b` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:09:31.731736 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e12c263-44c5-4e10-a078-0b1ff5722640 admin admin] RBAC: Authorizing `identity:get_project(project_id=42382f8dc1ee4162906b55d85040da7b)` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:09:31.783385 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: WARNING keystone.common.rbac_enforcer.enforcer [None req-8e12c263-44c5-4e10-a078-0b1ff5722640 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. May 04 07:09:31.783720 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e12c263-44c5-4e10-a078-0b1ff5722640 admin admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:09:31.788459 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 3/5] 10.222.0.21 () {56 vars in 1207 bytes} [Wed May 4 07:09:31 2022] GET /identity/v3/projects/42382f8dc1ee4162906b55d85040da7b => generated 344 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 07:09:33.997322 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057849d4-94a9-44ca-82c6-90fe1116e36a None None] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:09:33.997932 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057849d4-94a9-44ca-82c6-90fe1116e36a None None] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:09:33.998125 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057849d4-94a9-44ca-82c6-90fe1116e36a None None] PATH_INFO: `/` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:09:34.002328 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 3/6] 10.222.0.21 () {54 vars in 926 bytes} [Wed May 4 07:09:33 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 04 07:09:34.007936 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98b8f53-2ff1-46f7-9345-ef9ca720d1ce None None] REQUEST_METHOD: `POST` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:09:34.008355 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98b8f53-2ff1-46f7-9345-ef9ca720d1ce None None] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:09:34.008492 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98b8f53-2ff1-46f7-9345-ef9ca720d1ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:09:34.028684 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.auth.core [None req-a98b8f53-2ff1-46f7-9345-ef9ca720d1ce None None] MFA Rules not processed for user `83c5e0dcb991496ea6dee38384514508`. Rule list: `[]` (Enabled: `True`). {{(pid=79745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:09:34.030863 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.fernet_utils [None req-a98b8f53-2ff1-46f7-9345-ef9ca720d1ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:09:34.038603 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 4/7] 10.222.0.21 () {58 vars in 1023 bytes} [Wed May 4 07:09:34 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) May 04 07:09:34.061228 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057849d4-94a9-44ca-82c6-90fe1116e36a None None] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:09:34.073839 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057849d4-94a9-44ca-82c6-90fe1116e36a None None] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:09:34.078924 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfd5292-92a1-44fc-9f8d-d8f453e103e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:09:34.079630 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfd5292-92a1-44fc-9f8d-d8f453e103e5 admin admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:09:34.079913 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfd5292-92a1-44fc-9f8d-d8f453e103e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:09:34.080185 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfd5292-92a1-44fc-9f8d-d8f453e103e5 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:09:34.088690 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bfd5292-92a1-44fc-9f8d-d8f453e103e5 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:09:34.090505 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bfd5292-92a1-44fc-9f8d-d8f453e103e5 admin admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:09:34.100269 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 4/8] 10.222.0.21 () {58 vars in 1324 bytes} [Wed May 4 07:09:34 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 04 07:09:34.106079 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98b8f53-2ff1-46f7-9345-ef9ca720d1ce None None] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:09:34.115580 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98b8f53-2ff1-46f7-9345-ef9ca720d1ce None None] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:09:34.120017 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8b5e23-cf33-40c5-ae6d-dd9944ada1a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:09:34.120899 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8b5e23-cf33-40c5-ae6d-dd9944ada1a6 admin admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:09:34.121177 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8b5e23-cf33-40c5-ae6d-dd9944ada1a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:09:34.121448 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8b5e23-cf33-40c5-ae6d-dd9944ada1a6 admin admin] PATH_INFO: `/v3/users/83c5e0dcb991496ea6dee38384514508` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:09:34.123902 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8b5e23-cf33-40c5-ae6d-dd9944ada1a6 admin admin] RBAC: Authorizing `identity:get_user(user_id=83c5e0dcb991496ea6dee38384514508)` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:09:34.125935 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8b5e23-cf33-40c5-ae6d-dd9944ada1a6 admin admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:09:34.127706 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 5/9] 10.222.0.21 () {56 vars in 1198 bytes} [Wed May 4 07:09:34 2022] GET /identity/v3/users/83c5e0dcb991496ea6dee38384514508 => generated 247 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 07:09:36.469549 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73b53aa-a106-4d90-bf2b-58896d2b573e None None] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:09:36.470034 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73b53aa-a106-4d90-bf2b-58896d2b573e None None] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:09:36.470109 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73b53aa-a106-4d90-bf2b-58896d2b573e None None] PATH_INFO: `/` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:09:36.471469 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 5/10] 10.222.0.21 () {54 vars in 926 bytes} [Wed May 4 07:09:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 04 07:09:36.476143 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a50ef3-28c5-4376-9857-4e4f573233a7 None None] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:09:36.476544 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a8a39b-74ab-4e2e-b58f-e096d4272bd8 None None] REQUEST_METHOD: `POST` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:09:36.476637 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a50ef3-28c5-4376-9857-4e4f573233a7 None None] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:09:36.476714 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a8a39b-74ab-4e2e-b58f-e096d4272bd8 None None] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:09:36.476786 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a50ef3-28c5-4376-9857-4e4f573233a7 None None] PATH_INFO: `/` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:09:36.476953 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a8a39b-74ab-4e2e-b58f-e096d4272bd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:09:36.478014 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 6/11] 10.222.0.21 () {54 vars in 926 bytes} [Wed May 4 07:09:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 07:09:36.483045 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7a55a7-e82b-4f4a-897d-04ef38c7e144 None None] REQUEST_METHOD: `POST` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:09:36.483361 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7a55a7-e82b-4f4a-897d-04ef38c7e144 None None] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:09:36.483635 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7a55a7-e82b-4f4a-897d-04ef38c7e144 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:09:36.519533 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG passlib.handlers.bcrypt [None req-f9a8a39b-74ab-4e2e-b58f-e096d4272bd8 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=79744) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} May 04 07:09:36.519962 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG passlib.handlers.bcrypt [None req-f9a8a39b-74ab-4e2e-b58f-e096d4272bd8 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=79744) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} May 04 07:09:36.568339 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.auth.core [None req-f9a8a39b-74ab-4e2e-b58f-e096d4272bd8 None None] MFA Rules not processed for user `83c5e0dcb991496ea6dee38384514508`. Rule list: `[]` (Enabled: `True`). {{(pid=79744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:09:36.571228 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.fernet_utils [None req-f9a8a39b-74ab-4e2e-b58f-e096d4272bd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:09:36.617537 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.auth.core [None req-8b7a55a7-e82b-4f4a-897d-04ef38c7e144 None None] MFA Rules not processed for user `83c5e0dcb991496ea6dee38384514508`. Rule list: `[]` (Enabled: `True`). {{(pid=79745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:09:36.618719 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.fernet_utils [None req-8b7a55a7-e82b-4f4a-897d-04ef38c7e144 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:09:36.686746 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 6/12] 10.222.0.21 () {58 vars in 1023 bytes} [Wed May 4 07:09:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 04 07:09:36.707101 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 7/13] 10.222.0.21 () {58 vars in 1023 bytes} [Wed May 4 07:09:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 04 07:09:36.709817 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a8a39b-74ab-4e2e-b58f-e096d4272bd8 None None] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:09:36.727701 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7a55a7-e82b-4f4a-897d-04ef38c7e144 None None] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:09:36.809178 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a8a39b-74ab-4e2e-b58f-e096d4272bd8 None None] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:09:36.828039 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7a55a7-e82b-4f4a-897d-04ef38c7e144 None None] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:09:36.842464 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db231f37-0cc9-4a7b-8e09-e9f34922ec8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:09:36.843541 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db231f37-0cc9-4a7b-8e09-e9f34922ec8d None admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:09:36.843832 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db231f37-0cc9-4a7b-8e09-e9f34922ec8d None admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:09:36.844108 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db231f37-0cc9-4a7b-8e09-e9f34922ec8d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:09:36.855570 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db231f37-0cc9-4a7b-8e09-e9f34922ec8d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 07:09:36.860927 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebc520d-ef60-4cb8-9eb0-530592eacb8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:09:36.861574 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebc520d-ef60-4cb8-9eb0-530592eacb8d None admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:09:36.861856 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebc520d-ef60-4cb8-9eb0-530592eacb8d None admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:09:36.862131 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebc520d-ef60-4cb8-9eb0-530592eacb8d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:09:36.867178 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application [None req-db231f37-0cc9-4a7b-8e09-e9f34922ec8d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 04 07:09:36.867178 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 07:09:36.867178 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 07:09:36.867178 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 07:09:36.867178 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 07:09:36.867178 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 07:09:36.867178 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 07:09:36.867178 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 07:09:36.867178 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 07:09:36.867178 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 07:09:36.867178 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 07:09:36.867178 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 07:09:36.867178 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 07:09:36.867178 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 07:09:36.867178 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 07:09:36.867178 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 07:09:36.868167 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 07:09:36.868167 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 07:09:36.868167 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 07:09:36.868167 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 07:09:36.868167 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 07:09:36.868167 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 07:09:36.868167 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 07:09:36.868167 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 07:09:36.868167 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 07:09:36.868167 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.get_or_create( May 04 07:09:36.868167 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 07:09:36.868167 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application with Lock( May 04 07:09:36.868167 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 07:09:36.868167 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self._enter() May 04 07:09:36.868167 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 07:09:36.868167 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 07:09:36.868995 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 07:09:36.868995 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.creator() May 04 07:09:36.868995 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 07:09:36.868995 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application created_value = creator( May 04 07:09:36.868995 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 07:09:36.868995 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 07:09:36.868995 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 07:09:36.868995 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 07:09:36.868995 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 07:09:36.868995 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 07:09:36.868995 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 04 07:09:36.868995 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application May 04 07:09:36.871493 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 7/14] 10.222.0.21 () {56 vars in 1096 bytes} [Wed May 4 07:09:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 07:09:36.874122 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db231f37-0cc9-4a7b-8e09-e9f34922ec8d None admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:09:36.928676 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ebc520d-ef60-4cb8-9eb0-530592eacb8d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:09:36.930157 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ebc520d-ef60-4cb8-9eb0-530592eacb8d None admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:09:36.975539 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db231f37-0cc9-4a7b-8e09-e9f34922ec8d None admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:09:37.031181 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 8/15] 10.222.0.21 () {58 vars in 1282 bytes} [Wed May 4 07:09:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 04 07:09:37.037051 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebc520d-ef60-4cb8-9eb0-530592eacb8d None admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:09:37.117304 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0955ad14-2e88-4c1b-893f-2f8a97bcb9d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:09:37.117962 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0955ad14-2e88-4c1b-893f-2f8a97bcb9d6 None admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:09:37.118240 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0955ad14-2e88-4c1b-893f-2f8a97bcb9d6 None admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:09:37.118507 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0955ad14-2e88-4c1b-893f-2f8a97bcb9d6 None admin] PATH_INFO: `/v3/roles` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:09:37.119285 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0955ad14-2e88-4c1b-893f-2f8a97bcb9d6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79744) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 07:09:37.119592 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0955ad14-2e88-4c1b-893f-2f8a97bcb9d6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:09:37.121012 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0955ad14-2e88-4c1b-893f-2f8a97bcb9d6 None admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:09:37.133569 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 8/16] 10.222.0.21 () {56 vars in 1099 bytes} [Wed May 4 07:09:36 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 07:09:37.140206 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebc520d-ef60-4cb8-9eb0-530592eacb8d None admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:09:37.153170 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0955ad14-2e88-4c1b-893f-2f8a97bcb9d6 None admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:09:37.174861 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c365ef-51ec-4431-bd9a-ed9d5c1f14fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:09:37.179647 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c365ef-51ec-4431-bd9a-ed9d5c1f14fd None admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:09:37.179647 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c365ef-51ec-4431-bd9a-ed9d5c1f14fd None admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:09:37.179647 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c365ef-51ec-4431-bd9a-ed9d5c1f14fd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:09:37.186864 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c365ef-51ec-4431-bd9a-ed9d5c1f14fd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:09:37.188421 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c365ef-51ec-4431-bd9a-ed9d5c1f14fd None admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:09:37.209258 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application [None req-21c365ef-51ec-4431-bd9a-ed9d5c1f14fd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 07:09:37.209258 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 07:09:37.209258 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 07:09:37.209258 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 07:09:37.209258 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 07:09:37.209258 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 07:09:37.209258 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 07:09:37.209258 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 07:09:37.209258 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 07:09:37.209258 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 07:09:37.209258 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 07:09:37.209258 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 07:09:37.209258 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 07:09:37.209258 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 07:09:37.209258 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 07:09:37.210126 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 07:09:37.210126 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 07:09:37.210126 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 07:09:37.210126 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 07:09:37.210126 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 07:09:37.210126 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 07:09:37.210126 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self.get_or_create( May 04 07:09:37.210126 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 07:09:37.210126 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application with Lock( May 04 07:09:37.210126 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 07:09:37.210126 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self._enter() May 04 07:09:37.210126 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 07:09:37.210126 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 07:09:37.210126 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 07:09:37.210126 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self.creator() May 04 07:09:37.210126 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 07:09:37.210126 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application created_value = creator( May 04 07:09:37.210956 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 07:09:37.210956 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 07:09:37.210956 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 07:09:37.210956 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application May 04 07:09:37.210956 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 9/17] 10.222.0.21 () {56 vars in 1108 bytes} [Wed May 4 07:09:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 07:09:37.216275 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c365ef-51ec-4431-bd9a-ed9d5c1f14fd None admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:09:37.263838 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0955ad14-2e88-4c1b-893f-2f8a97bcb9d6 None admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:09:37.296894 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0fa9ff-7e96-45ee-a91c-dffd79dd3f57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:09:37.297773 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0fa9ff-7e96-45ee-a91c-dffd79dd3f57 None admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:09:37.298057 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0fa9ff-7e96-45ee-a91c-dffd79dd3f57 None admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:09:37.298334 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0fa9ff-7e96-45ee-a91c-dffd79dd3f57 None admin] PATH_INFO: `/v3/users/83c5e0dcb991496ea6dee38384514508` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:09:37.300247 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0fa9ff-7e96-45ee-a91c-dffd79dd3f57 None admin] RBAC: Authorizing `identity:get_user(user_id=83c5e0dcb991496ea6dee38384514508)` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:09:37.301700 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0fa9ff-7e96-45ee-a91c-dffd79dd3f57 None admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:09:37.303557 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 9/18] 10.222.0.21 () {56 vars in 1177 bytes} [Wed May 4 07:09:37 2022] GET /identity/v3/users/83c5e0dcb991496ea6dee38384514508 => generated 247 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 07:09:37.309567 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0fa9ff-7e96-45ee-a91c-dffd79dd3f57 None admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:09:37.312499 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c365ef-51ec-4431-bd9a-ed9d5c1f14fd None admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:09:37.344214 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc7412d-bbd3-4be8-b447-827caf5df8be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:09:37.344864 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc7412d-bbd3-4be8-b447-827caf5df8be None admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:09:37.345140 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc7412d-bbd3-4be8-b447-827caf5df8be None admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:09:37.345412 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc7412d-bbd3-4be8-b447-827caf5df8be None admin] PATH_INFO: `/v3/domains` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:09:37.346124 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc7412d-bbd3-4be8-b447-827caf5df8be None admin] RBAC: Adding query filter params (name=Default) {{(pid=79745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 07:09:37.346425 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc7412d-bbd3-4be8-b447-827caf5df8be None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:09:37.347844 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc7412d-bbd3-4be8-b447-827caf5df8be None admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:09:37.364248 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 10/19] 10.222.0.21 () {56 vars in 1109 bytes} [Wed May 4 07:09:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 07:09:37.410137 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0fa9ff-7e96-45ee-a91c-dffd79dd3f57 None admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:09:37.462224 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71025da-e420-403f-a39f-6495f89f8d5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:09:37.462224 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71025da-e420-403f-a39f-6495f89f8d5b None admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:09:37.462224 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71025da-e420-403f-a39f-6495f89f8d5b None admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:09:37.462224 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71025da-e420-403f-a39f-6495f89f8d5b None admin] PATH_INFO: `/v3/domains/default` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:09:37.463048 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71025da-e420-403f-a39f-6495f89f8d5b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:09:37.464588 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71025da-e420-403f-a39f-6495f89f8d5b None admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:09:37.467144 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 10/20] 10.222.0.21 () {56 vars in 1108 bytes} [Wed May 4 07:09:37 2022] GET /identity/v3/domains/default => generated 199 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 07:09:37.473048 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc7412d-bbd3-4be8-b447-827caf5df8be None admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:09:37.578427 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc7412d-bbd3-4be8-b447-827caf5df8be None admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:09:37.612021 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29771749-9c74-4690-ba4d-79525cb6182f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:09:37.612673 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29771749-9c74-4690-ba4d-79525cb6182f None admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:09:37.612946 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29771749-9c74-4690-ba4d-79525cb6182f None admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:09:37.613216 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29771749-9c74-4690-ba4d-79525cb6182f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:09:37.614041 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29771749-9c74-4690-ba4d-79525cb6182f None admin] RBAC: Adding query filter params (role.id=eb54c9cea2774a25b1fe8c79724408ee, scope.domain.id=default, user.id=83c5e0dcb991496ea6dee38384514508) {{(pid=79745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 07:09:37.614345 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29771749-9c74-4690-ba4d-79525cb6182f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:09:37.615837 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29771749-9c74-4690-ba4d-79525cb6182f None admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:09:37.622662 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 11/21] 10.222.0.21 () {56 vars in 1322 bytes} [Wed May 4 07:09:37 2022] GET /identity/v3/role_assignments?user.id=83c5e0dcb991496ea6dee38384514508&scope.domain.id=default&role.id=eb54c9cea2774a25b1fe8c79724408ee => generated 233 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 07:09:40.208098 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322bc64f-da33-4a99-ad48-228b4d2ea579 None None] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:09:40.209068 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322bc64f-da33-4a99-ad48-228b4d2ea579 None None] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:09:40.209579 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322bc64f-da33-4a99-ad48-228b4d2ea579 None None] PATH_INFO: `/` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:09:40.211482 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 11/22] 10.222.0.21 () {54 vars in 926 bytes} [Wed May 4 07:09:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 07:09:40.217124 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ba7caf-de99-44e2-9b9c-f60f875b68ea None None] REQUEST_METHOD: `POST` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:09:40.217718 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ba7caf-de99-44e2-9b9c-f60f875b68ea None None] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:09:40.217718 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ba7caf-de99-44e2-9b9c-f60f875b68ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:09:40.241262 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.auth.core [None req-69ba7caf-de99-44e2-9b9c-f60f875b68ea None None] MFA Rules not processed for user `83c5e0dcb991496ea6dee38384514508`. Rule list: `[]` (Enabled: `True`). {{(pid=79745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:09:40.242437 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.fernet_utils [None req-69ba7caf-de99-44e2-9b9c-f60f875b68ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:09:40.328832 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 12/23] 10.222.0.21 () {58 vars in 1023 bytes} [Wed May 4 07:09:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 07:09:40.363170 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322bc64f-da33-4a99-ad48-228b4d2ea579 None None] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:09:40.434296 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdedf18-a0f7-4c4a-9732-36e7d235721a None None] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:09:40.434613 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdedf18-a0f7-4c4a-9732-36e7d235721a None None] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:09:40.434849 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdedf18-a0f7-4c4a-9732-36e7d235721a None None] PATH_INFO: `/` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:09:40.436557 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 13/24] 10.222.0.21 () {54 vars in 926 bytes} [Wed May 4 07:09:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 04 07:09:40.441263 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1dff83-1dd6-493b-83db-1ab5ed6b74ca None None] REQUEST_METHOD: `POST` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:09:40.441547 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1dff83-1dd6-493b-83db-1ab5ed6b74ca None None] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:09:40.441826 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1dff83-1dd6-493b-83db-1ab5ed6b74ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:09:40.476205 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.auth.core [None req-db1dff83-1dd6-493b-83db-1ab5ed6b74ca None None] MFA Rules not processed for user `83c5e0dcb991496ea6dee38384514508`. Rule list: `[]` (Enabled: `True`). {{(pid=79745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:09:40.477705 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.fernet_utils [None req-db1dff83-1dd6-493b-83db-1ab5ed6b74ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:09:40.503901 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322bc64f-da33-4a99-ad48-228b4d2ea579 None None] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:09:40.552820 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e3123c-f0c9-44c4-861b-98a90736b607 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:09:40.552820 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e3123c-f0c9-44c4-861b-98a90736b607 None admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:09:40.553120 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e3123c-f0c9-44c4-861b-98a90736b607 None admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:09:40.553405 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e3123c-f0c9-44c4-861b-98a90736b607 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:09:40.574543 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 14/25] 10.222.0.21 () {58 vars in 1023 bytes} [Wed May 4 07:09:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 04 07:09:40.585756 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e3123c-f0c9-44c4-861b-98a90736b607 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:09:40.587642 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e3123c-f0c9-44c4-861b-98a90736b607 None admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:09:40.616249 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1dff83-1dd6-493b-83db-1ab5ed6b74ca None None] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:09:40.628341 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application [None req-f3e3123c-f0c9-44c4-861b-98a90736b607 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 07:09:40.628341 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 07:09:40.628341 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 07:09:40.628341 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 07:09:40.628341 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 07:09:40.628341 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 07:09:40.628341 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 07:09:40.628341 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 07:09:40.628341 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 07:09:40.628341 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 07:09:40.628341 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 07:09:40.628341 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 07:09:40.628341 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 07:09:40.628341 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 07:09:40.628341 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 07:09:40.629217 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 07:09:40.629217 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 07:09:40.629217 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 07:09:40.629217 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 07:09:40.629217 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 07:09:40.629217 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 07:09:40.629217 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.get_or_create( May 04 07:09:40.629217 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 07:09:40.629217 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application with Lock( May 04 07:09:40.629217 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 07:09:40.629217 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self._enter() May 04 07:09:40.629217 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 07:09:40.629217 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 07:09:40.629217 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 07:09:40.629217 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.creator() May 04 07:09:40.629217 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 07:09:40.629217 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application created_value = creator( May 04 07:09:40.630013 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 07:09:40.630013 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 07:09:40.630013 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 07:09:40.630013 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application May 04 07:09:40.640180 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 12/26] 10.222.0.21 () {56 vars in 1108 bytes} [Wed May 4 07:09:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 277 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 07:09:40.645404 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e3123c-f0c9-44c4-861b-98a90736b607 None admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:09:40.755252 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1dff83-1dd6-493b-83db-1ab5ed6b74ca None None] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:09:40.791794 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c698f967-d773-40d2-8088-c937d2db0136 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:09:40.795672 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c698f967-d773-40d2-8088-c937d2db0136 None admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:09:40.796176 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c698f967-d773-40d2-8088-c937d2db0136 None admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:09:40.796655 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c698f967-d773-40d2-8088-c937d2db0136 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:09:40.820987 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c698f967-d773-40d2-8088-c937d2db0136 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 07:09:40.834826 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application [None req-c698f967-d773-40d2-8088-c937d2db0136 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 04 07:09:40.834826 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 07:09:40.834826 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 07:09:40.834826 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 07:09:40.834826 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 07:09:40.834826 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 07:09:40.834826 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 07:09:40.834826 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 07:09:40.834826 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 07:09:40.834826 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 07:09:40.834826 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 07:09:40.834826 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 07:09:40.834826 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 07:09:40.834826 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 07:09:40.834826 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 07:09:40.834826 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 07:09:40.835772 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 07:09:40.835772 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 07:09:40.835772 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 07:09:40.835772 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 07:09:40.835772 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 07:09:40.835772 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 07:09:40.835772 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 07:09:40.835772 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 07:09:40.835772 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 07:09:40.835772 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self.get_or_create( May 04 07:09:40.835772 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 07:09:40.835772 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application with Lock( May 04 07:09:40.835772 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 07:09:40.835772 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self._enter() May 04 07:09:40.835772 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 07:09:40.835772 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 07:09:40.836515 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 07:09:40.836515 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self.creator() May 04 07:09:40.836515 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 07:09:40.836515 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application created_value = creator( May 04 07:09:40.836515 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 07:09:40.836515 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 07:09:40.836515 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 07:09:40.836515 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 07:09:40.836515 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 07:09:40.836515 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 07:09:40.836515 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 04 07:09:40.836515 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application May 04 07:09:40.842901 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 15/27] 10.222.0.21 () {56 vars in 1096 bytes} [Wed May 4 07:09:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 07:09:40.845550 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28195abd-3e61-415a-b843-d663ef5db353 None None] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:09:40.847399 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28195abd-3e61-415a-b843-d663ef5db353 None None] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:09:40.848606 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28195abd-3e61-415a-b843-d663ef5db353 None None] PATH_INFO: `/` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:09:40.850711 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 16/28] 10.222.0.21 () {54 vars in 926 bytes} [Wed May 4 07:09:40 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 07:09:40.853036 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28195abd-3e61-415a-b843-d663ef5db353 None None] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:09:40.864394 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e3123c-f0c9-44c4-861b-98a90736b607 None admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:09:40.904986 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b85ea05-aae8-48f5-b59f-da8c5de943fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:09:40.905988 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b85ea05-aae8-48f5-b59f-da8c5de943fa None admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:09:40.906861 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b85ea05-aae8-48f5-b59f-da8c5de943fa None admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:09:40.907359 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b85ea05-aae8-48f5-b59f-da8c5de943fa None admin] PATH_INFO: `/v3/domains` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:09:40.908628 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b85ea05-aae8-48f5-b59f-da8c5de943fa None admin] RBAC: Adding query filter params (name=Default) {{(pid=79744) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 07:09:40.909117 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b85ea05-aae8-48f5-b59f-da8c5de943fa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:09:40.911314 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b85ea05-aae8-48f5-b59f-da8c5de943fa None admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:09:40.934498 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 13/29] 10.222.0.21 () {56 vars in 1109 bytes} [Wed May 4 07:09:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 07:09:40.936895 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e07791e-f23a-4c99-9ab7-e41101ce54f3 None None] REQUEST_METHOD: `POST` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:09:40.937359 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e07791e-f23a-4c99-9ab7-e41101ce54f3 None None] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:09:40.937791 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e07791e-f23a-4c99-9ab7-e41101ce54f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:09:40.958488 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.auth.core [None req-5e07791e-f23a-4c99-9ab7-e41101ce54f3 None None] MFA Rules not processed for user `83c5e0dcb991496ea6dee38384514508`. Rule list: `[]` (Enabled: `True`). {{(pid=79744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:09:40.960247 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.fernet_utils [None req-5e07791e-f23a-4c99-9ab7-e41101ce54f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:09:40.980032 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28195abd-3e61-415a-b843-d663ef5db353 None None] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:09:41.018648 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edccc89f-8bd8-4079-88fd-7b147f352b23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:09:41.019550 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edccc89f-8bd8-4079-88fd-7b147f352b23 None admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:09:41.019918 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edccc89f-8bd8-4079-88fd-7b147f352b23 None admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:09:41.020314 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edccc89f-8bd8-4079-88fd-7b147f352b23 None admin] PATH_INFO: `/v3/roles` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:09:41.021133 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edccc89f-8bd8-4079-88fd-7b147f352b23 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 07:09:41.021553 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edccc89f-8bd8-4079-88fd-7b147f352b23 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:09:41.023068 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edccc89f-8bd8-4079-88fd-7b147f352b23 None admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:09:41.042292 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 17/30] 10.222.0.21 () {56 vars in 1099 bytes} [Wed May 4 07:09:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 07:09:41.044034 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc88f40d-0e47-40ba-bf14-ebaa334b18a7 None None] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:09:41.044391 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc88f40d-0e47-40ba-bf14-ebaa334b18a7 None None] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:09:41.044877 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc88f40d-0e47-40ba-bf14-ebaa334b18a7 None None] PATH_INFO: `/` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:09:41.046613 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 18/32] 10.222.0.21 () {54 vars in 926 bytes} [Wed May 4 07:09:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 07:09:41.046814 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 14/32] 10.222.0.21 () {58 vars in 1023 bytes} [Wed May 4 07:09:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 07:09:41.048017 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e07791e-f23a-4c99-9ab7-e41101ce54f3 None None] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:09:41.052075 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc88f40d-0e47-40ba-bf14-ebaa334b18a7 None None] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:09:41.159632 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc88f40d-0e47-40ba-bf14-ebaa334b18a7 None None] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:09:41.172755 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e07791e-f23a-4c99-9ab7-e41101ce54f3 None None] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:09:41.194672 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665b40e7-3b8a-43ce-9c4c-8c6670d3e9f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:09:41.195665 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665b40e7-3b8a-43ce-9c4c-8c6670d3e9f5 None admin] REQUEST_METHOD: `POST` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:09:41.195884 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665b40e7-3b8a-43ce-9c4c-8c6670d3e9f5 None admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:09:41.196248 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665b40e7-3b8a-43ce-9c4c-8c6670d3e9f5 None admin] PATH_INFO: `/v3/projects` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:09:41.197105 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665b40e7-3b8a-43ce-9c4c-8c6670d3e9f5 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:09:41.198720 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665b40e7-3b8a-43ce-9c4c-8c6670d3e9f5 None admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:09:41.213476 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec75c6f-a326-4b35-abd2-db5adbdd39f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:09:41.214899 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec75c6f-a326-4b35-abd2-db5adbdd39f2 None admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:09:41.215349 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec75c6f-a326-4b35-abd2-db5adbdd39f2 None admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:09:41.215772 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec75c6f-a326-4b35-abd2-db5adbdd39f2 None admin] PATH_INFO: `/v3/users/83c5e0dcb991496ea6dee38384514508` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:09:41.217774 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec75c6f-a326-4b35-abd2-db5adbdd39f2 None admin] RBAC: Authorizing `identity:get_user(user_id=83c5e0dcb991496ea6dee38384514508)` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:09:41.219429 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec75c6f-a326-4b35-abd2-db5adbdd39f2 None admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:09:41.221364 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 15/33] 10.222.0.21 () {56 vars in 1177 bytes} [Wed May 4 07:09:41 2022] GET /identity/v3/users/83c5e0dcb991496ea6dee38384514508 => generated 247 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 07:09:41.222957 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83393e10-dd2c-47a3-b371-086c4e498a5a None None] REQUEST_METHOD: `POST` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:09:41.223487 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83393e10-dd2c-47a3-b371-086c4e498a5a None None] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:09:41.223956 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83393e10-dd2c-47a3-b371-086c4e498a5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:09:41.242170 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.auth.core [None req-83393e10-dd2c-47a3-b371-086c4e498a5a None None] MFA Rules not processed for user `83c5e0dcb991496ea6dee38384514508`. Rule list: `[]` (Enabled: `True`). {{(pid=79744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:09:41.243693 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.fernet_utils [None req-83393e10-dd2c-47a3-b371-086c4e498a5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:09:41.311782 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 16/34] 10.222.0.21 () {58 vars in 1023 bytes} [Wed May 4 07:09:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 07:09:41.313025 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83393e10-dd2c-47a3-b371-086c4e498a5a None None] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:09:41.369430 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 19/35] 10.222.0.21 () {60 vars in 1141 bytes} [Wed May 4 07:09:41 2022] POST /identity/v3/projects => generated 301 bytes in 322 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 07:09:41.370574 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665b40e7-3b8a-43ce-9c4c-8c6670d3e9f5 None admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:09:41.420060 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83393e10-dd2c-47a3-b371-086c4e498a5a None None] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:09:41.472644 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b864c29d-25d8-4090-9ae1-88aa4a82978d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:09:41.473704 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b864c29d-25d8-4090-9ae1-88aa4a82978d None admin] REQUEST_METHOD: `POST` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:09:41.474182 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b864c29d-25d8-4090-9ae1-88aa4a82978d None admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:09:41.474672 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b864c29d-25d8-4090-9ae1-88aa4a82978d None admin] PATH_INFO: `/v3/roles` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:09:41.475670 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b864c29d-25d8-4090-9ae1-88aa4a82978d None admin] RBAC: Authorizing `identity:create_role()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:09:41.477293 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b864c29d-25d8-4090-9ae1-88aa4a82978d None admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:09:41.543979 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665b40e7-3b8a-43ce-9c4c-8c6670d3e9f5 None admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:09:41.580944 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e92c68-26de-4efd-9982-eb9c17a282ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:09:41.581662 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e92c68-26de-4efd-9982-eb9c17a282ff None admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:09:41.581939 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e92c68-26de-4efd-9982-eb9c17a282ff None admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:09:41.582279 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e92c68-26de-4efd-9982-eb9c17a282ff None admin] PATH_INFO: `/v3/domains/default` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:09:41.583628 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e92c68-26de-4efd-9982-eb9c17a282ff None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:09:41.585205 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e92c68-26de-4efd-9982-eb9c17a282ff None admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:09:41.592276 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 20/36] 10.222.0.21 () {56 vars in 1108 bytes} [Wed May 4 07:09:41 2022] GET /identity/v3/domains/default => generated 199 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 07:09:41.593253 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e92c68-26de-4efd-9982-eb9c17a282ff None admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:09:41.641814 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 17/37] 10.222.0.21 () {60 vars in 1131 bytes} [Wed May 4 07:09:41 2022] POST /identity/v3/roles => generated 219 bytes in 329 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 07:09:41.643409 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e0ece2-4f41-4d0b-b642-415c50e6b6f9 None None] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:09:41.643705 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e0ece2-4f41-4d0b-b642-415c50e6b6f9 None None] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:09:41.643987 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e0ece2-4f41-4d0b-b642-415c50e6b6f9 None None] PATH_INFO: `/` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:09:41.645451 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 18/38] 10.222.0.21 () {54 vars in 926 bytes} [Wed May 4 07:09:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 07:09:41.646235 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e0ece2-4f41-4d0b-b642-415c50e6b6f9 None None] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:09:41.705266 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e92c68-26de-4efd-9982-eb9c17a282ff None admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:09:41.741770 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43625f4-ce8b-423e-9e8f-8fc056bcd6f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:09:41.742474 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43625f4-ce8b-423e-9e8f-8fc056bcd6f6 None admin] REQUEST_METHOD: `POST` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:09:41.742753 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43625f4-ce8b-423e-9e8f-8fc056bcd6f6 None admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:09:41.743047 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43625f4-ce8b-423e-9e8f-8fc056bcd6f6 None admin] PATH_INFO: `/v3/roles` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:09:41.743845 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43625f4-ce8b-423e-9e8f-8fc056bcd6f6 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:09:41.745283 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43625f4-ce8b-423e-9e8f-8fc056bcd6f6 None admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:09:41.767624 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 21/39] 10.222.0.21 () {60 vars in 1131 bytes} [Wed May 4 07:09:41 2022] POST /identity/v3/roles => generated 225 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 07:09:41.771547 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e7f10d-15b5-4054-a47f-d667c8120a7f None None] REQUEST_METHOD: `POST` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:09:41.771866 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e7f10d-15b5-4054-a47f-d667c8120a7f None None] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:09:41.772210 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e7f10d-15b5-4054-a47f-d667c8120a7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:09:41.818669 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.auth.core [None req-94e7f10d-15b5-4054-a47f-d667c8120a7f None None] MFA Rules not processed for user `83c5e0dcb991496ea6dee38384514508`. Rule list: `[]` (Enabled: `True`). {{(pid=79745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:09:41.822134 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.fernet_utils [None req-94e7f10d-15b5-4054-a47f-d667c8120a7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:09:41.831698 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e0ece2-4f41-4d0b-b642-415c50e6b6f9 None None] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:09:41.888883 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff428553-593e-4738-985d-9575974f54ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:09:41.890269 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff428553-593e-4738-985d-9575974f54ca None admin] REQUEST_METHOD: `PUT` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:09:41.890760 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff428553-593e-4738-985d-9575974f54ca None admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:09:41.891300 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff428553-593e-4738-985d-9575974f54ca None admin] PATH_INFO: `/v3/domains/default/users/83c5e0dcb991496ea6dee38384514508/roles/eb54c9cea2774a25b1fe8c79724408ee` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:09:41.894304 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff428553-593e-4738-985d-9575974f54ca None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=83c5e0dcb991496ea6dee38384514508, role_id=eb54c9cea2774a25b1fe8c79724408ee)` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:09:41.896172 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff428553-593e-4738-985d-9575974f54ca None admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:09:41.917706 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 19/40] 10.222.0.21 () {58 vars in 1361 bytes} [Wed May 4 07:09:41 2022] PUT /identity/v3/domains/default/users/83c5e0dcb991496ea6dee38384514508/roles/eb54c9cea2774a25b1fe8c79724408ee => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 07:09:41.933201 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 22/41] 10.222.0.21 () {58 vars in 1023 bytes} [Wed May 4 07:09:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 07:09:41.959904 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff428553-593e-4738-985d-9575974f54ca None admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:09:42.080211 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff428553-593e-4738-985d-9575974f54ca None admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:09:42.121366 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789bc8e9-feb4-4c2c-bbcc-de84881d7ec1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:09:42.122047 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789bc8e9-feb4-4c2c-bbcc-de84881d7ec1 None admin] REQUEST_METHOD: `POST` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:09:42.122331 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789bc8e9-feb4-4c2c-bbcc-de84881d7ec1 None admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:09:42.122724 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789bc8e9-feb4-4c2c-bbcc-de84881d7ec1 None admin] PATH_INFO: `/v3/roles` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:09:42.123826 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789bc8e9-feb4-4c2c-bbcc-de84881d7ec1 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:09:42.125289 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789bc8e9-feb4-4c2c-bbcc-de84881d7ec1 None admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:09:42.144770 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 20/42] 10.222.0.21 () {60 vars in 1131 bytes} [Wed May 4 07:09:41 2022] POST /identity/v3/roles => generated 223 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 07:09:42.300151 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92785cf5-0a0d-4ba6-8d30-8cfea9214b2b None None] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:09:42.300521 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92785cf5-0a0d-4ba6-8d30-8cfea9214b2b None None] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:09:42.300718 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92785cf5-0a0d-4ba6-8d30-8cfea9214b2b None None] PATH_INFO: `/` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:09:42.302307 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 23/43] 10.222.0.21 () {54 vars in 926 bytes} [Wed May 4 07:09:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 07:09:42.307706 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cb2772-c273-490d-9b2d-c5113114a5eb None None] REQUEST_METHOD: `POST` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:09:42.308224 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cb2772-c273-490d-9b2d-c5113114a5eb None None] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:09:42.308310 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cb2772-c273-490d-9b2d-c5113114a5eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:09:42.325911 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.auth.core [None req-52cb2772-c273-490d-9b2d-c5113114a5eb None None] MFA Rules not processed for user `83c5e0dcb991496ea6dee38384514508`. Rule list: `[]` (Enabled: `True`). {{(pid=79744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:09:42.327462 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.fernet_utils [None req-52cb2772-c273-490d-9b2d-c5113114a5eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:09:42.394662 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 21/44] 10.222.0.21 () {58 vars in 1023 bytes} [Wed May 4 07:09:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 07:09:42.417665 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92785cf5-0a0d-4ba6-8d30-8cfea9214b2b None None] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:09:42.515890 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92785cf5-0a0d-4ba6-8d30-8cfea9214b2b None None] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:09:42.547627 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d354942-0481-4aec-a435-994e6aa744f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:09:42.548413 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d354942-0481-4aec-a435-994e6aa744f3 None admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:09:42.548698 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d354942-0481-4aec-a435-994e6aa744f3 None admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:09:42.548975 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d354942-0481-4aec-a435-994e6aa744f3 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:09:42.550142 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d354942-0481-4aec-a435-994e6aa744f3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:09:42.551650 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d354942-0481-4aec-a435-994e6aa744f3 None admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:09:42.553264 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 24/45] 10.222.0.21 () {56 vars in 1108 bytes} [Wed May 4 07:09:42 2022] GET /identity/v3/domains/default => generated 199 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 07:09:42.558869 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52cb2772-c273-490d-9b2d-c5113114a5eb None None] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:09:42.653271 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52cb2772-c273-490d-9b2d-c5113114a5eb None None] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:09:42.686714 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d2f418-c41f-44eb-9b49-1396ac8a38e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:09:42.687400 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d2f418-c41f-44eb-9b49-1396ac8a38e1 None admin] REQUEST_METHOD: `POST` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:09:42.687685 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d2f418-c41f-44eb-9b49-1396ac8a38e1 None admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:09:42.687962 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d2f418-c41f-44eb-9b49-1396ac8a38e1 None admin] PATH_INFO: `/v3/projects` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:09:42.688669 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d2f418-c41f-44eb-9b49-1396ac8a38e1 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:09:42.690105 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d2f418-c41f-44eb-9b49-1396ac8a38e1 None admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:09:42.717309 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 22/46] 10.222.0.21 () {60 vars in 1141 bytes} [Wed May 4 07:09:42 2022] POST /identity/v3/projects => generated 312 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 07:09:44.243877 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e808a68-a62a-4b40-a0da-17a3f04e562e None None] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:09:44.244390 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e808a68-a62a-4b40-a0da-17a3f04e562e None None] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:09:44.244516 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e808a68-a62a-4b40-a0da-17a3f04e562e None None] PATH_INFO: `/` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:09:44.245780 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 25/47] 10.222.0.21 () {54 vars in 926 bytes} [Wed May 4 07:09:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 07:09:44.251002 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1754c796-1bf6-4953-9804-efa351bd2468 None None] REQUEST_METHOD: `POST` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:09:44.251467 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1754c796-1bf6-4953-9804-efa351bd2468 None None] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:09:44.251596 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1754c796-1bf6-4953-9804-efa351bd2468 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:09:44.268891 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.auth.core [None req-1754c796-1bf6-4953-9804-efa351bd2468 None None] MFA Rules not processed for user `83c5e0dcb991496ea6dee38384514508`. Rule list: `[]` (Enabled: `True`). {{(pid=79744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:09:44.270063 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.fernet_utils [None req-1754c796-1bf6-4953-9804-efa351bd2468 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:09:44.332601 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 23/48] 10.222.0.21 () {58 vars in 1023 bytes} [Wed May 4 07:09:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 07:09:44.355606 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e808a68-a62a-4b40-a0da-17a3f04e562e None None] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:09:44.456422 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e808a68-a62a-4b40-a0da-17a3f04e562e None None] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:09:44.489234 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ab7f44-f91c-4111-95ca-33cc7db397fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:09:44.490024 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ab7f44-f91c-4111-95ca-33cc7db397fa None admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:09:44.490305 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ab7f44-f91c-4111-95ca-33cc7db397fa None admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:09:44.490580 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ab7f44-f91c-4111-95ca-33cc7db397fa None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:09:44.500322 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ab7f44-f91c-4111-95ca-33cc7db397fa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 07:09:44.508029 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application [None req-83ab7f44-f91c-4111-95ca-33cc7db397fa None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 04 07:09:44.508029 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 07:09:44.508029 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 07:09:44.508029 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 07:09:44.508029 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 07:09:44.508029 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 07:09:44.508029 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 07:09:44.508029 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 07:09:44.508029 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 07:09:44.508029 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 07:09:44.508029 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 07:09:44.508029 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 07:09:44.508029 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 07:09:44.508029 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 07:09:44.508029 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 07:09:44.508029 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 07:09:44.508937 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 07:09:44.508937 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 07:09:44.508937 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 07:09:44.508937 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 07:09:44.508937 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 07:09:44.508937 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 07:09:44.508937 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 07:09:44.508937 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 07:09:44.508937 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 07:09:44.508937 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self.get_or_create( May 04 07:09:44.508937 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 07:09:44.508937 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application with Lock( May 04 07:09:44.508937 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 07:09:44.508937 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self._enter() May 04 07:09:44.508937 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 07:09:44.508937 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 07:09:44.509689 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 07:09:44.509689 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self.creator() May 04 07:09:44.509689 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 07:09:44.509689 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application created_value = creator( May 04 07:09:44.509689 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 07:09:44.509689 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 07:09:44.509689 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 07:09:44.509689 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 07:09:44.509689 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 07:09:44.509689 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 07:09:44.509689 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 04 07:09:44.509689 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application May 04 07:09:44.509689 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 26/49] 10.222.0.21 () {56 vars in 1096 bytes} [Wed May 4 07:09:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 07:09:44.516916 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1754c796-1bf6-4953-9804-efa351bd2468 None None] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:09:44.610298 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1754c796-1bf6-4953-9804-efa351bd2468 None None] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:09:44.643866 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c1ab79-0c28-431b-bc6f-570861302290 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:09:44.644572 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c1ab79-0c28-431b-bc6f-570861302290 None admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:09:44.644857 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c1ab79-0c28-431b-bc6f-570861302290 None admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:09:44.645128 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c1ab79-0c28-431b-bc6f-570861302290 None admin] PATH_INFO: `/v3/roles` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:09:44.645874 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c1ab79-0c28-431b-bc6f-570861302290 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79744) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 07:09:44.646179 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c1ab79-0c28-431b-bc6f-570861302290 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:09:44.647599 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c1ab79-0c28-431b-bc6f-570861302290 None admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:09:44.655703 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 24/50] 10.222.0.21 () {56 vars in 1099 bytes} [Wed May 4 07:09:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 07:09:44.661193 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ab7f44-f91c-4111-95ca-33cc7db397fa None admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:09:44.753603 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ab7f44-f91c-4111-95ca-33cc7db397fa None admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:09:44.786282 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423d512b-2dd3-425e-ad3f-3ac64b0fca74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:09:44.787166 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423d512b-2dd3-425e-ad3f-3ac64b0fca74 None admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:09:44.787446 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423d512b-2dd3-425e-ad3f-3ac64b0fca74 None admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:09:44.787713 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423d512b-2dd3-425e-ad3f-3ac64b0fca74 None admin] PATH_INFO: `/v3/users/83c5e0dcb991496ea6dee38384514508` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:09:44.788965 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423d512b-2dd3-425e-ad3f-3ac64b0fca74 None admin] RBAC: Authorizing `identity:get_user(user_id=83c5e0dcb991496ea6dee38384514508)` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:09:44.790417 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423d512b-2dd3-425e-ad3f-3ac64b0fca74 None admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:09:44.792079 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 27/51] 10.222.0.21 () {56 vars in 1177 bytes} [Wed May 4 07:09:44 2022] GET /identity/v3/users/83c5e0dcb991496ea6dee38384514508 => generated 247 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 07:09:44.798257 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c1ab79-0c28-431b-bc6f-570861302290 None admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:09:44.895534 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c1ab79-0c28-431b-bc6f-570861302290 None admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:09:44.927421 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae472d3-9a06-452c-9f93-c8b3db67388e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:09:44.928201 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae472d3-9a06-452c-9f93-c8b3db67388e None admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:09:44.928478 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae472d3-9a06-452c-9f93-c8b3db67388e None admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:09:44.928748 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae472d3-9a06-452c-9f93-c8b3db67388e None admin] PATH_INFO: `/v3/domains/default` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:09:44.929908 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae472d3-9a06-452c-9f93-c8b3db67388e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:09:44.931379 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae472d3-9a06-452c-9f93-c8b3db67388e None admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:09:44.932969 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 25/52] 10.222.0.21 () {56 vars in 1108 bytes} [Wed May 4 07:09:44 2022] GET /identity/v3/domains/default => generated 199 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 07:09:44.938792 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423d512b-2dd3-425e-ad3f-3ac64b0fca74 None admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:09:44.996367 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08669b37-1d66-46e2-99b1-101f945e155d None None] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:09:44.996660 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08669b37-1d66-46e2-99b1-101f945e155d None None] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:09:44.996948 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08669b37-1d66-46e2-99b1-101f945e155d None None] PATH_INFO: `/` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:09:44.998444 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 26/53] 10.222.0.21 () {54 vars in 926 bytes} [Wed May 4 07:09:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 04 07:09:45.003296 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e401d3-c296-47b3-93e9-f9dac8860a9d None None] REQUEST_METHOD: `POST` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:09:45.003585 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e401d3-c296-47b3-93e9-f9dac8860a9d None None] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:09:45.003916 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e401d3-c296-47b3-93e9-f9dac8860a9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:09:45.023692 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.auth.core [None req-88e401d3-c296-47b3-93e9-f9dac8860a9d None None] MFA Rules not processed for user `83c5e0dcb991496ea6dee38384514508`. Rule list: `[]` (Enabled: `True`). {{(pid=79744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:09:45.024895 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.fernet_utils [None req-88e401d3-c296-47b3-93e9-f9dac8860a9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:09:45.036840 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423d512b-2dd3-425e-ad3f-3ac64b0fca74 None admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:09:45.068276 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18df5ba-be20-4850-90a1-7d14bbb3ef1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:09:45.069065 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18df5ba-be20-4850-90a1-7d14bbb3ef1f None admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:09:45.069532 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18df5ba-be20-4850-90a1-7d14bbb3ef1f None admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:09:45.069998 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18df5ba-be20-4850-90a1-7d14bbb3ef1f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:09:45.071573 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18df5ba-be20-4850-90a1-7d14bbb3ef1f None admin] RBAC: Adding query filter params (role.id=eb54c9cea2774a25b1fe8c79724408ee, scope.domain.id=default, user.id=83c5e0dcb991496ea6dee38384514508) {{(pid=79745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 07:09:45.072117 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18df5ba-be20-4850-90a1-7d14bbb3ef1f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:09:45.073945 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18df5ba-be20-4850-90a1-7d14bbb3ef1f None admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:09:45.080352 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 28/54] 10.222.0.21 () {56 vars in 1322 bytes} [Wed May 4 07:09:44 2022] GET /identity/v3/role_assignments?user.id=83c5e0dcb991496ea6dee38384514508&scope.domain.id=default&role.id=eb54c9cea2774a25b1fe8c79724408ee => generated 530 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 07:09:45.097952 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 27/55] 10.222.0.21 () {58 vars in 1023 bytes} [Wed May 4 07:09:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 04 07:09:45.125720 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18df5ba-be20-4850-90a1-7d14bbb3ef1f None admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:09:45.227660 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18df5ba-be20-4850-90a1-7d14bbb3ef1f None admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:09:45.261465 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d96dcb1-b802-4790-97d0-bac69ccd66d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:09:45.262194 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d96dcb1-b802-4790-97d0-bac69ccd66d7 None admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:09:45.262469 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d96dcb1-b802-4790-97d0-bac69ccd66d7 None admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:09:45.262740 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d96dcb1-b802-4790-97d0-bac69ccd66d7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:09:45.264875 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d96dcb1-b802-4790-97d0-bac69ccd66d7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:09:45.266329 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d96dcb1-b802-4790-97d0-bac69ccd66d7 None admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:09:45.267992 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 29/56] 10.222.0.21 () {56 vars in 1108 bytes} [Wed May 4 07:09:45 2022] GET /identity/v3/domains/default => generated 199 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 07:09:45.273573 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e401d3-c296-47b3-93e9-f9dac8860a9d None None] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:09:45.368990 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e401d3-c296-47b3-93e9-f9dac8860a9d None None] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:09:45.403590 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4774ed2-78a9-42fd-aaba-908cfec5c525 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:09:45.404768 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4774ed2-78a9-42fd-aaba-908cfec5c525 None admin] REQUEST_METHOD: `POST` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:09:45.405049 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4774ed2-78a9-42fd-aaba-908cfec5c525 None admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:09:45.405328 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4774ed2-78a9-42fd-aaba-908cfec5c525 None admin] PATH_INFO: `/v3/projects` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:09:45.406052 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4774ed2-78a9-42fd-aaba-908cfec5c525 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:09:45.407531 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4774ed2-78a9-42fd-aaba-908cfec5c525 None admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:09:45.431550 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 28/57] 10.222.0.21 () {60 vars in 1140 bytes} [Wed May 4 07:09:45 2022] POST /identity/v3/projects => generated 298 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 07:09:47.632301 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021d5ffd-2124-4c66-a9d6-f616ffef2673 None None] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:09:47.632827 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021d5ffd-2124-4c66-a9d6-f616ffef2673 None None] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:09:47.632827 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021d5ffd-2124-4c66-a9d6-f616ffef2673 None None] PATH_INFO: `/` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:09:47.634202 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 30/58] 10.222.0.21 () {54 vars in 926 bytes} [Wed May 4 07:09:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 07:09:47.639406 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6c423b-fe2f-44e2-b379-268eeb8f6c1c None None] REQUEST_METHOD: `POST` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:09:47.639817 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6c423b-fe2f-44e2-b379-268eeb8f6c1c None None] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:09:47.639968 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6c423b-fe2f-44e2-b379-268eeb8f6c1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:09:47.656555 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.auth.core [None req-3f6c423b-fe2f-44e2-b379-268eeb8f6c1c None None] MFA Rules not processed for user `83c5e0dcb991496ea6dee38384514508`. Rule list: `[]` (Enabled: `True`). {{(pid=79744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:09:47.657738 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.fernet_utils [None req-3f6c423b-fe2f-44e2-b379-268eeb8f6c1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:09:47.719957 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 29/59] 10.222.0.21 () {58 vars in 1023 bytes} [Wed May 4 07:09:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 07:09:47.744119 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021d5ffd-2124-4c66-a9d6-f616ffef2673 None None] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:09:47.837875 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021d5ffd-2124-4c66-a9d6-f616ffef2673 None None] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:09:47.869260 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4dec5b-6e50-499e-a437-649f0dd0b0b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:09:47.870027 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4dec5b-6e50-499e-a437-649f0dd0b0b2 None admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:09:47.870306 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4dec5b-6e50-499e-a437-649f0dd0b0b2 None admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:09:47.870578 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4dec5b-6e50-499e-a437-649f0dd0b0b2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:09:47.871752 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4dec5b-6e50-499e-a437-649f0dd0b0b2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:09:47.873199 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4dec5b-6e50-499e-a437-649f0dd0b0b2 None admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:09:47.874761 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 31/60] 10.222.0.21 () {56 vars in 1108 bytes} [Wed May 4 07:09:47 2022] GET /identity/v3/domains/default => generated 199 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 07:09:47.880200 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6c423b-fe2f-44e2-b379-268eeb8f6c1c None None] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:09:47.979115 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6c423b-fe2f-44e2-b379-268eeb8f6c1c None None] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:09:48.011505 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed17dfe4-fb73-4b30-9efe-13851bc99405 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:09:48.012412 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed17dfe4-fb73-4b30-9efe-13851bc99405 None admin] REQUEST_METHOD: `POST` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:09:48.012905 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed17dfe4-fb73-4b30-9efe-13851bc99405 None admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:09:48.013816 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed17dfe4-fb73-4b30-9efe-13851bc99405 None admin] PATH_INFO: `/v3/users` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:09:48.014712 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed17dfe4-fb73-4b30-9efe-13851bc99405 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:09:48.016333 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed17dfe4-fb73-4b30-9efe-13851bc99405 None admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:09:48.041246 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 30/61] 10.222.0.21 () {60 vars in 1132 bytes} [Wed May 4 07:09:47 2022] POST /identity/v3/users => generated 275 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 07:09:51.440683 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22550e71-b402-4f3f-8af9-16cdb7a27a46 None None] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:09:51.441714 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22550e71-b402-4f3f-8af9-16cdb7a27a46 None None] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:09:51.442223 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22550e71-b402-4f3f-8af9-16cdb7a27a46 None None] PATH_INFO: `/` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:09:51.444206 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 32/62] 10.222.0.21 () {54 vars in 926 bytes} [Wed May 4 07:09:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 07:09:51.453937 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decda6a5-e114-43bb-b848-c0719a92b578 None None] REQUEST_METHOD: `POST` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:09:51.454344 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decda6a5-e114-43bb-b848-c0719a92b578 None None] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:09:51.454515 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decda6a5-e114-43bb-b848-c0719a92b578 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:09:51.480199 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.auth.core [None req-decda6a5-e114-43bb-b848-c0719a92b578 None None] MFA Rules not processed for user `83c5e0dcb991496ea6dee38384514508`. Rule list: `[]` (Enabled: `True`). {{(pid=79744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:09:51.481394 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.fernet_utils [None req-decda6a5-e114-43bb-b848-c0719a92b578 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:09:51.569028 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 31/63] 10.222.0.21 () {58 vars in 1023 bytes} [Wed May 4 07:09:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 07:09:51.596667 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22550e71-b402-4f3f-8af9-16cdb7a27a46 None None] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:09:51.598992 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc3584b-64b6-4feb-b31e-cb1d387d6429 None None] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:09:51.599317 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc3584b-64b6-4feb-b31e-cb1d387d6429 None None] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:09:51.599602 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc3584b-64b6-4feb-b31e-cb1d387d6429 None None] PATH_INFO: `/` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:09:51.601268 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 32/64] 10.222.0.21 () {54 vars in 926 bytes} [Wed May 4 07:09:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 07:09:51.605952 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55e7a28-7fed-449f-b086-6abdd42cb1c1 None None] REQUEST_METHOD: `POST` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:09:51.606271 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55e7a28-7fed-449f-b086-6abdd42cb1c1 None None] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:09:51.606553 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55e7a28-7fed-449f-b086-6abdd42cb1c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:09:51.636954 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.auth.core [None req-c55e7a28-7fed-449f-b086-6abdd42cb1c1 None None] MFA Rules not processed for user `83c5e0dcb991496ea6dee38384514508`. Rule list: `[]` (Enabled: `True`). {{(pid=79744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:09:51.639046 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.fernet_utils [None req-c55e7a28-7fed-449f-b086-6abdd42cb1c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:09:51.760435 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22550e71-b402-4f3f-8af9-16cdb7a27a46 None None] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:09:51.769156 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 33/65] 10.222.0.21 () {58 vars in 1023 bytes} [Wed May 4 07:09:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 04 07:09:51.770570 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad69e1f-f342-40fe-8870-829e20bc3ccb None None] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:09:51.770861 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad69e1f-f342-40fe-8870-829e20bc3ccb None None] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:09:51.771141 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad69e1f-f342-40fe-8870-829e20bc3ccb None None] PATH_INFO: `/` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:09:51.772432 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 34/66] 10.222.0.21 () {54 vars in 926 bytes} [Wed May 4 07:09:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 07:09:51.777505 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9728a09-d4b5-4956-9c5c-aa6897b9effd None None] REQUEST_METHOD: `POST` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:09:51.777796 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9728a09-d4b5-4956-9c5c-aa6897b9effd None None] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:09:51.778084 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9728a09-d4b5-4956-9c5c-aa6897b9effd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:09:51.796810 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.auth.core [None req-a9728a09-d4b5-4956-9c5c-aa6897b9effd None None] MFA Rules not processed for user `83c5e0dcb991496ea6dee38384514508`. Rule list: `[]` (Enabled: `True`). {{(pid=79744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:09:51.798559 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.fernet_utils [None req-a9728a09-d4b5-4956-9c5c-aa6897b9effd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:09:51.809743 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06fbab12-5585-4061-8312-93f143735eb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:09:51.811582 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fbab12-5585-4061-8312-93f143735eb7 None admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:09:51.811870 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fbab12-5585-4061-8312-93f143735eb7 None admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:09:51.812479 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fbab12-5585-4061-8312-93f143735eb7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:09:51.824857 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06fbab12-5585-4061-8312-93f143735eb7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 07:09:51.836208 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application [None req-06fbab12-5585-4061-8312-93f143735eb7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 04 07:09:51.836208 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 07:09:51.836208 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 07:09:51.836208 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 07:09:51.836208 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 07:09:51.836208 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 07:09:51.836208 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 07:09:51.836208 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 07:09:51.836208 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 07:09:51.836208 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 07:09:51.836208 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 07:09:51.836208 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 07:09:51.836208 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 07:09:51.836208 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 07:09:51.836208 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 07:09:51.836208 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 07:09:51.837449 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 07:09:51.837449 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 07:09:51.837449 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 07:09:51.837449 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 07:09:51.837449 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 07:09:51.837449 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 07:09:51.837449 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 07:09:51.837449 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 07:09:51.837449 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 07:09:51.837449 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self.get_or_create( May 04 07:09:51.837449 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 07:09:51.837449 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application with Lock( May 04 07:09:51.837449 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 07:09:51.837449 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self._enter() May 04 07:09:51.837449 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 07:09:51.837449 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 07:09:51.838424 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 07:09:51.838424 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self.creator() May 04 07:09:51.838424 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 07:09:51.838424 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application created_value = creator( May 04 07:09:51.838424 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 07:09:51.838424 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 07:09:51.838424 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 07:09:51.838424 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 07:09:51.838424 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 07:09:51.838424 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 07:09:51.838424 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 04 07:09:51.838424 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application May 04 07:09:51.842556 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 33/67] 10.222.0.21 () {56 vars in 1096 bytes} [Wed May 4 07:09:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 07:09:51.843726 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06fbab12-5585-4061-8312-93f143735eb7 None admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:09:51.888781 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 35/68] 10.222.0.21 () {58 vars in 1023 bytes} [Wed May 4 07:09:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 07:09:51.891418 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9728a09-d4b5-4956-9c5c-aa6897b9effd None None] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:09:51.975356 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06fbab12-5585-4061-8312-93f143735eb7 None admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:09:52.005262 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9728a09-d4b5-4956-9c5c-aa6897b9effd None None] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:09:52.011352 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aedb9b08-48ad-4887-9f69-8c8477df25c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:09:52.012386 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedb9b08-48ad-4887-9f69-8c8477df25c5 None admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:09:52.012816 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedb9b08-48ad-4887-9f69-8c8477df25c5 None admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:09:52.014478 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedb9b08-48ad-4887-9f69-8c8477df25c5 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:09:52.025274 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aedb9b08-48ad-4887-9f69-8c8477df25c5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 07:09:52.033899 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application [None req-aedb9b08-48ad-4887-9f69-8c8477df25c5 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 04 07:09:52.033899 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 07:09:52.033899 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 07:09:52.033899 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 07:09:52.033899 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 07:09:52.033899 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 07:09:52.033899 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 07:09:52.033899 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 07:09:52.033899 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 07:09:52.033899 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 07:09:52.033899 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 07:09:52.033899 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 07:09:52.033899 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 07:09:52.033899 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 07:09:52.033899 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 07:09:52.033899 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 07:09:52.034801 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 07:09:52.034801 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 07:09:52.034801 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 07:09:52.034801 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 07:09:52.034801 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 07:09:52.034801 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 07:09:52.034801 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 07:09:52.034801 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 07:09:52.034801 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 07:09:52.034801 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self.get_or_create( May 04 07:09:52.034801 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 07:09:52.034801 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application with Lock( May 04 07:09:52.034801 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 07:09:52.034801 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self._enter() May 04 07:09:52.034801 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 07:09:52.034801 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 07:09:52.035936 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 07:09:52.035936 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self.creator() May 04 07:09:52.035936 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 07:09:52.035936 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application created_value = creator( May 04 07:09:52.035936 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 07:09:52.035936 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 07:09:52.035936 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 07:09:52.035936 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 07:09:52.035936 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 07:09:52.035936 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 07:09:52.035936 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 04 07:09:52.035936 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application May 04 07:09:52.036526 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 34/69] 10.222.0.21 () {56 vars in 1099 bytes} [Wed May 4 07:09:51 2022] GET /identity/v3/roles/member => generated 84 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 07:09:52.041289 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aedb9b08-48ad-4887-9f69-8c8477df25c5 None admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:09:52.046018 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cbc7b6-5695-4b62-8ef5-86a0119e8b85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:09:52.046907 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cbc7b6-5695-4b62-8ef5-86a0119e8b85 None admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:09:52.047219 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cbc7b6-5695-4b62-8ef5-86a0119e8b85 None admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:09:52.047505 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cbc7b6-5695-4b62-8ef5-86a0119e8b85 None admin] PATH_INFO: `/v3/roles` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:09:52.048264 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2cbc7b6-5695-4b62-8ef5-86a0119e8b85 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79744) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 07:09:52.048577 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2cbc7b6-5695-4b62-8ef5-86a0119e8b85 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:09:52.049979 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2cbc7b6-5695-4b62-8ef5-86a0119e8b85 None admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:09:52.058493 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 36/70] 10.222.0.21 () {56 vars in 1099 bytes} [Wed May 4 07:09:51 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 07:09:52.059581 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc00976-3bdb-41be-83eb-6caadcd1a928 None None] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:09:52.059918 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc00976-3bdb-41be-83eb-6caadcd1a928 None None] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:09:52.060847 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc00976-3bdb-41be-83eb-6caadcd1a928 None None] PATH_INFO: `/` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:09:52.062317 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 37/71] 10.222.0.21 () {54 vars in 926 bytes} [Wed May 4 07:09:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 07:09:52.063262 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc00976-3bdb-41be-83eb-6caadcd1a928 None None] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:09:52.142660 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aedb9b08-48ad-4887-9f69-8c8477df25c5 None admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:09:52.163660 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc00976-3bdb-41be-83eb-6caadcd1a928 None None] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:09:52.174648 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d284810-60df-4a6b-b89e-b82217d37c64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:09:52.175487 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d284810-60df-4a6b-b89e-b82217d37c64 None admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:09:52.175771 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d284810-60df-4a6b-b89e-b82217d37c64 None admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:09:52.176046 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d284810-60df-4a6b-b89e-b82217d37c64 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:09:52.186655 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d284810-60df-4a6b-b89e-b82217d37c64 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 07:09:52.194628 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application [None req-6d284810-60df-4a6b-b89e-b82217d37c64 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 04 07:09:52.194628 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 07:09:52.194628 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 07:09:52.194628 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 07:09:52.194628 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 07:09:52.194628 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 07:09:52.194628 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 07:09:52.194628 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 07:09:52.194628 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 07:09:52.194628 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 07:09:52.194628 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 07:09:52.194628 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 07:09:52.194628 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 07:09:52.194628 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 07:09:52.194628 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 07:09:52.194628 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 07:09:52.195668 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 07:09:52.195668 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 07:09:52.195668 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 07:09:52.195668 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 07:09:52.195668 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 07:09:52.195668 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 07:09:52.195668 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 07:09:52.195668 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 07:09:52.195668 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 07:09:52.195668 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self.get_or_create( May 04 07:09:52.195668 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 07:09:52.195668 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application with Lock( May 04 07:09:52.195668 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 07:09:52.195668 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self._enter() May 04 07:09:52.195668 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 07:09:52.195668 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 07:09:52.196492 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 07:09:52.196492 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self.creator() May 04 07:09:52.196492 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 07:09:52.196492 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application created_value = creator( May 04 07:09:52.196492 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 07:09:52.196492 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 07:09:52.196492 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 07:09:52.196492 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 07:09:52.196492 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 07:09:52.196492 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 07:09:52.196492 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 04 07:09:52.196492 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application May 04 07:09:52.197066 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9d7ece-45fb-48c3-b843-fdd42c60e447 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:09:52.197066 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9d7ece-45fb-48c3-b843-fdd42c60e447 None admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:09:52.197066 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9d7ece-45fb-48c3-b843-fdd42c60e447 None admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:09:52.197258 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 35/72] 10.222.0.21 () {56 vars in 1114 bytes} [Wed May 4 07:09:52 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 07:09:52.197322 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9d7ece-45fb-48c3-b843-fdd42c60e447 None admin] PATH_INFO: `/v3/roles` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:09:52.197383 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d284810-60df-4a6b-b89e-b82217d37c64 None admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:09:52.197446 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9d7ece-45fb-48c3-b843-fdd42c60e447 None admin] RBAC: Adding query filter params (name=member) {{(pid=79744) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 07:09:52.197446 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9d7ece-45fb-48c3-b843-fdd42c60e447 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:09:52.198495 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9d7ece-45fb-48c3-b843-fdd42c60e447 None admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:09:52.207949 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 38/73] 10.222.0.21 () {56 vars in 1101 bytes} [Wed May 4 07:09:52 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 07:09:52.209227 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d663ccdd-0c9a-4053-b4c0-5ac564fb2b12 None None] REQUEST_METHOD: `POST` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:09:52.209517 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d663ccdd-0c9a-4053-b4c0-5ac564fb2b12 None None] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:09:52.209794 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d663ccdd-0c9a-4053-b4c0-5ac564fb2b12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:09:52.225766 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.auth.core [None req-d663ccdd-0c9a-4053-b4c0-5ac564fb2b12 None None] MFA Rules not processed for user `83c5e0dcb991496ea6dee38384514508`. Rule list: `[]` (Enabled: `True`). {{(pid=79744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:09:52.226965 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.fernet_utils [None req-d663ccdd-0c9a-4053-b4c0-5ac564fb2b12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:09:52.291053 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 39/74] 10.222.0.21 () {58 vars in 1023 bytes} [Wed May 4 07:09:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 07:09:52.292217 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c8c883-250a-41ae-bb4f-bbd6b345bf69 None None] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:09:52.292503 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c8c883-250a-41ae-bb4f-bbd6b345bf69 None None] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:09:52.292773 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c8c883-250a-41ae-bb4f-bbd6b345bf69 None None] PATH_INFO: `/` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:09:52.293553 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d284810-60df-4a6b-b89e-b82217d37c64 None admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:09:52.298548 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 40/75] 10.222.0.21 () {54 vars in 926 bytes} [Wed May 4 07:09:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 07:09:52.298548 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c8c883-250a-41ae-bb4f-bbd6b345bf69 None None] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:09:52.329999 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7638f454-44ae-4e62-9765-3e9590887ee4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:09:52.330874 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7638f454-44ae-4e62-9765-3e9590887ee4 None admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:09:52.331176 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7638f454-44ae-4e62-9765-3e9590887ee4 None admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:09:52.331458 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7638f454-44ae-4e62-9765-3e9590887ee4 None admin] PATH_INFO: `/v3/users/83c5e0dcb991496ea6dee38384514508` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:09:52.332659 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7638f454-44ae-4e62-9765-3e9590887ee4 None admin] RBAC: Authorizing `identity:get_user(user_id=83c5e0dcb991496ea6dee38384514508)` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:09:52.334104 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7638f454-44ae-4e62-9765-3e9590887ee4 None admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:09:52.335757 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 36/76] 10.222.0.21 () {56 vars in 1177 bytes} [Wed May 4 07:09:52 2022] GET /identity/v3/users/83c5e0dcb991496ea6dee38384514508 => generated 247 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 07:09:52.336511 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7638f454-44ae-4e62-9765-3e9590887ee4 None admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:09:52.390732 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c8c883-250a-41ae-bb4f-bbd6b345bf69 None None] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:09:52.422332 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f320a8-b8c6-4ca5-b482-29e3cf8d3073 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:09:52.422992 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f320a8-b8c6-4ca5-b482-29e3cf8d3073 None admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:09:52.423305 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f320a8-b8c6-4ca5-b482-29e3cf8d3073 None admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:09:52.423584 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f320a8-b8c6-4ca5-b482-29e3cf8d3073 None admin] PATH_INFO: `/v3/roles` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:09:52.424326 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f320a8-b8c6-4ca5-b482-29e3cf8d3073 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79744) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 07:09:52.424661 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f320a8-b8c6-4ca5-b482-29e3cf8d3073 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:09:52.426019 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f320a8-b8c6-4ca5-b482-29e3cf8d3073 None admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:09:52.429300 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7638f454-44ae-4e62-9765-3e9590887ee4 None admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:09:52.433541 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 41/77] 10.222.0.21 () {56 vars in 1111 bytes} [Wed May 4 07:09:52 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 07:09:52.436929 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477fbc3f-abdc-42fe-a4b3-003a49bcdbb9 None None] REQUEST_METHOD: `POST` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:09:52.436929 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477fbc3f-abdc-42fe-a4b3-003a49bcdbb9 None None] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:09:52.436929 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477fbc3f-abdc-42fe-a4b3-003a49bcdbb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:09:52.451731 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.auth.core [None req-477fbc3f-abdc-42fe-a4b3-003a49bcdbb9 None None] MFA Rules not processed for user `83c5e0dcb991496ea6dee38384514508`. Rule list: `[]` (Enabled: `True`). {{(pid=79744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:09:52.453308 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.fernet_utils [None req-477fbc3f-abdc-42fe-a4b3-003a49bcdbb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:09:52.464269 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2857c4b0-3655-4eee-a2cf-3b0d2a4da2b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:09:52.465140 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2857c4b0-3655-4eee-a2cf-3b0d2a4da2b0 None admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:09:52.465416 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2857c4b0-3655-4eee-a2cf-3b0d2a4da2b0 None admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:09:52.465686 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2857c4b0-3655-4eee-a2cf-3b0d2a4da2b0 None admin] PATH_INFO: `/v3/users/6fa76119d31c4c4a839f95afaefeda66` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:09:52.479209 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2857c4b0-3655-4eee-a2cf-3b0d2a4da2b0 None admin] RBAC: Authorizing `identity:get_user(user_id=6fa76119d31c4c4a839f95afaefeda66)` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:09:52.480665 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2857c4b0-3655-4eee-a2cf-3b0d2a4da2b0 None admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:09:52.482460 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 37/78] 10.222.0.21 () {56 vars in 1177 bytes} [Wed May 4 07:09:52 2022] GET /identity/v3/users/6fa76119d31c4c4a839f95afaefeda66 => generated 275 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 07:09:52.483304 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2857c4b0-3655-4eee-a2cf-3b0d2a4da2b0 None admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:09:52.517454 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 42/79] 10.222.0.21 () {58 vars in 1023 bytes} [Wed May 4 07:09:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 07:09:52.530645 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477fbc3f-abdc-42fe-a4b3-003a49bcdbb9 None None] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:09:52.576222 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2857c4b0-3655-4eee-a2cf-3b0d2a4da2b0 None admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:09:52.607762 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c0814c-d2eb-4f29-936c-1c89d1b4a390 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:09:52.608541 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c0814c-d2eb-4f29-936c-1c89d1b4a390 None admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:09:52.608823 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c0814c-d2eb-4f29-936c-1c89d1b4a390 None admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:09:52.609098 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c0814c-d2eb-4f29-936c-1c89d1b4a390 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:09:52.609200 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477fbc3f-abdc-42fe-a4b3-003a49bcdbb9 None None] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:09:52.610264 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c0814c-d2eb-4f29-936c-1c89d1b4a390 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:09:52.611736 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c0814c-d2eb-4f29-936c-1c89d1b4a390 None admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:09:52.613329 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 38/80] 10.222.0.21 () {56 vars in 1108 bytes} [Wed May 4 07:09:52 2022] GET /identity/v3/domains/default => generated 199 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 07:09:52.614092 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c0814c-d2eb-4f29-936c-1c89d1b4a390 None admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:09:52.643713 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f247135-f976-4794-a110-79f98f9b49ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:09:52.644369 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f247135-f976-4794-a110-79f98f9b49ad None admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:09:52.644650 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f247135-f976-4794-a110-79f98f9b49ad None admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:09:52.644926 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f247135-f976-4794-a110-79f98f9b49ad None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:09:52.706167 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c0814c-d2eb-4f29-936c-1c89d1b4a390 None admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:09:52.710299 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f247135-f976-4794-a110-79f98f9b49ad None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:09:52.711812 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f247135-f976-4794-a110-79f98f9b49ad None admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:09:52.737734 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3ea086-8e1b-4535-bc9c-8da7323f88a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:09:52.738645 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3ea086-8e1b-4535-bc9c-8da7323f88a7 None admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:09:52.738926 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3ea086-8e1b-4535-bc9c-8da7323f88a7 None admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:09:52.739221 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3ea086-8e1b-4535-bc9c-8da7323f88a7 None admin] PATH_INFO: `/v3/users/6fa76119d31c4c4a839f95afaefeda66` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:09:52.740400 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3ea086-8e1b-4535-bc9c-8da7323f88a7 None admin] RBAC: Authorizing `identity:get_user(user_id=6fa76119d31c4c4a839f95afaefeda66)` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:09:52.741832 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3ea086-8e1b-4535-bc9c-8da7323f88a7 None admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:09:52.743648 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 39/81] 10.222.0.21 () {56 vars in 1177 bytes} [Wed May 4 07:09:52 2022] GET /identity/v3/users/6fa76119d31c4c4a839f95afaefeda66 => generated 275 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 07:09:52.744236 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3ea086-8e1b-4535-bc9c-8da7323f88a7 None admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:09:52.814598 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 43/82] 10.222.0.21 () {58 vars in 1282 bytes} [Wed May 4 07:09:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 04 07:09:52.815470 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f247135-f976-4794-a110-79f98f9b49ad None admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:09:52.839134 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3ea086-8e1b-4535-bc9c-8da7323f88a7 None admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:09:52.870299 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25aa74f5-5343-4772-b1c5-d3ee42f59eca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:09:52.870943 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25aa74f5-5343-4772-b1c5-d3ee42f59eca None admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:09:52.871268 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25aa74f5-5343-4772-b1c5-d3ee42f59eca None admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:09:52.871540 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25aa74f5-5343-4772-b1c5-d3ee42f59eca None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:09:52.907536 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f247135-f976-4794-a110-79f98f9b49ad None admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:09:52.934701 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25aa74f5-5343-4772-b1c5-d3ee42f59eca None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:09:52.936222 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25aa74f5-5343-4772-b1c5-d3ee42f59eca None admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:09:52.939259 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fefbe6-b9a0-4c5d-99c4-d1797b2fae74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:09:52.940044 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fefbe6-b9a0-4c5d-99c4-d1797b2fae74 None admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:09:52.940328 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fefbe6-b9a0-4c5d-99c4-d1797b2fae74 None admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:09:52.940599 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fefbe6-b9a0-4c5d-99c4-d1797b2fae74 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:09:52.950182 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33fefbe6-b9a0-4c5d-99c4-d1797b2fae74 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 07:09:52.957978 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application [None req-33fefbe6-b9a0-4c5d-99c4-d1797b2fae74 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 04 07:09:52.957978 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 07:09:52.957978 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 07:09:52.957978 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 07:09:52.957978 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 07:09:52.957978 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 07:09:52.957978 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 07:09:52.957978 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 07:09:52.957978 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 07:09:52.957978 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 07:09:52.957978 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 07:09:52.957978 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 07:09:52.957978 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 07:09:52.957978 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 07:09:52.957978 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 07:09:52.957978 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 07:09:52.958805 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 07:09:52.958805 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 07:09:52.958805 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 07:09:52.958805 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 07:09:52.958805 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 07:09:52.958805 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 07:09:52.958805 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 07:09:52.958805 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 07:09:52.958805 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 07:09:52.958805 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.get_or_create( May 04 07:09:52.958805 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 07:09:52.958805 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application with Lock( May 04 07:09:52.958805 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 07:09:52.958805 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self._enter() May 04 07:09:52.958805 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 07:09:52.958805 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 07:09:52.959600 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 07:09:52.959600 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.creator() May 04 07:09:52.959600 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 07:09:52.959600 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application created_value = creator( May 04 07:09:52.959600 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 07:09:52.959600 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 07:09:52.959600 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 07:09:52.959600 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 07:09:52.959600 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 07:09:52.959600 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 07:09:52.959600 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 04 07:09:52.959600 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application May 04 07:09:52.959600 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 44/83] 10.222.0.21 () {56 vars in 1099 bytes} [Wed May 4 07:09:52 2022] GET /identity/v3/roles/member => generated 84 bytes in 144 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 07:09:52.960217 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fefbe6-b9a0-4c5d-99c4-d1797b2fae74 None admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:09:53.033626 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 40/84] 10.222.0.21 () {58 vars in 1282 bytes} [Wed May 4 07:09:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 04 07:09:53.034463 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25aa74f5-5343-4772-b1c5-d3ee42f59eca None admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:09:53.053052 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fefbe6-b9a0-4c5d-99c4-d1797b2fae74 None admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:09:53.087728 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0727651e-d499-420c-8168-6ca93795aac6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:09:53.088403 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0727651e-d499-420c-8168-6ca93795aac6 None admin] REQUEST_METHOD: `POST` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:09:53.088685 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0727651e-d499-420c-8168-6ca93795aac6 None admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:09:53.088968 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0727651e-d499-420c-8168-6ca93795aac6 None admin] PATH_INFO: `/v3/users` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:09:53.089730 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0727651e-d499-420c-8168-6ca93795aac6 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:09:53.091760 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0727651e-d499-420c-8168-6ca93795aac6 None admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:09:53.114549 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 45/85] 10.222.0.21 () {60 vars in 1132 bytes} [Wed May 4 07:09:52 2022] POST /identity/v3/users => generated 289 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 07:09:53.115208 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0727651e-d499-420c-8168-6ca93795aac6 None admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:09:53.142069 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25aa74f5-5343-4772-b1c5-d3ee42f59eca None admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:09:53.177586 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac596a9-cae4-44dd-ba1a-d6779bb9124f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:09:53.178254 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac596a9-cae4-44dd-ba1a-d6779bb9124f None admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:09:53.178592 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac596a9-cae4-44dd-ba1a-d6779bb9124f None admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:09:53.178869 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac596a9-cae4-44dd-ba1a-d6779bb9124f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:09:53.219206 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0727651e-d499-420c-8168-6ca93795aac6 None admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:09:53.250143 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac596a9-cae4-44dd-ba1a-d6779bb9124f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:09:53.251794 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac596a9-cae4-44dd-ba1a-d6779bb9124f None admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:09:53.255327 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375e77ea-4865-46b7-b7bf-d65b139952ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:09:53.255531 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375e77ea-4865-46b7-b7bf-d65b139952ce None admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:09:53.255737 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375e77ea-4865-46b7-b7bf-d65b139952ce None admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:09:53.255963 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375e77ea-4865-46b7-b7bf-d65b139952ce None admin] PATH_INFO: `/v3/projects/c1c61577200842b7bf6af16defd5fcbc` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:09:53.257476 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375e77ea-4865-46b7-b7bf-d65b139952ce None admin] RBAC: Authorizing `identity:get_project(project_id=c1c61577200842b7bf6af16defd5fcbc)` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:09:53.258928 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375e77ea-4865-46b7-b7bf-d65b139952ce None admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:09:53.260702 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 46/86] 10.222.0.21 () {56 vars in 1186 bytes} [Wed May 4 07:09:53 2022] GET /identity/v3/projects/c1c61577200842b7bf6af16defd5fcbc => generated 298 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 07:09:53.261487 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375e77ea-4865-46b7-b7bf-d65b139952ce None admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:09:53.358099 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 41/87] 10.222.0.21 () {58 vars in 1282 bytes} [Wed May 4 07:09:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 04 07:09:53.358099 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac596a9-cae4-44dd-ba1a-d6779bb9124f None admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:09:53.363837 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375e77ea-4865-46b7-b7bf-d65b139952ce None admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:09:53.398716 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136e2ebc-e6d2-47b4-8260-1becbff5b2f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:09:53.399304 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136e2ebc-e6d2-47b4-8260-1becbff5b2f4 None admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:09:53.399835 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136e2ebc-e6d2-47b4-8260-1becbff5b2f4 None admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:09:53.399835 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136e2ebc-e6d2-47b4-8260-1becbff5b2f4 None admin] PATH_INFO: `/v3/roles` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:09:53.401127 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136e2ebc-e6d2-47b4-8260-1becbff5b2f4 None admin] RBAC: Adding query filter params (name=member) {{(pid=79744) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 07:09:53.401127 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136e2ebc-e6d2-47b4-8260-1becbff5b2f4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:09:53.404615 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136e2ebc-e6d2-47b4-8260-1becbff5b2f4 None admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:09:53.411760 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 47/88] 10.222.0.21 () {56 vars in 1101 bytes} [Wed May 4 07:09:53 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 07:09:53.412620 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136e2ebc-e6d2-47b4-8260-1becbff5b2f4 None admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:09:53.465592 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac596a9-cae4-44dd-ba1a-d6779bb9124f None admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:09:53.500956 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497091d6-d341-4666-b112-dfaea1453ca3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:09:53.501826 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497091d6-d341-4666-b112-dfaea1453ca3 None admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:09:53.502109 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497091d6-d341-4666-b112-dfaea1453ca3 None admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:09:53.502386 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497091d6-d341-4666-b112-dfaea1453ca3 None admin] PATH_INFO: `/v3/projects/c1c61577200842b7bf6af16defd5fcbc` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:09:53.503611 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497091d6-d341-4666-b112-dfaea1453ca3 None admin] RBAC: Authorizing `identity:get_project(project_id=c1c61577200842b7bf6af16defd5fcbc)` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:09:53.505094 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497091d6-d341-4666-b112-dfaea1453ca3 None admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:09:53.507002 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 42/89] 10.222.0.21 () {56 vars in 1186 bytes} [Wed May 4 07:09:53 2022] GET /identity/v3/projects/c1c61577200842b7bf6af16defd5fcbc => generated 298 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 07:09:53.507795 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497091d6-d341-4666-b112-dfaea1453ca3 None admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:09:53.525783 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136e2ebc-e6d2-47b4-8260-1becbff5b2f4 None admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:09:53.562771 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437e1fc6-28f7-4bcd-9519-284dae1b62a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:09:53.563539 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437e1fc6-28f7-4bcd-9519-284dae1b62a9 None admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:09:53.563769 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437e1fc6-28f7-4bcd-9519-284dae1b62a9 None admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:09:53.564049 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437e1fc6-28f7-4bcd-9519-284dae1b62a9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:09:53.564890 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437e1fc6-28f7-4bcd-9519-284dae1b62a9 None admin] RBAC: Adding query filter params (role.id=eb54c9cea2774a25b1fe8c79724408ee, scope.project.id=c1c61577200842b7bf6af16defd5fcbc, user.id=83c5e0dcb991496ea6dee38384514508) {{(pid=79744) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 07:09:53.565256 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437e1fc6-28f7-4bcd-9519-284dae1b62a9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:09:53.566767 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437e1fc6-28f7-4bcd-9519-284dae1b62a9 None admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:09:53.575236 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 48/90] 10.222.0.21 () {56 vars in 1374 bytes} [Wed May 4 07:09:53 2022] GET /identity/v3/role_assignments?user.id=83c5e0dcb991496ea6dee38384514508&scope.project.id=c1c61577200842b7bf6af16defd5fcbc&role.id=eb54c9cea2774a25b1fe8c79724408ee => generated 259 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 07:09:53.576736 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437e1fc6-28f7-4bcd-9519-284dae1b62a9 None admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:09:53.609935 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497091d6-d341-4666-b112-dfaea1453ca3 None admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:09:53.646140 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab189b2b-2b3c-4891-8241-452475692b89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:09:53.647019 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab189b2b-2b3c-4891-8241-452475692b89 None admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:09:53.647328 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab189b2b-2b3c-4891-8241-452475692b89 None admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:09:53.647609 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab189b2b-2b3c-4891-8241-452475692b89 None admin] PATH_INFO: `/v3/projects/c1c61577200842b7bf6af16defd5fcbc` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:09:53.648856 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab189b2b-2b3c-4891-8241-452475692b89 None admin] RBAC: Authorizing `identity:get_project(project_id=c1c61577200842b7bf6af16defd5fcbc)` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:09:53.650342 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab189b2b-2b3c-4891-8241-452475692b89 None admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:09:53.652476 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 43/91] 10.222.0.21 () {56 vars in 1186 bytes} [Wed May 4 07:09:53 2022] GET /identity/v3/projects/c1c61577200842b7bf6af16defd5fcbc => generated 298 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 07:09:53.653299 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab189b2b-2b3c-4891-8241-452475692b89 None admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:09:53.689815 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437e1fc6-28f7-4bcd-9519-284dae1b62a9 None admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:09:53.727325 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ebc482-dea3-45eb-aa67-e071f9b76b82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:09:53.728227 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ebc482-dea3-45eb-aa67-e071f9b76b82 None admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:09:53.728515 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ebc482-dea3-45eb-aa67-e071f9b76b82 None admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:09:53.728793 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ebc482-dea3-45eb-aa67-e071f9b76b82 None admin] PATH_INFO: `/v3/users/6fa76119d31c4c4a839f95afaefeda66` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:09:53.730017 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ebc482-dea3-45eb-aa67-e071f9b76b82 None admin] RBAC: Authorizing `identity:get_user(user_id=6fa76119d31c4c4a839f95afaefeda66)` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:09:53.731560 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ebc482-dea3-45eb-aa67-e071f9b76b82 None admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:09:53.734311 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 49/92] 10.222.0.21 () {56 vars in 1177 bytes} [Wed May 4 07:09:53 2022] GET /identity/v3/users/6fa76119d31c4c4a839f95afaefeda66 => generated 275 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 07:09:53.735064 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ebc482-dea3-45eb-aa67-e071f9b76b82 None admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:09:53.778278 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab189b2b-2b3c-4891-8241-452475692b89 None admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:09:53.844467 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ebc482-dea3-45eb-aa67-e071f9b76b82 None admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:09:53.851910 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49cefab-87a8-432b-8de1-fd88a8a72b02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:09:53.852590 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49cefab-87a8-432b-8de1-fd88a8a72b02 None admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:09:53.852871 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49cefab-87a8-432b-8de1-fd88a8a72b02 None admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:09:53.853148 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49cefab-87a8-432b-8de1-fd88a8a72b02 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:09:53.853996 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49cefab-87a8-432b-8de1-fd88a8a72b02 None admin] RBAC: Adding query filter params (role.id=9f89c07b05a14f18836116af22cba5f6, scope.project.id=c1c61577200842b7bf6af16defd5fcbc, user.id=6fa76119d31c4c4a839f95afaefeda66) {{(pid=79745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 07:09:53.854306 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49cefab-87a8-432b-8de1-fd88a8a72b02 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:09:53.855835 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49cefab-87a8-432b-8de1-fd88a8a72b02 None admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:09:53.870264 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 44/93] 10.222.0.21 () {56 vars in 1374 bytes} [Wed May 4 07:09:53 2022] GET /identity/v3/role_assignments?user.id=6fa76119d31c4c4a839f95afaefeda66&scope.project.id=c1c61577200842b7bf6af16defd5fcbc&role.id=9f89c07b05a14f18836116af22cba5f6 => generated 259 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 07:09:53.870994 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49cefab-87a8-432b-8de1-fd88a8a72b02 None admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:09:53.900599 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74063bf0-3189-41d7-b7cc-a4f0ed154671 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:09:53.901585 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74063bf0-3189-41d7-b7cc-a4f0ed154671 None admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:09:53.901868 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74063bf0-3189-41d7-b7cc-a4f0ed154671 None admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:09:53.902142 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74063bf0-3189-41d7-b7cc-a4f0ed154671 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:09:53.903176 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74063bf0-3189-41d7-b7cc-a4f0ed154671 None admin] RBAC: Adding query filter params (role.id=91b8526a43a4426a883870ad97362652, scope.project.id=c1c61577200842b7bf6af16defd5fcbc, user.id=6fa76119d31c4c4a839f95afaefeda66) {{(pid=79744) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 07:09:53.904416 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74063bf0-3189-41d7-b7cc-a4f0ed154671 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:09:53.907483 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74063bf0-3189-41d7-b7cc-a4f0ed154671 None admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:09:53.914458 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 50/94] 10.222.0.21 () {56 vars in 1374 bytes} [Wed May 4 07:09:53 2022] GET /identity/v3/role_assignments?user.id=6fa76119d31c4c4a839f95afaefeda66&scope.project.id=c1c61577200842b7bf6af16defd5fcbc&role.id=91b8526a43a4426a883870ad97362652 => generated 259 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 07:09:54.015897 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49cefab-87a8-432b-8de1-fd88a8a72b02 None admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:09:54.054353 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b92dbba-ec91-4ac8-8e20-bd81edaa18eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:09:54.055017 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b92dbba-ec91-4ac8-8e20-bd81edaa18eb None admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:09:54.055325 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b92dbba-ec91-4ac8-8e20-bd81edaa18eb None admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:09:54.055605 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b92dbba-ec91-4ac8-8e20-bd81edaa18eb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:09:54.136746 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b92dbba-ec91-4ac8-8e20-bd81edaa18eb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:09:54.138789 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b92dbba-ec91-4ac8-8e20-bd81edaa18eb None admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:09:54.260535 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 45/95] 10.222.0.21 () {58 vars in 1282 bytes} [Wed May 4 07:09:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 04 07:09:54.266823 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74063bf0-3189-41d7-b7cc-a4f0ed154671 None admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:09:54.379751 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74063bf0-3189-41d7-b7cc-a4f0ed154671 None admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:09:54.415203 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8182dd30-2ca5-4b94-8ba3-caabcf5809d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:09:54.416012 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8182dd30-2ca5-4b94-8ba3-caabcf5809d5 None admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:09:54.416301 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8182dd30-2ca5-4b94-8ba3-caabcf5809d5 None admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:09:54.416580 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8182dd30-2ca5-4b94-8ba3-caabcf5809d5 None admin] PATH_INFO: `/v3/projects/ee7199f3d20d47f8919b11b86dd5382f` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:09:54.417795 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8182dd30-2ca5-4b94-8ba3-caabcf5809d5 None admin] RBAC: Authorizing `identity:get_project(project_id=ee7199f3d20d47f8919b11b86dd5382f)` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:09:54.419306 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8182dd30-2ca5-4b94-8ba3-caabcf5809d5 None admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:09:54.421740 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 51/96] 10.222.0.21 () {56 vars in 1186 bytes} [Wed May 4 07:09:54 2022] GET /identity/v3/projects/ee7199f3d20d47f8919b11b86dd5382f => generated 312 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 07:09:54.427597 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b92dbba-ec91-4ac8-8e20-bd81edaa18eb None admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:09:54.556668 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b92dbba-ec91-4ac8-8e20-bd81edaa18eb None admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:09:54.601403 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7e5d79-edc3-4b47-924a-cec5a70aa182 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:09:54.602068 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7e5d79-edc3-4b47-924a-cec5a70aa182 None admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:09:54.602352 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7e5d79-edc3-4b47-924a-cec5a70aa182 None admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:09:54.602627 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7e5d79-edc3-4b47-924a-cec5a70aa182 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:09:54.603505 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7e5d79-edc3-4b47-924a-cec5a70aa182 None admin] RBAC: Adding query filter params (role.id=9f89c07b05a14f18836116af22cba5f6, scope.project.id=ee7199f3d20d47f8919b11b86dd5382f, user.id=6fa76119d31c4c4a839f95afaefeda66) {{(pid=79745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 07:09:54.603822 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7e5d79-edc3-4b47-924a-cec5a70aa182 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:09:54.605271 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7e5d79-edc3-4b47-924a-cec5a70aa182 None admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:09:54.611987 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 46/97] 10.222.0.21 () {56 vars in 1374 bytes} [Wed May 4 07:09:54 2022] GET /identity/v3/role_assignments?user.id=6fa76119d31c4c4a839f95afaefeda66&scope.project.id=ee7199f3d20d47f8919b11b86dd5382f&role.id=9f89c07b05a14f18836116af22cba5f6 => generated 259 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 07:09:56.192328 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8cc408-33eb-48bf-8aa9-77ca7afb8433 None None] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:09:56.193044 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8cc408-33eb-48bf-8aa9-77ca7afb8433 None None] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:09:56.193044 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8cc408-33eb-48bf-8aa9-77ca7afb8433 None None] PATH_INFO: `/` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:09:56.194543 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 52/98] 10.222.0.21 () {54 vars in 926 bytes} [Wed May 4 07:09:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 07:09:56.199363 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1315ad1-d171-4473-991d-0289f9d21c38 None None] REQUEST_METHOD: `POST` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:09:56.200213 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1315ad1-d171-4473-991d-0289f9d21c38 None None] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:09:56.200916 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1315ad1-d171-4473-991d-0289f9d21c38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:09:56.228223 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.auth.core [None req-a1315ad1-d171-4473-991d-0289f9d21c38 None None] MFA Rules not processed for user `83c5e0dcb991496ea6dee38384514508`. Rule list: `[]` (Enabled: `True`). {{(pid=79745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:09:56.229780 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.fernet_utils [None req-a1315ad1-d171-4473-991d-0289f9d21c38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:09:56.314101 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 47/99] 10.222.0.21 () {58 vars in 1023 bytes} [Wed May 4 07:09:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 07:09:56.348480 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8cc408-33eb-48bf-8aa9-77ca7afb8433 None None] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:09:56.496822 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8cc408-33eb-48bf-8aa9-77ca7afb8433 None None] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:09:56.542618 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c261d98-64d9-4759-a103-b611386a4759 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:09:56.543456 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c261d98-64d9-4759-a103-b611386a4759 None admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:09:56.543743 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c261d98-64d9-4759-a103-b611386a4759 None admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:09:56.544024 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c261d98-64d9-4759-a103-b611386a4759 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:09:56.546241 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c261d98-64d9-4759-a103-b611386a4759 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:09:56.547745 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c261d98-64d9-4759-a103-b611386a4759 None admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:09:56.550432 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 53/100] 10.222.0.21 () {56 vars in 1108 bytes} [Wed May 4 07:09:56 2022] GET /identity/v3/domains/default => generated 199 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 07:09:56.555106 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1315ad1-d171-4473-991d-0289f9d21c38 None None] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:09:56.651856 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0c1653-d39f-44fe-b296-2fc15fc80cc2 None None] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:09:56.652166 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0c1653-d39f-44fe-b296-2fc15fc80cc2 None None] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:09:56.652417 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0c1653-d39f-44fe-b296-2fc15fc80cc2 None None] PATH_INFO: `/` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:09:56.654495 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 54/101] 10.222.0.21 () {54 vars in 926 bytes} [Wed May 4 07:09:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 04 07:09:56.659459 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c388d92e-cda7-47dd-b80d-2a4d66c777f1 None None] REQUEST_METHOD: `POST` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:09:56.659753 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c388d92e-cda7-47dd-b80d-2a4d66c777f1 None None] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:09:56.660299 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c388d92e-cda7-47dd-b80d-2a4d66c777f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:09:56.670347 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1315ad1-d171-4473-991d-0289f9d21c38 None None] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:09:56.696227 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.auth.core [None req-c388d92e-cda7-47dd-b80d-2a4d66c777f1 None None] MFA Rules not processed for user `83c5e0dcb991496ea6dee38384514508`. Rule list: `[]` (Enabled: `True`). {{(pid=79744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:09:56.697471 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.fernet_utils [None req-c388d92e-cda7-47dd-b80d-2a4d66c777f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:09:56.710715 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e97374b-ffa1-4e83-884e-7f41ba7ad591 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:09:56.711361 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e97374b-ffa1-4e83-884e-7f41ba7ad591 None admin] REQUEST_METHOD: `POST` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:09:56.711645 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e97374b-ffa1-4e83-884e-7f41ba7ad591 None admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:09:56.711923 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e97374b-ffa1-4e83-884e-7f41ba7ad591 None admin] PATH_INFO: `/v3/projects` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:09:56.712654 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e97374b-ffa1-4e83-884e-7f41ba7ad591 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:09:56.714168 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e97374b-ffa1-4e83-884e-7f41ba7ad591 None admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:09:56.779488 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 48/102] 10.222.0.21 () {60 vars in 1141 bytes} [Wed May 4 07:09:56 2022] POST /identity/v3/projects => generated 302 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 07:09:56.780965 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ca19c8-6dd5-4551-af34-8e4dd20e5d2a None None] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:09:56.781261 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ca19c8-6dd5-4551-af34-8e4dd20e5d2a None None] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:09:56.781537 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ca19c8-6dd5-4551-af34-8e4dd20e5d2a None None] PATH_INFO: `/` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:09:56.785713 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 49/103] 10.222.0.21 () {54 vars in 926 bytes} [Wed May 4 07:09:56 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 07:09:56.788785 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71853ea4-38ab-4c7b-ba52-c55460c9d7f3 None None] REQUEST_METHOD: `POST` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:09:56.789080 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71853ea4-38ab-4c7b-ba52-c55460c9d7f3 None None] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:09:56.789363 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71853ea4-38ab-4c7b-ba52-c55460c9d7f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:09:56.813570 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 55/104] 10.222.0.21 () {58 vars in 1023 bytes} [Wed May 4 07:09:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 07:09:56.828353 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.auth.core [None req-71853ea4-38ab-4c7b-ba52-c55460c9d7f3 None None] MFA Rules not processed for user `83c5e0dcb991496ea6dee38384514508`. Rule list: `[]` (Enabled: `True`). {{(pid=79745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:09:56.829581 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.fernet_utils [None req-71853ea4-38ab-4c7b-ba52-c55460c9d7f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:09:56.845041 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c388d92e-cda7-47dd-b80d-2a4d66c777f1 None None] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:09:56.941622 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 50/105] 10.222.0.21 () {58 vars in 1023 bytes} [Wed May 4 07:09:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 07:09:56.974171 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71853ea4-38ab-4c7b-ba52-c55460c9d7f3 None None] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:09:56.989692 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c388d92e-cda7-47dd-b80d-2a4d66c777f1 None None] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:09:57.033322 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b659b45f-429b-4803-ab24-78738c018a9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:09:57.034487 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b659b45f-429b-4803-ab24-78738c018a9a None admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:09:57.034986 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b659b45f-429b-4803-ab24-78738c018a9a None admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:09:57.035469 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b659b45f-429b-4803-ab24-78738c018a9a None admin] PATH_INFO: `/v3/roles/reader` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:09:57.057132 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b659b45f-429b-4803-ab24-78738c018a9a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 07:09:57.074318 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application [None req-b659b45f-429b-4803-ab24-78738c018a9a None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 04 07:09:57.074318 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 07:09:57.074318 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 07:09:57.074318 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 07:09:57.074318 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 07:09:57.074318 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 07:09:57.074318 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 07:09:57.074318 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 07:09:57.074318 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 07:09:57.074318 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 07:09:57.074318 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 07:09:57.074318 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 07:09:57.074318 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 07:09:57.074318 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 07:09:57.074318 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 07:09:57.074318 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 07:09:57.075288 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 07:09:57.075288 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 07:09:57.075288 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 07:09:57.075288 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 07:09:57.075288 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 07:09:57.075288 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 07:09:57.075288 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 07:09:57.075288 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 07:09:57.075288 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 07:09:57.075288 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.get_or_create( May 04 07:09:57.075288 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 07:09:57.075288 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application with Lock( May 04 07:09:57.075288 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 07:09:57.075288 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self._enter() May 04 07:09:57.075288 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 07:09:57.075288 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 07:09:57.076721 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 07:09:57.076721 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.creator() May 04 07:09:57.076721 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 07:09:57.076721 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application created_value = creator( May 04 07:09:57.076721 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 07:09:57.076721 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 07:09:57.076721 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 07:09:57.076721 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 07:09:57.076721 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 07:09:57.076721 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 07:09:57.076721 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 04 07:09:57.076721 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application May 04 07:09:57.079278 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 56/106] 10.222.0.21 () {56 vars in 1099 bytes} [Wed May 4 07:09:56 2022] GET /identity/v3/roles/reader => generated 84 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 07:09:57.085356 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b659b45f-429b-4803-ab24-78738c018a9a None admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:09:57.103601 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71853ea4-38ab-4c7b-ba52-c55460c9d7f3 None None] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:09:57.135228 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9531e8-4c6b-4b08-8a85-5445efc154da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:09:57.135983 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9531e8-4c6b-4b08-8a85-5445efc154da None admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:09:57.136323 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9531e8-4c6b-4b08-8a85-5445efc154da None admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:09:57.136599 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9531e8-4c6b-4b08-8a85-5445efc154da None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:09:57.148398 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9531e8-4c6b-4b08-8a85-5445efc154da None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 07:09:57.156524 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application [None req-fa9531e8-4c6b-4b08-8a85-5445efc154da None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 04 07:09:57.156524 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 07:09:57.156524 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 07:09:57.156524 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 07:09:57.156524 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 07:09:57.156524 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 07:09:57.156524 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 07:09:57.156524 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 07:09:57.156524 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 07:09:57.156524 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 07:09:57.156524 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 07:09:57.156524 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 07:09:57.156524 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 07:09:57.156524 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 07:09:57.156524 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 07:09:57.156524 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 07:09:57.157413 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 07:09:57.157413 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 07:09:57.157413 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 07:09:57.157413 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 07:09:57.157413 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 07:09:57.157413 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 07:09:57.157413 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 07:09:57.157413 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 07:09:57.157413 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 07:09:57.157413 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self.get_or_create( May 04 07:09:57.157413 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 07:09:57.157413 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application with Lock( May 04 07:09:57.157413 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 07:09:57.157413 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self._enter() May 04 07:09:57.157413 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 07:09:57.157413 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 07:09:57.158190 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 07:09:57.158190 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self.creator() May 04 07:09:57.158190 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 07:09:57.158190 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application created_value = creator( May 04 07:09:57.158190 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 07:09:57.158190 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 07:09:57.158190 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 07:09:57.158190 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 07:09:57.158190 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 07:09:57.158190 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 07:09:57.158190 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 04 07:09:57.158190 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application May 04 07:09:57.158190 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 51/107] 10.222.0.21 () {56 vars in 1096 bytes} [Wed May 4 07:09:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 07:09:57.163649 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9531e8-4c6b-4b08-8a85-5445efc154da None admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:09:57.266646 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9531e8-4c6b-4b08-8a85-5445efc154da None admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:09:57.300666 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23343e6d-0620-4d93-bf03-2a47e075a0ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:09:57.301338 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23343e6d-0620-4d93-bf03-2a47e075a0ef None admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:09:57.301665 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23343e6d-0620-4d93-bf03-2a47e075a0ef None admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:09:57.301949 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23343e6d-0620-4d93-bf03-2a47e075a0ef None admin] PATH_INFO: `/v3/roles` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:09:57.302699 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23343e6d-0620-4d93-bf03-2a47e075a0ef None admin] RBAC: Adding query filter params (name=admin) {{(pid=79745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 07:09:57.303008 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23343e6d-0620-4d93-bf03-2a47e075a0ef None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:09:57.304431 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23343e6d-0620-4d93-bf03-2a47e075a0ef None admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:09:57.313266 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 52/108] 10.222.0.21 () {56 vars in 1099 bytes} [Wed May 4 07:09:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 07:09:57.323305 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23343e6d-0620-4d93-bf03-2a47e075a0ef None admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:09:57.344039 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b659b45f-429b-4803-ab24-78738c018a9a None admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:09:57.395731 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ef4009-6e78-4ff3-afcc-4f4f5eacd79a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:09:57.396788 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ef4009-6e78-4ff3-afcc-4f4f5eacd79a None admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:09:57.397277 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ef4009-6e78-4ff3-afcc-4f4f5eacd79a None admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:09:57.397744 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ef4009-6e78-4ff3-afcc-4f4f5eacd79a None admin] PATH_INFO: `/v3/roles` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:09:57.398686 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ef4009-6e78-4ff3-afcc-4f4f5eacd79a None admin] RBAC: Adding query filter params (name=reader) {{(pid=79744) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 07:09:57.399230 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ef4009-6e78-4ff3-afcc-4f4f5eacd79a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:09:57.400836 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ef4009-6e78-4ff3-afcc-4f4f5eacd79a None admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:09:57.414647 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 57/109] 10.222.0.21 () {56 vars in 1101 bytes} [Wed May 4 07:09:57 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 330 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 07:09:57.428828 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ef4009-6e78-4ff3-afcc-4f4f5eacd79a None admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:09:57.430628 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23343e6d-0620-4d93-bf03-2a47e075a0ef None admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:09:57.467172 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b347eec5-a867-48a8-ad18-7d4179878277 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:09:57.467172 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b347eec5-a867-48a8-ad18-7d4179878277 None admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:09:57.467172 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b347eec5-a867-48a8-ad18-7d4179878277 None admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:09:57.467172 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b347eec5-a867-48a8-ad18-7d4179878277 None admin] PATH_INFO: `/v3/users/83c5e0dcb991496ea6dee38384514508` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:09:57.468138 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b347eec5-a867-48a8-ad18-7d4179878277 None admin] RBAC: Authorizing `identity:get_user(user_id=83c5e0dcb991496ea6dee38384514508)` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:09:57.469707 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b347eec5-a867-48a8-ad18-7d4179878277 None admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:09:57.471747 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 53/110] 10.222.0.21 () {56 vars in 1177 bytes} [Wed May 4 07:09:57 2022] GET /identity/v3/users/83c5e0dcb991496ea6dee38384514508 => generated 247 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 07:09:57.478895 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b347eec5-a867-48a8-ad18-7d4179878277 None admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:09:57.582838 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b347eec5-a867-48a8-ad18-7d4179878277 None admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:09:57.619236 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3be93f-aa37-454f-a2b1-bc04e437bf05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:09:57.620110 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3be93f-aa37-454f-a2b1-bc04e437bf05 None admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:09:57.620393 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3be93f-aa37-454f-a2b1-bc04e437bf05 None admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:09:57.620669 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3be93f-aa37-454f-a2b1-bc04e437bf05 None admin] PATH_INFO: `/v3/projects/c1c61577200842b7bf6af16defd5fcbc` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:09:57.621880 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3be93f-aa37-454f-a2b1-bc04e437bf05 None admin] RBAC: Authorizing `identity:get_project(project_id=c1c61577200842b7bf6af16defd5fcbc)` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:09:57.623904 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3be93f-aa37-454f-a2b1-bc04e437bf05 None admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:09:57.626011 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 54/111] 10.222.0.21 () {56 vars in 1186 bytes} [Wed May 4 07:09:57 2022] GET /identity/v3/projects/c1c61577200842b7bf6af16defd5fcbc => generated 298 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 07:09:57.631429 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f3d07e-5475-4a7a-8d30-96f67b93bd48 None None] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:09:57.632049 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f3d07e-5475-4a7a-8d30-96f67b93bd48 None None] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:09:57.632338 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f3d07e-5475-4a7a-8d30-96f67b93bd48 None None] PATH_INFO: `/` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:09:57.633683 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 55/112] 10.222.0.21 () {54 vars in 926 bytes} [Wed May 4 07:09:57 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 07:09:57.635566 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f3d07e-5475-4a7a-8d30-96f67b93bd48 None None] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:09:57.658794 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ef4009-6e78-4ff3-afcc-4f4f5eacd79a None admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:09:57.723874 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2133c2bc-4630-4d9e-87b0-a7562c925818 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:09:57.725160 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2133c2bc-4630-4d9e-87b0-a7562c925818 None admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:09:57.725649 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2133c2bc-4630-4d9e-87b0-a7562c925818 None admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:09:57.726124 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2133c2bc-4630-4d9e-87b0-a7562c925818 None admin] PATH_INFO: `/v3/users/d58e92b4d33041cab878a5ed1fc4c245` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:09:57.742102 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f3d07e-5475-4a7a-8d30-96f67b93bd48 None None] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:09:57.755018 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2133c2bc-4630-4d9e-87b0-a7562c925818 None admin] RBAC: Authorizing `identity:get_user(user_id=d58e92b4d33041cab878a5ed1fc4c245)` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:09:57.757033 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2133c2bc-4630-4d9e-87b0-a7562c925818 None admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:09:57.759260 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 58/113] 10.222.0.21 () {56 vars in 1177 bytes} [Wed May 4 07:09:57 2022] GET /identity/v3/users/d58e92b4d33041cab878a5ed1fc4c245 => generated 289 bytes in 331 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 07:09:57.760846 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e50086-d65e-47be-98d2-c3e8cfa527eb None None] REQUEST_METHOD: `POST` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:09:57.761321 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e50086-d65e-47be-98d2-c3e8cfa527eb None None] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:09:57.761784 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e50086-d65e-47be-98d2-c3e8cfa527eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:09:57.780472 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338dd43e-95d4-4054-8829-4873e25833ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:09:57.781369 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338dd43e-95d4-4054-8829-4873e25833ea None admin] REQUEST_METHOD: `PUT` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:09:57.781650 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338dd43e-95d4-4054-8829-4873e25833ea None admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:09:57.781983 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338dd43e-95d4-4054-8829-4873e25833ea None admin] PATH_INFO: `/v3/projects/c1c61577200842b7bf6af16defd5fcbc/users/83c5e0dcb991496ea6dee38384514508/roles/eb54c9cea2774a25b1fe8c79724408ee` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:09:57.784072 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338dd43e-95d4-4054-8829-4873e25833ea None admin] RBAC: Authorizing `identity:create_grant(project_id=c1c61577200842b7bf6af16defd5fcbc, user_id=83c5e0dcb991496ea6dee38384514508, role_id=eb54c9cea2774a25b1fe8c79724408ee)` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:09:57.785556 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338dd43e-95d4-4054-8829-4873e25833ea None admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:09:57.795107 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.auth.core [None req-64e50086-d65e-47be-98d2-c3e8cfa527eb None None] MFA Rules not processed for user `83c5e0dcb991496ea6dee38384514508`. Rule list: `[]` (Enabled: `True`). {{(pid=79744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:09:57.796388 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.fernet_utils [None req-64e50086-d65e-47be-98d2-c3e8cfa527eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:09:57.803660 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 56/114] 10.222.0.21 () {58 vars in 1439 bytes} [Wed May 4 07:09:57 2022] PUT /identity/v3/projects/c1c61577200842b7bf6af16defd5fcbc/users/83c5e0dcb991496ea6dee38384514508/roles/eb54c9cea2774a25b1fe8c79724408ee => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 07:09:57.804940 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338dd43e-95d4-4054-8829-4873e25833ea None admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:09:57.929487 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 59/115] 10.222.0.21 () {58 vars in 1023 bytes} [Wed May 4 07:09:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 07:09:57.939273 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fe826c-fb19-48f9-8f50-fae97d229b7f None None] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:09:57.939604 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fe826c-fb19-48f9-8f50-fae97d229b7f None None] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:09:57.939833 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fe826c-fb19-48f9-8f50-fae97d229b7f None None] PATH_INFO: `/` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:09:57.941504 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 60/116] 10.222.0.21 () {54 vars in 926 bytes} [Wed May 4 07:09:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 04 07:09:57.951663 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbaefc6-7842-4cd4-96f2-d17ddb4b82a9 None None] REQUEST_METHOD: `POST` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:09:57.951992 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbaefc6-7842-4cd4-96f2-d17ddb4b82a9 None None] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:09:57.952218 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbaefc6-7842-4cd4-96f2-d17ddb4b82a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:09:57.973757 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.auth.core [None req-5fbaefc6-7842-4cd4-96f2-d17ddb4b82a9 None None] MFA Rules not processed for user `83c5e0dcb991496ea6dee38384514508`. Rule list: `[]` (Enabled: `True`). {{(pid=79744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:09:57.974979 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.fernet_utils [None req-5fbaefc6-7842-4cd4-96f2-d17ddb4b82a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:09:58.041035 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338dd43e-95d4-4054-8829-4873e25833ea None admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:09:58.069917 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 61/117] 10.222.0.21 () {58 vars in 1023 bytes} [Wed May 4 07:09:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 04 07:09:58.070532 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbaefc6-7842-4cd4-96f2-d17ddb4b82a9 None None] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:09:58.078351 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836c81c7-9391-4645-95fe-a37fa17d80a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:09:58.079335 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836c81c7-9391-4645-95fe-a37fa17d80a5 None admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:09:58.079856 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836c81c7-9391-4645-95fe-a37fa17d80a5 None admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:09:58.080351 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836c81c7-9391-4645-95fe-a37fa17d80a5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:09:58.150700 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836c81c7-9391-4645-95fe-a37fa17d80a5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:09:58.152609 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836c81c7-9391-4645-95fe-a37fa17d80a5 None admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:09:58.168978 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbaefc6-7842-4cd4-96f2-d17ddb4b82a9 None None] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:09:58.210287 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34d5952-4a22-40cc-8701-f038fe8951d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:09:58.211014 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34d5952-4a22-40cc-8701-f038fe8951d9 None admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:09:58.211323 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34d5952-4a22-40cc-8701-f038fe8951d9 None admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:09:58.211600 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34d5952-4a22-40cc-8701-f038fe8951d9 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:09:58.222999 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34d5952-4a22-40cc-8701-f038fe8951d9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 07:09:58.230989 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application [None req-f34d5952-4a22-40cc-8701-f038fe8951d9 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 04 07:09:58.230989 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 07:09:58.230989 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 07:09:58.230989 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 07:09:58.230989 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 07:09:58.230989 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 07:09:58.230989 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 07:09:58.230989 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 07:09:58.230989 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 07:09:58.230989 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 07:09:58.230989 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 07:09:58.230989 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 07:09:58.230989 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 07:09:58.230989 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 07:09:58.230989 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 07:09:58.230989 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 07:09:58.232016 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 07:09:58.232016 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 07:09:58.232016 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 07:09:58.232016 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 07:09:58.232016 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 07:09:58.232016 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 07:09:58.232016 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 07:09:58.232016 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 07:09:58.232016 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 07:09:58.232016 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.get_or_create( May 04 07:09:58.232016 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 07:09:58.232016 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application with Lock( May 04 07:09:58.232016 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 07:09:58.232016 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self._enter() May 04 07:09:58.232016 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 07:09:58.232016 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 07:09:58.232894 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 07:09:58.232894 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.creator() May 04 07:09:58.232894 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 07:09:58.232894 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application created_value = creator( May 04 07:09:58.232894 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 07:09:58.232894 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 07:09:58.232894 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 07:09:58.232894 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 07:09:58.232894 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 07:09:58.232894 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 07:09:58.232894 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 04 07:09:58.232894 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application May 04 07:09:58.232894 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 62/118] 10.222.0.21 () {56 vars in 1114 bytes} [Wed May 4 07:09:58 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 07:09:58.233562 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34d5952-4a22-40cc-8701-f038fe8951d9 None admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:09:58.265475 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 57/119] 10.222.0.21 () {58 vars in 1282 bytes} [Wed May 4 07:09:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 461 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 04 07:09:58.267318 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98aaf71-7c13-45d8-878c-4a6d7621e7ae None None] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:09:58.268298 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98aaf71-7c13-45d8-878c-4a6d7621e7ae None None] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:09:58.268790 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98aaf71-7c13-45d8-878c-4a6d7621e7ae None None] PATH_INFO: `/` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:09:58.270635 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 58/120] 10.222.0.21 () {54 vars in 926 bytes} [Wed May 4 07:09:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 07:09:58.271633 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98aaf71-7c13-45d8-878c-4a6d7621e7ae None None] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:09:58.348259 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34d5952-4a22-40cc-8701-f038fe8951d9 None admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:09:58.390050 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98aaf71-7c13-45d8-878c-4a6d7621e7ae None None] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:09:58.391034 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1520bea-2554-4baf-ad36-ab1e2720e995 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:09:58.391928 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1520bea-2554-4baf-ad36-ab1e2720e995 None admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:09:58.392447 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1520bea-2554-4baf-ad36-ab1e2720e995 None admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:09:58.392794 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1520bea-2554-4baf-ad36-ab1e2720e995 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:09:58.406743 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1520bea-2554-4baf-ad36-ab1e2720e995 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 07:09:58.416682 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application [None req-a1520bea-2554-4baf-ad36-ab1e2720e995 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 04 07:09:58.416682 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 07:09:58.416682 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 07:09:58.416682 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 07:09:58.416682 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 07:09:58.416682 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 07:09:58.416682 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 07:09:58.416682 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 07:09:58.416682 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 07:09:58.416682 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 07:09:58.416682 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 07:09:58.416682 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 07:09:58.416682 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 07:09:58.416682 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 07:09:58.416682 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 07:09:58.416682 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 07:09:58.417551 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 07:09:58.417551 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 07:09:58.417551 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 07:09:58.417551 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 07:09:58.417551 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 07:09:58.417551 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 07:09:58.417551 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 07:09:58.417551 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 07:09:58.417551 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 07:09:58.417551 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.get_or_create( May 04 07:09:58.417551 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 07:09:58.417551 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application with Lock( May 04 07:09:58.417551 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 07:09:58.417551 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self._enter() May 04 07:09:58.417551 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 07:09:58.417551 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 07:09:58.418437 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 07:09:58.418437 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.creator() May 04 07:09:58.418437 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 07:09:58.418437 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application created_value = creator( May 04 07:09:58.418437 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 07:09:58.418437 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 07:09:58.418437 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 07:09:58.418437 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 07:09:58.418437 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 07:09:58.418437 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 07:09:58.418437 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 04 07:09:58.418437 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application May 04 07:09:58.418437 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 63/121] 10.222.0.21 () {56 vars in 1099 bytes} [Wed May 4 07:09:58 2022] GET /identity/v3/roles/member => generated 84 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 07:09:58.419326 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1520bea-2554-4baf-ad36-ab1e2720e995 None admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:09:58.429578 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24866ef6-4841-4e86-99ac-8cd5e4667997 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:09:58.430567 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24866ef6-4841-4e86-99ac-8cd5e4667997 None admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:09:58.431100 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24866ef6-4841-4e86-99ac-8cd5e4667997 None admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:09:58.431594 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24866ef6-4841-4e86-99ac-8cd5e4667997 None admin] PATH_INFO: `/v3/roles` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:09:58.432589 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24866ef6-4841-4e86-99ac-8cd5e4667997 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 07:09:58.433108 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24866ef6-4841-4e86-99ac-8cd5e4667997 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:09:58.434744 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24866ef6-4841-4e86-99ac-8cd5e4667997 None admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:09:58.443187 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 59/122] 10.222.0.21 () {56 vars in 1111 bytes} [Wed May 4 07:09:58 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 07:09:58.444787 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b181360-ddf4-4e56-9532-b983f2cdbdbc None None] REQUEST_METHOD: `POST` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:09:58.445331 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b181360-ddf4-4e56-9532-b983f2cdbdbc None None] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:09:58.445835 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b181360-ddf4-4e56-9532-b983f2cdbdbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:09:58.463978 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.auth.core [None req-6b181360-ddf4-4e56-9532-b983f2cdbdbc None None] MFA Rules not processed for user `83c5e0dcb991496ea6dee38384514508`. Rule list: `[]` (Enabled: `True`). {{(pid=79745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:09:58.467022 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.fernet_utils [None req-6b181360-ddf4-4e56-9532-b983f2cdbdbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:09:58.536127 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1520bea-2554-4baf-ad36-ab1e2720e995 None admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:09:58.555591 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 60/123] 10.222.0.21 () {58 vars in 1023 bytes} [Wed May 4 07:09:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 07:09:58.556545 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b181360-ddf4-4e56-9532-b983f2cdbdbc None None] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:09:58.571022 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a687189c-7338-4616-b231-2678e4b7a5b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:09:58.572239 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a687189c-7338-4616-b231-2678e4b7a5b1 None admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:09:58.572734 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a687189c-7338-4616-b231-2678e4b7a5b1 None admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:09:58.573217 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a687189c-7338-4616-b231-2678e4b7a5b1 None admin] PATH_INFO: `/v3/projects/c1c61577200842b7bf6af16defd5fcbc` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:09:58.574658 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a687189c-7338-4616-b231-2678e4b7a5b1 None admin] RBAC: Authorizing `identity:get_project(project_id=c1c61577200842b7bf6af16defd5fcbc)` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:09:58.577111 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a687189c-7338-4616-b231-2678e4b7a5b1 None admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:09:58.579139 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 64/124] 10.222.0.21 () {56 vars in 1186 bytes} [Wed May 4 07:09:58 2022] GET /identity/v3/projects/c1c61577200842b7bf6af16defd5fcbc => generated 298 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 07:09:58.580243 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a687189c-7338-4616-b231-2678e4b7a5b1 None admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:09:58.667879 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b181360-ddf4-4e56-9532-b983f2cdbdbc None None] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:09:58.695513 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a687189c-7338-4616-b231-2678e4b7a5b1 None admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:09:58.711278 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d206fe-e0e5-4676-937f-b879eedf3600 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:09:58.711955 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d206fe-e0e5-4676-937f-b879eedf3600 None admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:09:58.712232 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d206fe-e0e5-4676-937f-b879eedf3600 None admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:09:58.712513 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d206fe-e0e5-4676-937f-b879eedf3600 None admin] PATH_INFO: `/v3/roles` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:09:58.713259 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d206fe-e0e5-4676-937f-b879eedf3600 None admin] RBAC: Adding query filter params (name=member) {{(pid=79745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 07:09:58.713558 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d206fe-e0e5-4676-937f-b879eedf3600 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:09:58.715746 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d206fe-e0e5-4676-937f-b879eedf3600 None admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:09:58.727250 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 61/125] 10.222.0.21 () {56 vars in 1101 bytes} [Wed May 4 07:09:58 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 07:09:58.728267 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d206fe-e0e5-4676-937f-b879eedf3600 None admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:09:58.735864 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76e38a3-a738-48ed-b40e-3246081577b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:09:58.737084 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76e38a3-a738-48ed-b40e-3246081577b6 None admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:09:58.737564 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76e38a3-a738-48ed-b40e-3246081577b6 None admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:09:58.738069 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76e38a3-a738-48ed-b40e-3246081577b6 None admin] PATH_INFO: `/v3/users/6fa76119d31c4c4a839f95afaefeda66` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:09:58.739529 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76e38a3-a738-48ed-b40e-3246081577b6 None admin] RBAC: Authorizing `identity:get_user(user_id=6fa76119d31c4c4a839f95afaefeda66)` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:09:58.741276 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76e38a3-a738-48ed-b40e-3246081577b6 None admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:09:58.743199 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 65/126] 10.222.0.21 () {56 vars in 1177 bytes} [Wed May 4 07:09:58 2022] GET /identity/v3/users/6fa76119d31c4c4a839f95afaefeda66 => generated 275 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 07:09:58.744208 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76e38a3-a738-48ed-b40e-3246081577b6 None admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:09:58.855806 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d206fe-e0e5-4676-937f-b879eedf3600 None admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:09:58.862124 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76e38a3-a738-48ed-b40e-3246081577b6 None admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:09:58.897579 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0c1515-9c39-4b50-86ba-c038805a040e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:09:58.898709 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0c1515-9c39-4b50-86ba-c038805a040e None admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:09:58.899334 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0c1515-9c39-4b50-86ba-c038805a040e None admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:09:58.899868 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0c1515-9c39-4b50-86ba-c038805a040e None admin] PATH_INFO: `/v3/roles/member` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:09:58.900703 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e404f0a2-8953-4d5f-b4a6-c21cc4ce7643 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:09:58.901349 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e404f0a2-8953-4d5f-b4a6-c21cc4ce7643 None admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:09:58.901633 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e404f0a2-8953-4d5f-b4a6-c21cc4ce7643 None admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:09:58.901915 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e404f0a2-8953-4d5f-b4a6-c21cc4ce7643 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:09:58.902910 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e404f0a2-8953-4d5f-b4a6-c21cc4ce7643 None admin] RBAC: Adding query filter params (role.id=8dc3044bbffe459fb7166d4456243785, scope.project.id=c1c61577200842b7bf6af16defd5fcbc, user.id=d58e92b4d33041cab878a5ed1fc4c245) {{(pid=79745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 07:09:58.903257 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e404f0a2-8953-4d5f-b4a6-c21cc4ce7643 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:09:58.905615 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e404f0a2-8953-4d5f-b4a6-c21cc4ce7643 None admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:09:58.912482 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 62/127] 10.222.0.21 () {56 vars in 1374 bytes} [Wed May 4 07:09:58 2022] GET /identity/v3/role_assignments?user.id=d58e92b4d33041cab878a5ed1fc4c245&scope.project.id=c1c61577200842b7bf6af16defd5fcbc&role.id=8dc3044bbffe459fb7166d4456243785 => generated 259 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 07:09:58.912966 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0c1515-9c39-4b50-86ba-c038805a040e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 07:09:58.913288 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e404f0a2-8953-4d5f-b4a6-c21cc4ce7643 None admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:09:58.922346 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application [None req-2b0c1515-9c39-4b50-86ba-c038805a040e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 04 07:09:58.922346 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 07:09:58.922346 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 07:09:58.922346 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 07:09:58.922346 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 07:09:58.922346 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 07:09:58.922346 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 07:09:58.922346 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 07:09:58.922346 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 07:09:58.922346 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 07:09:58.922346 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 07:09:58.922346 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 07:09:58.922346 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 07:09:58.922346 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 07:09:58.922346 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 07:09:58.922346 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 07:09:58.923356 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 07:09:58.923356 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 07:09:58.923356 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 07:09:58.923356 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 07:09:58.923356 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 07:09:58.923356 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 07:09:58.923356 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 07:09:58.923356 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 07:09:58.923356 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 07:09:58.923356 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.get_or_create( May 04 07:09:58.923356 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 07:09:58.923356 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application with Lock( May 04 07:09:58.923356 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 07:09:58.923356 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self._enter() May 04 07:09:58.923356 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 07:09:58.923356 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 07:09:58.924157 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 07:09:58.924157 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.creator() May 04 07:09:58.924157 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 07:09:58.924157 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application created_value = creator( May 04 07:09:58.924157 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 07:09:58.924157 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 07:09:58.924157 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 07:09:58.924157 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 07:09:58.924157 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 07:09:58.924157 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 07:09:58.924157 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 04 07:09:58.924157 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application May 04 07:09:58.926690 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 66/128] 10.222.0.21 () {56 vars in 1099 bytes} [Wed May 4 07:09:58 2022] GET /identity/v3/roles/member => generated 84 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 07:09:58.928087 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0c1515-9c39-4b50-86ba-c038805a040e None admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:09:59.021919 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e404f0a2-8953-4d5f-b4a6-c21cc4ce7643 None admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:09:59.039274 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0c1515-9c39-4b50-86ba-c038805a040e None admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:09:59.057242 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c19216-865d-4ec3-87d5-9067d14fa5fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:09:59.058125 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c19216-865d-4ec3-87d5-9067d14fa5fa None admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:09:59.058407 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c19216-865d-4ec3-87d5-9067d14fa5fa None admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:09:59.058683 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c19216-865d-4ec3-87d5-9067d14fa5fa None admin] PATH_INFO: `/v3/users/6fa76119d31c4c4a839f95afaefeda66` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:09:59.060524 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c19216-865d-4ec3-87d5-9067d14fa5fa None admin] RBAC: Authorizing `identity:get_user(user_id=6fa76119d31c4c4a839f95afaefeda66)` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:09:59.062006 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c19216-865d-4ec3-87d5-9067d14fa5fa None admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:09:59.064109 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 63/129] 10.222.0.21 () {56 vars in 1177 bytes} [Wed May 4 07:09:58 2022] GET /identity/v3/users/6fa76119d31c4c4a839f95afaefeda66 => generated 275 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 07:09:59.064978 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c19216-865d-4ec3-87d5-9067d14fa5fa None admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:09:59.080916 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea62abe-c24a-47af-a764-39fdafcac818 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:09:59.082159 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea62abe-c24a-47af-a764-39fdafcac818 None admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:09:59.082645 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea62abe-c24a-47af-a764-39fdafcac818 None admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:09:59.083132 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea62abe-c24a-47af-a764-39fdafcac818 None admin] PATH_INFO: `/v3/projects/c1c61577200842b7bf6af16defd5fcbc` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:09:59.084579 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea62abe-c24a-47af-a764-39fdafcac818 None admin] RBAC: Authorizing `identity:get_project(project_id=c1c61577200842b7bf6af16defd5fcbc)` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:09:59.086289 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea62abe-c24a-47af-a764-39fdafcac818 None admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:09:59.088996 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 67/130] 10.222.0.21 () {56 vars in 1186 bytes} [Wed May 4 07:09:58 2022] GET /identity/v3/projects/c1c61577200842b7bf6af16defd5fcbc => generated 298 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 07:09:59.090554 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea62abe-c24a-47af-a764-39fdafcac818 None admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:09:59.233496 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c19216-865d-4ec3-87d5-9067d14fa5fa None admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:09:59.239846 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea62abe-c24a-47af-a764-39fdafcac818 None admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:09:59.270440 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd61b8f-f6f4-4994-bbb7-76f258e7a9a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:09:59.271095 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd61b8f-f6f4-4994-bbb7-76f258e7a9a9 None admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:09:59.271425 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd61b8f-f6f4-4994-bbb7-76f258e7a9a9 None admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:09:59.271688 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd61b8f-f6f4-4994-bbb7-76f258e7a9a9 None admin] PATH_INFO: `/v3/roles` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:09:59.272481 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd61b8f-f6f4-4994-bbb7-76f258e7a9a9 None admin] RBAC: Adding query filter params (name=member) {{(pid=79745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 07:09:59.272732 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd61b8f-f6f4-4994-bbb7-76f258e7a9a9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:09:59.274098 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd61b8f-f6f4-4994-bbb7-76f258e7a9a9 None admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:09:59.277246 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdde3c35-eb7c-4014-9c14-3326eae4bd6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:09:59.278358 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdde3c35-eb7c-4014-9c14-3326eae4bd6f None admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:09:59.279407 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdde3c35-eb7c-4014-9c14-3326eae4bd6f None admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:09:59.279938 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdde3c35-eb7c-4014-9c14-3326eae4bd6f None admin] PATH_INFO: `/v3/projects/c1c61577200842b7bf6af16defd5fcbc` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:09:59.281325 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdde3c35-eb7c-4014-9c14-3326eae4bd6f None admin] RBAC: Authorizing `identity:get_project(project_id=c1c61577200842b7bf6af16defd5fcbc)` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:09:59.283164 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 64/131] 10.222.0.21 () {56 vars in 1101 bytes} [Wed May 4 07:09:59 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 07:09:59.283458 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdde3c35-eb7c-4014-9c14-3326eae4bd6f None admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:09:59.284096 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd61b8f-f6f4-4994-bbb7-76f258e7a9a9 None admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:09:59.285642 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 68/132] 10.222.0.21 () {56 vars in 1186 bytes} [Wed May 4 07:09:59 2022] GET /identity/v3/projects/c1c61577200842b7bf6af16defd5fcbc => generated 298 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 07:09:59.291523 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdde3c35-eb7c-4014-9c14-3326eae4bd6f None admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:09:59.391560 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdde3c35-eb7c-4014-9c14-3326eae4bd6f None admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:09:59.425931 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a59764-fde2-4d5b-b891-291d5ad98a0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:09:59.427299 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a59764-fde2-4d5b-b891-291d5ad98a0a None admin] REQUEST_METHOD: `PUT` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:09:59.427821 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a59764-fde2-4d5b-b891-291d5ad98a0a None admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:09:59.428292 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a59764-fde2-4d5b-b891-291d5ad98a0a None admin] PATH_INFO: `/v3/projects/c1c61577200842b7bf6af16defd5fcbc/users/6fa76119d31c4c4a839f95afaefeda66/roles/9f89c07b05a14f18836116af22cba5f6` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:09:59.430511 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a59764-fde2-4d5b-b891-291d5ad98a0a None admin] RBAC: Authorizing `identity:create_grant(project_id=c1c61577200842b7bf6af16defd5fcbc, user_id=6fa76119d31c4c4a839f95afaefeda66, role_id=9f89c07b05a14f18836116af22cba5f6)` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:09:59.432198 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a59764-fde2-4d5b-b891-291d5ad98a0a None admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:09:59.452885 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 69/133] 10.222.0.21 () {58 vars in 1439 bytes} [Wed May 4 07:09:59 2022] PUT /identity/v3/projects/c1c61577200842b7bf6af16defd5fcbc/users/6fa76119d31c4c4a839f95afaefeda66/roles/9f89c07b05a14f18836116af22cba5f6 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 07:09:59.454071 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a59764-fde2-4d5b-b891-291d5ad98a0a None admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:09:59.484385 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd61b8f-f6f4-4994-bbb7-76f258e7a9a9 None admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:09:59.547171 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59a0aef-6ac0-475a-a57a-a38662c4c8ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:09:59.550216 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59a0aef-6ac0-475a-a57a-a38662c4c8ce None admin] REQUEST_METHOD: `PUT` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:09:59.550723 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59a0aef-6ac0-475a-a57a-a38662c4c8ce None admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:09:59.551386 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59a0aef-6ac0-475a-a57a-a38662c4c8ce None admin] PATH_INFO: `/v3/projects/c1c61577200842b7bf6af16defd5fcbc/users/6fa76119d31c4c4a839f95afaefeda66/roles/91b8526a43a4426a883870ad97362652` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:09:59.555958 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59a0aef-6ac0-475a-a57a-a38662c4c8ce None admin] RBAC: Authorizing `identity:create_grant(project_id=c1c61577200842b7bf6af16defd5fcbc, user_id=6fa76119d31c4c4a839f95afaefeda66, role_id=91b8526a43a4426a883870ad97362652)` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:09:59.558635 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59a0aef-6ac0-475a-a57a-a38662c4c8ce None admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:09:59.582475 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 65/134] 10.222.0.21 () {58 vars in 1439 bytes} [Wed May 4 07:09:59 2022] PUT /identity/v3/projects/c1c61577200842b7bf6af16defd5fcbc/users/6fa76119d31c4c4a839f95afaefeda66/roles/91b8526a43a4426a883870ad97362652 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 07:09:59.624700 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a59764-fde2-4d5b-b891-291d5ad98a0a None admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:09:59.669139 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee01970-7844-4c74-8022-ac32a28ee460 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:09:59.670613 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee01970-7844-4c74-8022-ac32a28ee460 None admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:09:59.671123 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee01970-7844-4c74-8022-ac32a28ee460 None admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:09:59.671629 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee01970-7844-4c74-8022-ac32a28ee460 None admin] PATH_INFO: `/v3/users/6fa76119d31c4c4a839f95afaefeda66` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:09:59.673320 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee01970-7844-4c74-8022-ac32a28ee460 None admin] RBAC: Authorizing `identity:get_user(user_id=6fa76119d31c4c4a839f95afaefeda66)` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:09:59.675287 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee01970-7844-4c74-8022-ac32a28ee460 None admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:09:59.677470 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 70/135] 10.222.0.21 () {56 vars in 1177 bytes} [Wed May 4 07:09:59 2022] GET /identity/v3/users/6fa76119d31c4c4a839f95afaefeda66 => generated 275 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 07:09:59.684004 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59a0aef-6ac0-475a-a57a-a38662c4c8ce None admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:09:59.804251 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59a0aef-6ac0-475a-a57a-a38662c4c8ce None admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:09:59.851634 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbee4d41-09a1-44bf-8bb0-df34c17f125d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:09:59.852523 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbee4d41-09a1-44bf-8bb0-df34c17f125d None admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:09:59.852793 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbee4d41-09a1-44bf-8bb0-df34c17f125d None admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:09:59.853067 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbee4d41-09a1-44bf-8bb0-df34c17f125d None admin] PATH_INFO: `/v3/projects/ee7199f3d20d47f8919b11b86dd5382f` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:09:59.855918 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbee4d41-09a1-44bf-8bb0-df34c17f125d None admin] RBAC: Authorizing `identity:get_project(project_id=ee7199f3d20d47f8919b11b86dd5382f)` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:09:59.857490 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbee4d41-09a1-44bf-8bb0-df34c17f125d None admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:09:59.859432 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 66/136] 10.222.0.21 () {56 vars in 1186 bytes} [Wed May 4 07:09:59 2022] GET /identity/v3/projects/ee7199f3d20d47f8919b11b86dd5382f => generated 312 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 07:09:59.865133 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee01970-7844-4c74-8022-ac32a28ee460 None admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:09:59.974033 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee01970-7844-4c74-8022-ac32a28ee460 None admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:10:00.009531 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e45fcc2-264a-461d-8d5b-be208828eba7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:10:00.010801 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e45fcc2-264a-461d-8d5b-be208828eba7 None admin] REQUEST_METHOD: `PUT` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:10:00.011335 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e45fcc2-264a-461d-8d5b-be208828eba7 None admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:10:00.011813 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e45fcc2-264a-461d-8d5b-be208828eba7 None admin] PATH_INFO: `/v3/projects/ee7199f3d20d47f8919b11b86dd5382f/users/6fa76119d31c4c4a839f95afaefeda66/roles/9f89c07b05a14f18836116af22cba5f6` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:10:00.015093 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e45fcc2-264a-461d-8d5b-be208828eba7 None admin] RBAC: Authorizing `identity:create_grant(project_id=ee7199f3d20d47f8919b11b86dd5382f, user_id=6fa76119d31c4c4a839f95afaefeda66, role_id=9f89c07b05a14f18836116af22cba5f6)` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:10:00.017107 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e45fcc2-264a-461d-8d5b-be208828eba7 None admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:10:00.048214 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 71/137] 10.222.0.21 () {58 vars in 1439 bytes} [Wed May 4 07:09:59 2022] PUT /identity/v3/projects/ee7199f3d20d47f8919b11b86dd5382f/users/6fa76119d31c4c4a839f95afaefeda66/roles/9f89c07b05a14f18836116af22cba5f6 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 07:10:00.427939 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d245aac-343e-4d2b-9bf1-751c0e517bdf None None] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:10:00.428470 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d245aac-343e-4d2b-9bf1-751c0e517bdf None None] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:10:00.428560 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d245aac-343e-4d2b-9bf1-751c0e517bdf None None] PATH_INFO: `/` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:10:00.429990 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 67/138] 10.222.0.21 () {54 vars in 926 bytes} [Wed May 4 07:10:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 07:10:00.435672 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2727d5c1-846e-4e07-8515-6ffb20b624cc None None] REQUEST_METHOD: `POST` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:10:00.435672 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2727d5c1-846e-4e07-8515-6ffb20b624cc None None] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:10:00.436579 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2727d5c1-846e-4e07-8515-6ffb20b624cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:10:00.460174 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.auth.core [None req-2727d5c1-846e-4e07-8515-6ffb20b624cc None None] MFA Rules not processed for user `83c5e0dcb991496ea6dee38384514508`. Rule list: `[]` (Enabled: `True`). {{(pid=79744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:10:00.461369 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.fernet_utils [None req-2727d5c1-846e-4e07-8515-6ffb20b624cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:10:00.542459 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 72/139] 10.222.0.21 () {58 vars in 1023 bytes} [Wed May 4 07:10:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 04 07:10:00.576418 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d245aac-343e-4d2b-9bf1-751c0e517bdf None None] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:10:00.692875 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d245aac-343e-4d2b-9bf1-751c0e517bdf None None] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:10:00.725447 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f216f434-fbaf-4379-88e6-0d03f41f2060 None None] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:10:00.725837 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f216f434-fbaf-4379-88e6-0d03f41f2060 None None] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:10:00.726151 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f216f434-fbaf-4379-88e6-0d03f41f2060 None None] PATH_INFO: `/` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:10:00.727680 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 73/140] 10.222.0.21 () {54 vars in 926 bytes} [Wed May 4 07:10:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 04 07:10:00.733097 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d0c8e2-0fc5-4e8e-b7c7-f9715448a7c5 None None] REQUEST_METHOD: `POST` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:10:00.733383 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d0c8e2-0fc5-4e8e-b7c7-f9715448a7c5 None None] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:10:00.733662 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d0c8e2-0fc5-4e8e-b7c7-f9715448a7c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:10:00.745309 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ee723a-92f0-4ff8-ace7-e9a731bf6147 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:10:00.746110 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ee723a-92f0-4ff8-ace7-e9a731bf6147 None admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:10:00.746393 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ee723a-92f0-4ff8-ace7-e9a731bf6147 None admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:10:00.746665 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ee723a-92f0-4ff8-ace7-e9a731bf6147 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:10:00.750646 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.auth.core [None req-f3d0c8e2-0fc5-4e8e-b7c7-f9715448a7c5 None None] MFA Rules not processed for user `83c5e0dcb991496ea6dee38384514508`. Rule list: `[]` (Enabled: `True`). {{(pid=79744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:10:00.751851 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ee723a-92f0-4ff8-ace7-e9a731bf6147 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:10:00.751958 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.fernet_utils [None req-f3d0c8e2-0fc5-4e8e-b7c7-f9715448a7c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:10:00.753325 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ee723a-92f0-4ff8-ace7-e9a731bf6147 None admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:10:00.754967 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 68/141] 10.222.0.21 () {56 vars in 1108 bytes} [Wed May 4 07:10:00 2022] GET /identity/v3/domains/default => generated 199 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 07:10:00.760739 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ee723a-92f0-4ff8-ace7-e9a731bf6147 None admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:10:00.836876 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 74/142] 10.222.0.21 () {58 vars in 1023 bytes} [Wed May 4 07:10:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 07:10:00.862971 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d0c8e2-0fc5-4e8e-b7c7-f9715448a7c5 None None] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:10:00.961396 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ee723a-92f0-4ff8-ace7-e9a731bf6147 None admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:10:00.971269 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d0c8e2-0fc5-4e8e-b7c7-f9715448a7c5 None None] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:10:01.007729 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ead7cfc-db30-4cc4-84a9-0e550f77b36e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:10:01.008521 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ead7cfc-db30-4cc4-84a9-0e550f77b36e None admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:10:01.008799 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ead7cfc-db30-4cc4-84a9-0e550f77b36e None admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:10:01.009068 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ead7cfc-db30-4cc4-84a9-0e550f77b36e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:10:01.021819 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ead7cfc-db30-4cc4-84a9-0e550f77b36e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 07:10:01.031468 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application [None req-9ead7cfc-db30-4cc4-84a9-0e550f77b36e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 04 07:10:01.031468 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 07:10:01.031468 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 07:10:01.031468 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 07:10:01.031468 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 07:10:01.031468 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 07:10:01.031468 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 07:10:01.031468 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 07:10:01.031468 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 07:10:01.031468 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 07:10:01.031468 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 07:10:01.031468 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 07:10:01.031468 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 07:10:01.031468 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 07:10:01.031468 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 07:10:01.031468 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 07:10:01.032347 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 07:10:01.032347 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 07:10:01.032347 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 07:10:01.032347 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 07:10:01.032347 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 07:10:01.032347 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 07:10:01.032347 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 07:10:01.032347 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 07:10:01.032347 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 07:10:01.032347 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.get_or_create( May 04 07:10:01.032347 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 07:10:01.032347 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application with Lock( May 04 07:10:01.032347 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 07:10:01.032347 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self._enter() May 04 07:10:01.032347 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 07:10:01.032347 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 07:10:01.033122 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 07:10:01.033122 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.creator() May 04 07:10:01.033122 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 07:10:01.033122 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application created_value = creator( May 04 07:10:01.033122 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 07:10:01.033122 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 07:10:01.033122 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 07:10:01.033122 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 07:10:01.033122 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 07:10:01.033122 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 07:10:01.033122 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 04 07:10:01.033122 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application May 04 07:10:01.036207 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 75/143] 10.222.0.21 () {56 vars in 1096 bytes} [Wed May 4 07:10:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 07:10:01.039182 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ead7cfc-db30-4cc4-84a9-0e550f77b36e None admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:10:01.049175 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559fd999-de3f-45cc-9162-be42732e18a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:10:01.049853 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559fd999-de3f-45cc-9162-be42732e18a4 None admin] REQUEST_METHOD: `POST` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:10:01.050133 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559fd999-de3f-45cc-9162-be42732e18a4 None admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:10:01.050406 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559fd999-de3f-45cc-9162-be42732e18a4 None admin] PATH_INFO: `/v3/users` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:10:01.051211 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559fd999-de3f-45cc-9162-be42732e18a4 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:10:01.052669 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559fd999-de3f-45cc-9162-be42732e18a4 None admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:10:01.105705 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 69/144] 10.222.0.21 () {60 vars in 1132 bytes} [Wed May 4 07:10:00 2022] POST /identity/v3/users => generated 283 bytes in 345 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 07:10:01.145871 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ead7cfc-db30-4cc4-84a9-0e550f77b36e None admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:10:01.180786 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499b48d6-0100-40c5-9842-09ba9b00a377 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:10:01.181470 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499b48d6-0100-40c5-9842-09ba9b00a377 None admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:10:01.181752 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499b48d6-0100-40c5-9842-09ba9b00a377 None admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:10:01.182027 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499b48d6-0100-40c5-9842-09ba9b00a377 None admin] PATH_INFO: `/v3/roles` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:10:01.182788 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499b48d6-0100-40c5-9842-09ba9b00a377 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79744) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 07:10:01.183094 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499b48d6-0100-40c5-9842-09ba9b00a377 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:10:01.184528 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499b48d6-0100-40c5-9842-09ba9b00a377 None admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:10:01.197908 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 76/145] 10.222.0.21 () {56 vars in 1099 bytes} [Wed May 4 07:10:01 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 07:10:01.201462 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559fd999-de3f-45cc-9162-be42732e18a4 None admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:10:01.317101 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559fd999-de3f-45cc-9162-be42732e18a4 None admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:10:01.359612 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c947b9d-ffea-4d2b-ae49-0f9c6df25fc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:10:01.360488 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c947b9d-ffea-4d2b-ae49-0f9c6df25fc9 None admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:10:01.360766 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c947b9d-ffea-4d2b-ae49-0f9c6df25fc9 None admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:10:01.361035 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c947b9d-ffea-4d2b-ae49-0f9c6df25fc9 None admin] PATH_INFO: `/v3/users/83c5e0dcb991496ea6dee38384514508` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:10:01.363488 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c947b9d-ffea-4d2b-ae49-0f9c6df25fc9 None admin] RBAC: Authorizing `identity:get_user(user_id=83c5e0dcb991496ea6dee38384514508)` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:10:01.365030 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c947b9d-ffea-4d2b-ae49-0f9c6df25fc9 None admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:10:01.366973 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 70/146] 10.222.0.21 () {56 vars in 1177 bytes} [Wed May 4 07:10:01 2022] GET /identity/v3/users/83c5e0dcb991496ea6dee38384514508 => generated 247 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 07:10:01.373173 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499b48d6-0100-40c5-9842-09ba9b00a377 None admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:10:01.481151 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499b48d6-0100-40c5-9842-09ba9b00a377 None admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:10:01.520852 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9d5956-017a-4696-b302-4151494ec45d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:10:01.521511 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9d5956-017a-4696-b302-4151494ec45d None admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:10:01.521792 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9d5956-017a-4696-b302-4151494ec45d None admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:10:01.522062 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9d5956-017a-4696-b302-4151494ec45d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:10:01.590287 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9d5956-017a-4696-b302-4151494ec45d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:10:01.591778 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9d5956-017a-4696-b302-4151494ec45d None admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:10:01.690910 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 77/147] 10.222.0.21 () {58 vars in 1282 bytes} [Wed May 4 07:10:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 04 07:10:01.696537 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c947b9d-ffea-4d2b-ae49-0f9c6df25fc9 None admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:10:01.807164 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c947b9d-ffea-4d2b-ae49-0f9c6df25fc9 None admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:10:01.847637 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fe0277-0a1a-4a2a-894c-8d478c33aceb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:10:01.848508 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fe0277-0a1a-4a2a-894c-8d478c33aceb None admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:10:01.848794 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fe0277-0a1a-4a2a-894c-8d478c33aceb None admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:10:01.849069 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fe0277-0a1a-4a2a-894c-8d478c33aceb None admin] PATH_INFO: `/v3/projects/c1c61577200842b7bf6af16defd5fcbc` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:10:01.850278 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0fe0277-0a1a-4a2a-894c-8d478c33aceb None admin] RBAC: Authorizing `identity:get_project(project_id=c1c61577200842b7bf6af16defd5fcbc)` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:10:01.851823 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0fe0277-0a1a-4a2a-894c-8d478c33aceb None admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:10:01.853522 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 71/148] 10.222.0.21 () {56 vars in 1186 bytes} [Wed May 4 07:10:01 2022] GET /identity/v3/projects/c1c61577200842b7bf6af16defd5fcbc => generated 298 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 07:10:01.860226 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9d5956-017a-4696-b302-4151494ec45d None admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:10:01.970373 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9d5956-017a-4696-b302-4151494ec45d None admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:10:02.006942 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f0cd6c-e35e-4328-898d-cac7d745deb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:10:02.007644 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f0cd6c-e35e-4328-898d-cac7d745deb5 None admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:10:02.007924 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f0cd6c-e35e-4328-898d-cac7d745deb5 None admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:10:02.008200 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f0cd6c-e35e-4328-898d-cac7d745deb5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:10:02.009046 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f0cd6c-e35e-4328-898d-cac7d745deb5 None admin] RBAC: Adding query filter params (role.id=eb54c9cea2774a25b1fe8c79724408ee, scope.project.id=c1c61577200842b7bf6af16defd5fcbc, user.id=83c5e0dcb991496ea6dee38384514508) {{(pid=79744) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 07:10:02.009365 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f0cd6c-e35e-4328-898d-cac7d745deb5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:10:02.010815 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f0cd6c-e35e-4328-898d-cac7d745deb5 None admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:10:02.017712 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 78/149] 10.222.0.21 () {56 vars in 1374 bytes} [Wed May 4 07:10:01 2022] GET /identity/v3/role_assignments?user.id=83c5e0dcb991496ea6dee38384514508&scope.project.id=c1c61577200842b7bf6af16defd5fcbc&role.id=eb54c9cea2774a25b1fe8c79724408ee => generated 608 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 07:10:02.477000 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d68ebaf-1d5f-4abd-aa2b-a901948ba4f2 None None] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:10:02.477316 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d68ebaf-1d5f-4abd-aa2b-a901948ba4f2 None None] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:10:02.477564 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d68ebaf-1d5f-4abd-aa2b-a901948ba4f2 None None] PATH_INFO: `/` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:10:02.479284 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 72/150] 10.222.0.21 () {54 vars in 926 bytes} [Wed May 4 07:10:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 07:10:02.486723 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805a0f23-b8da-4568-81dd-637f0c0d48a5 None None] REQUEST_METHOD: `POST` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:10:02.487221 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805a0f23-b8da-4568-81dd-637f0c0d48a5 None None] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:10:02.487429 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805a0f23-b8da-4568-81dd-637f0c0d48a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:10:02.505976 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.auth.core [None req-805a0f23-b8da-4568-81dd-637f0c0d48a5 None None] MFA Rules not processed for user `83c5e0dcb991496ea6dee38384514508`. Rule list: `[]` (Enabled: `True`). {{(pid=79744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:10:02.507444 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.fernet_utils [None req-805a0f23-b8da-4568-81dd-637f0c0d48a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:10:02.583266 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 79/151] 10.222.0.21 () {58 vars in 1023 bytes} [Wed May 4 07:10:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 07:10:02.603600 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d68ebaf-1d5f-4abd-aa2b-a901948ba4f2 None None] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:10:02.686184 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611331ce-5214-4d9d-84bf-e80444f7c0d0 None None] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:10:02.686521 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611331ce-5214-4d9d-84bf-e80444f7c0d0 None None] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:10:02.686735 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611331ce-5214-4d9d-84bf-e80444f7c0d0 None None] PATH_INFO: `/` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:10:02.688174 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 80/152] 10.222.0.21 () {54 vars in 926 bytes} [Wed May 4 07:10:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 07:10:02.694187 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ea6fc1-d2f9-4e45-8573-3213f67f976a None None] REQUEST_METHOD: `POST` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:10:02.694459 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ea6fc1-d2f9-4e45-8573-3213f67f976a None None] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:10:02.694736 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ea6fc1-d2f9-4e45-8573-3213f67f976a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:10:02.720269 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.auth.core [None req-21ea6fc1-d2f9-4e45-8573-3213f67f976a None None] MFA Rules not processed for user `83c5e0dcb991496ea6dee38384514508`. Rule list: `[]` (Enabled: `True`). {{(pid=79744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:10:02.721777 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.fernet_utils [None req-21ea6fc1-d2f9-4e45-8573-3213f67f976a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:10:02.735310 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d68ebaf-1d5f-4abd-aa2b-a901948ba4f2 None None] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:10:02.774835 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90eb22e-ed66-46e9-91a2-5721c99ad3f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:10:02.775670 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90eb22e-ed66-46e9-91a2-5721c99ad3f2 None admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:10:02.775951 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90eb22e-ed66-46e9-91a2-5721c99ad3f2 None admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:10:02.776232 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90eb22e-ed66-46e9-91a2-5721c99ad3f2 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:10:02.788767 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90eb22e-ed66-46e9-91a2-5721c99ad3f2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 07:10:02.797726 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application [None req-e90eb22e-ed66-46e9-91a2-5721c99ad3f2 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 04 07:10:02.797726 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 07:10:02.797726 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 07:10:02.797726 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 07:10:02.797726 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 07:10:02.797726 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 07:10:02.797726 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 07:10:02.797726 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 07:10:02.797726 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 07:10:02.797726 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 07:10:02.797726 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 07:10:02.797726 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 07:10:02.797726 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 07:10:02.797726 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 07:10:02.797726 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 07:10:02.797726 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 07:10:02.798640 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 07:10:02.798640 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 07:10:02.798640 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 07:10:02.798640 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 07:10:02.798640 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 07:10:02.798640 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 07:10:02.798640 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 07:10:02.798640 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 07:10:02.798640 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 07:10:02.798640 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self.get_or_create( May 04 07:10:02.798640 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 07:10:02.798640 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application with Lock( May 04 07:10:02.798640 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 07:10:02.798640 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self._enter() May 04 07:10:02.798640 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 07:10:02.798640 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 07:10:02.799459 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 07:10:02.799459 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self.creator() May 04 07:10:02.799459 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 07:10:02.799459 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application created_value = creator( May 04 07:10:02.799459 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 07:10:02.799459 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 07:10:02.799459 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 07:10:02.799459 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 07:10:02.799459 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 07:10:02.799459 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 07:10:02.799459 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 04 07:10:02.799459 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application May 04 07:10:02.803440 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 73/153] 10.222.0.21 () {56 vars in 1099 bytes} [Wed May 4 07:10:02 2022] GET /identity/v3/roles/reader => generated 84 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 07:10:02.805227 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90eb22e-ed66-46e9-91a2-5721c99ad3f2 None admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:10:02.884549 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 81/154] 10.222.0.21 () {58 vars in 1023 bytes} [Wed May 4 07:10:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 04 07:10:02.915995 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ea6fc1-d2f9-4e45-8573-3213f67f976a None None] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:10:02.918101 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90eb22e-ed66-46e9-91a2-5721c99ad3f2 None admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:10:02.959839 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6193acb5-e6f9-4c49-a2c6-523129bff711 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:10:02.960514 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6193acb5-e6f9-4c49-a2c6-523129bff711 None admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:10:02.960799 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6193acb5-e6f9-4c49-a2c6-523129bff711 None admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:10:02.961072 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6193acb5-e6f9-4c49-a2c6-523129bff711 None admin] PATH_INFO: `/v3/roles` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:10:02.961830 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6193acb5-e6f9-4c49-a2c6-523129bff711 None admin] RBAC: Adding query filter params (name=reader) {{(pid=79745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 07:10:02.962138 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6193acb5-e6f9-4c49-a2c6-523129bff711 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:10:02.967176 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6193acb5-e6f9-4c49-a2c6-523129bff711 None admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:10:02.976432 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 74/155] 10.222.0.21 () {56 vars in 1101 bytes} [Wed May 4 07:10:02 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 07:10:02.979754 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6193acb5-e6f9-4c49-a2c6-523129bff711 None admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:10:03.088520 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ea6fc1-d2f9-4e45-8573-3213f67f976a None None] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:10:03.109932 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6193acb5-e6f9-4c49-a2c6-523129bff711 None admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:10:03.137694 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf098cb2-5f0f-4c32-9c8a-c83a8e2b5dcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:10:03.139604 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf098cb2-5f0f-4c32-9c8a-c83a8e2b5dcc None admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:10:03.140113 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf098cb2-5f0f-4c32-9c8a-c83a8e2b5dcc None admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:10:03.140585 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf098cb2-5f0f-4c32-9c8a-c83a8e2b5dcc None admin] PATH_INFO: `/v3/roles/member` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:10:03.150984 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0161e5-7517-4345-96e5-529fea28f4fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:10:03.151949 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0161e5-7517-4345-96e5-529fea28f4fa None admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:10:03.152240 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0161e5-7517-4345-96e5-529fea28f4fa None admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:10:03.152515 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0161e5-7517-4345-96e5-529fea28f4fa None admin] PATH_INFO: `/v3/users/d58e92b4d33041cab878a5ed1fc4c245` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:10:03.154220 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f0161e5-7517-4345-96e5-529fea28f4fa None admin] RBAC: Authorizing `identity:get_user(user_id=d58e92b4d33041cab878a5ed1fc4c245)` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:10:03.155764 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f0161e5-7517-4345-96e5-529fea28f4fa None admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:10:03.165975 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 75/156] 10.222.0.21 () {56 vars in 1177 bytes} [Wed May 4 07:10:02 2022] GET /identity/v3/users/d58e92b4d33041cab878a5ed1fc4c245 => generated 289 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 07:10:03.167337 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fceb483-0154-473c-a99a-49e8e90b4fc8 None None] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:10:03.167626 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fceb483-0154-473c-a99a-49e8e90b4fc8 None None] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:10:03.167902 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fceb483-0154-473c-a99a-49e8e90b4fc8 None None] PATH_INFO: `/` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:10:03.169963 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 76/157] 10.222.0.21 () {54 vars in 926 bytes} [Wed May 4 07:10:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 07:10:03.170623 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf098cb2-5f0f-4c32-9c8a-c83a8e2b5dcc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 07:10:03.176499 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba53d7ca-371f-48c3-9071-a0ad372d2fe5 None None] REQUEST_METHOD: `POST` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:10:03.176795 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba53d7ca-371f-48c3-9071-a0ad372d2fe5 None None] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:10:03.180459 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application [None req-cf098cb2-5f0f-4c32-9c8a-c83a8e2b5dcc None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 04 07:10:03.180459 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 07:10:03.180459 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 07:10:03.180459 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 07:10:03.180459 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 07:10:03.180459 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 07:10:03.180459 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 07:10:03.180459 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 07:10:03.180459 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 07:10:03.180459 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 07:10:03.180459 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 07:10:03.180459 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 07:10:03.180459 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 07:10:03.180459 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 07:10:03.180459 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 07:10:03.180459 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 07:10:03.181306 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 07:10:03.181306 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 07:10:03.181306 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 07:10:03.181306 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 07:10:03.181306 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 07:10:03.181306 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 07:10:03.181306 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 07:10:03.181306 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 07:10:03.181306 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 07:10:03.181306 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.get_or_create( May 04 07:10:03.181306 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 07:10:03.181306 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application with Lock( May 04 07:10:03.181306 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 07:10:03.181306 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self._enter() May 04 07:10:03.181306 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 07:10:03.181306 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 07:10:03.182082 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 07:10:03.182082 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.creator() May 04 07:10:03.182082 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 07:10:03.182082 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application created_value = creator( May 04 07:10:03.182082 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 07:10:03.182082 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 07:10:03.182082 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 07:10:03.182082 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 07:10:03.182082 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 07:10:03.182082 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 07:10:03.182082 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 04 07:10:03.182082 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application May 04 07:10:03.182082 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 82/158] 10.222.0.21 () {56 vars in 1099 bytes} [Wed May 4 07:10:02 2022] GET /identity/v3/roles/member => generated 84 bytes in 266 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 07:10:03.182711 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba53d7ca-371f-48c3-9071-a0ad372d2fe5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:10:03.184933 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf098cb2-5f0f-4c32-9c8a-c83a8e2b5dcc None admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:10:03.210847 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.auth.core [None req-ba53d7ca-371f-48c3-9071-a0ad372d2fe5 None None] MFA Rules not processed for user `83c5e0dcb991496ea6dee38384514508`. Rule list: `[]` (Enabled: `True`). {{(pid=79745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:10:03.213271 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.fernet_utils [None req-ba53d7ca-371f-48c3-9071-a0ad372d2fe5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:10:03.309495 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 77/159] 10.222.0.21 () {58 vars in 1023 bytes} [Wed May 4 07:10:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 07:10:03.310915 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba53d7ca-371f-48c3-9071-a0ad372d2fe5 None None] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:10:03.400740 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf098cb2-5f0f-4c32-9c8a-c83a8e2b5dcc None admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:10:03.419430 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba53d7ca-371f-48c3-9071-a0ad372d2fe5 None None] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:10:03.455732 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9885f2-f7f0-4ac3-91e1-db99a30fa905 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:10:03.455882 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f181c091-d692-4243-a8c9-1e371669071a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:10:03.456390 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9885f2-f7f0-4ac3-91e1-db99a30fa905 None admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:10:03.456583 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f181c091-d692-4243-a8c9-1e371669071a None admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:10:03.456702 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9885f2-f7f0-4ac3-91e1-db99a30fa905 None admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:10:03.456856 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f181c091-d692-4243-a8c9-1e371669071a None admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:10:03.456947 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9885f2-f7f0-4ac3-91e1-db99a30fa905 None admin] PATH_INFO: `/v3/roles` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:10:03.457134 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f181c091-d692-4243-a8c9-1e371669071a None admin] PATH_INFO: `/v3/projects/c1c61577200842b7bf6af16defd5fcbc` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:10:03.457663 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9885f2-f7f0-4ac3-91e1-db99a30fa905 None admin] RBAC: Adding query filter params (name=member) {{(pid=79745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 07:10:03.458016 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9885f2-f7f0-4ac3-91e1-db99a30fa905 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:10:03.458336 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f181c091-d692-4243-a8c9-1e371669071a None admin] RBAC: Authorizing `identity:get_project(project_id=c1c61577200842b7bf6af16defd5fcbc)` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:10:03.459821 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f181c091-d692-4243-a8c9-1e371669071a None admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:10:03.460045 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9885f2-f7f0-4ac3-91e1-db99a30fa905 None admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:10:03.467412 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 83/160] 10.222.0.21 () {56 vars in 1186 bytes} [Wed May 4 07:10:03 2022] GET /identity/v3/projects/c1c61577200842b7bf6af16defd5fcbc => generated 298 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 07:10:03.468268 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f181c091-d692-4243-a8c9-1e371669071a None admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:10:03.473661 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 78/161] 10.222.0.21 () {56 vars in 1101 bytes} [Wed May 4 07:10:03 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 07:10:03.476189 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9885f2-f7f0-4ac3-91e1-db99a30fa905 None admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:10:03.577000 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9885f2-f7f0-4ac3-91e1-db99a30fa905 None admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:10:03.611376 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3b3877-d5a2-4df3-8e62-584510f860d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:10:03.612682 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3b3877-d5a2-4df3-8e62-584510f860d5 None admin] REQUEST_METHOD: `PUT` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:10:03.613166 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3b3877-d5a2-4df3-8e62-584510f860d5 None admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:10:03.613631 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3b3877-d5a2-4df3-8e62-584510f860d5 None admin] PATH_INFO: `/v3/projects/c1c61577200842b7bf6af16defd5fcbc/users/d58e92b4d33041cab878a5ed1fc4c245/roles/8dc3044bbffe459fb7166d4456243785` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:10:03.615837 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3b3877-d5a2-4df3-8e62-584510f860d5 None admin] RBAC: Authorizing `identity:create_grant(project_id=c1c61577200842b7bf6af16defd5fcbc, user_id=d58e92b4d33041cab878a5ed1fc4c245, role_id=8dc3044bbffe459fb7166d4456243785)` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:10:03.617520 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3b3877-d5a2-4df3-8e62-584510f860d5 None admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:10:03.633192 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f181c091-d692-4243-a8c9-1e371669071a None admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:10:03.643010 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 79/162] 10.222.0.21 () {58 vars in 1439 bytes} [Wed May 4 07:10:03 2022] PUT /identity/v3/projects/c1c61577200842b7bf6af16defd5fcbc/users/d58e92b4d33041cab878a5ed1fc4c245/roles/8dc3044bbffe459fb7166d4456243785 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 07:10:03.645259 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3b3877-d5a2-4df3-8e62-584510f860d5 None admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:10:03.705584 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cce88d9-e803-4440-9759-a33317748169 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:10:03.706797 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cce88d9-e803-4440-9759-a33317748169 None admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:10:03.708207 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cce88d9-e803-4440-9759-a33317748169 None admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:10:03.708720 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cce88d9-e803-4440-9759-a33317748169 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:10:03.736662 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cce88d9-e803-4440-9759-a33317748169 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 07:10:03.754104 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application [None req-6cce88d9-e803-4440-9759-a33317748169 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 04 07:10:03.754104 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 07:10:03.754104 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 07:10:03.754104 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 07:10:03.754104 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 07:10:03.754104 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 07:10:03.754104 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 07:10:03.754104 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 07:10:03.754104 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 07:10:03.754104 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 07:10:03.754104 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 07:10:03.754104 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 07:10:03.754104 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 07:10:03.754104 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 07:10:03.754104 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 07:10:03.754104 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 07:10:03.755169 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 07:10:03.755169 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 07:10:03.755169 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 07:10:03.755169 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 07:10:03.755169 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 07:10:03.755169 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 07:10:03.755169 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 07:10:03.755169 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 07:10:03.755169 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 07:10:03.755169 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.get_or_create( May 04 07:10:03.755169 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 07:10:03.755169 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application with Lock( May 04 07:10:03.755169 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 07:10:03.755169 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self._enter() May 04 07:10:03.755169 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 07:10:03.755169 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 07:10:03.755981 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 07:10:03.755981 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.creator() May 04 07:10:03.755981 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 07:10:03.755981 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application created_value = creator( May 04 07:10:03.755981 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 07:10:03.755981 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 07:10:03.755981 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 07:10:03.755981 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 07:10:03.755981 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 07:10:03.755981 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 07:10:03.755981 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 04 07:10:03.755981 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application May 04 07:10:03.755981 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 84/163] 10.222.0.21 () {56 vars in 1114 bytes} [Wed May 4 07:10:03 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 281 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 07:10:03.755981 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cce88d9-e803-4440-9759-a33317748169 None admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:10:03.858193 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3b3877-d5a2-4df3-8e62-584510f860d5 None admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:10:03.905330 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cce88d9-e803-4440-9759-a33317748169 None admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:10:03.940699 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab268f9-62b0-49c7-bee1-352b0c7d6a52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:10:03.941374 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab268f9-62b0-49c7-bee1-352b0c7d6a52 None admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:10:03.941656 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab268f9-62b0-49c7-bee1-352b0c7d6a52 None admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:10:03.941931 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab268f9-62b0-49c7-bee1-352b0c7d6a52 None admin] PATH_INFO: `/v3/roles` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:10:03.942330 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d607081-945a-44ec-92e2-94f8224492c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:10:03.942679 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab268f9-62b0-49c7-bee1-352b0c7d6a52 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79744) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 07:10:03.942983 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab268f9-62b0-49c7-bee1-352b0c7d6a52 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:10:03.943225 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d607081-945a-44ec-92e2-94f8224492c3 None admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:10:03.943502 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d607081-945a-44ec-92e2-94f8224492c3 None admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:10:03.943766 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d607081-945a-44ec-92e2-94f8224492c3 None admin] PATH_INFO: `/v3/users/6fa76119d31c4c4a839f95afaefeda66` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:10:03.944387 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab268f9-62b0-49c7-bee1-352b0c7d6a52 None admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:10:03.952094 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d607081-945a-44ec-92e2-94f8224492c3 None admin] RBAC: Authorizing `identity:get_user(user_id=6fa76119d31c4c4a839f95afaefeda66)` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:10:03.953475 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 85/164] 10.222.0.21 () {56 vars in 1111 bytes} [Wed May 4 07:10:03 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 07:10:03.953702 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d607081-945a-44ec-92e2-94f8224492c3 None admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:10:03.955601 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 80/165] 10.222.0.21 () {56 vars in 1177 bytes} [Wed May 4 07:10:03 2022] GET /identity/v3/users/6fa76119d31c4c4a839f95afaefeda66 => generated 275 bytes in 312 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 07:10:03.959645 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab268f9-62b0-49c7-bee1-352b0c7d6a52 None admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:10:03.960979 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d607081-945a-44ec-92e2-94f8224492c3 None admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:10:04.065278 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab268f9-62b0-49c7-bee1-352b0c7d6a52 None admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:10:04.113359 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac824357-df00-4b6b-95c3-6ef61c36e181 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:10:04.114163 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac824357-df00-4b6b-95c3-6ef61c36e181 None admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:10:04.114437 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac824357-df00-4b6b-95c3-6ef61c36e181 None admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:10:04.114700 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac824357-df00-4b6b-95c3-6ef61c36e181 None admin] PATH_INFO: `/v3/users/6fa76119d31c4c4a839f95afaefeda66` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:10:04.119933 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac824357-df00-4b6b-95c3-6ef61c36e181 None admin] RBAC: Authorizing `identity:get_user(user_id=6fa76119d31c4c4a839f95afaefeda66)` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:10:04.121392 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac824357-df00-4b6b-95c3-6ef61c36e181 None admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:10:04.123802 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 86/166] 10.222.0.21 () {56 vars in 1177 bytes} [Wed May 4 07:10:03 2022] GET /identity/v3/users/6fa76119d31c4c4a839f95afaefeda66 => generated 275 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 07:10:04.124133 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d607081-945a-44ec-92e2-94f8224492c3 None admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:10:04.124865 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff56dfb-7773-498e-88e0-78a9f0467b28 None None] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:10:04.125140 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff56dfb-7773-498e-88e0-78a9f0467b28 None None] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:10:04.125503 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff56dfb-7773-498e-88e0-78a9f0467b28 None None] PATH_INFO: `/` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:10:04.126650 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 87/167] 10.222.0.21 () {54 vars in 926 bytes} [Wed May 4 07:10:04 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 07:10:04.143396 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfe6272-a515-4991-8696-08467b842ad3 None None] REQUEST_METHOD: `POST` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:10:04.143674 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfe6272-a515-4991-8696-08467b842ad3 None None] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:10:04.143953 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfe6272-a515-4991-8696-08467b842ad3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:10:04.170334 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31298c9a-749d-4564-a324-3a81d6be056c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:10:04.171416 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31298c9a-749d-4564-a324-3a81d6be056c None admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:10:04.171893 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31298c9a-749d-4564-a324-3a81d6be056c None admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:10:04.172415 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31298c9a-749d-4564-a324-3a81d6be056c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:10:04.180297 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.auth.core [None req-7bfe6272-a515-4991-8696-08467b842ad3 None None] MFA Rules not processed for user `83c5e0dcb991496ea6dee38384514508`. Rule list: `[]` (Enabled: `True`). {{(pid=79744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:10:04.181512 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.fernet_utils [None req-7bfe6272-a515-4991-8696-08467b842ad3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:10:04.258411 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31298c9a-749d-4564-a324-3a81d6be056c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:10:04.260028 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31298c9a-749d-4564-a324-3a81d6be056c None admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:10:04.273969 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 88/168] 10.222.0.21 () {58 vars in 1023 bytes} [Wed May 4 07:10:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 07:10:04.274831 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfe6272-a515-4991-8696-08467b842ad3 None None] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:10:04.360052 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 81/169] 10.222.0.21 () {58 vars in 1282 bytes} [Wed May 4 07:10:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 399 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 04 07:10:04.360614 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31298c9a-749d-4564-a324-3a81d6be056c None admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:10:04.424274 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfe6272-a515-4991-8696-08467b842ad3 None None] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:10:04.460459 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31298c9a-749d-4564-a324-3a81d6be056c None admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:10:04.486183 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810a7870-c1eb-4e9b-9303-9c40752ce340 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:10:04.486838 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810a7870-c1eb-4e9b-9303-9c40752ce340 None admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:10:04.487111 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810a7870-c1eb-4e9b-9303-9c40752ce340 None admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:10:04.487403 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810a7870-c1eb-4e9b-9303-9c40752ce340 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:10:04.509091 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01abcef-7abe-499b-bc7b-cd8699f57f1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:10:04.509889 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01abcef-7abe-499b-bc7b-cd8699f57f1f None admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:10:04.510167 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01abcef-7abe-499b-bc7b-cd8699f57f1f None admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:10:04.510438 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01abcef-7abe-499b-bc7b-cd8699f57f1f None admin] PATH_INFO: `/v3/roles/member` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:10:04.528043 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01abcef-7abe-499b-bc7b-cd8699f57f1f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 07:10:04.545156 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application [None req-c01abcef-7abe-499b-bc7b-cd8699f57f1f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 04 07:10:04.545156 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 07:10:04.545156 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 07:10:04.545156 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 07:10:04.545156 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 07:10:04.545156 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 07:10:04.545156 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 07:10:04.545156 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 07:10:04.545156 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 07:10:04.545156 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 07:10:04.545156 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 07:10:04.545156 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 07:10:04.545156 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 07:10:04.545156 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 07:10:04.545156 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 07:10:04.545156 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 07:10:04.546053 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 07:10:04.546053 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 07:10:04.546053 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 07:10:04.546053 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 07:10:04.546053 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 07:10:04.546053 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 07:10:04.546053 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 07:10:04.546053 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 07:10:04.546053 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 07:10:04.546053 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self.get_or_create( May 04 07:10:04.546053 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 07:10:04.546053 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application with Lock( May 04 07:10:04.546053 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 07:10:04.546053 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self._enter() May 04 07:10:04.546053 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 07:10:04.546053 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 07:10:04.547744 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 07:10:04.547744 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self.creator() May 04 07:10:04.547744 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 07:10:04.547744 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application created_value = creator( May 04 07:10:04.547744 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 07:10:04.547744 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 07:10:04.547744 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 07:10:04.547744 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 07:10:04.547744 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 07:10:04.547744 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 07:10:04.547744 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 04 07:10:04.547744 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application May 04 07:10:04.547744 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 82/170] 10.222.0.21 () {56 vars in 1099 bytes} [Wed May 4 07:10:04 2022] GET /identity/v3/roles/member => generated 84 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 07:10:04.547744 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01abcef-7abe-499b-bc7b-cd8699f57f1f None admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:10:04.555261 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810a7870-c1eb-4e9b-9303-9c40752ce340 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:10:04.556712 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810a7870-c1eb-4e9b-9303-9c40752ce340 None admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:10:04.656105 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 89/171] 10.222.0.21 () {58 vars in 1282 bytes} [Wed May 4 07:10:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 04 07:10:04.656952 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810a7870-c1eb-4e9b-9303-9c40752ce340 None admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:10:04.741415 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01abcef-7abe-499b-bc7b-cd8699f57f1f None admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:10:04.758152 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810a7870-c1eb-4e9b-9303-9c40752ce340 None admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:10:04.795254 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ccee2b2-c1c3-4276-bf9d-1b449fa2ed35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:10:04.797473 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccee2b2-c1c3-4276-bf9d-1b449fa2ed35 None admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:10:04.797740 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccee2b2-c1c3-4276-bf9d-1b449fa2ed35 None admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:10:04.798016 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccee2b2-c1c3-4276-bf9d-1b449fa2ed35 None admin] PATH_INFO: `/v3/roles` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:10:04.798761 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ccee2b2-c1c3-4276-bf9d-1b449fa2ed35 None admin] RBAC: Adding query filter params (name=member) {{(pid=79744) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 07:10:04.799064 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ccee2b2-c1c3-4276-bf9d-1b449fa2ed35 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:10:04.800448 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ccee2b2-c1c3-4276-bf9d-1b449fa2ed35 None admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:10:04.803365 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f52ee6-a9c9-47fa-8d85-dedaec70d1d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:10:04.804219 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f52ee6-a9c9-47fa-8d85-dedaec70d1d2 None admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:10:04.804493 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f52ee6-a9c9-47fa-8d85-dedaec70d1d2 None admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:10:04.804758 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f52ee6-a9c9-47fa-8d85-dedaec70d1d2 None admin] PATH_INFO: `/v3/projects/c1c61577200842b7bf6af16defd5fcbc` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:10:04.805949 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f52ee6-a9c9-47fa-8d85-dedaec70d1d2 None admin] RBAC: Authorizing `identity:get_project(project_id=c1c61577200842b7bf6af16defd5fcbc)` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:10:04.807393 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f52ee6-a9c9-47fa-8d85-dedaec70d1d2 None admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:10:04.809081 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 83/172] 10.222.0.21 () {56 vars in 1186 bytes} [Wed May 4 07:10:04 2022] GET /identity/v3/projects/c1c61577200842b7bf6af16defd5fcbc => generated 298 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 07:10:04.810587 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f52ee6-a9c9-47fa-8d85-dedaec70d1d2 None admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:10:04.822882 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 90/173] 10.222.0.21 () {56 vars in 1101 bytes} [Wed May 4 07:10:04 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 07:10:04.827220 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ccee2b2-c1c3-4276-bf9d-1b449fa2ed35 None admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:10:04.955816 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f52ee6-a9c9-47fa-8d85-dedaec70d1d2 None admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:10:04.995659 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9c67d8-6341-41ed-a6df-0353baca8c69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:10:04.996436 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9c67d8-6341-41ed-a6df-0353baca8c69 None admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:10:04.999015 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9c67d8-6341-41ed-a6df-0353baca8c69 None admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:10:04.999336 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9c67d8-6341-41ed-a6df-0353baca8c69 None admin] PATH_INFO: `/v3/projects/c1c61577200842b7bf6af16defd5fcbc` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:10:05.001571 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9c67d8-6341-41ed-a6df-0353baca8c69 None admin] RBAC: Authorizing `identity:get_project(project_id=c1c61577200842b7bf6af16defd5fcbc)` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:10:05.003020 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9c67d8-6341-41ed-a6df-0353baca8c69 None admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:10:05.009828 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 84/174] 10.222.0.21 () {56 vars in 1186 bytes} [Wed May 4 07:10:04 2022] GET /identity/v3/projects/c1c61577200842b7bf6af16defd5fcbc => generated 298 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 07:10:05.010734 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9c67d8-6341-41ed-a6df-0353baca8c69 None admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:10:05.024787 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ccee2b2-c1c3-4276-bf9d-1b449fa2ed35 None admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:10:05.068435 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214598b3-f1c6-4e74-8f6f-07ab38f9d016 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:10:05.069097 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214598b3-f1c6-4e74-8f6f-07ab38f9d016 None admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:10:05.069380 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214598b3-f1c6-4e74-8f6f-07ab38f9d016 None admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:10:05.069652 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214598b3-f1c6-4e74-8f6f-07ab38f9d016 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:10:05.070488 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214598b3-f1c6-4e74-8f6f-07ab38f9d016 None admin] RBAC: Adding query filter params (role.id=9f89c07b05a14f18836116af22cba5f6, scope.project.id=c1c61577200842b7bf6af16defd5fcbc, user.id=6fa76119d31c4c4a839f95afaefeda66) {{(pid=79744) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 07:10:05.070799 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214598b3-f1c6-4e74-8f6f-07ab38f9d016 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:10:05.072275 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214598b3-f1c6-4e74-8f6f-07ab38f9d016 None admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:10:05.089736 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 91/175] 10.222.0.21 () {56 vars in 1374 bytes} [Wed May 4 07:10:04 2022] GET /identity/v3/role_assignments?user.id=6fa76119d31c4c4a839f95afaefeda66&scope.project.id=c1c61577200842b7bf6af16defd5fcbc&role.id=9f89c07b05a14f18836116af22cba5f6 => generated 608 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 07:10:05.090277 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214598b3-f1c6-4e74-8f6f-07ab38f9d016 None admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:10:05.253821 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214598b3-f1c6-4e74-8f6f-07ab38f9d016 None admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:10:05.295630 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a2e6de-c3d0-4be0-8ab7-60cd67ba3400 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:10:05.296284 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a2e6de-c3d0-4be0-8ab7-60cd67ba3400 None admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:10:05.296556 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a2e6de-c3d0-4be0-8ab7-60cd67ba3400 None admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:10:05.296823 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a2e6de-c3d0-4be0-8ab7-60cd67ba3400 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:10:05.297656 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a2e6de-c3d0-4be0-8ab7-60cd67ba3400 None admin] RBAC: Adding query filter params (role.id=91b8526a43a4426a883870ad97362652, scope.project.id=c1c61577200842b7bf6af16defd5fcbc, user.id=6fa76119d31c4c4a839f95afaefeda66) {{(pid=79744) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 07:10:05.297961 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a2e6de-c3d0-4be0-8ab7-60cd67ba3400 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:10:05.299428 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a2e6de-c3d0-4be0-8ab7-60cd67ba3400 None admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:10:05.301728 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9c67d8-6341-41ed-a6df-0353baca8c69 None admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:10:05.316437 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 92/176] 10.222.0.21 () {56 vars in 1374 bytes} [Wed May 4 07:10:05 2022] GET /identity/v3/role_assignments?user.id=6fa76119d31c4c4a839f95afaefeda66&scope.project.id=c1c61577200842b7bf6af16defd5fcbc&role.id=91b8526a43a4426a883870ad97362652 => generated 608 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 07:10:05.350898 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92bd52f-c3a5-4615-9844-8201a59c09fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:10:05.351821 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92bd52f-c3a5-4615-9844-8201a59c09fb None admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:10:05.352095 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92bd52f-c3a5-4615-9844-8201a59c09fb None admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:10:05.352370 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92bd52f-c3a5-4615-9844-8201a59c09fb None admin] PATH_INFO: `/v3/users/6fa76119d31c4c4a839f95afaefeda66` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:10:05.353647 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92bd52f-c3a5-4615-9844-8201a59c09fb None admin] RBAC: Authorizing `identity:get_user(user_id=6fa76119d31c4c4a839f95afaefeda66)` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:10:05.355112 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92bd52f-c3a5-4615-9844-8201a59c09fb None admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:10:05.357743 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 85/177] 10.222.0.21 () {56 vars in 1177 bytes} [Wed May 4 07:10:05 2022] GET /identity/v3/users/6fa76119d31c4c4a839f95afaefeda66 => generated 275 bytes in 347 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 07:10:05.363622 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a2e6de-c3d0-4be0-8ab7-60cd67ba3400 None admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:10:05.484505 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a2e6de-c3d0-4be0-8ab7-60cd67ba3400 None admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:10:05.522423 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7ca5f3-fd80-4959-9a19-1ef1384f30a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:10:05.523009 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7ca5f3-fd80-4959-9a19-1ef1384f30a4 None admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:10:05.523358 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7ca5f3-fd80-4959-9a19-1ef1384f30a4 None admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:10:05.523630 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7ca5f3-fd80-4959-9a19-1ef1384f30a4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:10:05.604379 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7ca5f3-fd80-4959-9a19-1ef1384f30a4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:10:05.605910 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7ca5f3-fd80-4959-9a19-1ef1384f30a4 None admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:10:05.709319 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 93/178] 10.222.0.21 () {58 vars in 1282 bytes} [Wed May 4 07:10:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 04 07:10:05.715513 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92bd52f-c3a5-4615-9844-8201a59c09fb None admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:10:05.840906 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c59fe2-fc89-4f53-84fd-55a7bc88e7fb None None] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:10:05.841327 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c59fe2-fc89-4f53-84fd-55a7bc88e7fb None None] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:10:05.841595 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c59fe2-fc89-4f53-84fd-55a7bc88e7fb None None] PATH_INFO: `/` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:10:05.843103 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 94/179] 10.222.0.21 () {54 vars in 926 bytes} [Wed May 4 07:10:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 04 07:10:05.848518 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c63887-5d98-426e-a0d0-7348266285b5 None None] REQUEST_METHOD: `POST` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:10:05.848804 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c63887-5d98-426e-a0d0-7348266285b5 None None] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:10:05.849082 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c63887-5d98-426e-a0d0-7348266285b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:10:05.853969 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92bd52f-c3a5-4615-9844-8201a59c09fb None admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:10:05.886236 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.auth.core [None req-c5c63887-5d98-426e-a0d0-7348266285b5 None None] MFA Rules not processed for user `83c5e0dcb991496ea6dee38384514508`. Rule list: `[]` (Enabled: `True`). {{(pid=79744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:10:05.887466 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.fernet_utils [None req-c5c63887-5d98-426e-a0d0-7348266285b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:10:05.896934 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb8f50b-db9f-40b8-bf2a-0ffa8eafcf42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:10:05.897816 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb8f50b-db9f-40b8-bf2a-0ffa8eafcf42 None admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:10:05.898091 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb8f50b-db9f-40b8-bf2a-0ffa8eafcf42 None admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:10:05.898358 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb8f50b-db9f-40b8-bf2a-0ffa8eafcf42 None admin] PATH_INFO: `/v3/projects/ee7199f3d20d47f8919b11b86dd5382f` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:10:05.899616 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb8f50b-db9f-40b8-bf2a-0ffa8eafcf42 None admin] RBAC: Authorizing `identity:get_project(project_id=ee7199f3d20d47f8919b11b86dd5382f)` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:10:05.901108 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb8f50b-db9f-40b8-bf2a-0ffa8eafcf42 None admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:10:05.903987 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 86/180] 10.222.0.21 () {56 vars in 1186 bytes} [Wed May 4 07:10:05 2022] GET /identity/v3/projects/ee7199f3d20d47f8919b11b86dd5382f => generated 312 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 07:10:05.909761 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb8f50b-db9f-40b8-bf2a-0ffa8eafcf42 None admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:10:05.989180 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 95/181] 10.222.0.21 () {58 vars in 1023 bytes} [Wed May 4 07:10:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 07:10:06.016488 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb8f50b-db9f-40b8-bf2a-0ffa8eafcf42 None admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:10:06.030793 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c63887-5d98-426e-a0d0-7348266285b5 None None] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:10:06.050847 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afefe86-0086-47a5-b3ba-dde753eae195 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:10:06.051531 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afefe86-0086-47a5-b3ba-dde753eae195 None admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:10:06.051804 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afefe86-0086-47a5-b3ba-dde753eae195 None admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:10:06.052071 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afefe86-0086-47a5-b3ba-dde753eae195 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:10:06.052904 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6afefe86-0086-47a5-b3ba-dde753eae195 None admin] RBAC: Adding query filter params (role.id=9f89c07b05a14f18836116af22cba5f6, scope.project.id=ee7199f3d20d47f8919b11b86dd5382f, user.id=6fa76119d31c4c4a839f95afaefeda66) {{(pid=79745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 07:10:06.053212 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6afefe86-0086-47a5-b3ba-dde753eae195 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:10:06.054640 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6afefe86-0086-47a5-b3ba-dde753eae195 None admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:10:06.061026 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 87/182] 10.222.0.21 () {56 vars in 1374 bytes} [Wed May 4 07:10:05 2022] GET /identity/v3/role_assignments?user.id=6fa76119d31c4c4a839f95afaefeda66&scope.project.id=ee7199f3d20d47f8919b11b86dd5382f&role.id=9f89c07b05a14f18836116af22cba5f6 => generated 608 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 07:10:06.198128 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c63887-5d98-426e-a0d0-7348266285b5 None None] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:10:06.241124 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ff52a7-1889-4162-9bd2-aeda616fe452 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:10:06.241922 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ff52a7-1889-4162-9bd2-aeda616fe452 None admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:10:06.242195 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ff52a7-1889-4162-9bd2-aeda616fe452 None admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:10:06.242461 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ff52a7-1889-4162-9bd2-aeda616fe452 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:10:06.253556 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ff52a7-1889-4162-9bd2-aeda616fe452 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 07:10:06.261528 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application [None req-87ff52a7-1889-4162-9bd2-aeda616fe452 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 04 07:10:06.261528 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 07:10:06.261528 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 07:10:06.261528 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 07:10:06.261528 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 07:10:06.261528 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 07:10:06.261528 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 07:10:06.261528 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 07:10:06.261528 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 07:10:06.261528 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 07:10:06.261528 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 07:10:06.261528 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 07:10:06.261528 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 07:10:06.261528 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 07:10:06.261528 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 07:10:06.261528 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 07:10:06.262710 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 07:10:06.262710 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 07:10:06.262710 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 07:10:06.262710 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 07:10:06.262710 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 07:10:06.262710 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 07:10:06.262710 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 07:10:06.262710 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 07:10:06.262710 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 07:10:06.262710 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.get_or_create( May 04 07:10:06.262710 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 07:10:06.262710 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application with Lock( May 04 07:10:06.262710 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 07:10:06.262710 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self._enter() May 04 07:10:06.262710 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 07:10:06.262710 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 07:10:06.263542 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 07:10:06.263542 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.creator() May 04 07:10:06.263542 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 07:10:06.263542 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application created_value = creator( May 04 07:10:06.263542 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 07:10:06.263542 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 07:10:06.263542 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 07:10:06.263542 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 07:10:06.263542 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 07:10:06.263542 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 07:10:06.263542 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 04 07:10:06.263542 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application May 04 07:10:06.263542 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 96/183] 10.222.0.21 () {56 vars in 1096 bytes} [Wed May 4 07:10:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 07:10:06.270886 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afefe86-0086-47a5-b3ba-dde753eae195 None admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:10:06.386681 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afefe86-0086-47a5-b3ba-dde753eae195 None admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:10:06.428107 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a70a77-a833-46b9-b0f2-5f5e939c239e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:10:06.428783 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a70a77-a833-46b9-b0f2-5f5e939c239e None admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:10:06.429056 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a70a77-a833-46b9-b0f2-5f5e939c239e None admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:10:06.429324 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a70a77-a833-46b9-b0f2-5f5e939c239e None admin] PATH_INFO: `/v3/roles` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:10:06.430071 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a70a77-a833-46b9-b0f2-5f5e939c239e None admin] RBAC: Adding query filter params (name=admin) {{(pid=79745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 07:10:06.430370 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a70a77-a833-46b9-b0f2-5f5e939c239e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:10:06.431782 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a70a77-a833-46b9-b0f2-5f5e939c239e None admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:10:06.441163 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 88/184] 10.222.0.21 () {56 vars in 1099 bytes} [Wed May 4 07:10:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 07:10:06.456459 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ff52a7-1889-4162-9bd2-aeda616fe452 None admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:10:06.527622 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649b4d83-d8e3-460b-bda2-66276e433a8a None None] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:10:06.527940 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649b4d83-d8e3-460b-bda2-66276e433a8a None None] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:10:06.528848 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649b4d83-d8e3-460b-bda2-66276e433a8a None None] PATH_INFO: `/` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:10:06.530850 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 89/185] 10.222.0.21 () {54 vars in 926 bytes} [Wed May 4 07:10:06 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 04 07:10:06.538970 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925d3f9f-53e2-492d-855f-42e463cbcfea None None] REQUEST_METHOD: `POST` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:10:06.539275 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925d3f9f-53e2-492d-855f-42e463cbcfea None None] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:10:06.539553 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925d3f9f-53e2-492d-855f-42e463cbcfea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:10:06.560585 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.auth.core [None req-925d3f9f-53e2-492d-855f-42e463cbcfea None None] MFA Rules not processed for user `83c5e0dcb991496ea6dee38384514508`. Rule list: `[]` (Enabled: `True`). {{(pid=79745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:10:06.561758 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.fernet_utils [None req-925d3f9f-53e2-492d-855f-42e463cbcfea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:10:06.575975 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ff52a7-1889-4162-9bd2-aeda616fe452 None admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:10:06.610351 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519f56c5-b280-4f26-aa28-060aee1a0a9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:10:06.611257 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519f56c5-b280-4f26-aa28-060aee1a0a9e None admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:10:06.611539 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519f56c5-b280-4f26-aa28-060aee1a0a9e None admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:10:06.611812 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519f56c5-b280-4f26-aa28-060aee1a0a9e None admin] PATH_INFO: `/v3/users/95f672ad952f4afdad41f0bc6cc39429` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:10:06.625364 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519f56c5-b280-4f26-aa28-060aee1a0a9e None admin] RBAC: Authorizing `identity:get_user(user_id=95f672ad952f4afdad41f0bc6cc39429)` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:10:06.626824 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519f56c5-b280-4f26-aa28-060aee1a0a9e None admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:10:06.628784 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 97/186] 10.222.0.21 () {56 vars in 1177 bytes} [Wed May 4 07:10:06 2022] GET /identity/v3/users/95f672ad952f4afdad41f0bc6cc39429 => generated 283 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 07:10:06.629752 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafa56fd-78f6-4262-a6c8-41c5ea83e3ab None None] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:10:06.630036 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafa56fd-78f6-4262-a6c8-41c5ea83e3ab None None] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:10:06.630309 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafa56fd-78f6-4262-a6c8-41c5ea83e3ab None None] PATH_INFO: `/` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:10:06.635224 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 98/187] 10.222.0.21 () {54 vars in 926 bytes} [Wed May 4 07:10:06 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 07:10:06.635224 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafa56fd-78f6-4262-a6c8-41c5ea83e3ab None None] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:10:06.637419 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 90/188] 10.222.0.21 () {58 vars in 1023 bytes} [Wed May 4 07:10:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 07:10:06.639521 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fba15e-3f94-49ba-92a5-2514b8dedfa0 None None] REQUEST_METHOD: `POST` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:10:06.639940 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fba15e-3f94-49ba-92a5-2514b8dedfa0 None None] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:10:06.640350 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fba15e-3f94-49ba-92a5-2514b8dedfa0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:10:06.660487 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.auth.core [None req-49fba15e-3f94-49ba-92a5-2514b8dedfa0 None None] MFA Rules not processed for user `83c5e0dcb991496ea6dee38384514508`. Rule list: `[]` (Enabled: `True`). {{(pid=79745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:10:06.661946 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.fernet_utils [None req-49fba15e-3f94-49ba-92a5-2514b8dedfa0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:10:06.728359 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 91/189] 10.222.0.21 () {58 vars in 1023 bytes} [Wed May 4 07:10:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 07:10:06.733303 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fba15e-3f94-49ba-92a5-2514b8dedfa0 None None] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:10:06.745453 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafa56fd-78f6-4262-a6c8-41c5ea83e3ab None None] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:10:06.782798 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e733d339-9985-4f20-96ff-c6304591accd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:10:06.783534 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e733d339-9985-4f20-96ff-c6304591accd None admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:10:06.783807 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e733d339-9985-4f20-96ff-c6304591accd None admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:10:06.784072 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e733d339-9985-4f20-96ff-c6304591accd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:10:06.835500 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fba15e-3f94-49ba-92a5-2514b8dedfa0 None None] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:10:06.852211 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e733d339-9985-4f20-96ff-c6304591accd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:10:06.853669 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e733d339-9985-4f20-96ff-c6304591accd None admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:10:06.869037 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35149cb1-9927-4339-b94f-eadd30f753c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:10:06.869831 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35149cb1-9927-4339-b94f-eadd30f753c1 None admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:10:06.870103 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35149cb1-9927-4339-b94f-eadd30f753c1 None admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:10:06.870367 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35149cb1-9927-4339-b94f-eadd30f753c1 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:10:06.880763 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35149cb1-9927-4339-b94f-eadd30f753c1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 07:10:06.889221 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application [None req-35149cb1-9927-4339-b94f-eadd30f753c1 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 04 07:10:06.889221 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 07:10:06.889221 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 07:10:06.889221 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 07:10:06.889221 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 07:10:06.889221 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 07:10:06.889221 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 07:10:06.889221 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 07:10:06.889221 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 07:10:06.889221 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 07:10:06.889221 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 07:10:06.889221 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 07:10:06.889221 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 07:10:06.889221 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 07:10:06.889221 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 07:10:06.889221 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 07:10:06.890109 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 07:10:06.890109 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 07:10:06.890109 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 07:10:06.890109 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 07:10:06.890109 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 07:10:06.890109 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 07:10:06.890109 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 07:10:06.890109 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 07:10:06.890109 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 07:10:06.890109 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self.get_or_create( May 04 07:10:06.890109 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 07:10:06.890109 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application with Lock( May 04 07:10:06.890109 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 07:10:06.890109 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self._enter() May 04 07:10:06.890109 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 07:10:06.890109 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 07:10:06.896055 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 07:10:06.896055 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self.creator() May 04 07:10:06.896055 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 07:10:06.896055 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application created_value = creator( May 04 07:10:06.896055 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 07:10:06.896055 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 07:10:06.896055 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 07:10:06.896055 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 07:10:06.896055 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 07:10:06.896055 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 07:10:06.896055 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 04 07:10:06.896055 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application May 04 07:10:06.896055 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 92/190] 10.222.0.21 () {56 vars in 1114 bytes} [Wed May 4 07:10:06 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 07:10:06.896055 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35149cb1-9927-4339-b94f-eadd30f753c1 None admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:10:06.967878 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 99/191] 10.222.0.21 () {58 vars in 1282 bytes} [Wed May 4 07:10:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 04 07:10:06.969574 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e733d339-9985-4f20-96ff-c6304591accd None admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:10:06.991419 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35149cb1-9927-4339-b94f-eadd30f753c1 None admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:10:07.028903 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5910d6-4b2d-4c5e-a49c-e718f165bee9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:10:07.030104 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5910d6-4b2d-4c5e-a49c-e718f165bee9 None admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:10:07.030185 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5910d6-4b2d-4c5e-a49c-e718f165bee9 None admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:10:07.030405 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5910d6-4b2d-4c5e-a49c-e718f165bee9 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:10:07.031633 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5910d6-4b2d-4c5e-a49c-e718f165bee9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:10:07.033092 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5910d6-4b2d-4c5e-a49c-e718f165bee9 None admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:10:07.034714 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 93/192] 10.222.0.21 () {56 vars in 1108 bytes} [Wed May 4 07:10:06 2022] GET /identity/v3/domains/default => generated 199 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 07:10:07.035496 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5910d6-4b2d-4c5e-a49c-e718f165bee9 None admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:10:07.085422 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e733d339-9985-4f20-96ff-c6304591accd None admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:10:07.129683 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f98b4b-c0d3-49d7-a967-7760a271b588 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:10:07.131107 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f98b4b-c0d3-49d7-a967-7760a271b588 None admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:10:07.131539 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f98b4b-c0d3-49d7-a967-7760a271b588 None admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:10:07.132077 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f98b4b-c0d3-49d7-a967-7760a271b588 None admin] PATH_INFO: `/v3/roles` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:10:07.133353 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5910d6-4b2d-4c5e-a49c-e718f165bee9 None admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:10:07.133670 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f98b4b-c0d3-49d7-a967-7760a271b588 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79744) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 07:10:07.133980 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f98b4b-c0d3-49d7-a967-7760a271b588 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:10:07.135380 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f98b4b-c0d3-49d7-a967-7760a271b588 None admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:10:07.143975 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 100/193] 10.222.0.21 () {56 vars in 1111 bytes} [Wed May 4 07:10:06 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 07:10:07.144755 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f98b4b-c0d3-49d7-a967-7760a271b588 None admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:10:07.165549 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610713c5-bf07-4690-a6c5-d6357144cadb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:10:07.166403 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610713c5-bf07-4690-a6c5-d6357144cadb None admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:10:07.166682 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610713c5-bf07-4690-a6c5-d6357144cadb None admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:10:07.166952 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610713c5-bf07-4690-a6c5-d6357144cadb None admin] PATH_INFO: `/v3/projects/c3c877aea85b47dea9daa6ab598d831f` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:10:07.168147 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610713c5-bf07-4690-a6c5-d6357144cadb None admin] RBAC: Authorizing `identity:get_project(project_id=c3c877aea85b47dea9daa6ab598d831f)` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:10:07.169679 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610713c5-bf07-4690-a6c5-d6357144cadb None admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:10:07.171412 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 94/194] 10.222.0.21 () {56 vars in 1186 bytes} [Wed May 4 07:10:07 2022] GET /identity/v3/projects/c3c877aea85b47dea9daa6ab598d831f => generated 302 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 07:10:07.172566 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a21104c-3014-4290-8e34-a0258629c90a None None] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:10:07.172849 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a21104c-3014-4290-8e34-a0258629c90a None None] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:10:07.173125 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a21104c-3014-4290-8e34-a0258629c90a None None] PATH_INFO: `/` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:10:07.174517 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 95/195] 10.222.0.21 () {54 vars in 926 bytes} [Wed May 4 07:10:07 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 07:10:07.175050 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a21104c-3014-4290-8e34-a0258629c90a None None] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:10:07.244569 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f98b4b-c0d3-49d7-a967-7760a271b588 None admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:10:07.272454 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a21104c-3014-4290-8e34-a0258629c90a None None] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:10:07.277123 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90e820d-fb08-4e52-a1b1-675f792ce4a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:10:07.277783 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90e820d-fb08-4e52-a1b1-675f792ce4a0 None admin] REQUEST_METHOD: `POST` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:10:07.278060 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90e820d-fb08-4e52-a1b1-675f792ce4a0 None admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:10:07.278332 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90e820d-fb08-4e52-a1b1-675f792ce4a0 None admin] PATH_INFO: `/v3/users` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:10:07.279031 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90e820d-fb08-4e52-a1b1-675f792ce4a0 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:10:07.280488 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90e820d-fb08-4e52-a1b1-675f792ce4a0 None admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:10:07.298823 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 101/196] 10.222.0.21 () {60 vars in 1132 bytes} [Wed May 4 07:10:07 2022] POST /identity/v3/users => generated 297 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 07:10:07.299662 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90e820d-fb08-4e52-a1b1-675f792ce4a0 None admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:10:07.308121 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2426846e-3748-426d-bcc0-1f46543db75a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:10:07.309039 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2426846e-3748-426d-bcc0-1f46543db75a None admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:10:07.309334 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2426846e-3748-426d-bcc0-1f46543db75a None admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:10:07.310087 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2426846e-3748-426d-bcc0-1f46543db75a None admin] PATH_INFO: `/v3/users/95f672ad952f4afdad41f0bc6cc39429` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:10:07.311406 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2426846e-3748-426d-bcc0-1f46543db75a None admin] RBAC: Authorizing `identity:get_user(user_id=95f672ad952f4afdad41f0bc6cc39429)` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:10:07.312882 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2426846e-3748-426d-bcc0-1f46543db75a None admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:10:07.314595 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 96/197] 10.222.0.21 () {56 vars in 1177 bytes} [Wed May 4 07:10:07 2022] GET /identity/v3/users/95f672ad952f4afdad41f0bc6cc39429 => generated 283 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 07:10:07.316039 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52d180f-dd50-4b5e-aee3-47cee7d533a0 None None] REQUEST_METHOD: `POST` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:10:07.316325 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52d180f-dd50-4b5e-aee3-47cee7d533a0 None None] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:10:07.316591 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52d180f-dd50-4b5e-aee3-47cee7d533a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:10:07.334284 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.auth.core [None req-e52d180f-dd50-4b5e-aee3-47cee7d533a0 None None] MFA Rules not processed for user `83c5e0dcb991496ea6dee38384514508`. Rule list: `[]` (Enabled: `True`). {{(pid=79745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:10:07.335670 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.fernet_utils [None req-e52d180f-dd50-4b5e-aee3-47cee7d533a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:10:07.412525 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 97/198] 10.222.0.21 () {58 vars in 1023 bytes} [Wed May 4 07:10:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 07:10:07.412525 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52d180f-dd50-4b5e-aee3-47cee7d533a0 None None] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:10:07.438983 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90e820d-fb08-4e52-a1b1-675f792ce4a0 None admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:10:07.486059 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46fe5b2c-75c2-425d-a24a-7b9ccc061a7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:10:07.486725 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fe5b2c-75c2-425d-a24a-7b9ccc061a7f None admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:10:07.487870 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fe5b2c-75c2-425d-a24a-7b9ccc061a7f None admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:10:07.488146 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fe5b2c-75c2-425d-a24a-7b9ccc061a7f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:10:07.488983 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46fe5b2c-75c2-425d-a24a-7b9ccc061a7f None admin] RBAC: Adding query filter params (role.id=eb54c9cea2774a25b1fe8c79724408ee, scope.project.id=c3c877aea85b47dea9daa6ab598d831f, user.id=95f672ad952f4afdad41f0bc6cc39429) {{(pid=79744) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 07:10:07.489290 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46fe5b2c-75c2-425d-a24a-7b9ccc061a7f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:10:07.490829 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46fe5b2c-75c2-425d-a24a-7b9ccc061a7f None admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:10:07.496957 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 102/199] 10.222.0.21 () {56 vars in 1374 bytes} [Wed May 4 07:10:07 2022] GET /identity/v3/role_assignments?user.id=95f672ad952f4afdad41f0bc6cc39429&scope.project.id=c3c877aea85b47dea9daa6ab598d831f&role.id=eb54c9cea2774a25b1fe8c79724408ee => generated 259 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 07:10:07.497807 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46fe5b2c-75c2-425d-a24a-7b9ccc061a7f None admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:10:07.525199 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52d180f-dd50-4b5e-aee3-47cee7d533a0 None None] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:10:07.573976 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b215b2b-1708-4fb5-8b7b-03d115d9020b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:10:07.575751 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b215b2b-1708-4fb5-8b7b-03d115d9020b None admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:10:07.575751 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b215b2b-1708-4fb5-8b7b-03d115d9020b None admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:10:07.578122 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b215b2b-1708-4fb5-8b7b-03d115d9020b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:10:07.611771 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46fe5b2c-75c2-425d-a24a-7b9ccc061a7f None admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:10:07.648892 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bf13a6-ffd3-416c-b4a2-8b7fb9d3e99f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:10:07.649719 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bf13a6-ffd3-416c-b4a2-8b7fb9d3e99f None admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:10:07.650002 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bf13a6-ffd3-416c-b4a2-8b7fb9d3e99f None admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:10:07.650282 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bf13a6-ffd3-416c-b4a2-8b7fb9d3e99f None admin] PATH_INFO: `/v3/roles/reader` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:10:07.663996 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84bf13a6-ffd3-416c-b4a2-8b7fb9d3e99f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 07:10:07.672626 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application [None req-84bf13a6-ffd3-416c-b4a2-8b7fb9d3e99f None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 04 07:10:07.672626 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 07:10:07.672626 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 07:10:07.672626 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 07:10:07.672626 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 07:10:07.672626 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 07:10:07.672626 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 07:10:07.672626 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 07:10:07.672626 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 07:10:07.672626 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 07:10:07.672626 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 07:10:07.672626 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 07:10:07.672626 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 07:10:07.672626 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 07:10:07.672626 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 07:10:07.672626 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 07:10:07.673581 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 07:10:07.673581 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 07:10:07.673581 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 07:10:07.673581 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 07:10:07.673581 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 07:10:07.673581 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 07:10:07.673581 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 07:10:07.673581 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 07:10:07.673581 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 07:10:07.673581 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.get_or_create( May 04 07:10:07.673581 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 07:10:07.673581 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application with Lock( May 04 07:10:07.673581 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 07:10:07.673581 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self._enter() May 04 07:10:07.673581 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 07:10:07.673581 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 07:10:07.674383 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 07:10:07.674383 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.creator() May 04 07:10:07.674383 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 07:10:07.674383 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application created_value = creator( May 04 07:10:07.674383 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 07:10:07.674383 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 07:10:07.674383 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 07:10:07.674383 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 07:10:07.674383 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 07:10:07.674383 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 07:10:07.674383 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 04 07:10:07.674383 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application May 04 07:10:07.674383 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 103/200] 10.222.0.21 () {56 vars in 1099 bytes} [Wed May 4 07:10:07 2022] GET /identity/v3/roles/reader => generated 84 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 07:10:07.677297 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b215b2b-1708-4fb5-8b7b-03d115d9020b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:10:07.678900 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b215b2b-1708-4fb5-8b7b-03d115d9020b None admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:10:07.680185 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bf13a6-ffd3-416c-b4a2-8b7fb9d3e99f None admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:10:07.786619 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 98/201] 10.222.0.21 () {58 vars in 1282 bytes} [Wed May 4 07:10:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 04 07:10:07.790406 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bf13a6-ffd3-416c-b4a2-8b7fb9d3e99f None admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:10:07.792224 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b215b2b-1708-4fb5-8b7b-03d115d9020b None admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:10:07.824585 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e058b75-6a4c-4d4f-8702-3e869b9ddba8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:10:07.825814 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e058b75-6a4c-4d4f-8702-3e869b9ddba8 None admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:10:07.826093 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e058b75-6a4c-4d4f-8702-3e869b9ddba8 None admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:10:07.826354 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e058b75-6a4c-4d4f-8702-3e869b9ddba8 None admin] PATH_INFO: `/v3/roles` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:10:07.827199 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e058b75-6a4c-4d4f-8702-3e869b9ddba8 None admin] RBAC: Adding query filter params (name=reader) {{(pid=79744) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 07:10:07.827508 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e058b75-6a4c-4d4f-8702-3e869b9ddba8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:10:07.828897 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e058b75-6a4c-4d4f-8702-3e869b9ddba8 None admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:10:07.841971 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 104/202] 10.222.0.21 () {56 vars in 1101 bytes} [Wed May 4 07:10:07 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 07:10:07.843247 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e058b75-6a4c-4d4f-8702-3e869b9ddba8 None admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:10:07.897877 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b215b2b-1708-4fb5-8b7b-03d115d9020b None admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:10:07.932644 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8be9c4-38c0-454b-93ed-9e607f20c006 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:10:07.933869 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8be9c4-38c0-454b-93ed-9e607f20c006 None admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:10:07.934348 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8be9c4-38c0-454b-93ed-9e607f20c006 None admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:10:07.935362 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8be9c4-38c0-454b-93ed-9e607f20c006 None admin] PATH_INFO: `/v3/projects/c3c877aea85b47dea9daa6ab598d831f` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:10:07.937014 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8be9c4-38c0-454b-93ed-9e607f20c006 None admin] RBAC: Authorizing `identity:get_project(project_id=c3c877aea85b47dea9daa6ab598d831f)` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:10:07.938680 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8be9c4-38c0-454b-93ed-9e607f20c006 None admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:10:07.940637 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 99/203] 10.222.0.21 () {56 vars in 1186 bytes} [Wed May 4 07:10:07 2022] GET /identity/v3/projects/c3c877aea85b47dea9daa6ab598d831f => generated 302 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 07:10:07.941907 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e058b75-6a4c-4d4f-8702-3e869b9ddba8 None admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:10:07.948811 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8be9c4-38c0-454b-93ed-9e607f20c006 None admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:10:07.975899 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5cf24cd-a590-42e5-9529-0df2e6f9332b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:10:07.976761 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cf24cd-a590-42e5-9529-0df2e6f9332b None admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:10:07.977034 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cf24cd-a590-42e5-9529-0df2e6f9332b None admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:10:07.977297 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cf24cd-a590-42e5-9529-0df2e6f9332b None admin] PATH_INFO: `/v3/users/d58e92b4d33041cab878a5ed1fc4c245` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:10:07.978500 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5cf24cd-a590-42e5-9529-0df2e6f9332b None admin] RBAC: Authorizing `identity:get_user(user_id=d58e92b4d33041cab878a5ed1fc4c245)` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:10:07.979963 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5cf24cd-a590-42e5-9529-0df2e6f9332b None admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:10:07.991638 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 105/204] 10.222.0.21 () {56 vars in 1177 bytes} [Wed May 4 07:10:07 2022] GET /identity/v3/users/d58e92b4d33041cab878a5ed1fc4c245 => generated 289 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 07:10:07.991638 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5cf24cd-a590-42e5-9529-0df2e6f9332b None admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:10:08.086347 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5cf24cd-a590-42e5-9529-0df2e6f9332b None admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:10:08.119871 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209937ff-4f88-4374-8373-8e982070d2a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:10:08.120526 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209937ff-4f88-4374-8373-8e982070d2a5 None admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:10:08.120795 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209937ff-4f88-4374-8373-8e982070d2a5 None admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:10:08.121061 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209937ff-4f88-4374-8373-8e982070d2a5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:10:08.161249 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8be9c4-38c0-454b-93ed-9e607f20c006 None admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:10:08.188058 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209937ff-4f88-4374-8373-8e982070d2a5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:10:08.189525 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209937ff-4f88-4374-8373-8e982070d2a5 None admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:10:08.256846 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86dbcfb3-fe4d-4e69-aa0c-b52bd77a58a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:10:08.257508 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86dbcfb3-fe4d-4e69-aa0c-b52bd77a58a0 None admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:10:08.257786 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86dbcfb3-fe4d-4e69-aa0c-b52bd77a58a0 None admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:10:08.258056 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86dbcfb3-fe4d-4e69-aa0c-b52bd77a58a0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:10:08.258887 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86dbcfb3-fe4d-4e69-aa0c-b52bd77a58a0 None admin] RBAC: Adding query filter params (role.id=91b8526a43a4426a883870ad97362652, scope.project.id=c3c877aea85b47dea9daa6ab598d831f, user.id=95f672ad952f4afdad41f0bc6cc39429) {{(pid=79745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 07:10:08.259220 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86dbcfb3-fe4d-4e69-aa0c-b52bd77a58a0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:10:08.260654 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86dbcfb3-fe4d-4e69-aa0c-b52bd77a58a0 None admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:10:08.277309 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 100/205] 10.222.0.21 () {56 vars in 1374 bytes} [Wed May 4 07:10:07 2022] GET /identity/v3/role_assignments?user.id=95f672ad952f4afdad41f0bc6cc39429&scope.project.id=c3c877aea85b47dea9daa6ab598d831f&role.id=91b8526a43a4426a883870ad97362652 => generated 259 bytes in 329 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 07:10:08.286142 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 106/206] 10.222.0.21 () {58 vars in 1282 bytes} [Wed May 4 07:10:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 04 07:10:08.292006 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86dbcfb3-fe4d-4e69-aa0c-b52bd77a58a0 None admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:10:08.412691 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86dbcfb3-fe4d-4e69-aa0c-b52bd77a58a0 None admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:10:08.462367 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b8f024-3cde-4e4e-9043-773c771ea839 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:10:08.463274 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b8f024-3cde-4e4e-9043-773c771ea839 None admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:10:08.463550 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b8f024-3cde-4e4e-9043-773c771ea839 None admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:10:08.463818 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b8f024-3cde-4e4e-9043-773c771ea839 None admin] PATH_INFO: `/v3/projects/c1c61577200842b7bf6af16defd5fcbc` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:10:08.465067 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b8f024-3cde-4e4e-9043-773c771ea839 None admin] RBAC: Authorizing `identity:get_project(project_id=c1c61577200842b7bf6af16defd5fcbc)` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:10:08.466612 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b8f024-3cde-4e4e-9043-773c771ea839 None admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:10:08.468841 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 101/207] 10.222.0.21 () {56 vars in 1186 bytes} [Wed May 4 07:10:08 2022] GET /identity/v3/projects/c1c61577200842b7bf6af16defd5fcbc => generated 298 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 07:10:08.474859 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209937ff-4f88-4374-8373-8e982070d2a5 None admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:10:08.596030 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209937ff-4f88-4374-8373-8e982070d2a5 None admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:10:08.631380 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13b8b55-921b-449b-909c-41078c720d3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:10:08.632293 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13b8b55-921b-449b-909c-41078c720d3d None admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:10:08.635190 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13b8b55-921b-449b-909c-41078c720d3d None admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:10:08.635190 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13b8b55-921b-449b-909c-41078c720d3d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:10:08.635190 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13b8b55-921b-449b-909c-41078c720d3d None admin] RBAC: Adding query filter params (role.id=8dc3044bbffe459fb7166d4456243785, scope.project.id=c1c61577200842b7bf6af16defd5fcbc, user.id=d58e92b4d33041cab878a5ed1fc4c245) {{(pid=79744) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 07:10:08.635190 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13b8b55-921b-449b-909c-41078c720d3d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:10:08.635461 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13b8b55-921b-449b-909c-41078c720d3d None admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:10:08.641823 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 107/208] 10.222.0.21 () {56 vars in 1374 bytes} [Wed May 4 07:10:08 2022] GET /identity/v3/role_assignments?user.id=d58e92b4d33041cab878a5ed1fc4c245&scope.project.id=c1c61577200842b7bf6af16defd5fcbc&role.id=8dc3044bbffe459fb7166d4456243785 => generated 608 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 07:10:10.055610 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb6d56d-a4f8-415d-a05d-47ff6b40592b None None] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:10:10.056126 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb6d56d-a4f8-415d-a05d-47ff6b40592b None None] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:10:10.056126 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb6d56d-a4f8-415d-a05d-47ff6b40592b None None] PATH_INFO: `/` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:10:10.057788 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 102/209] 10.222.0.21 () {54 vars in 926 bytes} [Wed May 4 07:10:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 07:10:10.063280 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae41640-138c-488c-a6f0-d460f5626386 None None] REQUEST_METHOD: `POST` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:10:10.064094 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae41640-138c-488c-a6f0-d460f5626386 None None] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:10:10.064560 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae41640-138c-488c-a6f0-d460f5626386 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:10:10.081773 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.auth.core [None req-8ae41640-138c-488c-a6f0-d460f5626386 None None] MFA Rules not processed for user `83c5e0dcb991496ea6dee38384514508`. Rule list: `[]` (Enabled: `True`). {{(pid=79744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:10:10.083463 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.fernet_utils [None req-8ae41640-138c-488c-a6f0-d460f5626386 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:10:10.092961 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f66133-4588-4918-a671-ee3ed12d35fe None None] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:10:10.093583 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f66133-4588-4918-a671-ee3ed12d35fe None None] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:10:10.094053 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f66133-4588-4918-a671-ee3ed12d35fe None None] PATH_INFO: `/` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:10:10.095787 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 103/210] 10.222.0.21 () {54 vars in 926 bytes} [Wed May 4 07:10:10 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 04 07:10:10.104108 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1a1114-1e59-455b-8247-02998554e059 None None] REQUEST_METHOD: `POST` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:10:10.104732 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1a1114-1e59-455b-8247-02998554e059 None None] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:10:10.105214 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1a1114-1e59-455b-8247-02998554e059 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:10:10.124561 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.auth.core [None req-fd1a1114-1e59-455b-8247-02998554e059 None None] MFA Rules not processed for user `83c5e0dcb991496ea6dee38384514508`. Rule list: `[]` (Enabled: `True`). {{(pid=79745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:10:10.126079 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.fernet_utils [None req-fd1a1114-1e59-455b-8247-02998554e059 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:10:10.158611 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 108/211] 10.222.0.21 () {58 vars in 1023 bytes} [Wed May 4 07:10:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 07:10:10.181154 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae41640-138c-488c-a6f0-d460f5626386 None None] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:10:10.198940 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 104/212] 10.222.0.21 () {58 vars in 1023 bytes} [Wed May 4 07:10:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 07:10:10.225034 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1a1114-1e59-455b-8247-02998554e059 None None] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:10:10.279924 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae41640-138c-488c-a6f0-d460f5626386 None None] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:10:10.314692 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4048280c-0306-4767-af5a-9558aa35dc9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:10:10.315429 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4048280c-0306-4767-af5a-9558aa35dc9b None admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:10:10.315710 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4048280c-0306-4767-af5a-9558aa35dc9b None admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:10:10.315980 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4048280c-0306-4767-af5a-9558aa35dc9b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:10:10.326767 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4048280c-0306-4767-af5a-9558aa35dc9b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 07:10:10.330549 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1a1114-1e59-455b-8247-02998554e059 None None] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:10:10.334414 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application [None req-4048280c-0306-4767-af5a-9558aa35dc9b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 04 07:10:10.334414 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 07:10:10.334414 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 07:10:10.334414 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 07:10:10.334414 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 07:10:10.334414 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 07:10:10.334414 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 07:10:10.334414 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 07:10:10.334414 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 07:10:10.334414 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 07:10:10.334414 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 07:10:10.334414 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 07:10:10.334414 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 07:10:10.334414 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 07:10:10.334414 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 07:10:10.334414 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 07:10:10.335551 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 07:10:10.335551 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 07:10:10.335551 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 07:10:10.335551 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 07:10:10.335551 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 07:10:10.335551 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 07:10:10.335551 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 07:10:10.335551 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 07:10:10.335551 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 07:10:10.335551 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.get_or_create( May 04 07:10:10.335551 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 07:10:10.335551 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application with Lock( May 04 07:10:10.335551 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 07:10:10.335551 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self._enter() May 04 07:10:10.335551 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 07:10:10.335551 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 07:10:10.341361 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 07:10:10.341361 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.creator() May 04 07:10:10.341361 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 07:10:10.341361 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application created_value = creator( May 04 07:10:10.341361 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 07:10:10.341361 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 07:10:10.341361 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 07:10:10.341361 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 07:10:10.341361 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 07:10:10.341361 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 07:10:10.341361 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 04 07:10:10.341361 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application May 04 07:10:10.341361 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 109/213] 10.222.0.21 () {56 vars in 1096 bytes} [Wed May 4 07:10:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 07:10:10.341361 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13a3ab1-d238-4dea-809e-1efce77dfe3b None None] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:10:10.342063 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13a3ab1-d238-4dea-809e-1efce77dfe3b None None] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:10:10.342063 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13a3ab1-d238-4dea-809e-1efce77dfe3b None None] PATH_INFO: `/` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:10:10.342063 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 110/214] 10.222.0.21 () {54 vars in 926 bytes} [Wed May 4 07:10:10 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 07:10:10.344154 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13a3ab1-d238-4dea-809e-1efce77dfe3b None None] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:10:10.369346 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f834bd8e-95e4-4fd3-b111-d978b888b95c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:10:10.370139 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f834bd8e-95e4-4fd3-b111-d978b888b95c None admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:10:10.370416 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f834bd8e-95e4-4fd3-b111-d978b888b95c None admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:10:10.370688 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f834bd8e-95e4-4fd3-b111-d978b888b95c None admin] PATH_INFO: `/v3/domains/default` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:10:10.371885 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f834bd8e-95e4-4fd3-b111-d978b888b95c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:10:10.374543 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f834bd8e-95e4-4fd3-b111-d978b888b95c None admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:10:10.376408 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 105/215] 10.222.0.21 () {56 vars in 1108 bytes} [Wed May 4 07:10:10 2022] GET /identity/v3/domains/default => generated 199 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 07:10:10.382067 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee730e5-42d6-4fe5-9371-f1af8da0fcc5 None None] REQUEST_METHOD: `POST` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:10:10.382351 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee730e5-42d6-4fe5-9371-f1af8da0fcc5 None None] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:10:10.382627 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee730e5-42d6-4fe5-9371-f1af8da0fcc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:10:10.401508 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.auth.core [None req-bee730e5-42d6-4fe5-9371-f1af8da0fcc5 None None] MFA Rules not processed for user `83c5e0dcb991496ea6dee38384514508`. Rule list: `[]` (Enabled: `True`). {{(pid=79745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:10:10.402985 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.fernet_utils [None req-bee730e5-42d6-4fe5-9371-f1af8da0fcc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:10:10.448586 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13a3ab1-d238-4dea-809e-1efce77dfe3b None None] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:10:10.487584 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 106/216] 10.222.0.21 () {58 vars in 1023 bytes} [Wed May 4 07:10:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 07:10:10.488278 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f63e9e2-1f0c-404a-8dbb-46a69f3c4901 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:10:10.488402 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee730e5-42d6-4fe5-9371-f1af8da0fcc5 None None] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:10:10.489398 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f63e9e2-1f0c-404a-8dbb-46a69f3c4901 None admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:10:10.489735 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f63e9e2-1f0c-404a-8dbb-46a69f3c4901 None admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:10:10.490072 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f63e9e2-1f0c-404a-8dbb-46a69f3c4901 None admin] PATH_INFO: `/v3/roles` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:10:10.490886 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f63e9e2-1f0c-404a-8dbb-46a69f3c4901 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79744) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 07:10:10.491294 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f63e9e2-1f0c-404a-8dbb-46a69f3c4901 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:10:10.492741 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f63e9e2-1f0c-404a-8dbb-46a69f3c4901 None admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:10:10.507211 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 111/217] 10.222.0.21 () {56 vars in 1099 bytes} [Wed May 4 07:10:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 07:10:10.510512 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f63e9e2-1f0c-404a-8dbb-46a69f3c4901 None admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:10:10.605530 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee730e5-42d6-4fe5-9371-f1af8da0fcc5 None None] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:10:10.617996 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f63e9e2-1f0c-404a-8dbb-46a69f3c4901 None admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:10:10.638608 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb84895-9bef-4991-81aa-73cb9de653e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:10:10.639348 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb84895-9bef-4991-81aa-73cb9de653e3 None admin] REQUEST_METHOD: `POST` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:10:10.639562 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb84895-9bef-4991-81aa-73cb9de653e3 None admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:10:10.639828 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb84895-9bef-4991-81aa-73cb9de653e3 None admin] PATH_INFO: `/v3/users` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:10:10.640533 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb84895-9bef-4991-81aa-73cb9de653e3 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:10:10.642038 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb84895-9bef-4991-81aa-73cb9de653e3 None admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:10:10.653974 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e85fa9-f2a8-4969-897a-d667d56651fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:10:10.655203 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e85fa9-f2a8-4969-897a-d667d56651fa None admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:10:10.655586 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e85fa9-f2a8-4969-897a-d667d56651fa None admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:10:10.655861 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e85fa9-f2a8-4969-897a-d667d56651fa None admin] PATH_INFO: `/v3/users/95f672ad952f4afdad41f0bc6cc39429` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:10:10.657204 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e85fa9-f2a8-4969-897a-d667d56651fa None admin] RBAC: Authorizing `identity:get_user(user_id=95f672ad952f4afdad41f0bc6cc39429)` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:10:10.658745 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e85fa9-f2a8-4969-897a-d667d56651fa None admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:10:10.660613 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 112/218] 10.222.0.21 () {56 vars in 1177 bytes} [Wed May 4 07:10:10 2022] GET /identity/v3/users/95f672ad952f4afdad41f0bc6cc39429 => generated 283 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 07:10:10.671390 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 107/219] 10.222.0.21 () {60 vars in 1132 bytes} [Wed May 4 07:10:10 2022] POST /identity/v3/users => generated 297 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 07:10:10.671599 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e85fa9-f2a8-4969-897a-d667d56651fa None admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:10:10.671694 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb84895-9bef-4991-81aa-73cb9de653e3 None admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:10:10.786183 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb84895-9bef-4991-81aa-73cb9de653e3 None admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:10:10.792649 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e85fa9-f2a8-4969-897a-d667d56651fa None admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:10:10.820474 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b5b196-0f9c-45df-8705-0498bd22680e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:10:10.821348 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b5b196-0f9c-45df-8705-0498bd22680e None admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:10:10.821625 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b5b196-0f9c-45df-8705-0498bd22680e None admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:10:10.821892 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b5b196-0f9c-45df-8705-0498bd22680e None admin] PATH_INFO: `/v3/projects/c3c877aea85b47dea9daa6ab598d831f` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:10:10.823124 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b5b196-0f9c-45df-8705-0498bd22680e None admin] RBAC: Authorizing `identity:get_project(project_id=c3c877aea85b47dea9daa6ab598d831f)` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:10:10.824605 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b5b196-0f9c-45df-8705-0498bd22680e None admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:10:10.827194 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 108/220] 10.222.0.21 () {56 vars in 1186 bytes} [Wed May 4 07:10:10 2022] GET /identity/v3/projects/c3c877aea85b47dea9daa6ab598d831f => generated 302 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 07:10:10.828280 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76bf9fa2-f8b0-4e8d-86f7-b623dc971014 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:10:10.829084 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bf9fa2-f8b0-4e8d-86f7-b623dc971014 None admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:10:10.829360 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bf9fa2-f8b0-4e8d-86f7-b623dc971014 None admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:10:10.829669 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bf9fa2-f8b0-4e8d-86f7-b623dc971014 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:10:10.833638 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a10f057-e104-49ef-9720-f67d8b436ad3 None None] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:10:10.833918 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a10f057-e104-49ef-9720-f67d8b436ad3 None None] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:10:10.834195 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a10f057-e104-49ef-9720-f67d8b436ad3 None None] PATH_INFO: `/` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:10:10.835740 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 109/221] 10.222.0.21 () {54 vars in 926 bytes} [Wed May 4 07:10:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 07:10:10.836272 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a10f057-e104-49ef-9720-f67d8b436ad3 None None] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:10:10.844877 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76bf9fa2-f8b0-4e8d-86f7-b623dc971014 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 07:10:10.853030 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application [None req-76bf9fa2-f8b0-4e8d-86f7-b623dc971014 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 04 07:10:10.853030 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 07:10:10.853030 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 07:10:10.853030 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 07:10:10.853030 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 07:10:10.853030 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 07:10:10.853030 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 07:10:10.853030 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 07:10:10.853030 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 07:10:10.853030 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 07:10:10.853030 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 07:10:10.853030 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 07:10:10.853030 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 07:10:10.853030 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 07:10:10.853030 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 07:10:10.853030 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 07:10:10.853957 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 07:10:10.853957 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 07:10:10.853957 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 07:10:10.853957 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 07:10:10.853957 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 07:10:10.853957 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 07:10:10.853957 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 07:10:10.853957 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 07:10:10.853957 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 07:10:10.853957 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.get_or_create( May 04 07:10:10.853957 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 07:10:10.853957 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application with Lock( May 04 07:10:10.853957 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 07:10:10.853957 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self._enter() May 04 07:10:10.853957 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 07:10:10.853957 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 07:10:10.855335 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 07:10:10.855335 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.creator() May 04 07:10:10.855335 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 07:10:10.855335 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application created_value = creator( May 04 07:10:10.855335 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 07:10:10.855335 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 07:10:10.855335 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 07:10:10.855335 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 07:10:10.855335 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 07:10:10.855335 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 07:10:10.855335 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 04 07:10:10.855335 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application May 04 07:10:10.855335 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 113/222] 10.222.0.21 () {56 vars in 1099 bytes} [Wed May 4 07:10:10 2022] GET /identity/v3/roles/member => generated 84 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 07:10:10.856325 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba0a59a-2fa2-4cb3-b99f-60a8ea4c3a85 None None] REQUEST_METHOD: `POST` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:10:10.856325 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba0a59a-2fa2-4cb3-b99f-60a8ea4c3a85 None None] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:10:10.856325 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba0a59a-2fa2-4cb3-b99f-60a8ea4c3a85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:10:10.874164 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.auth.core [None req-1ba0a59a-2fa2-4cb3-b99f-60a8ea4c3a85 None None] MFA Rules not processed for user `83c5e0dcb991496ea6dee38384514508`. Rule list: `[]` (Enabled: `True`). {{(pid=79744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:10:10.876033 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.fernet_utils [None req-1ba0a59a-2fa2-4cb3-b99f-60a8ea4c3a85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:10:10.950134 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 114/223] 10.222.0.21 () {58 vars in 1023 bytes} [Wed May 4 07:10:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 07:10:10.950808 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba0a59a-2fa2-4cb3-b99f-60a8ea4c3a85 None None] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:10:10.953966 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a10f057-e104-49ef-9720-f67d8b436ad3 None None] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:10:11.004684 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c358a0d9-9f08-4207-b032-19378783a6e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:10:11.005574 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c358a0d9-9f08-4207-b032-19378783a6e4 None admin] REQUEST_METHOD: `PUT` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:10:11.005852 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c358a0d9-9f08-4207-b032-19378783a6e4 None admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:10:11.006123 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c358a0d9-9f08-4207-b032-19378783a6e4 None admin] PATH_INFO: `/v3/projects/c3c877aea85b47dea9daa6ab598d831f/users/95f672ad952f4afdad41f0bc6cc39429/roles/eb54c9cea2774a25b1fe8c79724408ee` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:10:11.009241 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c358a0d9-9f08-4207-b032-19378783a6e4 None admin] RBAC: Authorizing `identity:create_grant(project_id=c3c877aea85b47dea9daa6ab598d831f, user_id=95f672ad952f4afdad41f0bc6cc39429, role_id=eb54c9cea2774a25b1fe8c79724408ee)` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:10:11.010820 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c358a0d9-9f08-4207-b032-19378783a6e4 None admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:10:11.027944 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 110/224] 10.222.0.21 () {58 vars in 1439 bytes} [Wed May 4 07:10:10 2022] PUT /identity/v3/projects/c3c877aea85b47dea9daa6ab598d831f/users/95f672ad952f4afdad41f0bc6cc39429/roles/eb54c9cea2774a25b1fe8c79724408ee => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 07:10:11.030227 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c358a0d9-9f08-4207-b032-19378783a6e4 None admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:10:11.088153 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba0a59a-2fa2-4cb3-b99f-60a8ea4c3a85 None None] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:10:11.124613 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889f2eeb-9569-4318-886f-1ce29bac4551 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:10:11.125209 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889f2eeb-9569-4318-886f-1ce29bac4551 None admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:10:11.125495 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889f2eeb-9569-4318-886f-1ce29bac4551 None admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:10:11.125753 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889f2eeb-9569-4318-886f-1ce29bac4551 None admin] PATH_INFO: `/v3/roles` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:10:11.126583 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889f2eeb-9569-4318-886f-1ce29bac4551 None admin] RBAC: Adding query filter params (name=member) {{(pid=79744) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 07:10:11.126901 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889f2eeb-9569-4318-886f-1ce29bac4551 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:10:11.128367 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889f2eeb-9569-4318-886f-1ce29bac4551 None admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:10:11.138071 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 115/225] 10.222.0.21 () {56 vars in 1101 bytes} [Wed May 4 07:10:10 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 07:10:11.144123 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889f2eeb-9569-4318-886f-1ce29bac4551 None admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:10:11.150661 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c358a0d9-9f08-4207-b032-19378783a6e4 None admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:10:11.189040 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7a956c-b2af-407e-be3a-f63974adda5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:10:11.190293 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7a956c-b2af-407e-be3a-f63974adda5f None admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:10:11.190820 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7a956c-b2af-407e-be3a-f63974adda5f None admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:10:11.191375 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7a956c-b2af-407e-be3a-f63974adda5f None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:10:11.217702 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7a956c-b2af-407e-be3a-f63974adda5f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 07:10:11.232987 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application [None req-fa7a956c-b2af-407e-be3a-f63974adda5f None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 04 07:10:11.232987 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 07:10:11.232987 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 07:10:11.232987 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 07:10:11.232987 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 07:10:11.232987 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 07:10:11.232987 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 07:10:11.232987 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 07:10:11.232987 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 07:10:11.232987 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 07:10:11.232987 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 07:10:11.232987 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 07:10:11.232987 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 07:10:11.232987 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 07:10:11.232987 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 07:10:11.232987 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 07:10:11.233991 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 07:10:11.233991 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 07:10:11.233991 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 07:10:11.233991 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 07:10:11.233991 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 07:10:11.233991 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 07:10:11.233991 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 07:10:11.233991 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 07:10:11.233991 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 07:10:11.233991 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self.get_or_create( May 04 07:10:11.233991 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 07:10:11.233991 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application with Lock( May 04 07:10:11.233991 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 07:10:11.233991 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self._enter() May 04 07:10:11.233991 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 07:10:11.233991 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 07:10:11.234809 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 07:10:11.234809 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self.creator() May 04 07:10:11.234809 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 07:10:11.234809 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application created_value = creator( May 04 07:10:11.234809 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 07:10:11.234809 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 07:10:11.234809 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 07:10:11.234809 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 07:10:11.234809 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 07:10:11.234809 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 07:10:11.234809 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 04 07:10:11.234809 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application May 04 07:10:11.237587 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 111/226] 10.222.0.21 () {56 vars in 1114 bytes} [Wed May 4 07:10:11 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 07:10:11.244576 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7a956c-b2af-407e-be3a-f63974adda5f None admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:10:11.306646 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889f2eeb-9569-4318-886f-1ce29bac4551 None admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:10:11.340202 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f233cb-a11a-4a70-a17f-90de727fabe3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:10:11.341082 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f233cb-a11a-4a70-a17f-90de727fabe3 None admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:10:11.341360 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f233cb-a11a-4a70-a17f-90de727fabe3 None admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:10:11.341624 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f233cb-a11a-4a70-a17f-90de727fabe3 None admin] PATH_INFO: `/v3/users/450b1c7d539047c18b7a1406cb7189b6` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:10:11.355238 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f233cb-a11a-4a70-a17f-90de727fabe3 None admin] RBAC: Authorizing `identity:get_user(user_id=450b1c7d539047c18b7a1406cb7189b6)` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:10:11.357348 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f233cb-a11a-4a70-a17f-90de727fabe3 None admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:10:11.359050 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 116/227] 10.222.0.21 () {56 vars in 1177 bytes} [Wed May 4 07:10:11 2022] GET /identity/v3/users/450b1c7d539047c18b7a1406cb7189b6 => generated 297 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 07:10:11.369736 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f233cb-a11a-4a70-a17f-90de727fabe3 None admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:10:11.399472 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7a956c-b2af-407e-be3a-f63974adda5f None admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:10:11.463864 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d82e230-1341-4a2c-b3f5-9004beb66841 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:10:11.464530 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d82e230-1341-4a2c-b3f5-9004beb66841 None admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:10:11.464806 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d82e230-1341-4a2c-b3f5-9004beb66841 None admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:10:11.465076 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d82e230-1341-4a2c-b3f5-9004beb66841 None admin] PATH_INFO: `/v3/roles` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:10:11.466432 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d82e230-1341-4a2c-b3f5-9004beb66841 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 07:10:11.466737 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d82e230-1341-4a2c-b3f5-9004beb66841 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:10:11.468149 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d82e230-1341-4a2c-b3f5-9004beb66841 None admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:10:11.488244 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 112/228] 10.222.0.21 () {56 vars in 1111 bytes} [Wed May 4 07:10:11 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 07:10:11.503021 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d82e230-1341-4a2c-b3f5-9004beb66841 None admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:10:11.522632 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f233cb-a11a-4a70-a17f-90de727fabe3 None admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:10:11.556538 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf76160-cddb-43bc-ad07-2336fe6d8b77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:10:11.557182 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf76160-cddb-43bc-ad07-2336fe6d8b77 None admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:10:11.557455 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf76160-cddb-43bc-ad07-2336fe6d8b77 None admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:10:11.557741 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf76160-cddb-43bc-ad07-2336fe6d8b77 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:10:11.624367 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf76160-cddb-43bc-ad07-2336fe6d8b77 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:10:11.625840 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf76160-cddb-43bc-ad07-2336fe6d8b77 None admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:10:11.689033 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d82e230-1341-4a2c-b3f5-9004beb66841 None admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:10:11.723412 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a35cb3-d859-4dba-8482-01640ca8a05c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:10:11.724624 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a35cb3-d859-4dba-8482-01640ca8a05c None admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:10:11.725151 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a35cb3-d859-4dba-8482-01640ca8a05c None admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:10:11.725621 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a35cb3-d859-4dba-8482-01640ca8a05c None admin] PATH_INFO: `/v3/users/95f672ad952f4afdad41f0bc6cc39429` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:10:11.727000 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a35cb3-d859-4dba-8482-01640ca8a05c None admin] RBAC: Authorizing `identity:get_user(user_id=95f672ad952f4afdad41f0bc6cc39429)` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:10:11.728773 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a35cb3-d859-4dba-8482-01640ca8a05c None admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:10:11.730596 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 113/229] 10.222.0.21 () {56 vars in 1177 bytes} [Wed May 4 07:10:11 2022] GET /identity/v3/users/95f672ad952f4afdad41f0bc6cc39429 => generated 283 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 07:10:11.743322 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a35cb3-d859-4dba-8482-01640ca8a05c None admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:10:11.757909 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 117/230] 10.222.0.21 () {58 vars in 1282 bytes} [Wed May 4 07:10:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 04 07:10:11.768520 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf76160-cddb-43bc-ad07-2336fe6d8b77 None admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:10:11.915300 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf76160-cddb-43bc-ad07-2336fe6d8b77 None admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:10:11.925852 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a35cb3-d859-4dba-8482-01640ca8a05c None admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:10:11.946464 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2a95b9-cd9f-4e32-90f3-18bfdd034946 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:10:11.947640 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2a95b9-cd9f-4e32-90f3-18bfdd034946 None admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:10:11.948016 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2a95b9-cd9f-4e32-90f3-18bfdd034946 None admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:10:11.948380 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2a95b9-cd9f-4e32-90f3-18bfdd034946 None admin] PATH_INFO: `/v3/projects/c3c877aea85b47dea9daa6ab598d831f` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:10:11.949806 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2a95b9-cd9f-4e32-90f3-18bfdd034946 None admin] RBAC: Authorizing `identity:get_project(project_id=c3c877aea85b47dea9daa6ab598d831f)` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:10:11.952298 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2a95b9-cd9f-4e32-90f3-18bfdd034946 None admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:10:11.954249 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 118/231] 10.222.0.21 () {56 vars in 1186 bytes} [Wed May 4 07:10:11 2022] GET /identity/v3/projects/c3c877aea85b47dea9daa6ab598d831f => generated 302 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 07:10:11.959896 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2a95b9-cd9f-4e32-90f3-18bfdd034946 None admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:10:12.004319 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1335ec2-4659-444f-9c58-26cd0196831b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:10:12.005478 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1335ec2-4659-444f-9c58-26cd0196831b None admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:10:12.005968 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1335ec2-4659-444f-9c58-26cd0196831b None admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:10:12.006390 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1335ec2-4659-444f-9c58-26cd0196831b None admin] PATH_INFO: `/v3/projects/c3c877aea85b47dea9daa6ab598d831f` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:10:12.011960 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1335ec2-4659-444f-9c58-26cd0196831b None admin] RBAC: Authorizing `identity:get_project(project_id=c3c877aea85b47dea9daa6ab598d831f)` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:10:12.014656 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1335ec2-4659-444f-9c58-26cd0196831b None admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:10:12.017168 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 114/232] 10.222.0.21 () {56 vars in 1186 bytes} [Wed May 4 07:10:11 2022] GET /identity/v3/projects/c3c877aea85b47dea9daa6ab598d831f => generated 302 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 07:10:12.022766 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1335ec2-4659-444f-9c58-26cd0196831b None admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:10:12.095535 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2a95b9-cd9f-4e32-90f3-18bfdd034946 None admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:10:12.163276 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860967a4-d46f-4133-9a09-3b92fba0b476 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:10:12.164292 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860967a4-d46f-4133-9a09-3b92fba0b476 None admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:10:12.164802 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860967a4-d46f-4133-9a09-3b92fba0b476 None admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:10:12.165269 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860967a4-d46f-4133-9a09-3b92fba0b476 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:10:12.166292 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860967a4-d46f-4133-9a09-3b92fba0b476 None admin] RBAC: Adding query filter params (role.id=9f89c07b05a14f18836116af22cba5f6, scope.project.id=c3c877aea85b47dea9daa6ab598d831f, user.id=450b1c7d539047c18b7a1406cb7189b6) {{(pid=79744) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 07:10:12.166810 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860967a4-d46f-4133-9a09-3b92fba0b476 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:10:12.168525 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860967a4-d46f-4133-9a09-3b92fba0b476 None admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:10:12.175133 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 119/233] 10.222.0.21 () {56 vars in 1374 bytes} [Wed May 4 07:10:11 2022] GET /identity/v3/role_assignments?user.id=450b1c7d539047c18b7a1406cb7189b6&scope.project.id=c3c877aea85b47dea9daa6ab598d831f&role.id=9f89c07b05a14f18836116af22cba5f6 => generated 259 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 07:10:12.200371 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1335ec2-4659-444f-9c58-26cd0196831b None admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:10:12.240227 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3813614b-bcdf-47f2-b9a5-94951d6bc836 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:10:12.241134 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3813614b-bcdf-47f2-b9a5-94951d6bc836 None admin] REQUEST_METHOD: `PUT` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:10:12.241408 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3813614b-bcdf-47f2-b9a5-94951d6bc836 None admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:10:12.241675 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3813614b-bcdf-47f2-b9a5-94951d6bc836 None admin] PATH_INFO: `/v3/projects/c3c877aea85b47dea9daa6ab598d831f/users/95f672ad952f4afdad41f0bc6cc39429/roles/91b8526a43a4426a883870ad97362652` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:10:12.244000 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3813614b-bcdf-47f2-b9a5-94951d6bc836 None admin] RBAC: Authorizing `identity:create_grant(project_id=c3c877aea85b47dea9daa6ab598d831f, user_id=95f672ad952f4afdad41f0bc6cc39429, role_id=91b8526a43a4426a883870ad97362652)` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:10:12.245441 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3813614b-bcdf-47f2-b9a5-94951d6bc836 None admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:10:12.272638 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 115/234] 10.222.0.21 () {58 vars in 1439 bytes} [Wed May 4 07:10:12 2022] PUT /identity/v3/projects/c3c877aea85b47dea9daa6ab598d831f/users/95f672ad952f4afdad41f0bc6cc39429/roles/91b8526a43a4426a883870ad97362652 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 07:10:13.402651 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdd39eb-b62a-4e92-a02a-4bc1220d1c13 None None] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:10:13.403726 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdd39eb-b62a-4e92-a02a-4bc1220d1c13 None None] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:10:13.403831 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdd39eb-b62a-4e92-a02a-4bc1220d1c13 None None] PATH_INFO: `/` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:10:13.405449 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 120/235] 10.222.0.21 () {54 vars in 926 bytes} [Wed May 4 07:10:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 07:10:13.410549 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b04202c-692e-4cfd-89dd-84c478e6381d None None] REQUEST_METHOD: `POST` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:10:13.410986 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b04202c-692e-4cfd-89dd-84c478e6381d None None] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:10:13.411188 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b04202c-692e-4cfd-89dd-84c478e6381d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:10:13.432665 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.auth.core [None req-8b04202c-692e-4cfd-89dd-84c478e6381d None None] MFA Rules not processed for user `83c5e0dcb991496ea6dee38384514508`. Rule list: `[]` (Enabled: `True`). {{(pid=79745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:10:13.433844 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.fernet_utils [None req-8b04202c-692e-4cfd-89dd-84c478e6381d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:10:13.521016 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 116/236] 10.222.0.21 () {58 vars in 1023 bytes} [Wed May 4 07:10:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 07:10:13.572612 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bdd39eb-b62a-4e92-a02a-4bc1220d1c13 None None] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:10:13.663208 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f9b8eb-6c7e-4878-8574-25c28f1c6a68 None None] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:10:13.663500 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f9b8eb-6c7e-4878-8574-25c28f1c6a68 None None] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:10:13.663683 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f9b8eb-6c7e-4878-8574-25c28f1c6a68 None None] PATH_INFO: `/` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:10:13.665053 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 117/237] 10.222.0.21 () {54 vars in 926 bytes} [Wed May 4 07:10:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 04 07:10:13.670900 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e061ad6e-a011-451a-a7ed-e378a037ac08 None None] REQUEST_METHOD: `POST` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:10:13.671206 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e061ad6e-a011-451a-a7ed-e378a037ac08 None None] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:10:13.671484 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e061ad6e-a011-451a-a7ed-e378a037ac08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:10:13.695597 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bdd39eb-b62a-4e92-a02a-4bc1220d1c13 None None] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:10:13.712542 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.auth.core [None req-e061ad6e-a011-451a-a7ed-e378a037ac08 None None] MFA Rules not processed for user `83c5e0dcb991496ea6dee38384514508`. Rule list: `[]` (Enabled: `True`). {{(pid=79745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:10:13.714318 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.fernet_utils [None req-e061ad6e-a011-451a-a7ed-e378a037ac08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:10:13.739335 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ce12c8-d029-41a6-8f35-668b30655313 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:10:13.740137 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ce12c8-d029-41a6-8f35-668b30655313 None admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:10:13.740683 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ce12c8-d029-41a6-8f35-668b30655313 None admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:10:13.740957 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ce12c8-d029-41a6-8f35-668b30655313 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:10:13.753354 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ce12c8-d029-41a6-8f35-668b30655313 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 07:10:13.762203 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application [None req-b5ce12c8-d029-41a6-8f35-668b30655313 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 04 07:10:13.762203 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 07:10:13.762203 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 07:10:13.762203 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 07:10:13.762203 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 07:10:13.762203 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 07:10:13.762203 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 07:10:13.762203 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 07:10:13.762203 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 07:10:13.762203 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 07:10:13.762203 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 07:10:13.762203 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 07:10:13.762203 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 07:10:13.762203 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 07:10:13.762203 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 07:10:13.762203 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 07:10:13.763910 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 07:10:13.763910 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 07:10:13.763910 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 07:10:13.763910 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 07:10:13.763910 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 07:10:13.763910 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 07:10:13.763910 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 07:10:13.763910 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 07:10:13.763910 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 07:10:13.763910 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.get_or_create( May 04 07:10:13.763910 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 07:10:13.763910 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application with Lock( May 04 07:10:13.763910 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 07:10:13.763910 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self._enter() May 04 07:10:13.763910 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 07:10:13.763910 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 07:10:13.765744 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 07:10:13.765744 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.creator() May 04 07:10:13.765744 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 07:10:13.765744 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application created_value = creator( May 04 07:10:13.765744 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 07:10:13.765744 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 07:10:13.765744 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 07:10:13.765744 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 07:10:13.765744 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 07:10:13.765744 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 07:10:13.765744 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 04 07:10:13.765744 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application May 04 07:10:13.765744 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 121/238] 10.222.0.21 () {56 vars in 1099 bytes} [Wed May 4 07:10:13 2022] GET /identity/v3/roles/reader => generated 84 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 07:10:13.765744 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57641e75-0256-4a24-a5b4-9eec51f9f60b None None] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:10:13.767499 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57641e75-0256-4a24-a5b4-9eec51f9f60b None None] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:10:13.767499 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57641e75-0256-4a24-a5b4-9eec51f9f60b None None] PATH_INFO: `/` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:10:13.768884 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 122/239] 10.222.0.21 () {54 vars in 926 bytes} [Wed May 4 07:10:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 07:10:13.773305 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6446c3c1-1fda-4e44-a405-1e90a6ecc710 None None] REQUEST_METHOD: `POST` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:10:13.773592 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6446c3c1-1fda-4e44-a405-1e90a6ecc710 None None] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:10:13.773853 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6446c3c1-1fda-4e44-a405-1e90a6ecc710 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:10:13.791326 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.auth.core [None req-6446c3c1-1fda-4e44-a405-1e90a6ecc710 None None] MFA Rules not processed for user `83c5e0dcb991496ea6dee38384514508`. Rule list: `[]` (Enabled: `True`). {{(pid=79744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:10:13.792539 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.fernet_utils [None req-6446c3c1-1fda-4e44-a405-1e90a6ecc710 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:10:13.793261 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 118/240] 10.222.0.21 () {58 vars in 1023 bytes} [Wed May 4 07:10:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 04 07:10:13.794882 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e061ad6e-a011-451a-a7ed-e378a037ac08 None None] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:10:13.860207 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 123/241] 10.222.0.21 () {58 vars in 1023 bytes} [Wed May 4 07:10:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 07:10:13.861103 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6446c3c1-1fda-4e44-a405-1e90a6ecc710 None None] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:10:13.929891 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e061ad6e-a011-451a-a7ed-e378a037ac08 None None] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:10:13.962968 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7be57b1-120f-4ab6-88cd-07ff844a2992 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:10:13.963659 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7be57b1-120f-4ab6-88cd-07ff844a2992 None admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:10:13.963933 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7be57b1-120f-4ab6-88cd-07ff844a2992 None admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:10:13.964200 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7be57b1-120f-4ab6-88cd-07ff844a2992 None admin] PATH_INFO: `/v3/roles` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:10:13.964935 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7be57b1-120f-4ab6-88cd-07ff844a2992 None admin] RBAC: Adding query filter params (name=reader) {{(pid=79745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 07:10:13.965232 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7be57b1-120f-4ab6-88cd-07ff844a2992 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:10:13.967130 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7be57b1-120f-4ab6-88cd-07ff844a2992 None admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:10:13.970685 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6446c3c1-1fda-4e44-a405-1e90a6ecc710 None None] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:10:13.974999 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 119/242] 10.222.0.21 () {56 vars in 1101 bytes} [Wed May 4 07:10:13 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 07:10:13.975823 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7be57b1-120f-4ab6-88cd-07ff844a2992 None admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:10:14.004912 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a6a621-ee6b-45f1-8667-9f9fcd3127d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:10:14.005705 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a6a621-ee6b-45f1-8667-9f9fcd3127d4 None admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:10:14.005980 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a6a621-ee6b-45f1-8667-9f9fcd3127d4 None admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:10:14.006255 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a6a621-ee6b-45f1-8667-9f9fcd3127d4 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:10:14.007692 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a6a621-ee6b-45f1-8667-9f9fcd3127d4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:10:14.009118 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a6a621-ee6b-45f1-8667-9f9fcd3127d4 None admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:10:14.010714 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 124/243] 10.222.0.21 () {56 vars in 1108 bytes} [Wed May 4 07:10:13 2022] GET /identity/v3/domains/default => generated 199 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 07:10:14.011479 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a6a621-ee6b-45f1-8667-9f9fcd3127d4 None admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:10:14.077666 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7be57b1-120f-4ab6-88cd-07ff844a2992 None admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:10:14.109641 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a6a621-ee6b-45f1-8667-9f9fcd3127d4 None admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:10:14.110995 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4263a39b-5b5c-4dc6-9c77-36ffd28b5cf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:10:14.111809 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4263a39b-5b5c-4dc6-9c77-36ffd28b5cf3 None admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:10:14.112086 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4263a39b-5b5c-4dc6-9c77-36ffd28b5cf3 None admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:10:14.112353 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4263a39b-5b5c-4dc6-9c77-36ffd28b5cf3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:10:14.122669 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4263a39b-5b5c-4dc6-9c77-36ffd28b5cf3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 07:10:14.130205 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application [None req-4263a39b-5b5c-4dc6-9c77-36ffd28b5cf3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 04 07:10:14.130205 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 07:10:14.130205 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 07:10:14.130205 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 07:10:14.130205 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 07:10:14.130205 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 07:10:14.130205 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 07:10:14.130205 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 07:10:14.130205 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 07:10:14.130205 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 07:10:14.130205 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 07:10:14.130205 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 07:10:14.130205 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 07:10:14.130205 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 07:10:14.130205 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 07:10:14.130205 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 07:10:14.132544 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 07:10:14.132544 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 07:10:14.132544 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 07:10:14.132544 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 07:10:14.132544 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 07:10:14.132544 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 07:10:14.132544 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 07:10:14.132544 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 07:10:14.132544 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 07:10:14.132544 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self.get_or_create( May 04 07:10:14.132544 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 07:10:14.132544 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application with Lock( May 04 07:10:14.132544 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 07:10:14.132544 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self._enter() May 04 07:10:14.132544 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 07:10:14.132544 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 07:10:14.134502 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 07:10:14.134502 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self.creator() May 04 07:10:14.134502 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 07:10:14.134502 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application created_value = creator( May 04 07:10:14.134502 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 07:10:14.134502 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 07:10:14.134502 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 07:10:14.134502 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 07:10:14.134502 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 07:10:14.134502 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 07:10:14.134502 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 04 07:10:14.134502 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application May 04 07:10:14.139260 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 120/244] 10.222.0.21 () {56 vars in 1096 bytes} [Wed May 4 07:10:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 07:10:14.139260 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4263a39b-5b5c-4dc6-9c77-36ffd28b5cf3 None admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:10:14.144255 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26d82d6-7232-49ff-8ba6-1b0bf318a0c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:10:14.145299 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26d82d6-7232-49ff-8ba6-1b0bf318a0c8 None admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:10:14.145720 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26d82d6-7232-49ff-8ba6-1b0bf318a0c8 None admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:10:14.146157 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26d82d6-7232-49ff-8ba6-1b0bf318a0c8 None admin] PATH_INFO: `/v3/users/60ee043389194e39bf3d4090b2b56f25` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:10:14.161004 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26d82d6-7232-49ff-8ba6-1b0bf318a0c8 None admin] RBAC: Authorizing `identity:get_user(user_id=60ee043389194e39bf3d4090b2b56f25)` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:10:14.162686 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26d82d6-7232-49ff-8ba6-1b0bf318a0c8 None admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:10:14.164645 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 125/245] 10.222.0.21 () {56 vars in 1177 bytes} [Wed May 4 07:10:14 2022] GET /identity/v3/users/60ee043389194e39bf3d4090b2b56f25 => generated 297 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 07:10:14.165622 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26d82d6-7232-49ff-8ba6-1b0bf318a0c8 None admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:10:14.241231 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4263a39b-5b5c-4dc6-9c77-36ffd28b5cf3 None admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:10:14.267327 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26d82d6-7232-49ff-8ba6-1b0bf318a0c8 None admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:10:14.274869 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820b3682-220a-40c8-9e77-dd6a80b5b492 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:10:14.275548 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820b3682-220a-40c8-9e77-dd6a80b5b492 None admin] REQUEST_METHOD: `POST` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:10:14.275825 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820b3682-220a-40c8-9e77-dd6a80b5b492 None admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:10:14.276095 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820b3682-220a-40c8-9e77-dd6a80b5b492 None admin] PATH_INFO: `/v3/users` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:10:14.276799 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820b3682-220a-40c8-9e77-dd6a80b5b492 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:10:14.278898 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820b3682-220a-40c8-9e77-dd6a80b5b492 None admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:10:14.302946 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 121/246] 10.222.0.21 () {60 vars in 1132 bytes} [Wed May 4 07:10:14 2022] POST /identity/v3/users => generated 293 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 07:10:14.308687 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820b3682-220a-40c8-9e77-dd6a80b5b492 None admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:10:14.316612 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db04a9c3-810c-4a65-8d1c-aa5f1277fdeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:10:14.317612 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db04a9c3-810c-4a65-8d1c-aa5f1277fdeb None admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:10:14.318121 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db04a9c3-810c-4a65-8d1c-aa5f1277fdeb None admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:10:14.318612 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db04a9c3-810c-4a65-8d1c-aa5f1277fdeb None admin] PATH_INFO: `/v3/roles` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:10:14.319630 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db04a9c3-810c-4a65-8d1c-aa5f1277fdeb None admin] RBAC: Adding query filter params (name=admin) {{(pid=79744) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 07:10:14.322474 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db04a9c3-810c-4a65-8d1c-aa5f1277fdeb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:10:14.324266 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db04a9c3-810c-4a65-8d1c-aa5f1277fdeb None admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:10:14.340367 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 126/247] 10.222.0.21 () {56 vars in 1099 bytes} [Wed May 4 07:10:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 07:10:14.347467 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db04a9c3-810c-4a65-8d1c-aa5f1277fdeb None admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:10:14.518271 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820b3682-220a-40c8-9e77-dd6a80b5b492 None admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:10:14.550663 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db04a9c3-810c-4a65-8d1c-aa5f1277fdeb None admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:10:14.583889 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acc6dc1-c864-4634-8129-fd5a787887a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:10:14.585341 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acc6dc1-c864-4634-8129-fd5a787887a4 None admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:10:14.586113 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acc6dc1-c864-4634-8129-fd5a787887a4 None admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:10:14.586584 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acc6dc1-c864-4634-8129-fd5a787887a4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:10:14.594244 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb99f84-bfe1-4ab7-95f5-e906d98f873b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:10:14.595127 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb99f84-bfe1-4ab7-95f5-e906d98f873b None admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:10:14.595431 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb99f84-bfe1-4ab7-95f5-e906d98f873b None admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:10:14.595702 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb99f84-bfe1-4ab7-95f5-e906d98f873b None admin] PATH_INFO: `/v3/users/95f672ad952f4afdad41f0bc6cc39429` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:10:14.596921 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb99f84-bfe1-4ab7-95f5-e906d98f873b None admin] RBAC: Authorizing `identity:get_user(user_id=95f672ad952f4afdad41f0bc6cc39429)` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:10:14.598815 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb99f84-bfe1-4ab7-95f5-e906d98f873b None admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:10:14.600408 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 127/248] 10.222.0.21 () {56 vars in 1177 bytes} [Wed May 4 07:10:14 2022] GET /identity/v3/users/95f672ad952f4afdad41f0bc6cc39429 => generated 283 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 07:10:14.607601 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb99f84-bfe1-4ab7-95f5-e906d98f873b None admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:10:14.670689 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2acc6dc1-c864-4634-8129-fd5a787887a4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:10:14.672543 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2acc6dc1-c864-4634-8129-fd5a787887a4 None admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:10:14.721196 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb99f84-bfe1-4ab7-95f5-e906d98f873b None admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:10:14.755105 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730b2853-93a4-407d-b132-94322dfe24fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:10:14.755672 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730b2853-93a4-407d-b132-94322dfe24fa None admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:10:14.755951 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730b2853-93a4-407d-b132-94322dfe24fa None admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:10:14.756221 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730b2853-93a4-407d-b132-94322dfe24fa None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:10:14.775012 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 122/249] 10.222.0.21 () {58 vars in 1282 bytes} [Wed May 4 07:10:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 472 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 04 07:10:14.783446 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acc6dc1-c864-4634-8129-fd5a787887a4 None admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:10:14.849720 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730b2853-93a4-407d-b132-94322dfe24fa None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:10:14.851795 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730b2853-93a4-407d-b132-94322dfe24fa None admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:10:14.911393 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acc6dc1-c864-4634-8129-fd5a787887a4 None admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:10:14.951816 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12bfca3-ebac-4174-b87d-41fe815967c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:10:14.953024 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12bfca3-ebac-4174-b87d-41fe815967c0 None admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:10:14.953517 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12bfca3-ebac-4174-b87d-41fe815967c0 None admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:10:14.954001 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12bfca3-ebac-4174-b87d-41fe815967c0 None admin] PATH_INFO: `/v3/projects/c3c877aea85b47dea9daa6ab598d831f` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:10:14.955445 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12bfca3-ebac-4174-b87d-41fe815967c0 None admin] RBAC: Authorizing `identity:get_project(project_id=c3c877aea85b47dea9daa6ab598d831f)` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:10:14.957088 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12bfca3-ebac-4174-b87d-41fe815967c0 None admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:10:14.963242 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 123/250] 10.222.0.21 () {56 vars in 1186 bytes} [Wed May 4 07:10:14 2022] GET /identity/v3/projects/c3c877aea85b47dea9daa6ab598d831f => generated 302 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 07:10:14.965306 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12bfca3-ebac-4174-b87d-41fe815967c0 None admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:10:14.976291 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 128/251] 10.222.0.21 () {58 vars in 1282 bytes} [Wed May 4 07:10:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 04 07:10:14.983463 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730b2853-93a4-407d-b132-94322dfe24fa None admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:10:15.107574 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730b2853-93a4-407d-b132-94322dfe24fa None admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:10:15.108242 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12bfca3-ebac-4174-b87d-41fe815967c0 None admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:10:15.151568 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b247633-37e3-4aa2-89ad-1d8b1bf4a5e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:10:15.151809 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082163f4-c012-4088-8f26-762144e50f12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:10:15.152238 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082163f4-c012-4088-8f26-762144e50f12 None admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:10:15.152514 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082163f4-c012-4088-8f26-762144e50f12 None admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:10:15.152790 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082163f4-c012-4088-8f26-762144e50f12 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:10:15.153267 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b247633-37e3-4aa2-89ad-1d8b1bf4a5e9 None admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:10:15.153676 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082163f4-c012-4088-8f26-762144e50f12 None admin] RBAC: Adding query filter params (role.id=8dc3044bbffe459fb7166d4456243785, scope.project.id=c3c877aea85b47dea9daa6ab598d831f, user.id=60ee043389194e39bf3d4090b2b56f25) {{(pid=79745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 07:10:15.153804 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b247633-37e3-4aa2-89ad-1d8b1bf4a5e9 None admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:10:15.154127 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082163f4-c012-4088-8f26-762144e50f12 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:10:15.154386 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b247633-37e3-4aa2-89ad-1d8b1bf4a5e9 None admin] PATH_INFO: `/v3/projects/c3c877aea85b47dea9daa6ab598d831f` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:10:15.155721 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082163f4-c012-4088-8f26-762144e50f12 None admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:10:15.155933 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b247633-37e3-4aa2-89ad-1d8b1bf4a5e9 None admin] RBAC: Authorizing `identity:get_project(project_id=c3c877aea85b47dea9daa6ab598d831f)` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:10:15.157485 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b247633-37e3-4aa2-89ad-1d8b1bf4a5e9 None admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:10:15.159341 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 129/252] 10.222.0.21 () {56 vars in 1186 bytes} [Wed May 4 07:10:14 2022] GET /identity/v3/projects/c3c877aea85b47dea9daa6ab598d831f => generated 302 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 07:10:15.160681 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb6a9bf-7c79-40b5-91db-bfef84abbce3 None None] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:10:15.165723 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb6a9bf-7c79-40b5-91db-bfef84abbce3 None None] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:10:15.165904 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 124/253] 10.222.0.21 () {56 vars in 1374 bytes} [Wed May 4 07:10:14 2022] GET /identity/v3/role_assignments?user.id=60ee043389194e39bf3d4090b2b56f25&scope.project.id=c3c877aea85b47dea9daa6ab598d831f&role.id=8dc3044bbffe459fb7166d4456243785 => generated 259 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 07:10:15.165904 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e061124c-29e3-42b6-a916-e50d6b518e66 None None] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:10:15.165904 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e061124c-29e3-42b6-a916-e50d6b518e66 None None] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:10:15.165904 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e061124c-29e3-42b6-a916-e50d6b518e66 None None] PATH_INFO: `/` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:10:15.165904 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 125/254] 10.222.0.21 () {54 vars in 926 bytes} [Wed May 4 07:10:15 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 07:10:15.166734 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb6a9bf-7c79-40b5-91db-bfef84abbce3 None None] PATH_INFO: `/` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:10:15.169341 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 130/255] 10.222.0.21 () {54 vars in 926 bytes} [Wed May 4 07:10:15 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 07:10:15.170169 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e061124c-29e3-42b6-a916-e50d6b518e66 None None] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:10:15.170914 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9090255-aab9-42c9-9886-ebe81ee41741 None None] REQUEST_METHOD: `POST` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:10:15.171365 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9090255-aab9-42c9-9886-ebe81ee41741 None None] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:10:15.171850 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9090255-aab9-42c9-9886-ebe81ee41741 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:10:15.190091 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.auth.core [None req-a9090255-aab9-42c9-9886-ebe81ee41741 None None] MFA Rules not processed for user `83c5e0dcb991496ea6dee38384514508`. Rule list: `[]` (Enabled: `True`). {{(pid=79744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:10:15.191716 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.fernet_utils [None req-a9090255-aab9-42c9-9886-ebe81ee41741 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:10:15.322419 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 131/256] 10.222.0.21 () {58 vars in 1023 bytes} [Wed May 4 07:10:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 07:10:15.324171 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73283123-e6ba-40c3-8f45-e2691b2eb739 None None] REQUEST_METHOD: `POST` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:10:15.324652 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73283123-e6ba-40c3-8f45-e2691b2eb739 None None] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:10:15.325181 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73283123-e6ba-40c3-8f45-e2691b2eb739 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:10:15.348535 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e061124c-29e3-42b6-a916-e50d6b518e66 None None] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:10:15.368412 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.auth.core [None req-73283123-e6ba-40c3-8f45-e2691b2eb739 None None] MFA Rules not processed for user `83c5e0dcb991496ea6dee38384514508`. Rule list: `[]` (Enabled: `True`). {{(pid=79744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:10:15.369533 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.fernet_utils [None req-73283123-e6ba-40c3-8f45-e2691b2eb739 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:10:15.397849 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05963314-e8cd-47df-ae65-280d9946a2ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:10:15.398834 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05963314-e8cd-47df-ae65-280d9946a2ed None admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:10:15.399208 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05963314-e8cd-47df-ae65-280d9946a2ed None admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:10:15.399552 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05963314-e8cd-47df-ae65-280d9946a2ed None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:10:15.400465 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05963314-e8cd-47df-ae65-280d9946a2ed None admin] RBAC: Adding query filter params (role.id=eb54c9cea2774a25b1fe8c79724408ee, scope.project.id=c3c877aea85b47dea9daa6ab598d831f, user.id=95f672ad952f4afdad41f0bc6cc39429) {{(pid=79745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 07:10:15.400847 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05963314-e8cd-47df-ae65-280d9946a2ed None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:10:15.402476 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05963314-e8cd-47df-ae65-280d9946a2ed None admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:10:15.418310 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 126/257] 10.222.0.21 () {56 vars in 1374 bytes} [Wed May 4 07:10:15 2022] GET /identity/v3/role_assignments?user.id=95f672ad952f4afdad41f0bc6cc39429&scope.project.id=c3c877aea85b47dea9daa6ab598d831f&role.id=eb54c9cea2774a25b1fe8c79724408ee => generated 608 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 07:10:15.420469 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05963314-e8cd-47df-ae65-280d9946a2ed None admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:10:15.480185 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 132/258] 10.222.0.21 () {58 vars in 1023 bytes} [Wed May 4 07:10:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 07:10:15.524878 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73283123-e6ba-40c3-8f45-e2691b2eb739 None None] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:10:15.630113 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05963314-e8cd-47df-ae65-280d9946a2ed None admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:10:15.700736 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84215ec2-95bd-4844-b057-08c69695b145 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:10:15.701646 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84215ec2-95bd-4844-b057-08c69695b145 None admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:10:15.701923 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84215ec2-95bd-4844-b057-08c69695b145 None admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:10:15.702191 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84215ec2-95bd-4844-b057-08c69695b145 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:10:15.715572 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84215ec2-95bd-4844-b057-08c69695b145 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 07:10:15.729916 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73283123-e6ba-40c3-8f45-e2691b2eb739 None None] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:10:15.735110 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application [None req-84215ec2-95bd-4844-b057-08c69695b145 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 04 07:10:15.735110 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 07:10:15.735110 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 07:10:15.735110 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 07:10:15.735110 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 07:10:15.735110 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 07:10:15.735110 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 07:10:15.735110 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 07:10:15.735110 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 07:10:15.735110 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 07:10:15.735110 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 07:10:15.735110 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 07:10:15.735110 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 07:10:15.735110 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 07:10:15.735110 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 07:10:15.735110 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 07:10:15.736045 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 07:10:15.736045 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 07:10:15.736045 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 07:10:15.736045 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 07:10:15.736045 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 07:10:15.736045 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 07:10:15.736045 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 07:10:15.736045 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 07:10:15.736045 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 07:10:15.736045 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self.get_or_create( May 04 07:10:15.736045 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 07:10:15.736045 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application with Lock( May 04 07:10:15.736045 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 07:10:15.736045 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self._enter() May 04 07:10:15.736045 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 07:10:15.736045 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 07:10:15.736841 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 07:10:15.736841 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self.creator() May 04 07:10:15.736841 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 07:10:15.736841 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application created_value = creator( May 04 07:10:15.736841 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 07:10:15.736841 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 07:10:15.736841 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 07:10:15.736841 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 07:10:15.736841 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 07:10:15.736841 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 07:10:15.736841 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 04 07:10:15.736841 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application May 04 07:10:15.736841 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 127/259] 10.222.0.21 () {56 vars in 1114 bytes} [Wed May 4 07:10:15 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 316 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 07:10:15.743207 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84215ec2-95bd-4844-b057-08c69695b145 None admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:10:15.781884 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb5b781-c639-4df1-8b2a-fe0ff9a61e56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:10:15.782677 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb5b781-c639-4df1-8b2a-fe0ff9a61e56 None admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:10:15.782953 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb5b781-c639-4df1-8b2a-fe0ff9a61e56 None admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:10:15.783244 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb5b781-c639-4df1-8b2a-fe0ff9a61e56 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:10:15.804098 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb5b781-c639-4df1-8b2a-fe0ff9a61e56 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 07:10:15.813719 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application [None req-0fb5b781-c639-4df1-8b2a-fe0ff9a61e56 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 04 07:10:15.813719 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 07:10:15.813719 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 07:10:15.813719 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 07:10:15.813719 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 07:10:15.813719 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 07:10:15.813719 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 07:10:15.813719 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 07:10:15.813719 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 07:10:15.813719 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 07:10:15.813719 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 07:10:15.813719 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 07:10:15.813719 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 07:10:15.813719 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 07:10:15.813719 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 07:10:15.813719 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 07:10:15.814631 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 07:10:15.814631 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 07:10:15.814631 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 07:10:15.814631 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 07:10:15.814631 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 07:10:15.814631 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 07:10:15.814631 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 07:10:15.814631 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 07:10:15.814631 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 07:10:15.814631 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.get_or_create( May 04 07:10:15.814631 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 07:10:15.814631 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application with Lock( May 04 07:10:15.814631 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 07:10:15.814631 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self._enter() May 04 07:10:15.814631 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 07:10:15.814631 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 07:10:15.815878 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 07:10:15.815878 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.creator() May 04 07:10:15.815878 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 07:10:15.815878 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application created_value = creator( May 04 07:10:15.815878 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 07:10:15.815878 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 07:10:15.815878 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 07:10:15.815878 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 07:10:15.815878 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 07:10:15.815878 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 07:10:15.815878 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 04 07:10:15.815878 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application May 04 07:10:15.815878 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 133/260] 10.222.0.21 () {56 vars in 1099 bytes} [Wed May 4 07:10:15 2022] GET /identity/v3/roles/member => generated 84 bytes in 291 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 07:10:15.824141 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb5b781-c639-4df1-8b2a-fe0ff9a61e56 None admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:10:15.940574 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb5b781-c639-4df1-8b2a-fe0ff9a61e56 None admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:10:15.962745 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84215ec2-95bd-4844-b057-08c69695b145 None admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:10:15.977706 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a064c1a0-48ed-4a4f-bb0d-d7110b2be450 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:10:15.978946 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a064c1a0-48ed-4a4f-bb0d-d7110b2be450 None admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:10:15.979450 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a064c1a0-48ed-4a4f-bb0d-d7110b2be450 None admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:10:15.979917 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a064c1a0-48ed-4a4f-bb0d-d7110b2be450 None admin] PATH_INFO: `/v3/roles` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:10:15.980847 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a064c1a0-48ed-4a4f-bb0d-d7110b2be450 None admin] RBAC: Adding query filter params (name=member) {{(pid=79744) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 07:10:15.982020 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a064c1a0-48ed-4a4f-bb0d-d7110b2be450 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:10:15.983709 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a064c1a0-48ed-4a4f-bb0d-d7110b2be450 None admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:10:15.993258 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 134/261] 10.222.0.21 () {56 vars in 1101 bytes} [Wed May 4 07:10:15 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 07:10:16.003496 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a064c1a0-48ed-4a4f-bb0d-d7110b2be450 None admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:10:16.034032 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9de333-42c8-482d-9b64-3635cd4cfe8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:10:16.035091 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9de333-42c8-482d-9b64-3635cd4cfe8a None admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:10:16.035588 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9de333-42c8-482d-9b64-3635cd4cfe8a None admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:10:16.037537 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9de333-42c8-482d-9b64-3635cd4cfe8a None admin] PATH_INFO: `/v3/roles` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:10:16.038660 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9de333-42c8-482d-9b64-3635cd4cfe8a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 07:10:16.039184 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9de333-42c8-482d-9b64-3635cd4cfe8a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:10:16.042364 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9de333-42c8-482d-9b64-3635cd4cfe8a None admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:10:16.063832 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 128/262] 10.222.0.21 () {56 vars in 1111 bytes} [Wed May 4 07:10:15 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 321 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 07:10:16.067980 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9de333-42c8-482d-9b64-3635cd4cfe8a None admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:10:16.169966 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a064c1a0-48ed-4a4f-bb0d-d7110b2be450 None admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:10:16.207461 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21f66b2-48c9-4bf1-b833-3e70e786f384 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:10:16.208759 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21f66b2-48c9-4bf1-b833-3e70e786f384 None admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:10:16.209248 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21f66b2-48c9-4bf1-b833-3e70e786f384 None admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:10:16.209734 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21f66b2-48c9-4bf1-b833-3e70e786f384 None admin] PATH_INFO: `/v3/users/450b1c7d539047c18b7a1406cb7189b6` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:10:16.211540 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21f66b2-48c9-4bf1-b833-3e70e786f384 None admin] RBAC: Authorizing `identity:get_user(user_id=450b1c7d539047c18b7a1406cb7189b6)` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:10:16.213442 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21f66b2-48c9-4bf1-b833-3e70e786f384 None admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:10:16.215421 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 135/263] 10.222.0.21 () {56 vars in 1177 bytes} [Wed May 4 07:10:16 2022] GET /identity/v3/users/450b1c7d539047c18b7a1406cb7189b6 => generated 297 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 07:10:16.223106 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21f66b2-48c9-4bf1-b833-3e70e786f384 None admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:10:16.273611 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9de333-42c8-482d-9b64-3635cd4cfe8a None admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:10:16.316531 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e1e074-f3ae-4ab6-bcf6-a5b5c9f80bfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:10:16.317971 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e1e074-f3ae-4ab6-bcf6-a5b5c9f80bfb None admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:10:16.319483 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e1e074-f3ae-4ab6-bcf6-a5b5c9f80bfb None admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:10:16.321022 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e1e074-f3ae-4ab6-bcf6-a5b5c9f80bfb None admin] PATH_INFO: `/v3/users/95f672ad952f4afdad41f0bc6cc39429` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:10:16.322990 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e1e074-f3ae-4ab6-bcf6-a5b5c9f80bfb None admin] RBAC: Authorizing `identity:get_user(user_id=95f672ad952f4afdad41f0bc6cc39429)` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:10:16.327062 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e1e074-f3ae-4ab6-bcf6-a5b5c9f80bfb None admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:10:16.335194 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 129/264] 10.222.0.21 () {56 vars in 1177 bytes} [Wed May 4 07:10:16 2022] GET /identity/v3/users/95f672ad952f4afdad41f0bc6cc39429 => generated 283 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 07:10:16.340087 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e1e074-f3ae-4ab6-bcf6-a5b5c9f80bfb None admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:10:16.463189 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21f66b2-48c9-4bf1-b833-3e70e786f384 None admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:10:16.504146 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6861e5f-ea17-4d3e-9cdb-26b24d3c9b26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:10:16.505631 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6861e5f-ea17-4d3e-9cdb-26b24d3c9b26 None admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:10:16.506223 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6861e5f-ea17-4d3e-9cdb-26b24d3c9b26 None admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:10:16.507298 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6861e5f-ea17-4d3e-9cdb-26b24d3c9b26 None admin] PATH_INFO: `/v3/projects/c3c877aea85b47dea9daa6ab598d831f` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:10:16.508898 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6861e5f-ea17-4d3e-9cdb-26b24d3c9b26 None admin] RBAC: Authorizing `identity:get_project(project_id=c3c877aea85b47dea9daa6ab598d831f)` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:10:16.509745 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e1e074-f3ae-4ab6-bcf6-a5b5c9f80bfb None admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:10:16.510608 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6861e5f-ea17-4d3e-9cdb-26b24d3c9b26 None admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:10:16.518099 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 136/265] 10.222.0.21 () {56 vars in 1186 bytes} [Wed May 4 07:10:16 2022] GET /identity/v3/projects/c3c877aea85b47dea9daa6ab598d831f => generated 302 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 07:10:16.520795 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6861e5f-ea17-4d3e-9cdb-26b24d3c9b26 None admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:10:16.570577 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c0788d-19d2-4d86-8dd1-56324c89bb28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:10:16.571526 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c0788d-19d2-4d86-8dd1-56324c89bb28 None admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:10:16.571945 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c0788d-19d2-4d86-8dd1-56324c89bb28 None admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:10:16.572379 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c0788d-19d2-4d86-8dd1-56324c89bb28 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:10:16.628774 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6861e5f-ea17-4d3e-9cdb-26b24d3c9b26 None admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:10:16.674393 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826973e8-5d91-422d-88c0-6e6bb596a113 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:10:16.675366 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826973e8-5d91-422d-88c0-6e6bb596a113 None admin] REQUEST_METHOD: `PUT` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:10:16.675642 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826973e8-5d91-422d-88c0-6e6bb596a113 None admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:10:16.675919 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826973e8-5d91-422d-88c0-6e6bb596a113 None admin] PATH_INFO: `/v3/projects/c3c877aea85b47dea9daa6ab598d831f/users/450b1c7d539047c18b7a1406cb7189b6/roles/9f89c07b05a14f18836116af22cba5f6` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:10:16.681144 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826973e8-5d91-422d-88c0-6e6bb596a113 None admin] RBAC: Authorizing `identity:create_grant(project_id=c3c877aea85b47dea9daa6ab598d831f, user_id=450b1c7d539047c18b7a1406cb7189b6, role_id=9f89c07b05a14f18836116af22cba5f6)` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:10:16.682598 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826973e8-5d91-422d-88c0-6e6bb596a113 None admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:10:16.713790 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 137/266] 10.222.0.21 () {58 vars in 1439 bytes} [Wed May 4 07:10:16 2022] PUT /identity/v3/projects/c3c877aea85b47dea9daa6ab598d831f/users/450b1c7d539047c18b7a1406cb7189b6/roles/9f89c07b05a14f18836116af22cba5f6 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 07:10:16.725442 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c0788d-19d2-4d86-8dd1-56324c89bb28 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:10:16.727027 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c0788d-19d2-4d86-8dd1-56324c89bb28 None admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:10:16.838079 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 130/267] 10.222.0.21 () {58 vars in 1282 bytes} [Wed May 4 07:10:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 498 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 04 07:10:16.844194 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826973e8-5d91-422d-88c0-6e6bb596a113 None admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:10:16.976241 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826973e8-5d91-422d-88c0-6e6bb596a113 None admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:10:17.018101 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08780f25-6e30-461d-8ff5-76bb348e1f8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:10:17.018977 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08780f25-6e30-461d-8ff5-76bb348e1f8c None admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:10:17.019397 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08780f25-6e30-461d-8ff5-76bb348e1f8c None admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:10:17.019705 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08780f25-6e30-461d-8ff5-76bb348e1f8c None admin] PATH_INFO: `/v3/projects/c3c877aea85b47dea9daa6ab598d831f` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:10:17.020902 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08780f25-6e30-461d-8ff5-76bb348e1f8c None admin] RBAC: Authorizing `identity:get_project(project_id=c3c877aea85b47dea9daa6ab598d831f)` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:10:17.022392 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08780f25-6e30-461d-8ff5-76bb348e1f8c None admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:10:17.024183 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 138/268] 10.222.0.21 () {56 vars in 1186 bytes} [Wed May 4 07:10:16 2022] GET /identity/v3/projects/c3c877aea85b47dea9daa6ab598d831f => generated 302 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 07:10:17.031507 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c0788d-19d2-4d86-8dd1-56324c89bb28 None admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:10:17.142374 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c0788d-19d2-4d86-8dd1-56324c89bb28 None admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:10:17.183962 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d1ea4e-c92d-4f4e-b98f-e70732bd8bb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:10:17.184751 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d1ea4e-c92d-4f4e-b98f-e70732bd8bb0 None admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:10:17.185031 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d1ea4e-c92d-4f4e-b98f-e70732bd8bb0 None admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:10:17.185303 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d1ea4e-c92d-4f4e-b98f-e70732bd8bb0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:10:17.186143 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d1ea4e-c92d-4f4e-b98f-e70732bd8bb0 None admin] RBAC: Adding query filter params (role.id=91b8526a43a4426a883870ad97362652, scope.project.id=c3c877aea85b47dea9daa6ab598d831f, user.id=95f672ad952f4afdad41f0bc6cc39429) {{(pid=79745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 07:10:17.186452 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d1ea4e-c92d-4f4e-b98f-e70732bd8bb0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:10:17.187998 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d1ea4e-c92d-4f4e-b98f-e70732bd8bb0 None admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:10:17.196443 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 131/269] 10.222.0.21 () {56 vars in 1374 bytes} [Wed May 4 07:10:17 2022] GET /identity/v3/role_assignments?user.id=95f672ad952f4afdad41f0bc6cc39429&scope.project.id=c3c877aea85b47dea9daa6ab598d831f&role.id=91b8526a43a4426a883870ad97362652 => generated 608 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 07:10:17.567136 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159fcadf-e9df-4f70-a2fc-71acf3b902b5 None None] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:10:17.567440 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159fcadf-e9df-4f70-a2fc-71acf3b902b5 None None] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:10:17.568052 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159fcadf-e9df-4f70-a2fc-71acf3b902b5 None None] PATH_INFO: `/` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:10:17.569875 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 139/270] 10.222.0.21 () {54 vars in 926 bytes} [Wed May 4 07:10:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 07:10:17.577158 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635e7704-2318-4df3-a241-e43166d2eb78 None None] REQUEST_METHOD: `POST` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:10:17.577713 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635e7704-2318-4df3-a241-e43166d2eb78 None None] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:10:17.578191 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635e7704-2318-4df3-a241-e43166d2eb78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:10:17.601000 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.auth.core [None req-635e7704-2318-4df3-a241-e43166d2eb78 None None] MFA Rules not processed for user `83c5e0dcb991496ea6dee38384514508`. Rule list: `[]` (Enabled: `True`). {{(pid=79745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:10:17.602536 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.fernet_utils [None req-635e7704-2318-4df3-a241-e43166d2eb78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:10:17.686153 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 132/271] 10.222.0.21 () {58 vars in 1023 bytes} [Wed May 4 07:10:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 07:10:17.696792 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bc3f55-4fab-4b66-b361-67831b88407e None None] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:10:17.697070 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bc3f55-4fab-4b66-b361-67831b88407e None None] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:10:17.697503 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bc3f55-4fab-4b66-b361-67831b88407e None None] PATH_INFO: `/` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:10:17.699328 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 140/272] 10.222.0.21 () {54 vars in 926 bytes} [Wed May 4 07:10:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 07:10:17.704990 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6880e86e-19e2-4eaf-a15a-845a13d3dee8 None None] REQUEST_METHOD: `POST` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:10:17.705442 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6880e86e-19e2-4eaf-a15a-845a13d3dee8 None None] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:10:17.705855 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6880e86e-19e2-4eaf-a15a-845a13d3dee8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:10:17.713529 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bc3f55-4fab-4b66-b361-67831b88407e None None] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:10:17.723806 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.auth.core [None req-6880e86e-19e2-4eaf-a15a-845a13d3dee8 None None] MFA Rules not processed for user `83c5e0dcb991496ea6dee38384514508`. Rule list: `[]` (Enabled: `True`). {{(pid=79745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:10:17.724972 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.fernet_utils [None req-6880e86e-19e2-4eaf-a15a-845a13d3dee8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:10:17.802069 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 133/273] 10.222.0.21 () {58 vars in 1023 bytes} [Wed May 4 07:10:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 07:10:17.827722 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6880e86e-19e2-4eaf-a15a-845a13d3dee8 None None] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:10:17.848842 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bc3f55-4fab-4b66-b361-67831b88407e None None] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:10:17.882752 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47160a64-5d80-4ae6-a6c7-7b296acf39f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:10:17.883587 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47160a64-5d80-4ae6-a6c7-7b296acf39f8 None admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:10:17.883866 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47160a64-5d80-4ae6-a6c7-7b296acf39f8 None admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:10:17.884140 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47160a64-5d80-4ae6-a6c7-7b296acf39f8 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:10:17.894378 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47160a64-5d80-4ae6-a6c7-7b296acf39f8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 07:10:17.902171 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application [None req-47160a64-5d80-4ae6-a6c7-7b296acf39f8 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 04 07:10:17.902171 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 07:10:17.902171 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 07:10:17.902171 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 07:10:17.902171 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 07:10:17.902171 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 07:10:17.902171 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 07:10:17.902171 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 07:10:17.902171 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 07:10:17.902171 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 07:10:17.902171 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 07:10:17.902171 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 07:10:17.902171 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 07:10:17.902171 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 07:10:17.902171 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 07:10:17.902171 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 07:10:17.903627 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 07:10:17.903627 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 07:10:17.903627 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 07:10:17.903627 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 07:10:17.903627 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 07:10:17.903627 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 07:10:17.903627 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 07:10:17.903627 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 07:10:17.903627 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 07:10:17.903627 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.get_or_create( May 04 07:10:17.903627 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 07:10:17.903627 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application with Lock( May 04 07:10:17.903627 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 07:10:17.903627 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self._enter() May 04 07:10:17.903627 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 07:10:17.903627 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 07:10:17.904437 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 07:10:17.904437 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.creator() May 04 07:10:17.904437 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 07:10:17.904437 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application created_value = creator( May 04 07:10:17.904437 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 07:10:17.904437 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 07:10:17.904437 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 07:10:17.904437 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 07:10:17.904437 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 07:10:17.904437 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 07:10:17.904437 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 04 07:10:17.904437 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application May 04 07:10:17.904437 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 141/274] 10.222.0.21 () {56 vars in 1099 bytes} [Wed May 4 07:10:17 2022] GET /identity/v3/roles/member => generated 84 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 07:10:17.909886 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47160a64-5d80-4ae6-a6c7-7b296acf39f8 None admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:10:17.927467 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6880e86e-19e2-4eaf-a15a-845a13d3dee8 None None] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:10:17.962837 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3baefa7d-7d49-4fa1-b2aa-d36e2e6243d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:10:17.963577 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3baefa7d-7d49-4fa1-b2aa-d36e2e6243d9 None admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:10:17.963903 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3baefa7d-7d49-4fa1-b2aa-d36e2e6243d9 None admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:10:17.964185 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3baefa7d-7d49-4fa1-b2aa-d36e2e6243d9 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:10:17.965361 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3baefa7d-7d49-4fa1-b2aa-d36e2e6243d9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:10:17.967903 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3baefa7d-7d49-4fa1-b2aa-d36e2e6243d9 None admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:10:17.969315 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 134/275] 10.222.0.21 () {56 vars in 1108 bytes} [Wed May 4 07:10:17 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 07:10:17.974625 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0ccf46-8499-4a6a-8ec7-bec4d77a0460 None None] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:10:17.974913 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0ccf46-8499-4a6a-8ec7-bec4d77a0460 None None] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:10:17.975393 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0ccf46-8499-4a6a-8ec7-bec4d77a0460 None None] PATH_INFO: `/` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:10:17.979296 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 135/276] 10.222.0.21 () {54 vars in 926 bytes} [Wed May 4 07:10:17 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 07:10:17.979296 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0ccf46-8499-4a6a-8ec7-bec4d77a0460 None None] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:10:18.017538 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47160a64-5d80-4ae6-a6c7-7b296acf39f8 None admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:10:18.055899 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7a9de0-569a-445e-8c83-097e574fa58c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:10:18.056569 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7a9de0-569a-445e-8c83-097e574fa58c None admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:10:18.056848 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7a9de0-569a-445e-8c83-097e574fa58c None admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:10:18.057277 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7a9de0-569a-445e-8c83-097e574fa58c None admin] PATH_INFO: `/v3/roles` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:10:18.058390 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7a9de0-569a-445e-8c83-097e574fa58c None admin] RBAC: Adding query filter params (name=member) {{(pid=79744) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 07:10:18.058841 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7a9de0-569a-445e-8c83-097e574fa58c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:10:18.060598 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7a9de0-569a-445e-8c83-097e574fa58c None admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:10:18.069845 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 142/277] 10.222.0.21 () {56 vars in 1101 bytes} [Wed May 4 07:10:17 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 07:10:18.076228 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0ccf46-8499-4a6a-8ec7-bec4d77a0460 None None] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:10:18.076486 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac2868a-15b4-49cc-80c6-d9c6e002c928 None None] REQUEST_METHOD: `POST` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:10:18.076775 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac2868a-15b4-49cc-80c6-d9c6e002c928 None None] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:10:18.077054 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac2868a-15b4-49cc-80c6-d9c6e002c928 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:10:18.092934 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.auth.core [None req-1ac2868a-15b4-49cc-80c6-d9c6e002c928 None None] MFA Rules not processed for user `83c5e0dcb991496ea6dee38384514508`. Rule list: `[]` (Enabled: `True`). {{(pid=79744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:10:18.094102 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.fernet_utils [None req-1ac2868a-15b4-49cc-80c6-d9c6e002c928 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:10:18.110397 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9f0d2c-9d47-42ab-a416-ac69c909816d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:10:18.111063 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9f0d2c-9d47-42ab-a416-ac69c909816d None admin] REQUEST_METHOD: `POST` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:10:18.111373 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9f0d2c-9d47-42ab-a416-ac69c909816d None admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:10:18.111782 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9f0d2c-9d47-42ab-a416-ac69c909816d None admin] PATH_INFO: `/v3/users` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:10:18.112354 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9f0d2c-9d47-42ab-a416-ac69c909816d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:10:18.113800 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9f0d2c-9d47-42ab-a416-ac69c909816d None admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:10:18.135125 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 136/278] 10.222.0.21 () {60 vars in 1132 bytes} [Wed May 4 07:10:17 2022] POST /identity/v3/users => generated 293 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 07:10:18.136051 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9f0d2c-9d47-42ab-a416-ac69c909816d None admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:10:18.190224 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 143/279] 10.222.0.21 () {58 vars in 1023 bytes} [Wed May 4 07:10:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 07:10:18.222601 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac2868a-15b4-49cc-80c6-d9c6e002c928 None None] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:10:18.252823 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9f0d2c-9d47-42ab-a416-ac69c909816d None admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:10:18.289977 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba50369d-f8ee-4f47-92a0-f6ab4b6bd46f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:10:18.290901 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba50369d-f8ee-4f47-92a0-f6ab4b6bd46f None admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:10:18.291202 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba50369d-f8ee-4f47-92a0-f6ab4b6bd46f None admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:10:18.291479 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba50369d-f8ee-4f47-92a0-f6ab4b6bd46f None admin] PATH_INFO: `/v3/users/921815db9dbb476fbdc480c91e4ce881` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:10:18.307113 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba50369d-f8ee-4f47-92a0-f6ab4b6bd46f None admin] RBAC: Authorizing `identity:get_user(user_id=921815db9dbb476fbdc480c91e4ce881)` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:10:18.308994 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba50369d-f8ee-4f47-92a0-f6ab4b6bd46f None admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:10:18.315633 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 137/280] 10.222.0.21 () {56 vars in 1177 bytes} [Wed May 4 07:10:18 2022] GET /identity/v3/users/921815db9dbb476fbdc480c91e4ce881 => generated 293 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 07:10:18.316804 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba50369d-f8ee-4f47-92a0-f6ab4b6bd46f None admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:10:18.347412 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac2868a-15b4-49cc-80c6-d9c6e002c928 None None] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:10:18.398691 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965a65af-758e-4a19-b1fd-4f36c7fe60ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:10:18.399528 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965a65af-758e-4a19-b1fd-4f36c7fe60ef None admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:10:18.399809 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965a65af-758e-4a19-b1fd-4f36c7fe60ef None admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:10:18.400167 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965a65af-758e-4a19-b1fd-4f36c7fe60ef None admin] PATH_INFO: `/v3/roles/reader` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:10:18.418402 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965a65af-758e-4a19-b1fd-4f36c7fe60ef None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 07:10:18.426396 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application [None req-965a65af-758e-4a19-b1fd-4f36c7fe60ef None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 04 07:10:18.426396 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 07:10:18.426396 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 07:10:18.426396 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 07:10:18.426396 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 07:10:18.426396 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 07:10:18.426396 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 07:10:18.426396 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 07:10:18.426396 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 07:10:18.426396 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 07:10:18.426396 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 07:10:18.426396 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 07:10:18.426396 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 07:10:18.426396 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 07:10:18.426396 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 07:10:18.426396 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 07:10:18.427730 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 07:10:18.427730 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 07:10:18.427730 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 07:10:18.427730 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 07:10:18.427730 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 07:10:18.427730 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 07:10:18.427730 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 07:10:18.427730 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 07:10:18.427730 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 07:10:18.427730 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.get_or_create( May 04 07:10:18.427730 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 07:10:18.427730 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application with Lock( May 04 07:10:18.427730 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 07:10:18.427730 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self._enter() May 04 07:10:18.427730 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 07:10:18.427730 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 07:10:18.428531 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 07:10:18.428531 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.creator() May 04 07:10:18.428531 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 07:10:18.428531 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application created_value = creator( May 04 07:10:18.428531 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 07:10:18.428531 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 07:10:18.428531 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 07:10:18.428531 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 07:10:18.428531 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 07:10:18.428531 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 07:10:18.428531 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 04 07:10:18.428531 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application May 04 07:10:18.428531 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 144/281] 10.222.0.21 () {56 vars in 1099 bytes} [Wed May 4 07:10:18 2022] GET /identity/v3/roles/reader => generated 84 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 07:10:18.436806 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965a65af-758e-4a19-b1fd-4f36c7fe60ef None admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:10:18.451061 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba50369d-f8ee-4f47-92a0-f6ab4b6bd46f None admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:10:18.494269 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e500a6d-da3c-4f45-bb7a-7f88ed9342a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:10:18.494849 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e500a6d-da3c-4f45-bb7a-7f88ed9342a0 None admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:10:18.495126 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e500a6d-da3c-4f45-bb7a-7f88ed9342a0 None admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:10:18.495428 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e500a6d-da3c-4f45-bb7a-7f88ed9342a0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:10:18.496361 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e500a6d-da3c-4f45-bb7a-7f88ed9342a0 None admin] RBAC: Adding query filter params (role.id=9f89c07b05a14f18836116af22cba5f6, user.id=921815db9dbb476fbdc480c91e4ce881, scope.system=all) {{(pid=79745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 07:10:18.496574 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e500a6d-da3c-4f45-bb7a-7f88ed9342a0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:10:18.499214 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e500a6d-da3c-4f45-bb7a-7f88ed9342a0 None admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:10:18.508753 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 138/282] 10.222.0.21 () {56 vars in 1308 bytes} [Wed May 4 07:10:18 2022] GET /identity/v3/role_assignments?user.id=921815db9dbb476fbdc480c91e4ce881&scope.system=all&role.id=9f89c07b05a14f18836116af22cba5f6 => generated 226 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 07:10:18.570712 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965a65af-758e-4a19-b1fd-4f36c7fe60ef None admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:10:18.609953 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5adf5e26-f785-4822-86ee-1f2ddd8ef553 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:10:18.610889 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adf5e26-f785-4822-86ee-1f2ddd8ef553 None admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:10:18.611363 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adf5e26-f785-4822-86ee-1f2ddd8ef553 None admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:10:18.611778 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adf5e26-f785-4822-86ee-1f2ddd8ef553 None admin] PATH_INFO: `/v3/roles` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:10:18.612678 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5adf5e26-f785-4822-86ee-1f2ddd8ef553 None admin] RBAC: Adding query filter params (name=reader) {{(pid=79744) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 07:10:18.613149 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5adf5e26-f785-4822-86ee-1f2ddd8ef553 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:10:18.614691 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5adf5e26-f785-4822-86ee-1f2ddd8ef553 None admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:10:18.624825 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 145/283] 10.222.0.21 () {56 vars in 1101 bytes} [Wed May 4 07:10:18 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 07:10:18.630928 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e500a6d-da3c-4f45-bb7a-7f88ed9342a0 None admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:10:18.741787 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e500a6d-da3c-4f45-bb7a-7f88ed9342a0 None admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:10:18.777572 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a081cdf8-cd79-4aec-bcde-73e9bf9b0e61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:10:18.778822 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a081cdf8-cd79-4aec-bcde-73e9bf9b0e61 None admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:10:18.779358 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a081cdf8-cd79-4aec-bcde-73e9bf9b0e61 None admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:10:18.779826 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a081cdf8-cd79-4aec-bcde-73e9bf9b0e61 None admin] PATH_INFO: `/v3/users/60ee043389194e39bf3d4090b2b56f25` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:10:18.781246 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a081cdf8-cd79-4aec-bcde-73e9bf9b0e61 None admin] RBAC: Authorizing `identity:get_user(user_id=60ee043389194e39bf3d4090b2b56f25)` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:10:18.782879 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a081cdf8-cd79-4aec-bcde-73e9bf9b0e61 None admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:10:18.785066 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 139/284] 10.222.0.21 () {56 vars in 1177 bytes} [Wed May 4 07:10:18 2022] GET /identity/v3/users/60ee043389194e39bf3d4090b2b56f25 => generated 297 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 07:10:18.790288 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5adf5e26-f785-4822-86ee-1f2ddd8ef553 None admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:10:18.892467 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5adf5e26-f785-4822-86ee-1f2ddd8ef553 None admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:10:18.927262 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96686b1-966b-4c08-a564-1bddd323d243 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:10:18.928464 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96686b1-966b-4c08-a564-1bddd323d243 None admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:10:18.928962 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96686b1-966b-4c08-a564-1bddd323d243 None admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:10:18.929527 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96686b1-966b-4c08-a564-1bddd323d243 None admin] PATH_INFO: `/v3/projects/c3c877aea85b47dea9daa6ab598d831f` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:10:18.930902 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96686b1-966b-4c08-a564-1bddd323d243 None admin] RBAC: Authorizing `identity:get_project(project_id=c3c877aea85b47dea9daa6ab598d831f)` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:10:18.932576 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96686b1-966b-4c08-a564-1bddd323d243 None admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:10:18.934515 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 146/285] 10.222.0.21 () {56 vars in 1186 bytes} [Wed May 4 07:10:18 2022] GET /identity/v3/projects/c3c877aea85b47dea9daa6ab598d831f => generated 302 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 07:10:18.940328 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a081cdf8-cd79-4aec-bcde-73e9bf9b0e61 None admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:10:19.049879 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a081cdf8-cd79-4aec-bcde-73e9bf9b0e61 None admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:10:19.083444 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b5b61c-8770-4a37-a668-562c10f8a6a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:10:19.084680 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b5b61c-8770-4a37-a668-562c10f8a6a0 None admin] REQUEST_METHOD: `PUT` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:10:19.085153 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b5b61c-8770-4a37-a668-562c10f8a6a0 None admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:10:19.085618 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b5b61c-8770-4a37-a668-562c10f8a6a0 None admin] PATH_INFO: `/v3/projects/c3c877aea85b47dea9daa6ab598d831f/users/60ee043389194e39bf3d4090b2b56f25/roles/8dc3044bbffe459fb7166d4456243785` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:10:19.087839 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b5b61c-8770-4a37-a668-562c10f8a6a0 None admin] RBAC: Authorizing `identity:create_grant(project_id=c3c877aea85b47dea9daa6ab598d831f, user_id=60ee043389194e39bf3d4090b2b56f25, role_id=8dc3044bbffe459fb7166d4456243785)` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:10:19.089487 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b5b61c-8770-4a37-a668-562c10f8a6a0 None admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:10:19.113411 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 140/286] 10.222.0.21 () {58 vars in 1439 bytes} [Wed May 4 07:10:18 2022] PUT /identity/v3/projects/c3c877aea85b47dea9daa6ab598d831f/users/60ee043389194e39bf3d4090b2b56f25/roles/8dc3044bbffe459fb7166d4456243785 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 07:10:19.535013 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4d49a4-d353-472f-949a-50694e272f0a None None] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:10:19.535367 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4d49a4-d353-472f-949a-50694e272f0a None None] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:10:19.535591 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4d49a4-d353-472f-949a-50694e272f0a None None] PATH_INFO: `/` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:10:19.537280 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 147/287] 10.222.0.21 () {54 vars in 926 bytes} [Wed May 4 07:10:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 07:10:19.542936 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ba127b-4cdd-4f28-9b99-ca8dfccb2757 None None] REQUEST_METHOD: `POST` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:10:19.543257 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ba127b-4cdd-4f28-9b99-ca8dfccb2757 None None] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:10:19.543512 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ba127b-4cdd-4f28-9b99-ca8dfccb2757 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:10:19.565665 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.auth.core [None req-77ba127b-4cdd-4f28-9b99-ca8dfccb2757 None None] MFA Rules not processed for user `83c5e0dcb991496ea6dee38384514508`. Rule list: `[]` (Enabled: `True`). {{(pid=79745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:10:19.566849 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.fernet_utils [None req-77ba127b-4cdd-4f28-9b99-ca8dfccb2757 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:10:19.647399 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 141/288] 10.222.0.21 () {58 vars in 1023 bytes} [Wed May 4 07:10:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 07:10:19.674918 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4d49a4-d353-472f-949a-50694e272f0a None None] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:10:19.778553 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4d49a4-d353-472f-949a-50694e272f0a None None] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:10:19.823194 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3279e9c-6dce-46e0-8f44-228c593a4ceb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:10:19.824005 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3279e9c-6dce-46e0-8f44-228c593a4ceb None admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:10:19.824284 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3279e9c-6dce-46e0-8f44-228c593a4ceb None admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:10:19.824559 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3279e9c-6dce-46e0-8f44-228c593a4ceb None admin] PATH_INFO: `/v3/roles/member` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:10:19.844045 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3279e9c-6dce-46e0-8f44-228c593a4ceb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 07:10:19.851744 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application [None req-b3279e9c-6dce-46e0-8f44-228c593a4ceb None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 04 07:10:19.851744 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 07:10:19.851744 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 07:10:19.851744 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 07:10:19.851744 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 07:10:19.851744 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 07:10:19.851744 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 07:10:19.851744 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 07:10:19.851744 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 07:10:19.851744 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 07:10:19.851744 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 07:10:19.851744 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 07:10:19.851744 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 07:10:19.851744 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 07:10:19.851744 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 07:10:19.851744 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 07:10:19.852916 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 07:10:19.852916 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 07:10:19.852916 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 07:10:19.852916 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 07:10:19.852916 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 07:10:19.852916 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 07:10:19.852916 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 07:10:19.852916 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 07:10:19.852916 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 07:10:19.852916 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.get_or_create( May 04 07:10:19.852916 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 07:10:19.852916 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application with Lock( May 04 07:10:19.852916 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 07:10:19.852916 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self._enter() May 04 07:10:19.852916 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 07:10:19.852916 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 07:10:19.854885 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 07:10:19.854885 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.creator() May 04 07:10:19.854885 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 07:10:19.854885 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application created_value = creator( May 04 07:10:19.854885 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 07:10:19.854885 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 07:10:19.854885 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 07:10:19.854885 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 07:10:19.854885 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 07:10:19.854885 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 07:10:19.854885 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 04 07:10:19.854885 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application May 04 07:10:19.854885 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 148/289] 10.222.0.21 () {56 vars in 1099 bytes} [Wed May 4 07:10:19 2022] GET /identity/v3/roles/member => generated 84 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 07:10:19.862805 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ba127b-4cdd-4f28-9b99-ca8dfccb2757 None None] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:10:19.966061 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ba127b-4cdd-4f28-9b99-ca8dfccb2757 None None] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:10:20.000564 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187637b7-0c60-40f2-9f27-187414f11636 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:10:20.001231 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187637b7-0c60-40f2-9f27-187414f11636 None admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:10:20.001507 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187637b7-0c60-40f2-9f27-187414f11636 None admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:10:20.001779 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187637b7-0c60-40f2-9f27-187414f11636 None admin] PATH_INFO: `/v3/roles` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:10:20.002525 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187637b7-0c60-40f2-9f27-187414f11636 None admin] RBAC: Adding query filter params (name=member) {{(pid=79745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 07:10:20.002828 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187637b7-0c60-40f2-9f27-187414f11636 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:10:20.004254 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187637b7-0c60-40f2-9f27-187414f11636 None admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:10:20.017452 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 142/290] 10.222.0.21 () {56 vars in 1101 bytes} [Wed May 4 07:10:19 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 07:10:20.023867 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3279e9c-6dce-46e0-8f44-228c593a4ceb None admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:10:20.196759 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3279e9c-6dce-46e0-8f44-228c593a4ceb None admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:10:20.255061 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb4c67c-f733-44e1-ac80-56d4c6c854a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:10:20.255965 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb4c67c-f733-44e1-ac80-56d4c6c854a0 None admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:10:20.256238 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb4c67c-f733-44e1-ac80-56d4c6c854a0 None admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:10:20.256505 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb4c67c-f733-44e1-ac80-56d4c6c854a0 None admin] PATH_INFO: `/v3/users/450b1c7d539047c18b7a1406cb7189b6` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:10:20.264355 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb4c67c-f733-44e1-ac80-56d4c6c854a0 None admin] RBAC: Authorizing `identity:get_user(user_id=450b1c7d539047c18b7a1406cb7189b6)` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:10:20.266878 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb4c67c-f733-44e1-ac80-56d4c6c854a0 None admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:10:20.269860 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 149/291] 10.222.0.21 () {56 vars in 1177 bytes} [Wed May 4 07:10:20 2022] GET /identity/v3/users/450b1c7d539047c18b7a1406cb7189b6 => generated 297 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 07:10:20.275935 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187637b7-0c60-40f2-9f27-187414f11636 None admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:10:20.386250 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187637b7-0c60-40f2-9f27-187414f11636 None admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:10:20.421198 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e25ec4-4bce-40bb-9eee-093cd08aef35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:10:20.421850 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e25ec4-4bce-40bb-9eee-093cd08aef35 None admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:10:20.422126 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e25ec4-4bce-40bb-9eee-093cd08aef35 None admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:10:20.422395 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e25ec4-4bce-40bb-9eee-093cd08aef35 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:10:20.495874 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e25ec4-4bce-40bb-9eee-093cd08aef35 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:10:20.497368 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e25ec4-4bce-40bb-9eee-093cd08aef35 None admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:10:20.601361 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 143/292] 10.222.0.21 () {58 vars in 1282 bytes} [Wed May 4 07:10:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 04 07:10:20.607548 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb4c67c-f733-44e1-ac80-56d4c6c854a0 None admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:10:20.805142 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb4c67c-f733-44e1-ac80-56d4c6c854a0 None admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:10:20.869282 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a20e640-1c96-42de-a98a-3c91fe2cb4cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:10:20.870522 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a20e640-1c96-42de-a98a-3c91fe2cb4cc None admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:10:20.870993 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a20e640-1c96-42de-a98a-3c91fe2cb4cc None admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:10:20.871473 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a20e640-1c96-42de-a98a-3c91fe2cb4cc None admin] PATH_INFO: `/v3/projects/c3c877aea85b47dea9daa6ab598d831f` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:10:20.876107 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a20e640-1c96-42de-a98a-3c91fe2cb4cc None admin] RBAC: Authorizing `identity:get_project(project_id=c3c877aea85b47dea9daa6ab598d831f)` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:10:20.877815 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a20e640-1c96-42de-a98a-3c91fe2cb4cc None admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:10:20.880731 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 150/293] 10.222.0.21 () {56 vars in 1186 bytes} [Wed May 4 07:10:20 2022] GET /identity/v3/projects/c3c877aea85b47dea9daa6ab598d831f => generated 302 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 07:10:20.889452 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e25ec4-4bce-40bb-9eee-093cd08aef35 None admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:10:21.068461 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e25ec4-4bce-40bb-9eee-093cd08aef35 None admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:10:21.121018 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7d9d02-a1e4-4a77-8982-dc62475667f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:10:21.121723 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7d9d02-a1e4-4a77-8982-dc62475667f8 None admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:10:21.122519 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7d9d02-a1e4-4a77-8982-dc62475667f8 None admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:10:21.127176 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7d9d02-a1e4-4a77-8982-dc62475667f8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:10:21.127176 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7d9d02-a1e4-4a77-8982-dc62475667f8 None admin] RBAC: Adding query filter params (role.id=9f89c07b05a14f18836116af22cba5f6, scope.project.id=c3c877aea85b47dea9daa6ab598d831f, user.id=450b1c7d539047c18b7a1406cb7189b6) {{(pid=79745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 07:10:21.127176 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7d9d02-a1e4-4a77-8982-dc62475667f8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:10:21.127176 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7d9d02-a1e4-4a77-8982-dc62475667f8 None admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:10:21.139496 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 144/294] 10.222.0.21 () {56 vars in 1374 bytes} [Wed May 4 07:10:20 2022] GET /identity/v3/role_assignments?user.id=450b1c7d539047c18b7a1406cb7189b6&scope.project.id=c3c877aea85b47dea9daa6ab598d831f&role.id=9f89c07b05a14f18836116af22cba5f6 => generated 608 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 07:10:21.177136 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb15153-a400-49a7-945c-28814cf0996a None None] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:10:21.178114 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb15153-a400-49a7-945c-28814cf0996a None None] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:10:21.178586 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb15153-a400-49a7-945c-28814cf0996a None None] PATH_INFO: `/` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:10:21.180311 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 151/295] 10.222.0.21 () {54 vars in 926 bytes} [Wed May 4 07:10:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 07:10:21.188032 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24df31d-2e28-4575-9900-7ceabaed8968 None None] REQUEST_METHOD: `POST` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:10:21.188340 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24df31d-2e28-4575-9900-7ceabaed8968 None None] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:10:21.188586 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24df31d-2e28-4575-9900-7ceabaed8968 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:10:21.210817 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.auth.core [None req-e24df31d-2e28-4575-9900-7ceabaed8968 None None] MFA Rules not processed for user `83c5e0dcb991496ea6dee38384514508`. Rule list: `[]` (Enabled: `True`). {{(pid=79745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:10:21.212069 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.fernet_utils [None req-e24df31d-2e28-4575-9900-7ceabaed8968 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:10:21.266436 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2c49a0-790e-4c2b-8c6b-e4d473806db5 None None] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:10:21.267052 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2c49a0-790e-4c2b-8c6b-e4d473806db5 None None] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:10:21.267550 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2c49a0-790e-4c2b-8c6b-e4d473806db5 None None] PATH_INFO: `/` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:10:21.269185 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 152/296] 10.222.0.21 () {54 vars in 926 bytes} [Wed May 4 07:10:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 07:10:21.275274 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f842e091-83b7-4708-9be2-68ed6cf6b48f None None] REQUEST_METHOD: `POST` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:10:21.275558 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f842e091-83b7-4708-9be2-68ed6cf6b48f None None] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:10:21.275826 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f842e091-83b7-4708-9be2-68ed6cf6b48f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:10:21.306015 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 145/297] 10.222.0.21 () {58 vars in 1023 bytes} [Wed May 4 07:10:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 07:10:21.320431 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.auth.core [None req-f842e091-83b7-4708-9be2-68ed6cf6b48f None None] MFA Rules not processed for user `83c5e0dcb991496ea6dee38384514508`. Rule list: `[]` (Enabled: `True`). {{(pid=79744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:10:21.321661 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.fernet_utils [None req-f842e091-83b7-4708-9be2-68ed6cf6b48f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:10:21.330117 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24df31d-2e28-4575-9900-7ceabaed8968 None None] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:10:21.445549 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24df31d-2e28-4575-9900-7ceabaed8968 None None] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:10:21.483664 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11738363-d2d0-4354-a78b-9e3ef5eb2e0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:10:21.484460 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11738363-d2d0-4354-a78b-9e3ef5eb2e0c None admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:10:21.484738 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11738363-d2d0-4354-a78b-9e3ef5eb2e0c None admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:10:21.485011 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11738363-d2d0-4354-a78b-9e3ef5eb2e0c None admin] PATH_INFO: `/v3/roles/reader` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:10:21.495519 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11738363-d2d0-4354-a78b-9e3ef5eb2e0c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 07:10:21.503924 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application [None req-11738363-d2d0-4354-a78b-9e3ef5eb2e0c None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 04 07:10:21.503924 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 07:10:21.503924 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 07:10:21.503924 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 07:10:21.503924 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 07:10:21.503924 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 07:10:21.503924 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 07:10:21.503924 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 07:10:21.503924 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 07:10:21.503924 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 07:10:21.503924 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 07:10:21.503924 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 07:10:21.503924 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 07:10:21.503924 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 07:10:21.503924 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 07:10:21.503924 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 07:10:21.504823 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 07:10:21.504823 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 07:10:21.504823 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 07:10:21.504823 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 07:10:21.504823 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 07:10:21.504823 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 07:10:21.504823 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 07:10:21.504823 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 07:10:21.504823 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 07:10:21.504823 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self.get_or_create( May 04 07:10:21.504823 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 07:10:21.504823 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application with Lock( May 04 07:10:21.504823 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 07:10:21.504823 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self._enter() May 04 07:10:21.504823 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 07:10:21.504823 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 07:10:21.505617 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 07:10:21.505617 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self.creator() May 04 07:10:21.505617 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 07:10:21.505617 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application created_value = creator( May 04 07:10:21.505617 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 07:10:21.505617 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 07:10:21.505617 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 07:10:21.505617 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 07:10:21.505617 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 07:10:21.505617 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 07:10:21.505617 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 04 07:10:21.505617 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application May 04 07:10:21.505617 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 146/298] 10.222.0.21 () {56 vars in 1099 bytes} [Wed May 4 07:10:21 2022] GET /identity/v3/roles/reader => generated 84 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 07:10:21.511115 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11738363-d2d0-4354-a78b-9e3ef5eb2e0c None admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:10:21.519074 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 153/299] 10.222.0.21 () {58 vars in 1023 bytes} [Wed May 4 07:10:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 07:10:21.553799 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f842e091-83b7-4708-9be2-68ed6cf6b48f None None] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:10:21.632861 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11738363-d2d0-4354-a78b-9e3ef5eb2e0c None admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:10:21.667265 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681e3458-1494-4780-848b-69349d08baf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:10:21.668151 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681e3458-1494-4780-848b-69349d08baf3 None admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:10:21.668429 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681e3458-1494-4780-848b-69349d08baf3 None admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:10:21.669221 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681e3458-1494-4780-848b-69349d08baf3 None admin] PATH_INFO: `/v3/roles` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:10:21.669959 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681e3458-1494-4780-848b-69349d08baf3 None admin] RBAC: Adding query filter params (name=reader) {{(pid=79745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 07:10:21.670276 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681e3458-1494-4780-848b-69349d08baf3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:10:21.671656 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681e3458-1494-4780-848b-69349d08baf3 None admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:10:21.674204 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f842e091-83b7-4708-9be2-68ed6cf6b48f None None] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:10:21.683187 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 147/300] 10.222.0.21 () {56 vars in 1101 bytes} [Wed May 4 07:10:21 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 07:10:21.683187 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19bb7cb-5bec-4f6b-88c0-ed5dae2f9ac3 None None] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:10:21.683187 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19bb7cb-5bec-4f6b-88c0-ed5dae2f9ac3 None None] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:10:21.683187 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19bb7cb-5bec-4f6b-88c0-ed5dae2f9ac3 None None] PATH_INFO: `/` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:10:21.685906 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 148/301] 10.222.0.21 () {54 vars in 926 bytes} [Wed May 4 07:10:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 07:10:21.686887 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19bb7cb-5bec-4f6b-88c0-ed5dae2f9ac3 None None] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:10:21.711456 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908acd02-7fd0-4be3-a1a1-e20d18e32070 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:10:21.712256 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908acd02-7fd0-4be3-a1a1-e20d18e32070 None admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:10:21.712533 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908acd02-7fd0-4be3-a1a1-e20d18e32070 None admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:10:21.712804 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908acd02-7fd0-4be3-a1a1-e20d18e32070 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:10:21.722968 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908acd02-7fd0-4be3-a1a1-e20d18e32070 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 07:10:21.730644 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application [None req-908acd02-7fd0-4be3-a1a1-e20d18e32070 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 04 07:10:21.730644 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 07:10:21.730644 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 07:10:21.730644 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 07:10:21.730644 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 07:10:21.730644 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 07:10:21.730644 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 07:10:21.730644 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 07:10:21.730644 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 07:10:21.730644 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 07:10:21.730644 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 07:10:21.730644 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 07:10:21.730644 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 07:10:21.730644 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 07:10:21.730644 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 07:10:21.730644 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 07:10:21.732352 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 07:10:21.732352 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 07:10:21.732352 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 07:10:21.732352 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 07:10:21.732352 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 07:10:21.732352 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 07:10:21.732352 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 07:10:21.732352 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 07:10:21.732352 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 07:10:21.732352 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.get_or_create( May 04 07:10:21.732352 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 07:10:21.732352 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application with Lock( May 04 07:10:21.732352 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 07:10:21.732352 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self._enter() May 04 07:10:21.732352 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 07:10:21.732352 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 07:10:21.733177 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 07:10:21.733177 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.creator() May 04 07:10:21.733177 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 07:10:21.733177 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application created_value = creator( May 04 07:10:21.733177 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 07:10:21.733177 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 07:10:21.733177 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 07:10:21.733177 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 07:10:21.733177 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 07:10:21.733177 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 07:10:21.733177 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 04 07:10:21.733177 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application May 04 07:10:21.733177 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 154/302] 10.222.0.21 () {56 vars in 1099 bytes} [Wed May 4 07:10:21 2022] GET /identity/v3/roles/member => generated 84 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 07:10:21.733843 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bc0303-5973-4a08-bf8a-a9822538d545 None None] REQUEST_METHOD: `POST` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:10:21.733945 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bc0303-5973-4a08-bf8a-a9822538d545 None None] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:10:21.734219 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bc0303-5973-4a08-bf8a-a9822538d545 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:10:21.751445 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.auth.core [None req-c1bc0303-5973-4a08-bf8a-a9822538d545 None None] MFA Rules not processed for user `83c5e0dcb991496ea6dee38384514508`. Rule list: `[]` (Enabled: `True`). {{(pid=79744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:10:21.752601 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.fernet_utils [None req-c1bc0303-5973-4a08-bf8a-a9822538d545 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:10:21.796312 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19bb7cb-5bec-4f6b-88c0-ed5dae2f9ac3 None None] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:10:21.816668 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 155/303] 10.222.0.21 () {58 vars in 1023 bytes} [Wed May 4 07:10:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 07:10:21.817789 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1bc0303-5973-4a08-bf8a-a9822538d545 None None] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:10:21.845983 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd098296-54a3-4d76-9c13-1d4bf9e67991 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:10:21.847439 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd098296-54a3-4d76-9c13-1d4bf9e67991 None admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:10:21.847725 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd098296-54a3-4d76-9c13-1d4bf9e67991 None admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:10:21.847999 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd098296-54a3-4d76-9c13-1d4bf9e67991 None admin] PATH_INFO: `/v3/users/39a5d2e1c93446a5a8d8ce1663d08ebb` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:10:21.864723 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd098296-54a3-4d76-9c13-1d4bf9e67991 None admin] RBAC: Authorizing `identity:get_user(user_id=39a5d2e1c93446a5a8d8ce1663d08ebb)` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:10:21.866653 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd098296-54a3-4d76-9c13-1d4bf9e67991 None admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:10:21.873933 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 149/304] 10.222.0.21 () {56 vars in 1177 bytes} [Wed May 4 07:10:21 2022] GET /identity/v3/users/39a5d2e1c93446a5a8d8ce1663d08ebb => generated 293 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 07:10:21.873933 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd098296-54a3-4d76-9c13-1d4bf9e67991 None admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:10:21.914118 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1bc0303-5973-4a08-bf8a-a9822538d545 None None] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:10:21.947035 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3067668c-4d77-4eef-a408-7b6e851617fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:10:21.947737 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3067668c-4d77-4eef-a408-7b6e851617fe None admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:10:21.948009 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3067668c-4d77-4eef-a408-7b6e851617fe None admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:10:21.948277 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3067668c-4d77-4eef-a408-7b6e851617fe None admin] PATH_INFO: `/v3/roles` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:10:21.949015 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3067668c-4d77-4eef-a408-7b6e851617fe None admin] RBAC: Adding query filter params (name=member) {{(pid=79744) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 07:10:21.949312 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3067668c-4d77-4eef-a408-7b6e851617fe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:10:21.950811 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3067668c-4d77-4eef-a408-7b6e851617fe None admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:10:21.963312 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 156/305] 10.222.0.21 () {56 vars in 1101 bytes} [Wed May 4 07:10:21 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 07:10:21.963312 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3067668c-4d77-4eef-a408-7b6e851617fe None admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:10:21.979577 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd098296-54a3-4d76-9c13-1d4bf9e67991 None admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:10:22.022011 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c0e082-d1df-49c3-9b02-6f046a624f71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:10:22.022792 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c0e082-d1df-49c3-9b02-6f046a624f71 None admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:10:22.023067 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c0e082-d1df-49c3-9b02-6f046a624f71 None admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:10:22.023379 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c0e082-d1df-49c3-9b02-6f046a624f71 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:10:22.024535 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c0e082-d1df-49c3-9b02-6f046a624f71 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:10:22.025971 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c0e082-d1df-49c3-9b02-6f046a624f71 None admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:10:22.032439 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 150/306] 10.222.0.21 () {56 vars in 1108 bytes} [Wed May 4 07:10:21 2022] GET /identity/v3/domains/default => generated 199 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 07:10:22.032439 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c0e082-d1df-49c3-9b02-6f046a624f71 None admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:10:22.064379 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3067668c-4d77-4eef-a408-7b6e851617fe None admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:10:22.096534 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a52fce-a771-4756-9414-b9dc07c86d6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:10:22.097188 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a52fce-a771-4756-9414-b9dc07c86d6b None admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:10:22.097466 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a52fce-a771-4756-9414-b9dc07c86d6b None admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:10:22.097742 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a52fce-a771-4756-9414-b9dc07c86d6b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:10:22.098569 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a52fce-a771-4756-9414-b9dc07c86d6b None admin] RBAC: Adding query filter params (role.id=8dc3044bbffe459fb7166d4456243785, user.id=39a5d2e1c93446a5a8d8ce1663d08ebb, scope.system=all) {{(pid=79744) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 07:10:22.098874 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a52fce-a771-4756-9414-b9dc07c86d6b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:10:22.100323 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a52fce-a771-4756-9414-b9dc07c86d6b None admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:10:22.115554 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 157/307] 10.222.0.21 () {56 vars in 1308 bytes} [Wed May 4 07:10:21 2022] GET /identity/v3/role_assignments?user.id=39a5d2e1c93446a5a8d8ce1663d08ebb&scope.system=all&role.id=8dc3044bbffe459fb7166d4456243785 => generated 226 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 07:10:22.115554 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a52fce-a771-4756-9414-b9dc07c86d6b None admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:10:22.141610 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c0e082-d1df-49c3-9b02-6f046a624f71 None admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:10:22.186820 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ef65fd-8ee2-4d9c-a6cc-e02038b5ab42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:10:22.187848 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ef65fd-8ee2-4d9c-a6cc-e02038b5ab42 None admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:10:22.188192 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ef65fd-8ee2-4d9c-a6cc-e02038b5ab42 None admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:10:22.188530 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ef65fd-8ee2-4d9c-a6cc-e02038b5ab42 None admin] PATH_INFO: `/v3/users/921815db9dbb476fbdc480c91e4ce881` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:10:22.189817 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ef65fd-8ee2-4d9c-a6cc-e02038b5ab42 None admin] RBAC: Authorizing `identity:get_user(user_id=921815db9dbb476fbdc480c91e4ce881)` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:10:22.191456 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ef65fd-8ee2-4d9c-a6cc-e02038b5ab42 None admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:10:22.193202 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 151/308] 10.222.0.21 () {56 vars in 1177 bytes} [Wed May 4 07:10:22 2022] GET /identity/v3/users/921815db9dbb476fbdc480c91e4ce881 => generated 293 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 07:10:22.199120 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ef65fd-8ee2-4d9c-a6cc-e02038b5ab42 None admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:10:22.244947 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a52fce-a771-4756-9414-b9dc07c86d6b None admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:10:22.284721 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b328b4-1287-40b0-b5e6-68a1bfeb0686 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:10:22.285409 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b328b4-1287-40b0-b5e6-68a1bfeb0686 None admin] REQUEST_METHOD: `POST` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:10:22.285686 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b328b4-1287-40b0-b5e6-68a1bfeb0686 None admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:10:22.285957 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b328b4-1287-40b0-b5e6-68a1bfeb0686 None admin] PATH_INFO: `/v3/groups` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:10:22.286660 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b328b4-1287-40b0-b5e6-68a1bfeb0686 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:10:22.288188 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b328b4-1287-40b0-b5e6-68a1bfeb0686 None admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:10:22.312491 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 158/309] 10.222.0.21 () {60 vars in 1134 bytes} [Wed May 4 07:10:22 2022] POST /identity/v3/groups => generated 229 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 07:10:22.316045 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ef65fd-8ee2-4d9c-a6cc-e02038b5ab42 None admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:10:22.366690 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c434b4-1723-400c-8b78-ea2bf2913fd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:10:22.367600 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c434b4-1723-400c-8b78-ea2bf2913fd6 None admin] REQUEST_METHOD: `PUT` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:10:22.367876 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c434b4-1723-400c-8b78-ea2bf2913fd6 None admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:10:22.368145 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c434b4-1723-400c-8b78-ea2bf2913fd6 None admin] PATH_INFO: `/v3/system/users/921815db9dbb476fbdc480c91e4ce881/roles/9f89c07b05a14f18836116af22cba5f6` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:10:22.369764 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c434b4-1723-400c-8b78-ea2bf2913fd6 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=921815db9dbb476fbdc480c91e4ce881, role_id=9f89c07b05a14f18836116af22cba5f6)` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:10:22.371277 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c434b4-1723-400c-8b78-ea2bf2913fd6 None admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:10:22.387976 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 152/310] 10.222.0.21 () {58 vars in 1334 bytes} [Wed May 4 07:10:22 2022] PUT /identity/v3/system/users/921815db9dbb476fbdc480c91e4ce881/roles/9f89c07b05a14f18836116af22cba5f6 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 07:10:22.472904 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8dc4b2-18cf-4d44-9c71-a117abb88140 None None] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:10:22.473195 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8dc4b2-18cf-4d44-9c71-a117abb88140 None None] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:10:22.473475 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8dc4b2-18cf-4d44-9c71-a117abb88140 None None] PATH_INFO: `/` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:10:22.475278 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 159/311] 10.222.0.21 () {54 vars in 926 bytes} [Wed May 4 07:10:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 07:10:22.481926 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bf3995-d480-40ed-962c-6a1dca216adf None None] REQUEST_METHOD: `POST` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:10:22.482477 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bf3995-d480-40ed-962c-6a1dca216adf None None] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:10:22.482860 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bf3995-d480-40ed-962c-6a1dca216adf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:10:22.502300 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.auth.core [None req-f6bf3995-d480-40ed-962c-6a1dca216adf None None] MFA Rules not processed for user `83c5e0dcb991496ea6dee38384514508`. Rule list: `[]` (Enabled: `True`). {{(pid=79745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:10:22.503760 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.fernet_utils [None req-f6bf3995-d480-40ed-962c-6a1dca216adf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:10:22.582800 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 153/312] 10.222.0.21 () {58 vars in 1023 bytes} [Wed May 4 07:10:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 07:10:22.606878 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8dc4b2-18cf-4d44-9c71-a117abb88140 None None] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:10:22.716896 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8dc4b2-18cf-4d44-9c71-a117abb88140 None None] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:10:22.751702 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a1eb5c-e6bf-4225-b2fb-c15590bbe52d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:10:22.752560 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a1eb5c-e6bf-4225-b2fb-c15590bbe52d None admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:10:22.752845 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a1eb5c-e6bf-4225-b2fb-c15590bbe52d None admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:10:22.753118 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a1eb5c-e6bf-4225-b2fb-c15590bbe52d None admin] PATH_INFO: `/v3/roles/reader` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:10:22.764058 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a1eb5c-e6bf-4225-b2fb-c15590bbe52d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 07:10:22.772009 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application [None req-89a1eb5c-e6bf-4225-b2fb-c15590bbe52d None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 04 07:10:22.772009 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 07:10:22.772009 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 07:10:22.772009 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 07:10:22.772009 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 07:10:22.772009 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 07:10:22.772009 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 07:10:22.772009 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 07:10:22.772009 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 07:10:22.772009 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 07:10:22.772009 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 07:10:22.772009 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 07:10:22.772009 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 07:10:22.772009 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 07:10:22.772009 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 07:10:22.772009 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 07:10:22.774042 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 07:10:22.774042 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 07:10:22.774042 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 07:10:22.774042 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 07:10:22.774042 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 07:10:22.774042 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 07:10:22.774042 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 07:10:22.774042 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 07:10:22.774042 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 07:10:22.774042 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.get_or_create( May 04 07:10:22.774042 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 07:10:22.774042 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application with Lock( May 04 07:10:22.774042 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 07:10:22.774042 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self._enter() May 04 07:10:22.774042 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 07:10:22.774042 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 07:10:22.775925 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 07:10:22.775925 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.creator() May 04 07:10:22.775925 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 07:10:22.775925 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application created_value = creator( May 04 07:10:22.775925 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 07:10:22.775925 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 07:10:22.775925 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 07:10:22.775925 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 07:10:22.775925 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 07:10:22.775925 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 07:10:22.775925 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 04 07:10:22.775925 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application May 04 07:10:22.775925 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 160/313] 10.222.0.21 () {56 vars in 1099 bytes} [Wed May 4 07:10:22 2022] GET /identity/v3/roles/reader => generated 84 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 07:10:22.783168 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bf3995-d480-40ed-962c-6a1dca216adf None None] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:10:22.885044 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bf3995-d480-40ed-962c-6a1dca216adf None None] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:10:22.919924 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bccaa53c-44a8-4395-968d-472b60a94b61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:10:22.920587 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccaa53c-44a8-4395-968d-472b60a94b61 None admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:10:22.920866 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccaa53c-44a8-4395-968d-472b60a94b61 None admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:10:22.921139 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccaa53c-44a8-4395-968d-472b60a94b61 None admin] PATH_INFO: `/v3/roles` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:10:22.921888 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bccaa53c-44a8-4395-968d-472b60a94b61 None admin] RBAC: Adding query filter params (name=reader) {{(pid=79745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 07:10:22.922191 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bccaa53c-44a8-4395-968d-472b60a94b61 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:10:22.923611 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bccaa53c-44a8-4395-968d-472b60a94b61 None admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:10:22.932045 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 154/314] 10.222.0.21 () {56 vars in 1101 bytes} [Wed May 4 07:10:22 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 07:10:22.938052 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a1eb5c-e6bf-4225-b2fb-c15590bbe52d None admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:10:23.038060 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a1eb5c-e6bf-4225-b2fb-c15590bbe52d None admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:10:23.072028 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fc50c2-42b3-4b32-83fa-c7b0f25f560b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:10:23.072896 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fc50c2-42b3-4b32-83fa-c7b0f25f560b None admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:10:23.073173 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fc50c2-42b3-4b32-83fa-c7b0f25f560b None admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:10:23.073439 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fc50c2-42b3-4b32-83fa-c7b0f25f560b None admin] PATH_INFO: `/v3/users/60ee043389194e39bf3d4090b2b56f25` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:10:23.074635 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1fc50c2-42b3-4b32-83fa-c7b0f25f560b None admin] RBAC: Authorizing `identity:get_user(user_id=60ee043389194e39bf3d4090b2b56f25)` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:10:23.076449 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1fc50c2-42b3-4b32-83fa-c7b0f25f560b None admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:10:23.078389 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 161/315] 10.222.0.21 () {56 vars in 1177 bytes} [Wed May 4 07:10:22 2022] GET /identity/v3/users/60ee043389194e39bf3d4090b2b56f25 => generated 297 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 07:10:23.083815 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bccaa53c-44a8-4395-968d-472b60a94b61 None admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:10:23.186538 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bccaa53c-44a8-4395-968d-472b60a94b61 None admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:10:23.220514 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321c4967-9857-4708-bfd0-10b3040401cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:10:23.221213 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321c4967-9857-4708-bfd0-10b3040401cb None admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:10:23.221495 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321c4967-9857-4708-bfd0-10b3040401cb None admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:10:23.221770 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321c4967-9857-4708-bfd0-10b3040401cb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:10:23.291745 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321c4967-9857-4708-bfd0-10b3040401cb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:10:23.293169 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321c4967-9857-4708-bfd0-10b3040401cb None admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:10:23.398823 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 155/316] 10.222.0.21 () {58 vars in 1282 bytes} [Wed May 4 07:10:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 04 07:10:23.400812 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fc50c2-42b3-4b32-83fa-c7b0f25f560b None admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:10:23.501492 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fc50c2-42b3-4b32-83fa-c7b0f25f560b None admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:10:23.539561 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5354cc6-b340-4421-b1ea-b0d4aaafe87a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:10:23.540425 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5354cc6-b340-4421-b1ea-b0d4aaafe87a None admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:10:23.540703 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5354cc6-b340-4421-b1ea-b0d4aaafe87a None admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:10:23.540978 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5354cc6-b340-4421-b1ea-b0d4aaafe87a None admin] PATH_INFO: `/v3/projects/c3c877aea85b47dea9daa6ab598d831f` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:10:23.542219 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5354cc6-b340-4421-b1ea-b0d4aaafe87a None admin] RBAC: Authorizing `identity:get_project(project_id=c3c877aea85b47dea9daa6ab598d831f)` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:10:23.543673 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5354cc6-b340-4421-b1ea-b0d4aaafe87a None admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:10:23.545464 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 162/317] 10.222.0.21 () {56 vars in 1186 bytes} [Wed May 4 07:10:23 2022] GET /identity/v3/projects/c3c877aea85b47dea9daa6ab598d831f => generated 302 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 07:10:23.551230 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321c4967-9857-4708-bfd0-10b3040401cb None admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:10:23.653086 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321c4967-9857-4708-bfd0-10b3040401cb None admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:10:23.686725 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8840037f-9e32-4c8f-951b-692b91f54da6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:10:23.687397 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8840037f-9e32-4c8f-951b-692b91f54da6 None admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:10:23.687676 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8840037f-9e32-4c8f-951b-692b91f54da6 None admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:10:23.687944 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8840037f-9e32-4c8f-951b-692b91f54da6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:10:23.688763 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8840037f-9e32-4c8f-951b-692b91f54da6 None admin] RBAC: Adding query filter params (role.id=8dc3044bbffe459fb7166d4456243785, scope.project.id=c3c877aea85b47dea9daa6ab598d831f, user.id=60ee043389194e39bf3d4090b2b56f25) {{(pid=79745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 07:10:23.689067 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8840037f-9e32-4c8f-951b-692b91f54da6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:10:23.690495 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8840037f-9e32-4c8f-951b-692b91f54da6 None admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:10:23.696267 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 156/318] 10.222.0.21 () {56 vars in 1374 bytes} [Wed May 4 07:10:23 2022] GET /identity/v3/role_assignments?user.id=60ee043389194e39bf3d4090b2b56f25&scope.project.id=c3c877aea85b47dea9daa6ab598d831f&role.id=8dc3044bbffe459fb7166d4456243785 => generated 608 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 07:10:24.471656 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b0826e-9d27-422f-9b46-8d3089766dbe None None] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:10:24.472156 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b0826e-9d27-422f-9b46-8d3089766dbe None None] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:10:24.472232 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b0826e-9d27-422f-9b46-8d3089766dbe None None] PATH_INFO: `/` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:10:24.473745 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 163/319] 10.222.0.21 () {54 vars in 926 bytes} [Wed May 4 07:10:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 07:10:24.478748 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecde3c4-3815-4e2a-ad49-6c0f3b00ae17 None None] REQUEST_METHOD: `POST` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:10:24.479141 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecde3c4-3815-4e2a-ad49-6c0f3b00ae17 None None] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:10:24.479343 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecde3c4-3815-4e2a-ad49-6c0f3b00ae17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:10:24.497327 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.auth.core [None req-9ecde3c4-3815-4e2a-ad49-6c0f3b00ae17 None None] MFA Rules not processed for user `83c5e0dcb991496ea6dee38384514508`. Rule list: `[]` (Enabled: `True`). {{(pid=79745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:10:24.498540 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.fernet_utils [None req-9ecde3c4-3815-4e2a-ad49-6c0f3b00ae17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:10:24.565209 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 157/320] 10.222.0.21 () {58 vars in 1023 bytes} [Wed May 4 07:10:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 07:10:24.586877 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b0826e-9d27-422f-9b46-8d3089766dbe None None] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:10:24.684618 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a760da-b779-4fc2-9436-c84eae35ffba None None] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:10:24.685001 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a760da-b779-4fc2-9436-c84eae35ffba None None] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:10:24.685161 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a760da-b779-4fc2-9436-c84eae35ffba None None] PATH_INFO: `/` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:10:24.686652 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 158/321] 10.222.0.21 () {54 vars in 926 bytes} [Wed May 4 07:10:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 04 07:10:24.689712 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b0826e-9d27-422f-9b46-8d3089766dbe None None] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:10:24.691602 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc87de3-4b66-4ba7-b82f-6779960c126d None None] REQUEST_METHOD: `POST` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:10:24.691884 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc87de3-4b66-4ba7-b82f-6779960c126d None None] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:10:24.692157 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc87de3-4b66-4ba7-b82f-6779960c126d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:10:24.709005 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.auth.core [None req-6dc87de3-4b66-4ba7-b82f-6779960c126d None None] MFA Rules not processed for user `83c5e0dcb991496ea6dee38384514508`. Rule list: `[]` (Enabled: `True`). {{(pid=79745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:10:24.710494 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.fernet_utils [None req-6dc87de3-4b66-4ba7-b82f-6779960c126d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:10:24.726524 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e19aa9-c0b0-4115-8ee3-12fbb3970830 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:10:24.727339 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e19aa9-c0b0-4115-8ee3-12fbb3970830 None admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:10:24.727617 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e19aa9-c0b0-4115-8ee3-12fbb3970830 None admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:10:24.727884 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e19aa9-c0b0-4115-8ee3-12fbb3970830 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:10:24.737906 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e19aa9-c0b0-4115-8ee3-12fbb3970830 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 07:10:24.745485 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application [None req-b1e19aa9-c0b0-4115-8ee3-12fbb3970830 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 04 07:10:24.745485 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 07:10:24.745485 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 07:10:24.745485 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 07:10:24.745485 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 07:10:24.745485 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 07:10:24.745485 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 07:10:24.745485 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 07:10:24.745485 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 07:10:24.745485 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 07:10:24.745485 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 07:10:24.745485 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 07:10:24.745485 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 07:10:24.745485 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 07:10:24.745485 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 07:10:24.745485 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 07:10:24.746382 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 07:10:24.746382 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 07:10:24.746382 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 07:10:24.746382 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 07:10:24.746382 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 07:10:24.746382 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 07:10:24.746382 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 07:10:24.746382 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 07:10:24.746382 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 07:10:24.746382 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.get_or_create( May 04 07:10:24.746382 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 07:10:24.746382 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application with Lock( May 04 07:10:24.746382 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 07:10:24.746382 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self._enter() May 04 07:10:24.746382 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 07:10:24.746382 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 07:10:24.752190 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 07:10:24.752190 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.creator() May 04 07:10:24.752190 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 07:10:24.752190 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application created_value = creator( May 04 07:10:24.752190 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 07:10:24.752190 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 07:10:24.752190 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 07:10:24.752190 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 07:10:24.752190 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 07:10:24.752190 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 07:10:24.752190 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 04 07:10:24.752190 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application May 04 07:10:24.752190 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 164/322] 10.222.0.21 () {56 vars in 1099 bytes} [Wed May 4 07:10:24 2022] GET /identity/v3/roles/reader => generated 84 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 07:10:24.752845 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e19aa9-c0b0-4115-8ee3-12fbb3970830 None admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:10:24.784860 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 159/323] 10.222.0.21 () {58 vars in 1023 bytes} [Wed May 4 07:10:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 04 07:10:24.803791 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc74286d-e02e-4265-8509-226239984671 None None] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:10:24.804081 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc74286d-e02e-4265-8509-226239984671 None None] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:10:24.804356 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc74286d-e02e-4265-8509-226239984671 None None] PATH_INFO: `/` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:10:24.805966 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 160/324] 10.222.0.21 () {54 vars in 926 bytes} [Wed May 4 07:10:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 04 07:10:24.807420 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc74286d-e02e-4265-8509-226239984671 None None] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:10:24.851243 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e19aa9-c0b0-4115-8ee3-12fbb3970830 None admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:10:24.883023 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98f77d1-0160-4f9e-86d4-a7bfe87d855b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:10:24.883700 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98f77d1-0160-4f9e-86d4-a7bfe87d855b None admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:10:24.883974 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98f77d1-0160-4f9e-86d4-a7bfe87d855b None admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:10:24.884248 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98f77d1-0160-4f9e-86d4-a7bfe87d855b None admin] PATH_INFO: `/v3/roles` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:10:24.884971 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98f77d1-0160-4f9e-86d4-a7bfe87d855b None admin] RBAC: Adding query filter params (name=reader) {{(pid=79744) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 07:10:24.885270 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98f77d1-0160-4f9e-86d4-a7bfe87d855b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:10:24.886628 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98f77d1-0160-4f9e-86d4-a7bfe87d855b None admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:10:24.894901 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 165/325] 10.222.0.21 () {56 vars in 1101 bytes} [Wed May 4 07:10:24 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 07:10:24.896082 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802b099c-42ee-43f2-9452-ed389e4bc5f6 None None] REQUEST_METHOD: `POST` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:10:24.896362 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802b099c-42ee-43f2-9452-ed389e4bc5f6 None None] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:10:24.896634 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802b099c-42ee-43f2-9452-ed389e4bc5f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:10:24.903538 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc74286d-e02e-4265-8509-226239984671 None None] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:10:24.914159 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.auth.core [None req-802b099c-42ee-43f2-9452-ed389e4bc5f6 None None] MFA Rules not processed for user `83c5e0dcb991496ea6dee38384514508`. Rule list: `[]` (Enabled: `True`). {{(pid=79744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:10:24.915334 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.fernet_utils [None req-802b099c-42ee-43f2-9452-ed389e4bc5f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:10:24.935438 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d089bb0c-99eb-424c-b2f5-5e18e531027b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:10:24.936213 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d089bb0c-99eb-424c-b2f5-5e18e531027b None admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:10:24.936484 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d089bb0c-99eb-424c-b2f5-5e18e531027b None admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:10:24.936802 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d089bb0c-99eb-424c-b2f5-5e18e531027b None admin] PATH_INFO: `/v3/domains/default` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:10:24.937938 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d089bb0c-99eb-424c-b2f5-5e18e531027b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:10:24.939389 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d089bb0c-99eb-424c-b2f5-5e18e531027b None admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:10:24.941133 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 161/326] 10.222.0.21 () {56 vars in 1108 bytes} [Wed May 4 07:10:24 2022] GET /identity/v3/domains/default => generated 199 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 07:10:24.941708 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d089bb0c-99eb-424c-b2f5-5e18e531027b None admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:10:24.983129 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 166/327] 10.222.0.21 () {58 vars in 1023 bytes} [Wed May 4 07:10:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 07:10:24.983830 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802b099c-42ee-43f2-9452-ed389e4bc5f6 None None] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:10:25.039657 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d089bb0c-99eb-424c-b2f5-5e18e531027b None admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:10:25.071141 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd1e292-63e4-4045-ab9f-ee9b70a12bbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:10:25.072025 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd1e292-63e4-4045-ab9f-ee9b70a12bbb None admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:10:25.072301 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd1e292-63e4-4045-ab9f-ee9b70a12bbb None admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:10:25.072566 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd1e292-63e4-4045-ab9f-ee9b70a12bbb None admin] PATH_INFO: `/v3/users/39a5d2e1c93446a5a8d8ce1663d08ebb` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:10:25.073736 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd1e292-63e4-4045-ab9f-ee9b70a12bbb None admin] RBAC: Authorizing `identity:get_user(user_id=39a5d2e1c93446a5a8d8ce1663d08ebb)` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:10:25.075813 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd1e292-63e4-4045-ab9f-ee9b70a12bbb None admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:10:25.077507 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 162/328] 10.222.0.21 () {56 vars in 1177 bytes} [Wed May 4 07:10:24 2022] GET /identity/v3/users/39a5d2e1c93446a5a8d8ce1663d08ebb => generated 293 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 07:10:25.077741 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802b099c-42ee-43f2-9452-ed389e4bc5f6 None None] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:10:25.078261 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd1e292-63e4-4045-ab9f-ee9b70a12bbb None admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:10:25.109318 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860cfa31-824f-4150-b318-33d7a04d3395 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:10:25.109978 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860cfa31-824f-4150-b318-33d7a04d3395 None admin] REQUEST_METHOD: `POST` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:10:25.110252 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860cfa31-824f-4150-b318-33d7a04d3395 None admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:10:25.110525 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860cfa31-824f-4150-b318-33d7a04d3395 None admin] PATH_INFO: `/v3/groups` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:10:25.111219 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860cfa31-824f-4150-b318-33d7a04d3395 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:10:25.112626 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860cfa31-824f-4150-b318-33d7a04d3395 None admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:10:25.127279 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 167/329] 10.222.0.21 () {60 vars in 1134 bytes} [Wed May 4 07:10:24 2022] POST /identity/v3/groups => generated 226 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 07:10:25.128257 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860cfa31-824f-4150-b318-33d7a04d3395 None admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:10:25.180969 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd1e292-63e4-4045-ab9f-ee9b70a12bbb None admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:10:25.218225 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec42200-758b-4f93-8ffc-1f54b6ee79ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:10:25.219025 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec42200-758b-4f93-8ffc-1f54b6ee79ee None admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:10:25.219326 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec42200-758b-4f93-8ffc-1f54b6ee79ee None admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:10:25.219599 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec42200-758b-4f93-8ffc-1f54b6ee79ee None admin] PATH_INFO: `/v3/roles/member` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:10:25.231221 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec42200-758b-4f93-8ffc-1f54b6ee79ee None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 07:10:25.232863 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860cfa31-824f-4150-b318-33d7a04d3395 None admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:10:25.239313 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application [None req-dec42200-758b-4f93-8ffc-1f54b6ee79ee None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 04 07:10:25.239313 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 07:10:25.239313 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 07:10:25.239313 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 07:10:25.239313 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 07:10:25.239313 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 07:10:25.239313 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 07:10:25.239313 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 07:10:25.239313 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 07:10:25.239313 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 07:10:25.239313 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 07:10:25.239313 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 07:10:25.239313 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 07:10:25.239313 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 07:10:25.239313 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 07:10:25.239313 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 07:10:25.240527 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 07:10:25.240527 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 07:10:25.240527 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 07:10:25.240527 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 07:10:25.240527 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 07:10:25.240527 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 07:10:25.240527 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 07:10:25.240527 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 07:10:25.240527 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 07:10:25.240527 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self.get_or_create( May 04 07:10:25.240527 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 07:10:25.240527 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application with Lock( May 04 07:10:25.240527 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 07:10:25.240527 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self._enter() May 04 07:10:25.240527 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 07:10:25.240527 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 07:10:25.241956 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 07:10:25.241956 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self.creator() May 04 07:10:25.241956 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 07:10:25.241956 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application created_value = creator( May 04 07:10:25.241956 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 07:10:25.241956 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 07:10:25.241956 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 07:10:25.241956 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 07:10:25.241956 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 07:10:25.241956 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 07:10:25.241956 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 04 07:10:25.241956 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application May 04 07:10:25.241956 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 163/330] 10.222.0.21 () {56 vars in 1099 bytes} [Wed May 4 07:10:25 2022] GET /identity/v3/roles/member => generated 84 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 07:10:25.246408 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec42200-758b-4f93-8ffc-1f54b6ee79ee None admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:10:25.272240 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365da4c5-ef2c-483f-b81d-37d2d6cb6217 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:10:25.273139 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365da4c5-ef2c-483f-b81d-37d2d6cb6217 None admin] REQUEST_METHOD: `PUT` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:10:25.273417 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365da4c5-ef2c-483f-b81d-37d2d6cb6217 None admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:10:25.273689 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365da4c5-ef2c-483f-b81d-37d2d6cb6217 None admin] PATH_INFO: `/v3/system/users/39a5d2e1c93446a5a8d8ce1663d08ebb/roles/8dc3044bbffe459fb7166d4456243785` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:10:25.276631 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-365da4c5-ef2c-483f-b81d-37d2d6cb6217 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=39a5d2e1c93446a5a8d8ce1663d08ebb, role_id=8dc3044bbffe459fb7166d4456243785)` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:10:25.277227 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-365da4c5-ef2c-483f-b81d-37d2d6cb6217 None admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:10:25.286978 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 168/331] 10.222.0.21 () {58 vars in 1334 bytes} [Wed May 4 07:10:25 2022] PUT /identity/v3/system/users/39a5d2e1c93446a5a8d8ce1663d08ebb/roles/8dc3044bbffe459fb7166d4456243785 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 07:10:25.358448 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec42200-758b-4f93-8ffc-1f54b6ee79ee None admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:10:25.394752 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed227fd7-6d10-42c3-a919-f120aa545013 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:10:25.395489 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed227fd7-6d10-42c3-a919-f120aa545013 None admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:10:25.395765 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed227fd7-6d10-42c3-a919-f120aa545013 None admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:10:25.396033 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed227fd7-6d10-42c3-a919-f120aa545013 None admin] PATH_INFO: `/v3/roles` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:10:25.396786 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed227fd7-6d10-42c3-a919-f120aa545013 None admin] RBAC: Adding query filter params (name=member) {{(pid=79745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 07:10:25.397165 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed227fd7-6d10-42c3-a919-f120aa545013 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:10:25.398492 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed227fd7-6d10-42c3-a919-f120aa545013 None admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:10:25.408775 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 164/332] 10.222.0.21 () {56 vars in 1101 bytes} [Wed May 4 07:10:25 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 07:10:25.416359 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365da4c5-ef2c-483f-b81d-37d2d6cb6217 None admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:10:25.534967 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365da4c5-ef2c-483f-b81d-37d2d6cb6217 None admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:10:25.569398 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ce5110-d098-49c7-8584-15c6d9f8dfb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:10:25.570329 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ce5110-d098-49c7-8584-15c6d9f8dfb4 None admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:10:25.570646 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ce5110-d098-49c7-8584-15c6d9f8dfb4 None admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:10:25.570920 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ce5110-d098-49c7-8584-15c6d9f8dfb4 None admin] PATH_INFO: `/v3/users/921815db9dbb476fbdc480c91e4ce881` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:10:25.572175 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ce5110-d098-49c7-8584-15c6d9f8dfb4 None admin] RBAC: Authorizing `identity:get_user(user_id=921815db9dbb476fbdc480c91e4ce881)` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:10:25.576910 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ce5110-d098-49c7-8584-15c6d9f8dfb4 None admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:10:25.576910 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 169/333] 10.222.0.21 () {56 vars in 1177 bytes} [Wed May 4 07:10:25 2022] GET /identity/v3/users/921815db9dbb476fbdc480c91e4ce881 => generated 293 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 07:10:25.582055 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed227fd7-6d10-42c3-a919-f120aa545013 None admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:10:25.688041 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed227fd7-6d10-42c3-a919-f120aa545013 None admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:10:25.723647 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0ec608-91d7-480c-b8cb-e8a4686d9f38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:10:25.724668 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0ec608-91d7-480c-b8cb-e8a4686d9f38 None admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:10:25.725125 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0ec608-91d7-480c-b8cb-e8a4686d9f38 None admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:10:25.725588 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0ec608-91d7-480c-b8cb-e8a4686d9f38 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:10:25.726589 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0ec608-91d7-480c-b8cb-e8a4686d9f38 None admin] RBAC: Adding query filter params (role.id=9f89c07b05a14f18836116af22cba5f6, user.id=921815db9dbb476fbdc480c91e4ce881, scope.system=all) {{(pid=79745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 07:10:25.727087 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0ec608-91d7-480c-b8cb-e8a4686d9f38 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:10:25.728722 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0ec608-91d7-480c-b8cb-e8a4686d9f38 None admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:10:25.741512 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 165/334] 10.222.0.21 () {56 vars in 1308 bytes} [Wed May 4 07:10:25 2022] GET /identity/v3/role_assignments?user.id=921815db9dbb476fbdc480c91e4ce881&scope.system=all&role.id=9f89c07b05a14f18836116af22cba5f6 => generated 510 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 07:10:27.809117 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68a6188-e5d3-4a67-9308-39cec5b56ead None None] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:10:27.811309 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68a6188-e5d3-4a67-9308-39cec5b56ead None None] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:10:27.811802 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68a6188-e5d3-4a67-9308-39cec5b56ead None None] PATH_INFO: `/` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:10:27.813461 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 170/335] 10.222.0.21 () {54 vars in 926 bytes} [Wed May 4 07:10:27 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 07:10:27.818959 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab42c3c2-9879-410f-b58a-a04edc99cf14 None None] REQUEST_METHOD: `POST` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:10:27.819834 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab42c3c2-9879-410f-b58a-a04edc99cf14 None None] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:10:27.820304 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab42c3c2-9879-410f-b58a-a04edc99cf14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:10:27.844191 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.auth.core [None req-ab42c3c2-9879-410f-b58a-a04edc99cf14 None None] MFA Rules not processed for user `83c5e0dcb991496ea6dee38384514508`. Rule list: `[]` (Enabled: `True`). {{(pid=79745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:10:27.845726 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.fernet_utils [None req-ab42c3c2-9879-410f-b58a-a04edc99cf14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:10:27.924855 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 166/336] 10.222.0.21 () {58 vars in 1023 bytes} [Wed May 4 07:10:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 04 07:10:27.961250 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68a6188-e5d3-4a67-9308-39cec5b56ead None None] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:10:28.096999 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68a6188-e5d3-4a67-9308-39cec5b56ead None None] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:10:28.149855 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf299a6-a4ca-455a-bb3f-8bc7b521d695 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:10:28.151107 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf299a6-a4ca-455a-bb3f-8bc7b521d695 None admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:10:28.151632 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf299a6-a4ca-455a-bb3f-8bc7b521d695 None admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:10:28.152113 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf299a6-a4ca-455a-bb3f-8bc7b521d695 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:10:28.174000 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf299a6-a4ca-455a-bb3f-8bc7b521d695 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 07:10:28.182360 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application [None req-adf299a6-a4ca-455a-bb3f-8bc7b521d695 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 04 07:10:28.182360 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 07:10:28.182360 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 07:10:28.182360 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 07:10:28.182360 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 07:10:28.182360 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 07:10:28.182360 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 07:10:28.182360 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 07:10:28.182360 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 07:10:28.182360 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 07:10:28.182360 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 07:10:28.182360 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 07:10:28.182360 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 07:10:28.182360 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 07:10:28.182360 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 07:10:28.182360 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 07:10:28.187619 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 07:10:28.187619 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 07:10:28.187619 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 07:10:28.187619 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 07:10:28.187619 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 07:10:28.187619 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 07:10:28.187619 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 07:10:28.187619 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 07:10:28.187619 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 07:10:28.187619 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.get_or_create( May 04 07:10:28.187619 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 07:10:28.187619 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application with Lock( May 04 07:10:28.187619 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 07:10:28.187619 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self._enter() May 04 07:10:28.187619 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 07:10:28.187619 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 07:10:28.188435 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 07:10:28.188435 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.creator() May 04 07:10:28.188435 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 07:10:28.188435 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application created_value = creator( May 04 07:10:28.188435 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 07:10:28.188435 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 07:10:28.188435 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 07:10:28.188435 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 07:10:28.188435 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 07:10:28.188435 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 07:10:28.188435 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 04 07:10:28.188435 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application May 04 07:10:28.191094 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 171/337] 10.222.0.21 () {56 vars in 1099 bytes} [Wed May 4 07:10:27 2022] GET /identity/v3/roles/member => generated 84 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 07:10:28.197800 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab42c3c2-9879-410f-b58a-a04edc99cf14 None None] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:10:28.254284 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c43d5f5-5a3f-4402-843f-9f927e26dd03 None None] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:10:28.255077 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c43d5f5-5a3f-4402-843f-9f927e26dd03 None None] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:10:28.256426 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c43d5f5-5a3f-4402-843f-9f927e26dd03 None None] PATH_INFO: `/` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:10:28.258287 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 172/338] 10.222.0.21 () {54 vars in 926 bytes} [Wed May 4 07:10:28 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 07:10:28.264417 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909a67f2-75e6-4c0c-b4a2-d156cd17313d None None] REQUEST_METHOD: `POST` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:10:28.264960 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909a67f2-75e6-4c0c-b4a2-d156cd17313d None None] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:10:28.265437 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909a67f2-75e6-4c0c-b4a2-d156cd17313d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:10:28.296179 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.auth.core [None req-909a67f2-75e6-4c0c-b4a2-d156cd17313d None None] MFA Rules not processed for user `83c5e0dcb991496ea6dee38384514508`. Rule list: `[]` (Enabled: `True`). {{(pid=79744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:10:28.297927 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.fernet_utils [None req-909a67f2-75e6-4c0c-b4a2-d156cd17313d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:10:28.408387 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 173/339] 10.222.0.21 () {58 vars in 1023 bytes} [Wed May 4 07:10:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 04 07:10:28.413114 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab42c3c2-9879-410f-b58a-a04edc99cf14 None None] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:10:28.442749 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909a67f2-75e6-4c0c-b4a2-d156cd17313d None None] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:10:28.477762 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cff23a3-751d-42d6-8aba-625cd97b7ced None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:10:28.478440 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cff23a3-751d-42d6-8aba-625cd97b7ced None admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:10:28.478709 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cff23a3-751d-42d6-8aba-625cd97b7ced None admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:10:28.478976 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cff23a3-751d-42d6-8aba-625cd97b7ced None admin] PATH_INFO: `/v3/roles` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:10:28.479753 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cff23a3-751d-42d6-8aba-625cd97b7ced None admin] RBAC: Adding query filter params (name=member) {{(pid=79745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 07:10:28.480055 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cff23a3-751d-42d6-8aba-625cd97b7ced None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:10:28.481949 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cff23a3-751d-42d6-8aba-625cd97b7ced None admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:10:28.497472 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 167/340] 10.222.0.21 () {56 vars in 1101 bytes} [Wed May 4 07:10:28 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 07:10:28.498813 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2819210e-4f5e-444b-82b7-a3b4d163b7eb None None] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:10:28.499093 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2819210e-4f5e-444b-82b7-a3b4d163b7eb None None] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:10:28.499391 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2819210e-4f5e-444b-82b7-a3b4d163b7eb None None] PATH_INFO: `/` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:10:28.500848 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 168/341] 10.222.0.21 () {54 vars in 926 bytes} [Wed May 4 07:10:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 07:10:28.505991 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2819210e-4f5e-444b-82b7-a3b4d163b7eb None None] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:10:28.568772 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909a67f2-75e6-4c0c-b4a2-d156cd17313d None None] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:10:28.619707 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67ae933-7965-46fd-a3c8-260251d5de86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:10:28.620508 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67ae933-7965-46fd-a3c8-260251d5de86 None admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:10:28.620790 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67ae933-7965-46fd-a3c8-260251d5de86 None admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:10:28.621061 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67ae933-7965-46fd-a3c8-260251d5de86 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:10:28.641637 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67ae933-7965-46fd-a3c8-260251d5de86 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 07:10:28.650181 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application [None req-d67ae933-7965-46fd-a3c8-260251d5de86 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 04 07:10:28.650181 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 07:10:28.650181 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 07:10:28.650181 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 07:10:28.650181 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 07:10:28.650181 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 07:10:28.650181 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 07:10:28.650181 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 07:10:28.650181 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 07:10:28.650181 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 07:10:28.650181 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 07:10:28.650181 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 07:10:28.650181 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 07:10:28.650181 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 07:10:28.650181 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 07:10:28.650181 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 07:10:28.651310 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 07:10:28.651310 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 07:10:28.651310 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 07:10:28.651310 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 07:10:28.651310 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 07:10:28.651310 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 07:10:28.651310 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 07:10:28.651310 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 07:10:28.651310 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 07:10:28.651310 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.get_or_create( May 04 07:10:28.651310 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 07:10:28.651310 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application with Lock( May 04 07:10:28.651310 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 07:10:28.651310 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self._enter() May 04 07:10:28.651310 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 07:10:28.651310 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 07:10:28.652336 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 07:10:28.652336 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.creator() May 04 07:10:28.652336 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 07:10:28.652336 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application created_value = creator( May 04 07:10:28.652336 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 07:10:28.652336 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 07:10:28.652336 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 07:10:28.652336 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 07:10:28.652336 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 07:10:28.652336 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 07:10:28.652336 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 04 07:10:28.652336 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application May 04 07:10:28.656457 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 174/342] 10.222.0.21 () {56 vars in 1099 bytes} [Wed May 4 07:10:28 2022] GET /identity/v3/roles/reader => generated 84 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 07:10:28.657842 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebd167b-11db-42b8-84bd-c6a9fefa7e82 None None] REQUEST_METHOD: `POST` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:10:28.658273 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebd167b-11db-42b8-84bd-c6a9fefa7e82 None None] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:10:28.658744 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebd167b-11db-42b8-84bd-c6a9fefa7e82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:10:28.679341 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.auth.core [None req-7ebd167b-11db-42b8-84bd-c6a9fefa7e82 None None] MFA Rules not processed for user `83c5e0dcb991496ea6dee38384514508`. Rule list: `[]` (Enabled: `True`). {{(pid=79744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:10:28.680771 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.fernet_utils [None req-7ebd167b-11db-42b8-84bd-c6a9fefa7e82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:10:28.760807 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2819210e-4f5e-444b-82b7-a3b4d163b7eb None None] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:10:28.768171 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 175/343] 10.222.0.21 () {58 vars in 1023 bytes} [Wed May 4 07:10:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 07:10:28.769214 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebd167b-11db-42b8-84bd-c6a9fefa7e82 None None] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:10:28.820923 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a27edae-9ef0-4356-8585-d82b88a72c14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:10:28.822293 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a27edae-9ef0-4356-8585-d82b88a72c14 None admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:10:28.822764 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a27edae-9ef0-4356-8585-d82b88a72c14 None admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:10:28.823265 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a27edae-9ef0-4356-8585-d82b88a72c14 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:10:28.887188 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebd167b-11db-42b8-84bd-c6a9fefa7e82 None None] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:10:28.904170 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a27edae-9ef0-4356-8585-d82b88a72c14 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:10:28.906154 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a27edae-9ef0-4356-8585-d82b88a72c14 None admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:10:28.927871 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f01c864-2eb7-4d8d-9356-8a62a336dbe7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:10:28.928464 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f01c864-2eb7-4d8d-9356-8a62a336dbe7 None admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:10:28.928745 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f01c864-2eb7-4d8d-9356-8a62a336dbe7 None admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:10:28.929020 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f01c864-2eb7-4d8d-9356-8a62a336dbe7 None admin] PATH_INFO: `/v3/roles` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:10:28.929776 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f01c864-2eb7-4d8d-9356-8a62a336dbe7 None admin] RBAC: Adding query filter params (name=reader) {{(pid=79744) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 07:10:28.930082 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f01c864-2eb7-4d8d-9356-8a62a336dbe7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:10:28.931488 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f01c864-2eb7-4d8d-9356-8a62a336dbe7 None admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:10:28.941636 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 176/344] 10.222.0.21 () {56 vars in 1101 bytes} [Wed May 4 07:10:28 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 07:10:28.942839 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f01c864-2eb7-4d8d-9356-8a62a336dbe7 None admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:10:29.010051 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 169/345] 10.222.0.21 () {58 vars in 1282 bytes} [Wed May 4 07:10:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 507 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 04 07:10:29.011170 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a27edae-9ef0-4356-8585-d82b88a72c14 None admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:10:29.057525 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f01c864-2eb7-4d8d-9356-8a62a336dbe7 None admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:10:29.094362 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5cd8a8-4d81-4324-82fa-669370bb3fe0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:10:29.095635 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5cd8a8-4d81-4324-82fa-669370bb3fe0 None admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:10:29.096157 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5cd8a8-4d81-4324-82fa-669370bb3fe0 None admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:10:29.096639 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5cd8a8-4d81-4324-82fa-669370bb3fe0 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:10:29.108316 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5cd8a8-4d81-4324-82fa-669370bb3fe0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 07:10:29.116772 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application [None req-1c5cd8a8-4d81-4324-82fa-669370bb3fe0 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 04 07:10:29.116772 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 07:10:29.116772 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 07:10:29.116772 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 07:10:29.116772 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 07:10:29.116772 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 07:10:29.116772 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 07:10:29.116772 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 07:10:29.116772 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 07:10:29.116772 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 07:10:29.116772 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 07:10:29.116772 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 07:10:29.116772 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 07:10:29.116772 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 07:10:29.116772 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 07:10:29.116772 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 07:10:29.117757 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 07:10:29.117757 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 07:10:29.117757 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 07:10:29.117757 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 07:10:29.117757 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 07:10:29.117757 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 07:10:29.117757 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 07:10:29.117757 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 07:10:29.117757 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 07:10:29.117757 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.get_or_create( May 04 07:10:29.117757 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 07:10:29.117757 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application with Lock( May 04 07:10:29.117757 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 07:10:29.117757 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self._enter() May 04 07:10:29.117757 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 07:10:29.117757 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 07:10:29.118630 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 07:10:29.118630 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.creator() May 04 07:10:29.118630 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 07:10:29.118630 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application created_value = creator( May 04 07:10:29.118630 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 07:10:29.118630 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 07:10:29.118630 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 07:10:29.118630 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 07:10:29.118630 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 07:10:29.118630 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 07:10:29.118630 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 04 07:10:29.118630 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application May 04 07:10:29.122026 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 177/346] 10.222.0.21 () {56 vars in 1114 bytes} [Wed May 4 07:10:28 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 07:10:29.123176 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5cd8a8-4d81-4324-82fa-669370bb3fe0 None admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:10:29.225519 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a27edae-9ef0-4356-8585-d82b88a72c14 None admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:10:29.233951 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5cd8a8-4d81-4324-82fa-669370bb3fe0 None admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:10:29.275874 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7085f36-0ac3-40e6-a250-b91f00792374 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:10:29.276750 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7085f36-0ac3-40e6-a250-b91f00792374 None admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:10:29.277028 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7085f36-0ac3-40e6-a250-b91f00792374 None admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:10:29.277296 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7085f36-0ac3-40e6-a250-b91f00792374 None admin] PATH_INFO: `/v3/users/39a5d2e1c93446a5a8d8ce1663d08ebb` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:10:29.278504 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cccdeb96-50a1-403f-ba79-2e3c96e86e93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:10:29.278707 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7085f36-0ac3-40e6-a250-b91f00792374 None admin] RBAC: Authorizing `identity:get_user(user_id=39a5d2e1c93446a5a8d8ce1663d08ebb)` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:10:29.279775 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccdeb96-50a1-403f-ba79-2e3c96e86e93 None admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:10:29.281161 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7085f36-0ac3-40e6-a250-b91f00792374 None admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:10:29.281432 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccdeb96-50a1-403f-ba79-2e3c96e86e93 None admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:10:29.281852 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 170/347] 10.222.0.21 () {56 vars in 1177 bytes} [Wed May 4 07:10:29 2022] GET /identity/v3/users/39a5d2e1c93446a5a8d8ce1663d08ebb => generated 293 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 07:10:29.282131 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccdeb96-50a1-403f-ba79-2e3c96e86e93 None admin] PATH_INFO: `/v3/projects/c1c61577200842b7bf6af16defd5fcbc` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:10:29.283598 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cccdeb96-50a1-403f-ba79-2e3c96e86e93 None admin] RBAC: Authorizing `identity:get_project(project_id=c1c61577200842b7bf6af16defd5fcbc)` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:10:29.284339 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7085f36-0ac3-40e6-a250-b91f00792374 None admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:10:29.285566 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cccdeb96-50a1-403f-ba79-2e3c96e86e93 None admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:10:29.287993 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 178/348] 10.222.0.21 () {56 vars in 1186 bytes} [Wed May 4 07:10:29 2022] GET /identity/v3/projects/c1c61577200842b7bf6af16defd5fcbc => generated 298 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 07:10:29.289496 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bd85be-185c-415e-be74-f6dbf8962ffd None None] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:10:29.290012 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bd85be-185c-415e-be74-f6dbf8962ffd None None] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:10:29.290478 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bd85be-185c-415e-be74-f6dbf8962ffd None None] PATH_INFO: `/` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:10:29.291986 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 179/349] 10.222.0.21 () {54 vars in 926 bytes} [Wed May 4 07:10:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 07:10:29.292882 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bd85be-185c-415e-be74-f6dbf8962ffd None None] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:10:29.409368 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7085f36-0ac3-40e6-a250-b91f00792374 None admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:10:29.417337 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bd85be-185c-415e-be74-f6dbf8962ffd None None] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:10:29.455918 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090a5bf4-9062-405e-bbc0-076ef91e67ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:10:29.456091 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090a5bf4-9062-405e-bbc0-076ef91e67ee None admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:10:29.456358 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090a5bf4-9062-405e-bbc0-076ef91e67ee None admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:10:29.456634 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090a5bf4-9062-405e-bbc0-076ef91e67ee None admin] PATH_INFO: `/v3/roles` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:10:29.457099 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc97f7d6-9b2c-4e9f-82ab-d8b29e6d3c6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:10:29.457387 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090a5bf4-9062-405e-bbc0-076ef91e67ee None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 07:10:29.457693 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090a5bf4-9062-405e-bbc0-076ef91e67ee None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:10:29.457785 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc97f7d6-9b2c-4e9f-82ab-d8b29e6d3c6b None admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:10:29.458020 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc97f7d6-9b2c-4e9f-82ab-d8b29e6d3c6b None admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:10:29.458294 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc97f7d6-9b2c-4e9f-82ab-d8b29e6d3c6b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:10:29.459065 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090a5bf4-9062-405e-bbc0-076ef91e67ee None admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:10:29.459184 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc97f7d6-9b2c-4e9f-82ab-d8b29e6d3c6b None admin] RBAC: Adding query filter params (role.id=8dc3044bbffe459fb7166d4456243785, user.id=39a5d2e1c93446a5a8d8ce1663d08ebb, scope.system=all) {{(pid=79744) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 07:10:29.459474 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc97f7d6-9b2c-4e9f-82ab-d8b29e6d3c6b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:10:29.460885 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc97f7d6-9b2c-4e9f-82ab-d8b29e6d3c6b None admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:10:29.472027 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 171/350] 10.222.0.21 () {56 vars in 1111 bytes} [Wed May 4 07:10:29 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 07:10:29.472027 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0753f029-8963-4024-83e7-b2910a18eea5 None None] REQUEST_METHOD: `POST` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:10:29.472027 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0753f029-8963-4024-83e7-b2910a18eea5 None None] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:10:29.472027 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0753f029-8963-4024-83e7-b2910a18eea5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:10:29.482217 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 180/351] 10.222.0.21 () {56 vars in 1308 bytes} [Wed May 4 07:10:29 2022] GET /identity/v3/role_assignments?user.id=39a5d2e1c93446a5a8d8ce1663d08ebb&scope.system=all&role.id=8dc3044bbffe459fb7166d4456243785 => generated 510 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 07:10:29.484678 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc97f7d6-9b2c-4e9f-82ab-d8b29e6d3c6b None admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:10:29.487881 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.auth.core [None req-0753f029-8963-4024-83e7-b2910a18eea5 None None] MFA Rules not processed for user `83c5e0dcb991496ea6dee38384514508`. Rule list: `[]` (Enabled: `True`). {{(pid=79745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:10:29.490356 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.fernet_utils [None req-0753f029-8963-4024-83e7-b2910a18eea5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:10:29.583459 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 172/352] 10.222.0.21 () {58 vars in 1023 bytes} [Wed May 4 07:10:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 07:10:29.585232 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b415e65-14ac-4b55-87bc-21218959411d None None] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:10:29.586079 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b415e65-14ac-4b55-87bc-21218959411d None None] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:10:29.586561 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b415e65-14ac-4b55-87bc-21218959411d None None] PATH_INFO: `/` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:10:29.588983 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 173/353] 10.222.0.21 () {54 vars in 926 bytes} [Wed May 4 07:10:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 07:10:29.590591 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b415e65-14ac-4b55-87bc-21218959411d None None] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:10:29.625647 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc97f7d6-9b2c-4e9f-82ab-d8b29e6d3c6b None admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:10:29.667333 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a81685-f36b-46d9-99e5-4708427336d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:10:29.668206 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a81685-f36b-46d9-99e5-4708427336d4 None admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:10:29.668524 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a81685-f36b-46d9-99e5-4708427336d4 None admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:10:29.668796 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a81685-f36b-46d9-99e5-4708427336d4 None admin] PATH_INFO: `/v3/groups/179d57b113554c28816eda00a2f83a37` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:10:29.675328 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a81685-f36b-46d9-99e5-4708427336d4 None admin] RBAC: Authorizing `identity:get_group(group_id=179d57b113554c28816eda00a2f83a37)` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:10:29.676800 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a81685-f36b-46d9-99e5-4708427336d4 None admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:10:29.678548 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 181/354] 10.222.0.21 () {56 vars in 1180 bytes} [Wed May 4 07:10:29 2022] GET /identity/v3/groups/179d57b113554c28816eda00a2f83a37 => generated 226 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 07:10:29.679981 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4e5f8c-a1f7-4ac9-855d-49708144f73a None None] REQUEST_METHOD: `POST` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:10:29.680264 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4e5f8c-a1f7-4ac9-855d-49708144f73a None None] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:10:29.680539 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4e5f8c-a1f7-4ac9-855d-49708144f73a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:10:29.698439 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.auth.core [None req-af4e5f8c-a1f7-4ac9-855d-49708144f73a None None] MFA Rules not processed for user `83c5e0dcb991496ea6dee38384514508`. Rule list: `[]` (Enabled: `True`). {{(pid=79744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:10:29.700233 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.fernet_utils [None req-af4e5f8c-a1f7-4ac9-855d-49708144f73a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:10:29.744234 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b415e65-14ac-4b55-87bc-21218959411d None None] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:10:29.786116 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 182/355] 10.222.0.21 () {58 vars in 1023 bytes} [Wed May 4 07:10:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 07:10:29.787631 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4e5f8c-a1f7-4ac9-855d-49708144f73a None None] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:10:29.791995 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7724df-d90c-45a5-9db3-42bf1a5e9822 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:10:29.792945 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7724df-d90c-45a5-9db3-42bf1a5e9822 None admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:10:29.793465 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7724df-d90c-45a5-9db3-42bf1a5e9822 None admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:10:29.793937 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7724df-d90c-45a5-9db3-42bf1a5e9822 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:10:29.870276 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7724df-d90c-45a5-9db3-42bf1a5e9822 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:10:29.871624 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7724df-d90c-45a5-9db3-42bf1a5e9822 None admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:10:29.915843 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4e5f8c-a1f7-4ac9-855d-49708144f73a None None] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:10:29.958164 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb73c3a-69eb-4e3d-b310-3aeb5e6d1b8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:10:29.958985 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb73c3a-69eb-4e3d-b310-3aeb5e6d1b8d None admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:10:29.959297 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb73c3a-69eb-4e3d-b310-3aeb5e6d1b8d None admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:10:29.959570 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb73c3a-69eb-4e3d-b310-3aeb5e6d1b8d None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:10:29.974910 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb73c3a-69eb-4e3d-b310-3aeb5e6d1b8d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 07:10:29.976923 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 174/356] 10.222.0.21 () {58 vars in 1282 bytes} [Wed May 4 07:10:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 04 07:10:29.981793 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7724df-d90c-45a5-9db3-42bf1a5e9822 None admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:10:29.989287 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application [None req-8cb73c3a-69eb-4e3d-b310-3aeb5e6d1b8d None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 04 07:10:29.989287 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 07:10:29.989287 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 07:10:29.989287 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 07:10:29.989287 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 07:10:29.989287 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 07:10:29.989287 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 07:10:29.989287 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 07:10:29.989287 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 07:10:29.989287 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 07:10:29.989287 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 07:10:29.989287 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 07:10:29.989287 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 07:10:29.989287 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 07:10:29.989287 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 07:10:29.989287 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 07:10:29.990198 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 07:10:29.990198 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 07:10:29.990198 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 07:10:29.990198 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 07:10:29.990198 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 07:10:29.990198 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 07:10:29.990198 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 07:10:29.990198 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 07:10:29.990198 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 07:10:29.990198 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.get_or_create( May 04 07:10:29.990198 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 07:10:29.990198 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application with Lock( May 04 07:10:29.990198 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 07:10:29.990198 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self._enter() May 04 07:10:29.990198 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 07:10:29.990198 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 07:10:29.991568 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 07:10:29.991568 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.creator() May 04 07:10:29.991568 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 07:10:29.991568 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application created_value = creator( May 04 07:10:29.991568 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 07:10:29.991568 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 07:10:29.991568 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 07:10:29.991568 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 07:10:29.991568 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 07:10:29.991568 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 07:10:29.991568 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 04 07:10:29.991568 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application May 04 07:10:29.992720 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 183/357] 10.222.0.21 () {56 vars in 1114 bytes} [Wed May 4 07:10:29 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 07:10:29.992720 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb73c3a-69eb-4e3d-b310-3aeb5e6d1b8d None admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:10:30.110146 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7724df-d90c-45a5-9db3-42bf1a5e9822 None admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:10:30.118347 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb73c3a-69eb-4e3d-b310-3aeb5e6d1b8d None admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:10:30.150173 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44665b5d-2a97-4d88-a911-d3748878af7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:10:30.150829 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44665b5d-2a97-4d88-a911-d3748878af7e None admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:10:30.151106 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44665b5d-2a97-4d88-a911-d3748878af7e None admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:10:30.151407 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44665b5d-2a97-4d88-a911-d3748878af7e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:10:30.152442 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44665b5d-2a97-4d88-a911-d3748878af7e None admin] RBAC: Adding query filter params (group.id=179d57b113554c28816eda00a2f83a37, role.id=9f89c07b05a14f18836116af22cba5f6, scope.project.id=c1c61577200842b7bf6af16defd5fcbc) {{(pid=79745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 07:10:30.152944 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44665b5d-2a97-4d88-a911-d3748878af7e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:10:30.154517 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44665b5d-2a97-4d88-a911-d3748878af7e None admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:10:30.154692 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7fce2d-87fa-4efc-b871-c10bcaa4a736 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:10:30.155475 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7fce2d-87fa-4efc-b871-c10bcaa4a736 None admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:10:30.155753 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7fce2d-87fa-4efc-b871-c10bcaa4a736 None admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:10:30.156021 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7fce2d-87fa-4efc-b871-c10bcaa4a736 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:10:30.160831 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 175/358] 10.222.0.21 () {56 vars in 1376 bytes} [Wed May 4 07:10:29 2022] GET /identity/v3/role_assignments?group.id=179d57b113554c28816eda00a2f83a37&scope.project.id=c1c61577200842b7bf6af16defd5fcbc&role.id=9f89c07b05a14f18836116af22cba5f6 => generated 260 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 07:10:30.161670 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44665b5d-2a97-4d88-a911-d3748878af7e None admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:10:30.174945 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7fce2d-87fa-4efc-b871-c10bcaa4a736 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 07:10:30.183204 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application [None req-3a7fce2d-87fa-4efc-b871-c10bcaa4a736 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 04 07:10:30.183204 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 07:10:30.183204 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 07:10:30.183204 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 07:10:30.183204 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 07:10:30.183204 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 07:10:30.183204 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 07:10:30.183204 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 07:10:30.183204 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 07:10:30.183204 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 07:10:30.183204 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 07:10:30.183204 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 07:10:30.183204 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 07:10:30.183204 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 07:10:30.183204 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 07:10:30.183204 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 07:10:30.184758 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 07:10:30.184758 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 07:10:30.184758 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 07:10:30.184758 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 07:10:30.184758 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 07:10:30.184758 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 07:10:30.184758 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 07:10:30.184758 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 07:10:30.184758 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 07:10:30.184758 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.get_or_create( May 04 07:10:30.184758 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 07:10:30.184758 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application with Lock( May 04 07:10:30.184758 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 07:10:30.184758 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self._enter() May 04 07:10:30.184758 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 07:10:30.184758 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 07:10:30.185810 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 07:10:30.185810 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.creator() May 04 07:10:30.185810 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 07:10:30.185810 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application created_value = creator( May 04 07:10:30.185810 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 07:10:30.185810 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 07:10:30.185810 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 07:10:30.185810 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 07:10:30.185810 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 07:10:30.185810 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 07:10:30.185810 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 04 07:10:30.185810 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application May 04 07:10:30.185810 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 184/359] 10.222.0.21 () {56 vars in 1099 bytes} [Wed May 4 07:10:29 2022] GET /identity/v3/roles/member => generated 84 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 07:10:30.186529 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7fce2d-87fa-4efc-b871-c10bcaa4a736 None admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:10:30.275417 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44665b5d-2a97-4d88-a911-d3748878af7e None admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:10:30.299939 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7fce2d-87fa-4efc-b871-c10bcaa4a736 None admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:10:30.312980 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a1c016-0edc-4da0-bb00-352fc1a2e552 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:10:30.313859 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a1c016-0edc-4da0-bb00-352fc1a2e552 None admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:10:30.314137 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a1c016-0edc-4da0-bb00-352fc1a2e552 None admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:10:30.314413 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a1c016-0edc-4da0-bb00-352fc1a2e552 None admin] PATH_INFO: `/v3/projects/c1c61577200842b7bf6af16defd5fcbc` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:10:30.315693 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a1c016-0edc-4da0-bb00-352fc1a2e552 None admin] RBAC: Authorizing `identity:get_project(project_id=c1c61577200842b7bf6af16defd5fcbc)` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:10:30.317163 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a1c016-0edc-4da0-bb00-352fc1a2e552 None admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:10:30.318919 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 176/360] 10.222.0.21 () {56 vars in 1186 bytes} [Wed May 4 07:10:30 2022] GET /identity/v3/projects/c1c61577200842b7bf6af16defd5fcbc => generated 298 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 07:10:30.319724 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a1c016-0edc-4da0-bb00-352fc1a2e552 None admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:10:30.338484 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcddce11-443b-4526-8544-aaa25f306fda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:10:30.339180 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcddce11-443b-4526-8544-aaa25f306fda None admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:10:30.339475 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcddce11-443b-4526-8544-aaa25f306fda None admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:10:30.339746 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcddce11-443b-4526-8544-aaa25f306fda None admin] PATH_INFO: `/v3/roles` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:10:30.341092 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcddce11-443b-4526-8544-aaa25f306fda None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79744) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 07:10:30.341395 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcddce11-443b-4526-8544-aaa25f306fda None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:10:30.342909 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcddce11-443b-4526-8544-aaa25f306fda None admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:10:30.352235 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 185/361] 10.222.0.21 () {56 vars in 1111 bytes} [Wed May 4 07:10:30 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 07:10:30.353170 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcddce11-443b-4526-8544-aaa25f306fda None admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:10:30.429064 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a1c016-0edc-4da0-bb00-352fc1a2e552 None admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:10:30.456172 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcddce11-443b-4526-8544-aaa25f306fda None admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:10:30.463986 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0935540a-1c1d-4193-aa75-2ad9ce2a1b82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:10:30.464961 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0935540a-1c1d-4193-aa75-2ad9ce2a1b82 None admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:10:30.465994 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0935540a-1c1d-4193-aa75-2ad9ce2a1b82 None admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:10:30.466281 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0935540a-1c1d-4193-aa75-2ad9ce2a1b82 None admin] PATH_INFO: `/v3/roles` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:10:30.466996 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0935540a-1c1d-4193-aa75-2ad9ce2a1b82 None admin] RBAC: Adding query filter params (name=member) {{(pid=79745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 07:10:30.467337 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0935540a-1c1d-4193-aa75-2ad9ce2a1b82 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:10:30.468695 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0935540a-1c1d-4193-aa75-2ad9ce2a1b82 None admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:10:30.477376 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 177/362] 10.222.0.21 () {56 vars in 1101 bytes} [Wed May 4 07:10:30 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 07:10:30.478395 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0935540a-1c1d-4193-aa75-2ad9ce2a1b82 None admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:10:30.506145 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e631f0ae-73ab-44e0-9c61-4fd7434bea0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:10:30.507367 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e631f0ae-73ab-44e0-9c61-4fd7434bea0e None admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:10:30.507646 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e631f0ae-73ab-44e0-9c61-4fd7434bea0e None admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:10:30.507914 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e631f0ae-73ab-44e0-9c61-4fd7434bea0e None admin] PATH_INFO: `/v3/groups/179d57b113554c28816eda00a2f83a37` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:10:30.509260 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e631f0ae-73ab-44e0-9c61-4fd7434bea0e None admin] RBAC: Authorizing `identity:get_group(group_id=179d57b113554c28816eda00a2f83a37)` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:10:30.510699 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e631f0ae-73ab-44e0-9c61-4fd7434bea0e None admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:10:30.512413 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 186/363] 10.222.0.21 () {56 vars in 1180 bytes} [Wed May 4 07:10:30 2022] GET /identity/v3/groups/179d57b113554c28816eda00a2f83a37 => generated 226 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 07:10:30.513806 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccb398f-95b2-4c55-ac7a-dcece886304a None None] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:10:30.514303 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccb398f-95b2-4c55-ac7a-dcece886304a None None] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:10:30.514776 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccb398f-95b2-4c55-ac7a-dcece886304a None None] PATH_INFO: `/` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:10:30.517282 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 187/364] 10.222.0.21 () {54 vars in 926 bytes} [Wed May 4 07:10:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 07:10:30.518215 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eccb398f-95b2-4c55-ac7a-dcece886304a None None] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:10:30.595786 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0935540a-1c1d-4193-aa75-2ad9ce2a1b82 None admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:10:30.633371 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8ab601-493d-4c3e-948b-8dcf134a0c35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:10:30.634022 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8ab601-493d-4c3e-948b-8dcf134a0c35 None admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:10:30.635309 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8ab601-493d-4c3e-948b-8dcf134a0c35 None admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:10:30.635309 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8ab601-493d-4c3e-948b-8dcf134a0c35 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:10:30.642517 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eccb398f-95b2-4c55-ac7a-dcece886304a None None] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:10:30.691401 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5709687-588c-4e76-a778-4c21ce301673 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:10:30.692287 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5709687-588c-4e76-a778-4c21ce301673 None admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:10:30.692567 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5709687-588c-4e76-a778-4c21ce301673 None admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:10:30.692837 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5709687-588c-4e76-a778-4c21ce301673 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:10:30.718461 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8ab601-493d-4c3e-948b-8dcf134a0c35 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:10:30.719956 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8ab601-493d-4c3e-948b-8dcf134a0c35 None admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:10:30.787111 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5709687-588c-4e76-a778-4c21ce301673 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:10:30.789385 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5709687-588c-4e76-a778-4c21ce301673 None admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:10:30.838610 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 178/365] 10.222.0.21 () {58 vars in 1282 bytes} [Wed May 4 07:10:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 04 07:10:30.839641 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8ab601-493d-4c3e-948b-8dcf134a0c35 None admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:10:30.920271 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 188/366] 10.222.0.21 () {58 vars in 1282 bytes} [Wed May 4 07:10:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 402 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 04 07:10:30.922215 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b050ac-22d4-4bac-8e11-9a5521c1cec0 None None] REQUEST_METHOD: `POST` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:10:30.922698 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b050ac-22d4-4bac-8e11-9a5521c1cec0 None None] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:10:30.923167 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b050ac-22d4-4bac-8e11-9a5521c1cec0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:10:30.942166 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.auth.core [None req-38b050ac-22d4-4bac-8e11-9a5521c1cec0 None None] MFA Rules not processed for user `83c5e0dcb991496ea6dee38384514508`. Rule list: `[]` (Enabled: `True`). {{(pid=79744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:10:30.943294 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.fernet_utils [None req-38b050ac-22d4-4bac-8e11-9a5521c1cec0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:10:30.952426 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8ab601-493d-4c3e-948b-8dcf134a0c35 None admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:10:30.988951 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4b5966-475b-4311-95e6-577f16734265 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:10:30.989984 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4b5966-475b-4311-95e6-577f16734265 None admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:10:30.990264 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4b5966-475b-4311-95e6-577f16734265 None admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:10:30.990536 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4b5966-475b-4311-95e6-577f16734265 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:10:30.991403 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4b5966-475b-4311-95e6-577f16734265 None admin] RBAC: Adding query filter params (group.id=179d57b113554c28816eda00a2f83a37, role.id=91b8526a43a4426a883870ad97362652, scope.project.id=c1c61577200842b7bf6af16defd5fcbc) {{(pid=79745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 07:10:30.991716 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4b5966-475b-4311-95e6-577f16734265 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:10:30.993161 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4b5966-475b-4311-95e6-577f16734265 None admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:10:31.003602 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 179/367] 10.222.0.21 () {56 vars in 1376 bytes} [Wed May 4 07:10:30 2022] GET /identity/v3/role_assignments?group.id=179d57b113554c28816eda00a2f83a37&scope.project.id=c1c61577200842b7bf6af16defd5fcbc&role.id=91b8526a43a4426a883870ad97362652 => generated 260 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 07:10:31.004872 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4b5966-475b-4311-95e6-577f16734265 None admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:10:31.025732 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 189/368] 10.222.0.21 () {58 vars in 1023 bytes} [Wed May 4 07:10:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 07:10:31.026922 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b050ac-22d4-4bac-8e11-9a5521c1cec0 None None] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:10:31.132114 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4b5966-475b-4311-95e6-577f16734265 None admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:10:31.159191 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b050ac-22d4-4bac-8e11-9a5521c1cec0 None None] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:10:31.179865 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fff044-595b-42d6-b8f1-379278d379c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:10:31.181117 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fff044-595b-42d6-b8f1-379278d379c1 None admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:10:31.181561 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fff044-595b-42d6-b8f1-379278d379c1 None admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:10:31.181972 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fff044-595b-42d6-b8f1-379278d379c1 None admin] PATH_INFO: `/v3/projects/c3c877aea85b47dea9daa6ab598d831f` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:10:31.183680 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81fff044-595b-42d6-b8f1-379278d379c1 None admin] RBAC: Authorizing `identity:get_project(project_id=c3c877aea85b47dea9daa6ab598d831f)` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:10:31.186240 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81fff044-595b-42d6-b8f1-379278d379c1 None admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:10:31.188862 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 180/369] 10.222.0.21 () {56 vars in 1186 bytes} [Wed May 4 07:10:31 2022] GET /identity/v3/projects/c3c877aea85b47dea9daa6ab598d831f => generated 302 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 07:10:31.190273 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fff044-595b-42d6-b8f1-379278d379c1 None admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:10:31.211260 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b07b38-281f-4a0a-b46f-e077bdb445e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:10:31.212347 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b07b38-281f-4a0a-b46f-e077bdb445e7 None admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:10:31.212637 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b07b38-281f-4a0a-b46f-e077bdb445e7 None admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:10:31.212915 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b07b38-281f-4a0a-b46f-e077bdb445e7 None admin] PATH_INFO: `/v3/projects/c3c877aea85b47dea9daa6ab598d831f` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:10:31.214290 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b07b38-281f-4a0a-b46f-e077bdb445e7 None admin] RBAC: Authorizing `identity:get_project(project_id=c3c877aea85b47dea9daa6ab598d831f)` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:10:31.217133 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b07b38-281f-4a0a-b46f-e077bdb445e7 None admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:10:31.219078 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 190/370] 10.222.0.21 () {56 vars in 1186 bytes} [Wed May 4 07:10:31 2022] GET /identity/v3/projects/c3c877aea85b47dea9daa6ab598d831f => generated 302 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 07:10:31.220014 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b07b38-281f-4a0a-b46f-e077bdb445e7 None admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:10:31.310737 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fff044-595b-42d6-b8f1-379278d379c1 None admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:10:31.339694 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b07b38-281f-4a0a-b46f-e077bdb445e7 None admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:10:31.345582 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8020e96-4ae8-4393-a632-639b9918b6a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:10:31.346390 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8020e96-4ae8-4393-a632-639b9918b6a2 None admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:10:31.346666 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8020e96-4ae8-4393-a632-639b9918b6a2 None admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:10:31.346939 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8020e96-4ae8-4393-a632-639b9918b6a2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:10:31.357770 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8020e96-4ae8-4393-a632-639b9918b6a2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 07:10:31.366967 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application [None req-f8020e96-4ae8-4393-a632-639b9918b6a2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 04 07:10:31.366967 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 07:10:31.366967 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 07:10:31.366967 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 07:10:31.366967 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 07:10:31.366967 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 07:10:31.366967 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 07:10:31.366967 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 07:10:31.366967 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 07:10:31.366967 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 07:10:31.366967 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 07:10:31.366967 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 07:10:31.366967 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 07:10:31.366967 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 07:10:31.366967 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 07:10:31.366967 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 07:10:31.367946 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 07:10:31.367946 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 07:10:31.367946 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 07:10:31.367946 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 07:10:31.367946 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 07:10:31.367946 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 07:10:31.367946 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 07:10:31.367946 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 07:10:31.367946 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 07:10:31.367946 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self.get_or_create( May 04 07:10:31.367946 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 07:10:31.367946 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application with Lock( May 04 07:10:31.367946 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 07:10:31.367946 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self._enter() May 04 07:10:31.367946 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 07:10:31.367946 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 07:10:31.368745 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 07:10:31.368745 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self.creator() May 04 07:10:31.368745 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 07:10:31.368745 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application created_value = creator( May 04 07:10:31.368745 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 07:10:31.368745 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 07:10:31.368745 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 07:10:31.368745 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 07:10:31.368745 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 07:10:31.368745 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 07:10:31.368745 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 04 07:10:31.368745 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application May 04 07:10:31.368745 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 181/371] 10.222.0.21 () {56 vars in 1096 bytes} [Wed May 4 07:10:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 07:10:31.369431 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8020e96-4ae8-4393-a632-639b9918b6a2 None admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:10:31.383488 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201e4e86-3747-4045-95cb-3ae2fb6874e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:10:31.384684 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201e4e86-3747-4045-95cb-3ae2fb6874e9 None admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:10:31.385184 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201e4e86-3747-4045-95cb-3ae2fb6874e9 None admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:10:31.385665 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201e4e86-3747-4045-95cb-3ae2fb6874e9 None admin] PATH_INFO: `/v3/groups/179d57b113554c28816eda00a2f83a37` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:10:31.387109 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201e4e86-3747-4045-95cb-3ae2fb6874e9 None admin] RBAC: Authorizing `identity:get_group(group_id=179d57b113554c28816eda00a2f83a37)` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:10:31.389421 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201e4e86-3747-4045-95cb-3ae2fb6874e9 None admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:10:31.393467 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 191/372] 10.222.0.21 () {56 vars in 1180 bytes} [Wed May 4 07:10:31 2022] GET /identity/v3/groups/179d57b113554c28816eda00a2f83a37 => generated 226 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 07:10:31.394507 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201e4e86-3747-4045-95cb-3ae2fb6874e9 None admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:10:31.510148 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8020e96-4ae8-4393-a632-639b9918b6a2 None admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:10:31.535247 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201e4e86-3747-4045-95cb-3ae2fb6874e9 None admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:10:31.548463 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146526a4-9870-42f4-b002-003248b4a687 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:10:31.549681 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146526a4-9870-42f4-b002-003248b4a687 None admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:10:31.550162 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146526a4-9870-42f4-b002-003248b4a687 None admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:10:31.550660 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146526a4-9870-42f4-b002-003248b4a687 None admin] PATH_INFO: `/v3/groups/179d57b113554c28816eda00a2f83a37` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:10:31.552094 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146526a4-9870-42f4-b002-003248b4a687 None admin] RBAC: Authorizing `identity:get_group(group_id=179d57b113554c28816eda00a2f83a37)` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:10:31.553761 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146526a4-9870-42f4-b002-003248b4a687 None admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:10:31.555707 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 182/373] 10.222.0.21 () {56 vars in 1180 bytes} [Wed May 4 07:10:31 2022] GET /identity/v3/groups/179d57b113554c28816eda00a2f83a37 => generated 226 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 07:10:31.556682 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146526a4-9870-42f4-b002-003248b4a687 None admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:10:31.571584 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9088ed9e-d5ad-4aa3-9b0d-f15f0dd07f29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:10:31.572461 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9088ed9e-d5ad-4aa3-9b0d-f15f0dd07f29 None admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:10:31.572896 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9088ed9e-d5ad-4aa3-9b0d-f15f0dd07f29 None admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:10:31.573371 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9088ed9e-d5ad-4aa3-9b0d-f15f0dd07f29 None admin] PATH_INFO: `/v3/roles` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:10:31.574301 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9088ed9e-d5ad-4aa3-9b0d-f15f0dd07f29 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79744) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 07:10:31.575351 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9088ed9e-d5ad-4aa3-9b0d-f15f0dd07f29 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:10:31.576931 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9088ed9e-d5ad-4aa3-9b0d-f15f0dd07f29 None admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:10:31.585323 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 192/374] 10.222.0.21 () {56 vars in 1099 bytes} [Wed May 4 07:10:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 07:10:31.586325 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9088ed9e-d5ad-4aa3-9b0d-f15f0dd07f29 None admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:10:31.667943 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146526a4-9870-42f4-b002-003248b4a687 None admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:10:31.684629 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9088ed9e-d5ad-4aa3-9b0d-f15f0dd07f29 None admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:10:31.704767 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08cac155-dae4-479d-81c2-9d4237d448fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:10:31.705418 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cac155-dae4-479d-81c2-9d4237d448fb None admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:10:31.705935 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cac155-dae4-479d-81c2-9d4237d448fb None admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:10:31.706447 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cac155-dae4-479d-81c2-9d4237d448fb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:10:31.707529 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08cac155-dae4-479d-81c2-9d4237d448fb None admin] RBAC: Adding query filter params (group.id=179d57b113554c28816eda00a2f83a37, role.id=91b8526a43a4426a883870ad97362652, scope.project.id=c3c877aea85b47dea9daa6ab598d831f) {{(pid=79745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 07:10:31.708062 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08cac155-dae4-479d-81c2-9d4237d448fb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:10:31.709681 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08cac155-dae4-479d-81c2-9d4237d448fb None admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:10:31.716215 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 183/375] 10.222.0.21 () {56 vars in 1376 bytes} [Wed May 4 07:10:31 2022] GET /identity/v3/role_assignments?group.id=179d57b113554c28816eda00a2f83a37&scope.project.id=c3c877aea85b47dea9daa6ab598d831f&role.id=91b8526a43a4426a883870ad97362652 => generated 260 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 07:10:31.717252 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08cac155-dae4-479d-81c2-9d4237d448fb None admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:10:31.719056 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09678ca1-03a4-4443-8b03-a3a6e4939498 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:10:31.719937 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09678ca1-03a4-4443-8b03-a3a6e4939498 None admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:10:31.720377 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09678ca1-03a4-4443-8b03-a3a6e4939498 None admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:10:31.720791 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09678ca1-03a4-4443-8b03-a3a6e4939498 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:10:31.721820 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09678ca1-03a4-4443-8b03-a3a6e4939498 None admin] RBAC: Adding query filter params (group.id=179d57b113554c28816eda00a2f83a37, role.id=9f89c07b05a14f18836116af22cba5f6, scope.project.id=c3c877aea85b47dea9daa6ab598d831f) {{(pid=79744) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 07:10:31.722267 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09678ca1-03a4-4443-8b03-a3a6e4939498 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:10:31.723968 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09678ca1-03a4-4443-8b03-a3a6e4939498 None admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:10:31.731362 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 193/376] 10.222.0.21 () {56 vars in 1376 bytes} [Wed May 4 07:10:31 2022] GET /identity/v3/role_assignments?group.id=179d57b113554c28816eda00a2f83a37&scope.project.id=c3c877aea85b47dea9daa6ab598d831f&role.id=9f89c07b05a14f18836116af22cba5f6 => generated 260 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 07:10:31.866590 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08cac155-dae4-479d-81c2-9d4237d448fb None admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:10:31.913148 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9f1fe9-38c5-4b9d-be72-94d6b8159136 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:10:31.914147 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9f1fe9-38c5-4b9d-be72-94d6b8159136 None admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:10:31.914570 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9f1fe9-38c5-4b9d-be72-94d6b8159136 None admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:10:31.915002 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9f1fe9-38c5-4b9d-be72-94d6b8159136 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:10:32.008947 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9f1fe9-38c5-4b9d-be72-94d6b8159136 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:10:32.011173 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9f1fe9-38c5-4b9d-be72-94d6b8159136 None admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:10:32.138008 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 184/377] 10.222.0.21 () {58 vars in 1282 bytes} [Wed May 4 07:10:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 421 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 04 07:10:32.143222 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09678ca1-03a4-4443-8b03-a3a6e4939498 None admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:10:32.250714 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09678ca1-03a4-4443-8b03-a3a6e4939498 None admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:10:32.286556 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5700a62-0ab6-4da2-8a5a-7c7c98f7dc70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:10:32.287725 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5700a62-0ab6-4da2-8a5a-7c7c98f7dc70 None admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:10:32.288165 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5700a62-0ab6-4da2-8a5a-7c7c98f7dc70 None admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:10:32.288575 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5700a62-0ab6-4da2-8a5a-7c7c98f7dc70 None admin] PATH_INFO: `/v3/projects/42382f8dc1ee4162906b55d85040da7b` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:10:32.289890 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5700a62-0ab6-4da2-8a5a-7c7c98f7dc70 None admin] RBAC: Authorizing `identity:get_project(project_id=42382f8dc1ee4162906b55d85040da7b)` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:10:32.291474 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5700a62-0ab6-4da2-8a5a-7c7c98f7dc70 None admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:10:32.294208 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 194/378] 10.222.0.21 () {56 vars in 1186 bytes} [Wed May 4 07:10:32 2022] GET /identity/v3/projects/42382f8dc1ee4162906b55d85040da7b => generated 344 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 07:10:32.299292 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9f1fe9-38c5-4b9d-be72-94d6b8159136 None admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:10:32.412191 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9f1fe9-38c5-4b9d-be72-94d6b8159136 None admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:10:32.452152 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a86728-c27c-45ee-91dc-7db92160064e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:10:32.453384 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a86728-c27c-45ee-91dc-7db92160064e None admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:10:32.459756 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a86728-c27c-45ee-91dc-7db92160064e None admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:10:32.459756 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a86728-c27c-45ee-91dc-7db92160064e None admin] PATH_INFO: `/v3/groups/4d59d0196e0d45d4a737dc3e0c320743` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:10:32.460461 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a86728-c27c-45ee-91dc-7db92160064e None admin] RBAC: Authorizing `identity:get_group(group_id=4d59d0196e0d45d4a737dc3e0c320743)` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:10:32.461964 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a86728-c27c-45ee-91dc-7db92160064e None admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:10:32.464064 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 185/379] 10.222.0.21 () {56 vars in 1180 bytes} [Wed May 4 07:10:32 2022] GET /identity/v3/groups/4d59d0196e0d45d4a737dc3e0c320743 => generated 229 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 07:10:32.469815 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5700a62-0ab6-4da2-8a5a-7c7c98f7dc70 None admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:10:32.610696 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5700a62-0ab6-4da2-8a5a-7c7c98f7dc70 None admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:10:32.652521 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973b3dae-0d08-4b9d-b51c-e27c0f19b9ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:10:32.653863 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973b3dae-0d08-4b9d-b51c-e27c0f19b9ed None admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:10:32.654040 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973b3dae-0d08-4b9d-b51c-e27c0f19b9ed None admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:10:32.654277 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973b3dae-0d08-4b9d-b51c-e27c0f19b9ed None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:10:32.655098 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973b3dae-0d08-4b9d-b51c-e27c0f19b9ed None admin] RBAC: Adding query filter params (group.id=4d59d0196e0d45d4a737dc3e0c320743, role.id=eb54c9cea2774a25b1fe8c79724408ee, scope.project.id=42382f8dc1ee4162906b55d85040da7b) {{(pid=79744) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 07:10:32.655425 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973b3dae-0d08-4b9d-b51c-e27c0f19b9ed None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:10:32.656853 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973b3dae-0d08-4b9d-b51c-e27c0f19b9ed None admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:10:32.667428 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 195/380] 10.222.0.21 () {56 vars in 1376 bytes} [Wed May 4 07:10:32 2022] GET /identity/v3/role_assignments?group.id=4d59d0196e0d45d4a737dc3e0c320743&scope.project.id=42382f8dc1ee4162906b55d85040da7b&role.id=eb54c9cea2774a25b1fe8c79724408ee => generated 260 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 07:10:33.017727 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f4942c-289c-430b-814e-49a73f8dbd5d None None] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:10:33.018224 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f4942c-289c-430b-814e-49a73f8dbd5d None None] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:10:33.018224 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f4942c-289c-430b-814e-49a73f8dbd5d None None] PATH_INFO: `/` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:10:33.019893 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 186/381] 10.222.0.21 () {54 vars in 926 bytes} [Wed May 4 07:10:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 07:10:33.025402 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433ae7f8-69a1-45c8-a434-faca41a8e491 None None] REQUEST_METHOD: `POST` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:10:33.025684 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433ae7f8-69a1-45c8-a434-faca41a8e491 None None] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:10:33.025957 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433ae7f8-69a1-45c8-a434-faca41a8e491 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:10:33.045543 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.auth.core [None req-433ae7f8-69a1-45c8-a434-faca41a8e491 None None] MFA Rules not processed for user `83c5e0dcb991496ea6dee38384514508`. Rule list: `[]` (Enabled: `True`). {{(pid=79744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:10:33.046726 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.fernet_utils [None req-433ae7f8-69a1-45c8-a434-faca41a8e491 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:10:33.114625 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 196/382] 10.222.0.21 () {58 vars in 1023 bytes} [Wed May 4 07:10:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 07:10:33.137894 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f4942c-289c-430b-814e-49a73f8dbd5d None None] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:10:33.252847 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f4942c-289c-430b-814e-49a73f8dbd5d None None] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:10:33.291088 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5534b51-aed2-4870-b9f0-cdc0458c29fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:10:33.291911 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5534b51-aed2-4870-b9f0-cdc0458c29fd None admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:10:33.292184 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5534b51-aed2-4870-b9f0-cdc0458c29fd None admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:10:33.292451 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5534b51-aed2-4870-b9f0-cdc0458c29fd None admin] PATH_INFO: `/v3/roles/member` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:10:33.308548 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5534b51-aed2-4870-b9f0-cdc0458c29fd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 07:10:33.316865 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application [None req-a5534b51-aed2-4870-b9f0-cdc0458c29fd None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 04 07:10:33.316865 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 07:10:33.316865 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 07:10:33.316865 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 07:10:33.316865 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 07:10:33.316865 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 07:10:33.316865 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 07:10:33.316865 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 07:10:33.316865 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 07:10:33.316865 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 07:10:33.316865 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 07:10:33.316865 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 07:10:33.316865 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 07:10:33.316865 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 07:10:33.316865 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 07:10:33.316865 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 07:10:33.317795 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 07:10:33.317795 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 07:10:33.317795 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 07:10:33.317795 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 07:10:33.317795 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 07:10:33.317795 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 07:10:33.317795 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 07:10:33.317795 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 07:10:33.317795 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 07:10:33.317795 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self.get_or_create( May 04 07:10:33.317795 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 07:10:33.317795 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application with Lock( May 04 07:10:33.317795 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 07:10:33.317795 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self._enter() May 04 07:10:33.317795 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 07:10:33.317795 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 07:10:33.318603 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 07:10:33.318603 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self.creator() May 04 07:10:33.318603 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 07:10:33.318603 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application created_value = creator( May 04 07:10:33.318603 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 07:10:33.318603 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 07:10:33.318603 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 07:10:33.318603 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 07:10:33.318603 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 07:10:33.318603 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 07:10:33.318603 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 04 07:10:33.318603 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application May 04 07:10:33.318603 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 187/383] 10.222.0.21 () {56 vars in 1099 bytes} [Wed May 4 07:10:33 2022] GET /identity/v3/roles/member => generated 84 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 07:10:33.324204 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433ae7f8-69a1-45c8-a434-faca41a8e491 None None] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:10:33.434477 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433ae7f8-69a1-45c8-a434-faca41a8e491 None None] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:10:33.468497 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62298c0-ca62-427e-8c0e-fc36cceb0427 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:10:33.469212 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62298c0-ca62-427e-8c0e-fc36cceb0427 None admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:10:33.469537 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62298c0-ca62-427e-8c0e-fc36cceb0427 None admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:10:33.469809 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62298c0-ca62-427e-8c0e-fc36cceb0427 None admin] PATH_INFO: `/v3/roles` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:10:33.470550 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62298c0-ca62-427e-8c0e-fc36cceb0427 None admin] RBAC: Adding query filter params (name=member) {{(pid=79744) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 07:10:33.470847 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62298c0-ca62-427e-8c0e-fc36cceb0427 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:10:33.472216 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62298c0-ca62-427e-8c0e-fc36cceb0427 None admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:10:33.480552 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 197/384] 10.222.0.21 () {56 vars in 1101 bytes} [Wed May 4 07:10:33 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 07:10:33.486145 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5534b51-aed2-4870-b9f0-cdc0458c29fd None admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:10:33.600383 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5534b51-aed2-4870-b9f0-cdc0458c29fd None admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:10:33.635809 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd84e575-c0f7-4fb6-8108-62e21d5e41d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:10:33.636657 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd84e575-c0f7-4fb6-8108-62e21d5e41d4 None admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:10:33.636932 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd84e575-c0f7-4fb6-8108-62e21d5e41d4 None admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:10:33.637340 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd84e575-c0f7-4fb6-8108-62e21d5e41d4 None admin] PATH_INFO: `/v3/groups/179d57b113554c28816eda00a2f83a37` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:10:33.638507 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd84e575-c0f7-4fb6-8108-62e21d5e41d4 None admin] RBAC: Authorizing `identity:get_group(group_id=179d57b113554c28816eda00a2f83a37)` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:10:33.640079 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd84e575-c0f7-4fb6-8108-62e21d5e41d4 None admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:10:33.641704 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 188/385] 10.222.0.21 () {56 vars in 1180 bytes} [Wed May 4 07:10:33 2022] GET /identity/v3/groups/179d57b113554c28816eda00a2f83a37 => generated 226 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 07:10:33.647127 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62298c0-ca62-427e-8c0e-fc36cceb0427 None admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:10:33.752724 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62298c0-ca62-427e-8c0e-fc36cceb0427 None admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:10:33.790049 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62203c10-f816-4bf2-b6fc-42752a717195 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:10:33.790914 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62203c10-f816-4bf2-b6fc-42752a717195 None admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:10:33.791208 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62203c10-f816-4bf2-b6fc-42752a717195 None admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:10:33.791478 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62203c10-f816-4bf2-b6fc-42752a717195 None admin] PATH_INFO: `/v3/projects/c1c61577200842b7bf6af16defd5fcbc` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:10:33.792651 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62203c10-f816-4bf2-b6fc-42752a717195 None admin] RBAC: Authorizing `identity:get_project(project_id=c1c61577200842b7bf6af16defd5fcbc)` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:10:33.794360 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62203c10-f816-4bf2-b6fc-42752a717195 None admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:10:33.796199 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 198/386] 10.222.0.21 () {56 vars in 1186 bytes} [Wed May 4 07:10:33 2022] GET /identity/v3/projects/c1c61577200842b7bf6af16defd5fcbc => generated 298 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 07:10:33.801953 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd84e575-c0f7-4fb6-8108-62e21d5e41d4 None admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:10:33.919226 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd84e575-c0f7-4fb6-8108-62e21d5e41d4 None admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:10:33.955950 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa47e8be-c0fd-4c60-a0de-165bdff217f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:10:33.956826 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa47e8be-c0fd-4c60-a0de-165bdff217f2 None admin] REQUEST_METHOD: `PUT` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:10:33.957097 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa47e8be-c0fd-4c60-a0de-165bdff217f2 None admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:10:33.957368 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa47e8be-c0fd-4c60-a0de-165bdff217f2 None admin] PATH_INFO: `/v3/projects/c1c61577200842b7bf6af16defd5fcbc/groups/179d57b113554c28816eda00a2f83a37/roles/9f89c07b05a14f18836116af22cba5f6` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:10:33.959330 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa47e8be-c0fd-4c60-a0de-165bdff217f2 None admin] RBAC: Authorizing `identity:create_grant(project_id=c1c61577200842b7bf6af16defd5fcbc, group_id=179d57b113554c28816eda00a2f83a37, role_id=9f89c07b05a14f18836116af22cba5f6)` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:10:33.960773 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa47e8be-c0fd-4c60-a0de-165bdff217f2 None admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:10:33.990214 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 189/387] 10.222.0.21 () {58 vars in 1442 bytes} [Wed May 4 07:10:33 2022] PUT /identity/v3/projects/c1c61577200842b7bf6af16defd5fcbc/groups/179d57b113554c28816eda00a2f83a37/roles/9f89c07b05a14f18836116af22cba5f6 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 07:10:34.044782 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cff1e6-e88e-4805-938c-02d7f369b409 None None] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:10:34.045142 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cff1e6-e88e-4805-938c-02d7f369b409 None None] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:10:34.045369 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cff1e6-e88e-4805-938c-02d7f369b409 None None] PATH_INFO: `/` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:10:34.046953 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 199/388] 10.222.0.21 () {54 vars in 926 bytes} [Wed May 4 07:10:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 07:10:34.052545 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8c5179-52f3-44ae-a1bc-22d890f62c63 None None] REQUEST_METHOD: `POST` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:10:34.053117 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8c5179-52f3-44ae-a1bc-22d890f62c63 None None] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:10:34.053117 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8c5179-52f3-44ae-a1bc-22d890f62c63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:10:34.071464 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.auth.core [None req-5d8c5179-52f3-44ae-a1bc-22d890f62c63 None None] MFA Rules not processed for user `83c5e0dcb991496ea6dee38384514508`. Rule list: `[]` (Enabled: `True`). {{(pid=79745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:10:34.072695 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.fernet_utils [None req-5d8c5179-52f3-44ae-a1bc-22d890f62c63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:10:34.160061 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 190/389] 10.222.0.21 () {58 vars in 1023 bytes} [Wed May 4 07:10:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 07:10:34.196570 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0cff1e6-e88e-4805-938c-02d7f369b409 None None] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:10:34.318459 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0cff1e6-e88e-4805-938c-02d7f369b409 None None] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:10:34.360324 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f90aa23-4748-4843-a07c-d39220d2f14f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:10:34.361145 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f90aa23-4748-4843-a07c-d39220d2f14f None admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:10:34.361418 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f90aa23-4748-4843-a07c-d39220d2f14f None admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:10:34.361686 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f90aa23-4748-4843-a07c-d39220d2f14f None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:10:34.373404 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f90aa23-4748-4843-a07c-d39220d2f14f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 07:10:34.382076 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application [None req-3f90aa23-4748-4843-a07c-d39220d2f14f None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 04 07:10:34.382076 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 07:10:34.382076 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 07:10:34.382076 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 07:10:34.382076 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 07:10:34.382076 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 07:10:34.382076 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 07:10:34.382076 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 07:10:34.382076 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 07:10:34.382076 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 07:10:34.382076 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 07:10:34.382076 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 07:10:34.382076 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 07:10:34.382076 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 07:10:34.382076 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 07:10:34.382076 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 07:10:34.383024 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 07:10:34.383024 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 07:10:34.383024 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 07:10:34.383024 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 07:10:34.383024 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 07:10:34.383024 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 07:10:34.383024 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 07:10:34.383024 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 07:10:34.383024 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 07:10:34.383024 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.get_or_create( May 04 07:10:34.383024 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 07:10:34.383024 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application with Lock( May 04 07:10:34.383024 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 07:10:34.383024 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self._enter() May 04 07:10:34.383024 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 07:10:34.383024 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 07:10:34.383898 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 07:10:34.383898 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.creator() May 04 07:10:34.383898 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 07:10:34.383898 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application created_value = creator( May 04 07:10:34.383898 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 07:10:34.383898 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 07:10:34.383898 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 07:10:34.383898 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 07:10:34.383898 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 07:10:34.383898 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 07:10:34.383898 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 04 07:10:34.383898 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application May 04 07:10:34.383898 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 200/390] 10.222.0.21 () {56 vars in 1114 bytes} [Wed May 4 07:10:34 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 07:10:34.392331 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8c5179-52f3-44ae-a1bc-22d890f62c63 None None] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:10:34.508649 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8c5179-52f3-44ae-a1bc-22d890f62c63 None None] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:10:34.530816 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac535b3-d86e-4df9-8801-e50ff5fd2fea None None] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:10:34.531121 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac535b3-d86e-4df9-8801-e50ff5fd2fea None None] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:10:34.531892 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac535b3-d86e-4df9-8801-e50ff5fd2fea None None] PATH_INFO: `/` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:10:34.533459 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 201/391] 10.222.0.21 () {54 vars in 926 bytes} [Wed May 4 07:10:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 04 07:10:34.538266 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac14fa40-8301-48c1-aaa1-fd8d19bfa4fc None None] REQUEST_METHOD: `POST` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:10:34.538538 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac14fa40-8301-48c1-aaa1-fd8d19bfa4fc None None] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:10:34.538814 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac14fa40-8301-48c1-aaa1-fd8d19bfa4fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:10:34.551504 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651710bb-f62b-48d8-8a3e-6c234b1e073b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:10:34.552549 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651710bb-f62b-48d8-8a3e-6c234b1e073b None admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:10:34.553046 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651710bb-f62b-48d8-8a3e-6c234b1e073b None admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:10:34.553514 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651710bb-f62b-48d8-8a3e-6c234b1e073b None admin] PATH_INFO: `/v3/roles` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:10:34.554489 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651710bb-f62b-48d8-8a3e-6c234b1e073b None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 07:10:34.555018 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651710bb-f62b-48d8-8a3e-6c234b1e073b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:10:34.556653 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651710bb-f62b-48d8-8a3e-6c234b1e073b None admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:10:34.558319 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.auth.core [None req-ac14fa40-8301-48c1-aaa1-fd8d19bfa4fc None None] MFA Rules not processed for user `83c5e0dcb991496ea6dee38384514508`. Rule list: `[]` (Enabled: `True`). {{(pid=79744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:10:34.560783 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.fernet_utils [None req-ac14fa40-8301-48c1-aaa1-fd8d19bfa4fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:10:34.578550 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 191/392] 10.222.0.21 () {56 vars in 1111 bytes} [Wed May 4 07:10:34 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 07:10:34.584351 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651710bb-f62b-48d8-8a3e-6c234b1e073b None admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:10:34.635509 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 202/393] 10.222.0.21 () {58 vars in 1023 bytes} [Wed May 4 07:10:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 04 07:10:34.654739 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac14fa40-8301-48c1-aaa1-fd8d19bfa4fc None None] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:10:34.755422 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac14fa40-8301-48c1-aaa1-fd8d19bfa4fc None None] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:10:34.800904 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26a5e0c-7c53-4d47-8a13-86ac53e159de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:10:34.801705 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26a5e0c-7c53-4d47-8a13-86ac53e159de None admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:10:34.801976 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26a5e0c-7c53-4d47-8a13-86ac53e159de None admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:10:34.802238 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26a5e0c-7c53-4d47-8a13-86ac53e159de None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:10:34.807198 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651710bb-f62b-48d8-8a3e-6c234b1e073b None admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:10:34.817488 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26a5e0c-7c53-4d47-8a13-86ac53e159de None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 07:10:34.828616 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application [None req-c26a5e0c-7c53-4d47-8a13-86ac53e159de None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 04 07:10:34.828616 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 07:10:34.828616 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 07:10:34.828616 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 07:10:34.828616 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 07:10:34.828616 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 07:10:34.828616 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 07:10:34.828616 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 07:10:34.828616 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 07:10:34.828616 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 07:10:34.828616 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 07:10:34.828616 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 07:10:34.828616 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 07:10:34.828616 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 07:10:34.828616 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 07:10:34.828616 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 07:10:34.829507 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 07:10:34.829507 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 07:10:34.829507 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 07:10:34.829507 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 07:10:34.829507 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 07:10:34.829507 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 07:10:34.829507 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 07:10:34.829507 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 07:10:34.829507 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 07:10:34.829507 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.get_or_create( May 04 07:10:34.829507 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 07:10:34.829507 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application with Lock( May 04 07:10:34.829507 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 07:10:34.829507 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self._enter() May 04 07:10:34.829507 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 07:10:34.829507 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 07:10:34.830399 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 07:10:34.830399 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.creator() May 04 07:10:34.830399 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 07:10:34.830399 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application created_value = creator( May 04 07:10:34.830399 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 07:10:34.830399 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 07:10:34.830399 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 07:10:34.830399 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 07:10:34.830399 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 07:10:34.830399 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 07:10:34.830399 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 04 07:10:34.830399 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application May 04 07:10:34.833284 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 203/394] 10.222.0.21 () {56 vars in 1114 bytes} [Wed May 4 07:10:34 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 07:10:34.834659 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa1a8f0-88e8-4490-877e-ab48477e2bc1 None None] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:10:34.835067 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa1a8f0-88e8-4490-877e-ab48477e2bc1 None None] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:10:34.835496 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa1a8f0-88e8-4490-877e-ab48477e2bc1 None None] PATH_INFO: `/` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:10:34.841882 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 204/395] 10.222.0.21 () {54 vars in 926 bytes} [Wed May 4 07:10:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 07:10:34.841882 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa1a8f0-88e8-4490-877e-ab48477e2bc1 None None] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:10:34.852059 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e3a814-0c81-4117-a5d8-553604ebc053 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:10:34.852957 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e3a814-0c81-4117-a5d8-553604ebc053 None admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:10:34.853236 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e3a814-0c81-4117-a5d8-553604ebc053 None admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:10:34.853504 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e3a814-0c81-4117-a5d8-553604ebc053 None admin] PATH_INFO: `/v3/groups/179d57b113554c28816eda00a2f83a37` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:10:34.854679 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e3a814-0c81-4117-a5d8-553604ebc053 None admin] RBAC: Authorizing `identity:get_group(group_id=179d57b113554c28816eda00a2f83a37)` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:10:34.856875 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e3a814-0c81-4117-a5d8-553604ebc053 None admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:10:34.858601 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 192/396] 10.222.0.21 () {56 vars in 1180 bytes} [Wed May 4 07:10:34 2022] GET /identity/v3/groups/179d57b113554c28816eda00a2f83a37 => generated 226 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 07:10:34.859895 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1739971-57b8-43df-a0e9-01e2dec3eb6f None None] REQUEST_METHOD: `POST` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:10:34.860177 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1739971-57b8-43df-a0e9-01e2dec3eb6f None None] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:10:34.860548 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1739971-57b8-43df-a0e9-01e2dec3eb6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:10:34.877062 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.auth.core [None req-b1739971-57b8-43df-a0e9-01e2dec3eb6f None None] MFA Rules not processed for user `83c5e0dcb991496ea6dee38384514508`. Rule list: `[]` (Enabled: `True`). {{(pid=79745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:10:34.878332 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.fernet_utils [None req-b1739971-57b8-43df-a0e9-01e2dec3eb6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:10:34.964763 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 193/397] 10.222.0.21 () {58 vars in 1023 bytes} [Wed May 4 07:10:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 07:10:34.966092 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1739971-57b8-43df-a0e9-01e2dec3eb6f None None] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:10:34.966362 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa1a8f0-88e8-4490-877e-ab48477e2bc1 None None] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:10:35.000513 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa52cf62-cca0-4657-be9a-e0576e62018e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:10:35.001232 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa52cf62-cca0-4657-be9a-e0576e62018e None admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:10:35.001520 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa52cf62-cca0-4657-be9a-e0576e62018e None admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:10:35.001793 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa52cf62-cca0-4657-be9a-e0576e62018e None admin] PATH_INFO: `/v3/roles` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:10:35.002586 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa52cf62-cca0-4657-be9a-e0576e62018e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79744) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 07:10:35.002896 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa52cf62-cca0-4657-be9a-e0576e62018e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:10:35.004289 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa52cf62-cca0-4657-be9a-e0576e62018e None admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:10:35.013706 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 205/398] 10.222.0.21 () {56 vars in 1111 bytes} [Wed May 4 07:10:34 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 07:10:35.014465 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa52cf62-cca0-4657-be9a-e0576e62018e None admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:10:35.069751 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1739971-57b8-43df-a0e9-01e2dec3eb6f None None] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:10:35.103101 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7651aab6-7d48-43c5-a026-e9da1ad22b76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:10:35.104006 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7651aab6-7d48-43c5-a026-e9da1ad22b76 None admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:10:35.104277 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7651aab6-7d48-43c5-a026-e9da1ad22b76 None admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:10:35.104542 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7651aab6-7d48-43c5-a026-e9da1ad22b76 None admin] PATH_INFO: `/v3/projects/c1c61577200842b7bf6af16defd5fcbc` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:10:35.105798 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7651aab6-7d48-43c5-a026-e9da1ad22b76 None admin] RBAC: Authorizing `identity:get_project(project_id=c1c61577200842b7bf6af16defd5fcbc)` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:10:35.107330 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7651aab6-7d48-43c5-a026-e9da1ad22b76 None admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:10:35.114363 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 194/399] 10.222.0.21 () {56 vars in 1186 bytes} [Wed May 4 07:10:34 2022] GET /identity/v3/projects/c1c61577200842b7bf6af16defd5fcbc => generated 298 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 07:10:35.115241 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7651aab6-7d48-43c5-a026-e9da1ad22b76 None admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:10:35.115767 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa52cf62-cca0-4657-be9a-e0576e62018e None admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:10:35.152370 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ee1e24-14de-44cc-a048-10401cc90210 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:10:35.153910 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ee1e24-14de-44cc-a048-10401cc90210 None admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:10:35.154192 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ee1e24-14de-44cc-a048-10401cc90210 None admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:10:35.154466 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ee1e24-14de-44cc-a048-10401cc90210 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:10:35.165250 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ee1e24-14de-44cc-a048-10401cc90210 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 07:10:35.173117 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application [None req-53ee1e24-14de-44cc-a048-10401cc90210 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 04 07:10:35.173117 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 07:10:35.173117 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 07:10:35.173117 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 07:10:35.173117 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 07:10:35.173117 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 07:10:35.173117 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 07:10:35.173117 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 07:10:35.173117 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 07:10:35.173117 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 07:10:35.173117 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 07:10:35.173117 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 07:10:35.173117 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 07:10:35.173117 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 07:10:35.173117 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 07:10:35.173117 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 07:10:35.175259 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 07:10:35.175259 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 07:10:35.175259 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 07:10:35.175259 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 07:10:35.175259 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 07:10:35.175259 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 07:10:35.175259 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 07:10:35.175259 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 07:10:35.175259 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 07:10:35.175259 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.get_or_create( May 04 07:10:35.175259 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 07:10:35.175259 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application with Lock( May 04 07:10:35.175259 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 07:10:35.175259 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self._enter() May 04 07:10:35.175259 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 07:10:35.175259 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 07:10:35.177339 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 07:10:35.177339 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.creator() May 04 07:10:35.177339 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 07:10:35.177339 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application created_value = creator( May 04 07:10:35.177339 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 07:10:35.177339 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 07:10:35.177339 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 07:10:35.177339 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 07:10:35.177339 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 07:10:35.177339 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 07:10:35.177339 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 04 07:10:35.177339 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application May 04 07:10:35.177339 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 206/400] 10.222.0.21 () {56 vars in 1099 bytes} [Wed May 4 07:10:35 2022] GET /identity/v3/roles/member => generated 84 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 07:10:35.177339 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ee1e24-14de-44cc-a048-10401cc90210 None admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:10:35.217868 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7651aab6-7d48-43c5-a026-e9da1ad22b76 None admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:10:35.252249 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741b5ece-6876-42be-8e5f-280d55114408 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:10:35.253148 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741b5ece-6876-42be-8e5f-280d55114408 None admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:10:35.253424 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741b5ece-6876-42be-8e5f-280d55114408 None admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:10:35.253693 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741b5ece-6876-42be-8e5f-280d55114408 None admin] PATH_INFO: `/v3/groups/179d57b113554c28816eda00a2f83a37` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:10:35.254911 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741b5ece-6876-42be-8e5f-280d55114408 None admin] RBAC: Authorizing `identity:get_group(group_id=179d57b113554c28816eda00a2f83a37)` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:10:35.256467 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741b5ece-6876-42be-8e5f-280d55114408 None admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:10:35.258324 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 195/401] 10.222.0.21 () {56 vars in 1180 bytes} [Wed May 4 07:10:35 2022] GET /identity/v3/groups/179d57b113554c28816eda00a2f83a37 => generated 226 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 07:10:35.259094 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741b5ece-6876-42be-8e5f-280d55114408 None admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:10:35.280221 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ee1e24-14de-44cc-a048-10401cc90210 None admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:10:35.314527 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7b375f-f0b8-407a-9f05-9f83d4a08473 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:10:35.315452 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7b375f-f0b8-407a-9f05-9f83d4a08473 None admin] REQUEST_METHOD: `PUT` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:10:35.315732 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7b375f-f0b8-407a-9f05-9f83d4a08473 None admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:10:35.316011 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7b375f-f0b8-407a-9f05-9f83d4a08473 None admin] PATH_INFO: `/v3/projects/c1c61577200842b7bf6af16defd5fcbc/groups/179d57b113554c28816eda00a2f83a37/roles/91b8526a43a4426a883870ad97362652` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:10:35.318292 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7b375f-f0b8-407a-9f05-9f83d4a08473 None admin] RBAC: Authorizing `identity:create_grant(project_id=c1c61577200842b7bf6af16defd5fcbc, group_id=179d57b113554c28816eda00a2f83a37, role_id=91b8526a43a4426a883870ad97362652)` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:10:35.319767 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7b375f-f0b8-407a-9f05-9f83d4a08473 None admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:10:35.337720 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 207/402] 10.222.0.21 () {58 vars in 1442 bytes} [Wed May 4 07:10:35 2022] PUT /identity/v3/projects/c1c61577200842b7bf6af16defd5fcbc/groups/179d57b113554c28816eda00a2f83a37/roles/91b8526a43a4426a883870ad97362652 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 07:10:35.338690 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7b375f-f0b8-407a-9f05-9f83d4a08473 None admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:10:35.410015 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741b5ece-6876-42be-8e5f-280d55114408 None admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:10:35.487026 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7baaef1-20a2-4b8f-947c-34784cf94796 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:10:35.487792 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7baaef1-20a2-4b8f-947c-34784cf94796 None admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:10:35.488081 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7baaef1-20a2-4b8f-947c-34784cf94796 None admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:10:35.488358 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7baaef1-20a2-4b8f-947c-34784cf94796 None admin] PATH_INFO: `/v3/roles` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:10:35.489468 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7baaef1-20a2-4b8f-947c-34784cf94796 None admin] RBAC: Adding query filter params (name=member) {{(pid=79745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 07:10:35.489784 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7baaef1-20a2-4b8f-947c-34784cf94796 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:10:35.492530 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7baaef1-20a2-4b8f-947c-34784cf94796 None admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:10:35.507567 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 196/403] 10.222.0.21 () {56 vars in 1101 bytes} [Wed May 4 07:10:35 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 07:10:35.514565 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7b375f-f0b8-407a-9f05-9f83d4a08473 None admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:10:35.517108 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7baaef1-20a2-4b8f-947c-34784cf94796 None admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:10:35.579551 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b41846-e653-47bb-913b-b019700674ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:10:35.580797 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b41846-e653-47bb-913b-b019700674ca None admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:10:35.581281 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b41846-e653-47bb-913b-b019700674ca None admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:10:35.581752 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b41846-e653-47bb-913b-b019700674ca None admin] PATH_INFO: `/v3/projects/c3c877aea85b47dea9daa6ab598d831f` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:10:35.583244 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b41846-e653-47bb-913b-b019700674ca None admin] RBAC: Authorizing `identity:get_project(project_id=c3c877aea85b47dea9daa6ab598d831f)` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:10:35.584888 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b41846-e653-47bb-913b-b019700674ca None admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:10:35.587134 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 208/404] 10.222.0.21 () {56 vars in 1186 bytes} [Wed May 4 07:10:35 2022] GET /identity/v3/projects/c3c877aea85b47dea9daa6ab598d831f => generated 302 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 07:10:35.593642 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b41846-e653-47bb-913b-b019700674ca None admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:10:35.634986 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7baaef1-20a2-4b8f-947c-34784cf94796 None admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:10:35.669151 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec70249-04b5-4e9a-840e-00a182a75a60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:10:35.670372 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec70249-04b5-4e9a-840e-00a182a75a60 None admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:10:35.670850 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec70249-04b5-4e9a-840e-00a182a75a60 None admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:10:35.671358 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec70249-04b5-4e9a-840e-00a182a75a60 None admin] PATH_INFO: `/v3/groups/179d57b113554c28816eda00a2f83a37` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:10:35.672770 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec70249-04b5-4e9a-840e-00a182a75a60 None admin] RBAC: Authorizing `identity:get_group(group_id=179d57b113554c28816eda00a2f83a37)` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:10:35.674393 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec70249-04b5-4e9a-840e-00a182a75a60 None admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:10:35.676579 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 197/405] 10.222.0.21 () {56 vars in 1180 bytes} [Wed May 4 07:10:35 2022] GET /identity/v3/groups/179d57b113554c28816eda00a2f83a37 => generated 226 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 07:10:35.682013 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec70249-04b5-4e9a-840e-00a182a75a60 None admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:10:35.742956 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b41846-e653-47bb-913b-b019700674ca None admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:10:35.782842 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec70249-04b5-4e9a-840e-00a182a75a60 None admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:10:35.816769 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87de2ad3-bf56-434e-839a-2c722067edb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:10:35.817658 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87de2ad3-bf56-434e-839a-2c722067edb8 None admin] REQUEST_METHOD: `PUT` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:10:35.817938 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87de2ad3-bf56-434e-839a-2c722067edb8 None admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:10:35.818210 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87de2ad3-bf56-434e-839a-2c722067edb8 None admin] PATH_INFO: `/v3/projects/c3c877aea85b47dea9daa6ab598d831f/groups/179d57b113554c28816eda00a2f83a37/roles/91b8526a43a4426a883870ad97362652` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:10:35.818578 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5020fd-019f-44f9-b36c-878fa99dfbdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:10:35.819986 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5020fd-019f-44f9-b36c-878fa99dfbdf None admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:10:35.820479 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5020fd-019f-44f9-b36c-878fa99dfbdf None admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:10:35.820954 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5020fd-019f-44f9-b36c-878fa99dfbdf None admin] PATH_INFO: `/v3/projects/c3c877aea85b47dea9daa6ab598d831f` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:10:35.822351 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5020fd-019f-44f9-b36c-878fa99dfbdf None admin] RBAC: Authorizing `identity:get_project(project_id=c3c877aea85b47dea9daa6ab598d831f)` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:10:35.824224 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5020fd-019f-44f9-b36c-878fa99dfbdf None admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:10:35.826403 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87de2ad3-bf56-434e-839a-2c722067edb8 None admin] RBAC: Authorizing `identity:create_grant(project_id=c3c877aea85b47dea9daa6ab598d831f, group_id=179d57b113554c28816eda00a2f83a37, role_id=91b8526a43a4426a883870ad97362652)` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:10:35.826977 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 198/406] 10.222.0.21 () {56 vars in 1186 bytes} [Wed May 4 07:10:35 2022] GET /identity/v3/projects/c3c877aea85b47dea9daa6ab598d831f => generated 302 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 07:10:35.831280 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87de2ad3-bf56-434e-839a-2c722067edb8 None admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:10:35.833032 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5020fd-019f-44f9-b36c-878fa99dfbdf None admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:10:35.862115 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 209/407] 10.222.0.21 () {58 vars in 1442 bytes} [Wed May 4 07:10:35 2022] PUT /identity/v3/projects/c3c877aea85b47dea9daa6ab598d831f/groups/179d57b113554c28816eda00a2f83a37/roles/91b8526a43a4426a883870ad97362652 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 07:10:35.948900 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5020fd-019f-44f9-b36c-878fa99dfbdf None admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:10:35.984681 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbea4171-939e-4dac-9ea2-905ce2f6eb62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:10:35.985950 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbea4171-939e-4dac-9ea2-905ce2f6eb62 None admin] REQUEST_METHOD: `PUT` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:10:35.986432 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbea4171-939e-4dac-9ea2-905ce2f6eb62 None admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:10:35.986904 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbea4171-939e-4dac-9ea2-905ce2f6eb62 None admin] PATH_INFO: `/v3/projects/c3c877aea85b47dea9daa6ab598d831f/groups/179d57b113554c28816eda00a2f83a37/roles/9f89c07b05a14f18836116af22cba5f6` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:10:35.989320 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbea4171-939e-4dac-9ea2-905ce2f6eb62 None admin] RBAC: Authorizing `identity:create_grant(project_id=c3c877aea85b47dea9daa6ab598d831f, group_id=179d57b113554c28816eda00a2f83a37, role_id=9f89c07b05a14f18836116af22cba5f6)` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:10:35.990972 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbea4171-939e-4dac-9ea2-905ce2f6eb62 None admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:10:36.006751 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 199/408] 10.222.0.21 () {58 vars in 1442 bytes} [Wed May 4 07:10:35 2022] PUT /identity/v3/projects/c3c877aea85b47dea9daa6ab598d831f/groups/179d57b113554c28816eda00a2f83a37/roles/9f89c07b05a14f18836116af22cba5f6 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 07:10:36.195615 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c106109d-2bbc-49a0-8d41-7dbd4203e3f6 None None] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:10:36.195803 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c106109d-2bbc-49a0-8d41-7dbd4203e3f6 None None] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:10:36.196085 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c106109d-2bbc-49a0-8d41-7dbd4203e3f6 None None] PATH_INFO: `/` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:10:36.197858 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 210/409] 10.222.0.21 () {54 vars in 926 bytes} [Wed May 4 07:10:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 07:10:36.205029 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b284bbf7-c767-4d74-8940-94f1bf1356dd None None] REQUEST_METHOD: `POST` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:10:36.205972 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b284bbf7-c767-4d74-8940-94f1bf1356dd None None] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:10:36.206449 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b284bbf7-c767-4d74-8940-94f1bf1356dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:10:36.237417 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.auth.core [None req-b284bbf7-c767-4d74-8940-94f1bf1356dd None None] MFA Rules not processed for user `83c5e0dcb991496ea6dee38384514508`. Rule list: `[]` (Enabled: `True`). {{(pid=79745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:10:36.239045 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.fernet_utils [None req-b284bbf7-c767-4d74-8940-94f1bf1356dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:10:36.311386 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 200/410] 10.222.0.21 () {58 vars in 1023 bytes} [Wed May 4 07:10:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 04 07:10:36.345902 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c106109d-2bbc-49a0-8d41-7dbd4203e3f6 None None] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:10:36.455178 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c106109d-2bbc-49a0-8d41-7dbd4203e3f6 None None] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:10:36.488118 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8337d2c1-1108-489c-8c78-ffdb64d5a53b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:10:36.488911 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8337d2c1-1108-489c-8c78-ffdb64d5a53b None admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:10:36.489191 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8337d2c1-1108-489c-8c78-ffdb64d5a53b None admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:10:36.489463 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8337d2c1-1108-489c-8c78-ffdb64d5a53b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:10:36.500608 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8337d2c1-1108-489c-8c78-ffdb64d5a53b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 07:10:36.508540 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application [None req-8337d2c1-1108-489c-8c78-ffdb64d5a53b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 04 07:10:36.508540 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 07:10:36.508540 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 07:10:36.508540 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 07:10:36.508540 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 07:10:36.508540 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 07:10:36.508540 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 07:10:36.508540 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 07:10:36.508540 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 07:10:36.508540 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 07:10:36.508540 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 07:10:36.508540 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 07:10:36.508540 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 07:10:36.508540 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 07:10:36.508540 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 07:10:36.508540 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 07:10:36.509442 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 07:10:36.509442 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 07:10:36.509442 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 07:10:36.509442 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 07:10:36.509442 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 07:10:36.509442 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 07:10:36.509442 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 07:10:36.509442 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 07:10:36.509442 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 07:10:36.509442 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.get_or_create( May 04 07:10:36.509442 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 07:10:36.509442 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application with Lock( May 04 07:10:36.509442 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 07:10:36.509442 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self._enter() May 04 07:10:36.509442 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 07:10:36.509442 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 07:10:36.510259 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 07:10:36.510259 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.creator() May 04 07:10:36.510259 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 07:10:36.510259 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application created_value = creator( May 04 07:10:36.510259 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 07:10:36.510259 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 07:10:36.510259 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 07:10:36.510259 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 07:10:36.510259 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 07:10:36.510259 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 07:10:36.510259 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 04 07:10:36.510259 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application May 04 07:10:36.510259 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 211/411] 10.222.0.21 () {56 vars in 1096 bytes} [Wed May 4 07:10:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 07:10:36.520083 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b284bbf7-c767-4d74-8940-94f1bf1356dd None None] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:10:36.663175 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b284bbf7-c767-4d74-8940-94f1bf1356dd None None] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:10:36.714037 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9399e18-4f11-4906-93e6-f0f5dfc48d38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:10:36.715019 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9399e18-4f11-4906-93e6-f0f5dfc48d38 None admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:10:36.715688 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9399e18-4f11-4906-93e6-f0f5dfc48d38 None admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:10:36.716139 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9399e18-4f11-4906-93e6-f0f5dfc48d38 None admin] PATH_INFO: `/v3/roles` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:10:36.717114 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9399e18-4f11-4906-93e6-f0f5dfc48d38 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 07:10:36.717607 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9399e18-4f11-4906-93e6-f0f5dfc48d38 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:10:36.719247 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9399e18-4f11-4906-93e6-f0f5dfc48d38 None admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:10:36.731605 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 201/412] 10.222.0.21 () {56 vars in 1099 bytes} [Wed May 4 07:10:36 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 07:10:36.737266 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8337d2c1-1108-489c-8c78-ffdb64d5a53b None admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:10:36.865442 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8337d2c1-1108-489c-8c78-ffdb64d5a53b None admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:10:36.914619 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8cb2471-8ede-4853-9b44-5bb61e1232b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:10:36.915507 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cb2471-8ede-4853-9b44-5bb61e1232b3 None admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:10:36.915788 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cb2471-8ede-4853-9b44-5bb61e1232b3 None admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:10:36.916062 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cb2471-8ede-4853-9b44-5bb61e1232b3 None admin] PATH_INFO: `/v3/groups/4d59d0196e0d45d4a737dc3e0c320743` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:10:36.917260 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8cb2471-8ede-4853-9b44-5bb61e1232b3 None admin] RBAC: Authorizing `identity:get_group(group_id=4d59d0196e0d45d4a737dc3e0c320743)` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:10:36.918732 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8cb2471-8ede-4853-9b44-5bb61e1232b3 None admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:10:36.920469 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 212/413] 10.222.0.21 () {56 vars in 1180 bytes} [Wed May 4 07:10:36 2022] GET /identity/v3/groups/4d59d0196e0d45d4a737dc3e0c320743 => generated 229 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 07:10:36.926273 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9399e18-4f11-4906-93e6-f0f5dfc48d38 None admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:10:37.005192 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d894f53-4601-4079-b042-5bce3a851f47 None None] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:10:37.005481 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d894f53-4601-4079-b042-5bce3a851f47 None None] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:10:37.005675 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d894f53-4601-4079-b042-5bce3a851f47 None None] PATH_INFO: `/` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:10:37.007308 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 213/414] 10.222.0.21 () {54 vars in 926 bytes} [Wed May 4 07:10:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 07:10:37.013050 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96132c4e-07d4-43b4-b605-ee038b694bcf None None] REQUEST_METHOD: `POST` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:10:37.013333 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96132c4e-07d4-43b4-b605-ee038b694bcf None None] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:10:37.013610 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96132c4e-07d4-43b4-b605-ee038b694bcf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:10:37.048185 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.auth.core [None req-96132c4e-07d4-43b4-b605-ee038b694bcf None None] MFA Rules not processed for user `83c5e0dcb991496ea6dee38384514508`. Rule list: `[]` (Enabled: `True`). {{(pid=79744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:10:37.049395 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.fernet_utils [None req-96132c4e-07d4-43b4-b605-ee038b694bcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:10:37.052467 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9399e18-4f11-4906-93e6-f0f5dfc48d38 None admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:10:37.085430 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5c1b79-ecc1-4d48-ad09-7d3f91771e60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:10:37.086296 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5c1b79-ecc1-4d48-ad09-7d3f91771e60 None admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:10:37.086571 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5c1b79-ecc1-4d48-ad09-7d3f91771e60 None admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:10:37.086843 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5c1b79-ecc1-4d48-ad09-7d3f91771e60 None admin] PATH_INFO: `/v3/projects/42382f8dc1ee4162906b55d85040da7b` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:10:37.088054 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5c1b79-ecc1-4d48-ad09-7d3f91771e60 None admin] RBAC: Authorizing `identity:get_project(project_id=42382f8dc1ee4162906b55d85040da7b)` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:10:37.089505 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5c1b79-ecc1-4d48-ad09-7d3f91771e60 None admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:10:37.092294 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 202/415] 10.222.0.21 () {56 vars in 1186 bytes} [Wed May 4 07:10:36 2022] GET /identity/v3/projects/42382f8dc1ee4162906b55d85040da7b => generated 344 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 07:10:37.099827 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5c1b79-ecc1-4d48-ad09-7d3f91771e60 None admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:10:37.136050 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 214/416] 10.222.0.21 () {58 vars in 1023 bytes} [Wed May 4 07:10:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 04 07:10:37.167283 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96132c4e-07d4-43b4-b605-ee038b694bcf None None] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:10:37.232315 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5c1b79-ecc1-4d48-ad09-7d3f91771e60 None admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:10:37.277524 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a30756c-63be-4b8c-b5df-331455529413 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:10:37.279624 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a30756c-63be-4b8c-b5df-331455529413 None admin] REQUEST_METHOD: `PUT` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:10:37.279907 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a30756c-63be-4b8c-b5df-331455529413 None admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:10:37.280311 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a30756c-63be-4b8c-b5df-331455529413 None admin] PATH_INFO: `/v3/projects/42382f8dc1ee4162906b55d85040da7b/groups/4d59d0196e0d45d4a737dc3e0c320743/roles/eb54c9cea2774a25b1fe8c79724408ee` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:10:37.285159 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a30756c-63be-4b8c-b5df-331455529413 None admin] RBAC: Authorizing `identity:create_grant(project_id=42382f8dc1ee4162906b55d85040da7b, group_id=4d59d0196e0d45d4a737dc3e0c320743, role_id=eb54c9cea2774a25b1fe8c79724408ee)` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:10:37.286618 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a30756c-63be-4b8c-b5df-331455529413 None admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:10:37.316856 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 203/417] 10.222.0.21 () {58 vars in 1442 bytes} [Wed May 4 07:10:37 2022] PUT /identity/v3/projects/42382f8dc1ee4162906b55d85040da7b/groups/4d59d0196e0d45d4a737dc3e0c320743/roles/eb54c9cea2774a25b1fe8c79724408ee => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 07:10:37.346692 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96132c4e-07d4-43b4-b605-ee038b694bcf None None] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:10:37.384961 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ebf681-bccb-404d-86e2-29b807af5dfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:10:37.385785 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ebf681-bccb-404d-86e2-29b807af5dfd None admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:10:37.386066 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ebf681-bccb-404d-86e2-29b807af5dfd None admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:10:37.386340 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ebf681-bccb-404d-86e2-29b807af5dfd None admin] PATH_INFO: `/v3/roles/member` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:10:37.398421 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ebf681-bccb-404d-86e2-29b807af5dfd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 07:10:37.406750 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application [None req-a4ebf681-bccb-404d-86e2-29b807af5dfd None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 04 07:10:37.406750 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 07:10:37.406750 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 07:10:37.406750 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 07:10:37.406750 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 07:10:37.406750 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 07:10:37.406750 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 07:10:37.406750 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 07:10:37.406750 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 07:10:37.406750 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 07:10:37.406750 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 07:10:37.406750 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 07:10:37.406750 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 07:10:37.406750 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 07:10:37.406750 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 07:10:37.406750 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 07:10:37.407876 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 07:10:37.407876 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 07:10:37.407876 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 07:10:37.407876 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 07:10:37.407876 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 07:10:37.407876 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 07:10:37.407876 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 07:10:37.407876 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 07:10:37.407876 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 07:10:37.407876 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.get_or_create( May 04 07:10:37.407876 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 07:10:37.407876 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application with Lock( May 04 07:10:37.407876 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 07:10:37.407876 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self._enter() May 04 07:10:37.407876 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 07:10:37.407876 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 07:10:37.408675 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 07:10:37.408675 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.creator() May 04 07:10:37.408675 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 07:10:37.408675 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application created_value = creator( May 04 07:10:37.408675 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 07:10:37.408675 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 07:10:37.408675 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 07:10:37.408675 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 07:10:37.408675 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 07:10:37.408675 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 07:10:37.408675 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 04 07:10:37.408675 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application May 04 07:10:37.408675 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 215/418] 10.222.0.21 () {56 vars in 1099 bytes} [Wed May 4 07:10:37 2022] GET /identity/v3/roles/member => generated 84 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 07:10:37.416563 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a30756c-63be-4b8c-b5df-331455529413 None admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:10:37.557879 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a30756c-63be-4b8c-b5df-331455529413 None admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:10:37.593379 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1ac56d-8271-4e3b-8763-39855dfa6b21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:10:37.594059 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1ac56d-8271-4e3b-8763-39855dfa6b21 None admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:10:37.594341 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1ac56d-8271-4e3b-8763-39855dfa6b21 None admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:10:37.594620 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1ac56d-8271-4e3b-8763-39855dfa6b21 None admin] PATH_INFO: `/v3/roles` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:10:37.595410 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1ac56d-8271-4e3b-8763-39855dfa6b21 None admin] RBAC: Adding query filter params (name=member) {{(pid=79745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 07:10:37.595721 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1ac56d-8271-4e3b-8763-39855dfa6b21 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:10:37.597111 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1ac56d-8271-4e3b-8763-39855dfa6b21 None admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:10:37.607085 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 204/419] 10.222.0.21 () {56 vars in 1101 bytes} [Wed May 4 07:10:37 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 07:10:37.612934 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ebf681-bccb-404d-86e2-29b807af5dfd None admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:10:37.716447 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ebf681-bccb-404d-86e2-29b807af5dfd None admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:10:37.750797 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ceec27-47e6-4240-9bd8-5d17231cc04b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:10:37.751466 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ceec27-47e6-4240-9bd8-5d17231cc04b None admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:10:37.751746 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ceec27-47e6-4240-9bd8-5d17231cc04b None admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:10:37.752022 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ceec27-47e6-4240-9bd8-5d17231cc04b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:10:37.820373 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ceec27-47e6-4240-9bd8-5d17231cc04b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:10:37.821744 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ceec27-47e6-4240-9bd8-5d17231cc04b None admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:10:37.922729 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 216/420] 10.222.0.21 () {58 vars in 1282 bytes} [Wed May 4 07:10:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 04 07:10:37.928451 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1ac56d-8271-4e3b-8763-39855dfa6b21 None admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:10:38.053107 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1ac56d-8271-4e3b-8763-39855dfa6b21 None admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:10:38.099778 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6ea2d6-eb2d-445b-aa4b-f4469a029b2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:10:38.100492 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6ea2d6-eb2d-445b-aa4b-f4469a029b2f None admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:10:38.100771 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6ea2d6-eb2d-445b-aa4b-f4469a029b2f None admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:10:38.101041 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6ea2d6-eb2d-445b-aa4b-f4469a029b2f None admin] PATH_INFO: `/v3/projects/c1c61577200842b7bf6af16defd5fcbc` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:10:38.107898 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6ea2d6-eb2d-445b-aa4b-f4469a029b2f None admin] RBAC: Authorizing `identity:get_project(project_id=c1c61577200842b7bf6af16defd5fcbc)` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:10:38.109348 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6ea2d6-eb2d-445b-aa4b-f4469a029b2f None admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:10:38.111425 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 205/421] 10.222.0.21 () {56 vars in 1186 bytes} [Wed May 4 07:10:37 2022] GET /identity/v3/projects/c1c61577200842b7bf6af16defd5fcbc => generated 298 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 07:10:38.116969 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ceec27-47e6-4240-9bd8-5d17231cc04b None admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:10:38.219786 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ceec27-47e6-4240-9bd8-5d17231cc04b None admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:10:38.255058 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d1afba-c0cd-4715-b957-4886860e02e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:10:38.255938 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d1afba-c0cd-4715-b957-4886860e02e2 None admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:10:38.256216 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d1afba-c0cd-4715-b957-4886860e02e2 None admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:10:38.256486 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d1afba-c0cd-4715-b957-4886860e02e2 None admin] PATH_INFO: `/v3/groups/179d57b113554c28816eda00a2f83a37` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:10:38.257912 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d1afba-c0cd-4715-b957-4886860e02e2 None admin] RBAC: Authorizing `identity:get_group(group_id=179d57b113554c28816eda00a2f83a37)` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:10:38.259421 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d1afba-c0cd-4715-b957-4886860e02e2 None admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:10:38.261384 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 217/422] 10.222.0.21 () {56 vars in 1180 bytes} [Wed May 4 07:10:38 2022] GET /identity/v3/groups/179d57b113554c28816eda00a2f83a37 => generated 226 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 07:10:38.267889 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6ea2d6-eb2d-445b-aa4b-f4469a029b2f None admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:10:38.337082 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b42f978-e051-4ed7-9abe-385e50b0b84d None None] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:10:38.337401 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b42f978-e051-4ed7-9abe-385e50b0b84d None None] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:10:38.337633 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b42f978-e051-4ed7-9abe-385e50b0b84d None None] PATH_INFO: `/` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:10:38.339039 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 218/423] 10.222.0.21 () {54 vars in 926 bytes} [Wed May 4 07:10:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 04 07:10:38.344524 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8cb0b4-7752-4ec9-bd44-086d3c614210 None None] REQUEST_METHOD: `POST` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:10:38.344808 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8cb0b4-7752-4ec9-bd44-086d3c614210 None None] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:10:38.345086 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8cb0b4-7752-4ec9-bd44-086d3c614210 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:10:38.372807 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.auth.core [None req-8d8cb0b4-7752-4ec9-bd44-086d3c614210 None None] MFA Rules not processed for user `83c5e0dcb991496ea6dee38384514508`. Rule list: `[]` (Enabled: `True`). {{(pid=79744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:10:38.373929 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.fernet_utils [None req-8d8cb0b4-7752-4ec9-bd44-086d3c614210 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:10:38.433740 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6ea2d6-eb2d-445b-aa4b-f4469a029b2f None admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:10:38.479678 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 219/424] 10.222.0.21 () {58 vars in 1023 bytes} [Wed May 4 07:10:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 07:10:38.493054 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2768219-ced4-4512-93c7-c227adb7b39a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:10:38.493722 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2768219-ced4-4512-93c7-c227adb7b39a None admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:10:38.493997 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2768219-ced4-4512-93c7-c227adb7b39a None admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:10:38.494275 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2768219-ced4-4512-93c7-c227adb7b39a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:10:38.495124 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2768219-ced4-4512-93c7-c227adb7b39a None admin] RBAC: Adding query filter params (group.id=179d57b113554c28816eda00a2f83a37, role.id=9f89c07b05a14f18836116af22cba5f6, scope.project.id=c1c61577200842b7bf6af16defd5fcbc) {{(pid=79745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 07:10:38.495467 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2768219-ced4-4512-93c7-c227adb7b39a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:10:38.497817 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2768219-ced4-4512-93c7-c227adb7b39a None admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:10:38.504554 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 206/425] 10.222.0.21 () {56 vars in 1376 bytes} [Wed May 4 07:10:38 2022] GET /identity/v3/role_assignments?group.id=179d57b113554c28816eda00a2f83a37&scope.project.id=c1c61577200842b7bf6af16defd5fcbc&role.id=9f89c07b05a14f18836116af22cba5f6 => generated 611 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 07:10:38.519776 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8cb0b4-7752-4ec9-bd44-086d3c614210 None None] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:10:38.616465 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c709e52-be91-4bbb-95ef-d7e56fca8065 None None] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:10:38.616817 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c709e52-be91-4bbb-95ef-d7e56fca8065 None None] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:10:38.617022 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c709e52-be91-4bbb-95ef-d7e56fca8065 None None] PATH_INFO: `/` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:10:38.618671 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 207/426] 10.222.0.21 () {54 vars in 926 bytes} [Wed May 4 07:10:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 07:10:38.625506 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc54cbfa-5cf7-49cd-8d2a-50bede1bcab7 None None] REQUEST_METHOD: `POST` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:10:38.625771 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc54cbfa-5cf7-49cd-8d2a-50bede1bcab7 None None] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:10:38.625990 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc54cbfa-5cf7-49cd-8d2a-50bede1bcab7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:10:38.630487 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8cb0b4-7752-4ec9-bd44-086d3c614210 None None] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:10:38.672317 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91533a44-a694-4774-ae38-61ded6358093 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:10:38.673141 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91533a44-a694-4774-ae38-61ded6358093 None admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:10:38.673423 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91533a44-a694-4774-ae38-61ded6358093 None admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:10:38.673695 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91533a44-a694-4774-ae38-61ded6358093 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:10:38.680280 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.auth.core [None req-dc54cbfa-5cf7-49cd-8d2a-50bede1bcab7 None None] MFA Rules not processed for user `83c5e0dcb991496ea6dee38384514508`. Rule list: `[]` (Enabled: `True`). {{(pid=79745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:10:38.681515 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.fernet_utils [None req-dc54cbfa-5cf7-49cd-8d2a-50bede1bcab7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:10:38.686899 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91533a44-a694-4774-ae38-61ded6358093 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 07:10:38.695499 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application [None req-91533a44-a694-4774-ae38-61ded6358093 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 04 07:10:38.695499 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 07:10:38.695499 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 07:10:38.695499 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 07:10:38.695499 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 07:10:38.695499 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 07:10:38.695499 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 07:10:38.695499 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 07:10:38.695499 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 07:10:38.695499 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 07:10:38.695499 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 07:10:38.695499 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 07:10:38.695499 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 07:10:38.695499 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 07:10:38.695499 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 07:10:38.695499 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 07:10:38.696638 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 07:10:38.696638 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 07:10:38.696638 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 07:10:38.696638 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 07:10:38.696638 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 07:10:38.696638 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 07:10:38.696638 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 07:10:38.696638 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 07:10:38.696638 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 07:10:38.696638 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.get_or_create( May 04 07:10:38.696638 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 07:10:38.696638 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application with Lock( May 04 07:10:38.696638 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 07:10:38.696638 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self._enter() May 04 07:10:38.696638 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 07:10:38.696638 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 07:10:38.697623 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 07:10:38.697623 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.creator() May 04 07:10:38.697623 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 07:10:38.697623 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application created_value = creator( May 04 07:10:38.697623 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 07:10:38.697623 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 07:10:38.697623 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 07:10:38.697623 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 07:10:38.697623 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 07:10:38.697623 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 07:10:38.697623 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 04 07:10:38.697623 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application May 04 07:10:38.700199 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 220/427] 10.222.0.21 () {56 vars in 1114 bytes} [Wed May 4 07:10:38 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 07:10:38.706149 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91533a44-a694-4774-ae38-61ded6358093 None admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:10:38.801241 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 208/428] 10.222.0.21 () {58 vars in 1023 bytes} [Wed May 4 07:10:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 04 07:10:38.825795 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc54cbfa-5cf7-49cd-8d2a-50bede1bcab7 None None] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:10:38.861704 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91533a44-a694-4774-ae38-61ded6358093 None admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:10:38.901987 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73cd228-cc21-42bf-ada7-57543b929dad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:10:38.903517 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73cd228-cc21-42bf-ada7-57543b929dad None admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:10:38.904021 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73cd228-cc21-42bf-ada7-57543b929dad None admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:10:38.904489 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73cd228-cc21-42bf-ada7-57543b929dad None admin] PATH_INFO: `/v3/roles` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:10:38.905508 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73cd228-cc21-42bf-ada7-57543b929dad None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79744) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 07:10:38.906008 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73cd228-cc21-42bf-ada7-57543b929dad None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:10:38.907710 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73cd228-cc21-42bf-ada7-57543b929dad None admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:10:38.919226 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 221/429] 10.222.0.21 () {56 vars in 1111 bytes} [Wed May 4 07:10:38 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 07:10:38.924987 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73cd228-cc21-42bf-ada7-57543b929dad None admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:10:38.947313 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc54cbfa-5cf7-49cd-8d2a-50bede1bcab7 None None] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:10:38.985015 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5b9273-7f09-43c8-a94b-a6844b11d004 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:10:38.985816 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5b9273-7f09-43c8-a94b-a6844b11d004 None admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:10:38.986096 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5b9273-7f09-43c8-a94b-a6844b11d004 None admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:10:38.986366 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5b9273-7f09-43c8-a94b-a6844b11d004 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:10:38.996919 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5b9273-7f09-43c8-a94b-a6844b11d004 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 07:10:39.005534 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application [None req-df5b9273-7f09-43c8-a94b-a6844b11d004 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 04 07:10:39.005534 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 07:10:39.005534 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 07:10:39.005534 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 07:10:39.005534 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 07:10:39.005534 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 07:10:39.005534 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 07:10:39.005534 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 07:10:39.005534 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 07:10:39.005534 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 07:10:39.005534 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 07:10:39.005534 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 07:10:39.005534 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 07:10:39.005534 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 07:10:39.005534 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 07:10:39.005534 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 07:10:39.006496 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 07:10:39.006496 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 07:10:39.006496 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 07:10:39.006496 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 07:10:39.006496 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 07:10:39.006496 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 07:10:39.006496 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 07:10:39.006496 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 07:10:39.006496 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 07:10:39.006496 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self.get_or_create( May 04 07:10:39.006496 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 07:10:39.006496 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application with Lock( May 04 07:10:39.006496 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 07:10:39.006496 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self._enter() May 04 07:10:39.006496 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 07:10:39.006496 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 07:10:39.011553 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 07:10:39.011553 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self.creator() May 04 07:10:39.011553 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 07:10:39.011553 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application created_value = creator( May 04 07:10:39.011553 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 07:10:39.011553 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 07:10:39.011553 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 07:10:39.011553 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 07:10:39.011553 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 07:10:39.011553 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 07:10:39.011553 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 04 07:10:39.011553 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application May 04 07:10:39.011553 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 209/430] 10.222.0.21 () {56 vars in 1114 bytes} [Wed May 4 07:10:38 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 07:10:39.011553 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b556c63f-e162-4c5c-817f-2fc193b5aca1 None None] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:10:39.012950 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b556c63f-e162-4c5c-817f-2fc193b5aca1 None None] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:10:39.012950 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b556c63f-e162-4c5c-817f-2fc193b5aca1 None None] PATH_INFO: `/` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:10:39.012950 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 210/431] 10.222.0.21 () {54 vars in 926 bytes} [Wed May 4 07:10:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 07:10:39.016608 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b556c63f-e162-4c5c-817f-2fc193b5aca1 None None] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:10:39.049415 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73cd228-cc21-42bf-ada7-57543b929dad None admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:10:39.091794 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13104a1f-6d2b-42dd-a2d0-22c668059051 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:10:39.092875 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13104a1f-6d2b-42dd-a2d0-22c668059051 None admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:10:39.092875 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13104a1f-6d2b-42dd-a2d0-22c668059051 None admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:10:39.093066 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13104a1f-6d2b-42dd-a2d0-22c668059051 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:10:39.143759 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b556c63f-e162-4c5c-817f-2fc193b5aca1 None None] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:10:39.178814 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13104a1f-6d2b-42dd-a2d0-22c668059051 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:10:39.180605 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13104a1f-6d2b-42dd-a2d0-22c668059051 None admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:10:39.186321 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6864d092-807f-481b-8ed0-d1265014e233 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:10:39.187072 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6864d092-807f-481b-8ed0-d1265014e233 None admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:10:39.187452 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6864d092-807f-481b-8ed0-d1265014e233 None admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:10:39.187885 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6864d092-807f-481b-8ed0-d1265014e233 None admin] PATH_INFO: `/v3/roles` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:10:39.188708 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6864d092-807f-481b-8ed0-d1265014e233 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 07:10:39.189085 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6864d092-807f-481b-8ed0-d1265014e233 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:10:39.190515 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6864d092-807f-481b-8ed0-d1265014e233 None admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:10:39.199176 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 211/432] 10.222.0.21 () {56 vars in 1111 bytes} [Wed May 4 07:10:39 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 07:10:39.201164 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18eed1a-881b-4596-a4b5-bc391c35a965 None None] REQUEST_METHOD: `POST` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:10:39.201446 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18eed1a-881b-4596-a4b5-bc391c35a965 None None] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:10:39.201721 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18eed1a-881b-4596-a4b5-bc391c35a965 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:10:39.220684 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.auth.core [None req-b18eed1a-881b-4596-a4b5-bc391c35a965 None None] MFA Rules not processed for user `83c5e0dcb991496ea6dee38384514508`. Rule list: `[]` (Enabled: `True`). {{(pid=79745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:10:39.221853 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.fernet_utils [None req-b18eed1a-881b-4596-a4b5-bc391c35a965 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:10:39.294369 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 222/433] 10.222.0.21 () {58 vars in 1282 bytes} [Wed May 4 07:10:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 04 07:10:39.295267 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13104a1f-6d2b-42dd-a2d0-22c668059051 None admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:10:39.295674 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 212/434] 10.222.0.21 () {58 vars in 1023 bytes} [Wed May 4 07:10:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 07:10:39.303069 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18eed1a-881b-4596-a4b5-bc391c35a965 None None] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:10:39.397716 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13104a1f-6d2b-42dd-a2d0-22c668059051 None admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:10:39.405637 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18eed1a-881b-4596-a4b5-bc391c35a965 None None] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:10:39.433978 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd5b714-e577-498e-96ca-8a17ebf569b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:10:39.434530 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd5b714-e577-498e-96ca-8a17ebf569b2 None admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:10:39.434798 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd5b714-e577-498e-96ca-8a17ebf569b2 None admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:10:39.435065 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd5b714-e577-498e-96ca-8a17ebf569b2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:10:39.439268 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0278bb-277d-4525-be35-b8d71b2c7e3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:10:39.440128 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0278bb-277d-4525-be35-b8d71b2c7e3f None admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:10:39.440408 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0278bb-277d-4525-be35-b8d71b2c7e3f None admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:10:39.440746 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0278bb-277d-4525-be35-b8d71b2c7e3f None admin] PATH_INFO: `/v3/projects/c1c61577200842b7bf6af16defd5fcbc` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:10:39.441955 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0278bb-277d-4525-be35-b8d71b2c7e3f None admin] RBAC: Authorizing `identity:get_project(project_id=c1c61577200842b7bf6af16defd5fcbc)` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:10:39.443432 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0278bb-277d-4525-be35-b8d71b2c7e3f None admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:10:39.450377 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 213/435] 10.222.0.21 () {56 vars in 1186 bytes} [Wed May 4 07:10:39 2022] GET /identity/v3/projects/c1c61577200842b7bf6af16defd5fcbc => generated 298 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 07:10:39.451188 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0278bb-277d-4525-be35-b8d71b2c7e3f None admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:10:39.510954 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd5b714-e577-498e-96ca-8a17ebf569b2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:10:39.514154 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd5b714-e577-498e-96ca-8a17ebf569b2 None admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:10:39.548441 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0278bb-277d-4525-be35-b8d71b2c7e3f None admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:10:39.584939 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7ffeac-f966-4a1a-9eef-f7f171b19363 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:10:39.585731 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7ffeac-f966-4a1a-9eef-f7f171b19363 None admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:10:39.586010 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7ffeac-f966-4a1a-9eef-f7f171b19363 None admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:10:39.586283 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7ffeac-f966-4a1a-9eef-f7f171b19363 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:10:39.598964 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7ffeac-f966-4a1a-9eef-f7f171b19363 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 07:10:39.609181 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application [None req-8d7ffeac-f966-4a1a-9eef-f7f171b19363 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 04 07:10:39.609181 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 07:10:39.609181 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 07:10:39.609181 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 07:10:39.609181 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 07:10:39.609181 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 07:10:39.609181 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 07:10:39.609181 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 07:10:39.609181 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 07:10:39.609181 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 07:10:39.609181 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 07:10:39.609181 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 07:10:39.609181 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 07:10:39.609181 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 07:10:39.609181 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 07:10:39.609181 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 07:10:39.610091 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 07:10:39.610091 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 07:10:39.610091 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 07:10:39.610091 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 07:10:39.610091 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 07:10:39.610091 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 07:10:39.610091 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 07:10:39.610091 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 07:10:39.610091 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 07:10:39.610091 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self.get_or_create( May 04 07:10:39.610091 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 07:10:39.610091 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application with Lock( May 04 07:10:39.610091 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 07:10:39.610091 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self._enter() May 04 07:10:39.610091 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 07:10:39.610091 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 07:10:39.610995 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 07:10:39.610995 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self.creator() May 04 07:10:39.610995 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 07:10:39.610995 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application created_value = creator( May 04 07:10:39.610995 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 07:10:39.610995 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 07:10:39.610995 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 07:10:39.610995 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 07:10:39.610995 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 07:10:39.610995 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 07:10:39.610995 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 04 07:10:39.610995 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application May 04 07:10:39.610995 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 214/436] 10.222.0.21 () {56 vars in 1099 bytes} [Wed May 4 07:10:39 2022] GET /identity/v3/roles/member => generated 84 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 07:10:39.617418 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7ffeac-f966-4a1a-9eef-f7f171b19363 None admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:10:39.617492 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 223/437] 10.222.0.21 () {58 vars in 1282 bytes} [Wed May 4 07:10:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 04 07:10:39.617877 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd5b714-e577-498e-96ca-8a17ebf569b2 None admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:10:39.713204 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd5b714-e577-498e-96ca-8a17ebf569b2 None admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:10:39.716129 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7ffeac-f966-4a1a-9eef-f7f171b19363 None admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:10:39.745847 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d912003d-1cbe-4f4f-ba3c-535e6a723443 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:10:39.747094 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d912003d-1cbe-4f4f-ba3c-535e6a723443 None admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:10:39.747525 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d912003d-1cbe-4f4f-ba3c-535e6a723443 None admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:10:39.747899 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d912003d-1cbe-4f4f-ba3c-535e6a723443 None admin] PATH_INFO: `/v3/roles` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:10:39.748646 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d912003d-1cbe-4f4f-ba3c-535e6a723443 None admin] RBAC: Adding query filter params (name=member) {{(pid=79744) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 07:10:39.748954 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d912003d-1cbe-4f4f-ba3c-535e6a723443 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:10:39.749958 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530a14a0-fc13-4780-9ac8-0c85f0a746d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:10:39.750313 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d912003d-1cbe-4f4f-ba3c-535e6a723443 None admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:10:39.751172 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530a14a0-fc13-4780-9ac8-0c85f0a746d3 None admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:10:39.751610 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530a14a0-fc13-4780-9ac8-0c85f0a746d3 None admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:10:39.752025 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530a14a0-fc13-4780-9ac8-0c85f0a746d3 None admin] PATH_INFO: `/v3/groups/179d57b113554c28816eda00a2f83a37` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:10:39.753344 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530a14a0-fc13-4780-9ac8-0c85f0a746d3 None admin] RBAC: Authorizing `identity:get_group(group_id=179d57b113554c28816eda00a2f83a37)` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:10:39.754921 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530a14a0-fc13-4780-9ac8-0c85f0a746d3 None admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:10:39.756734 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 215/438] 10.222.0.21 () {56 vars in 1180 bytes} [Wed May 4 07:10:39 2022] GET /identity/v3/groups/179d57b113554c28816eda00a2f83a37 => generated 226 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 07:10:39.757870 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530a14a0-fc13-4780-9ac8-0c85f0a746d3 None admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:10:39.758744 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 224/439] 10.222.0.21 () {56 vars in 1101 bytes} [Wed May 4 07:10:39 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 07:10:39.763807 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d912003d-1cbe-4f4f-ba3c-535e6a723443 None admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:10:39.858533 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530a14a0-fc13-4780-9ac8-0c85f0a746d3 None admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:10:39.858916 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d912003d-1cbe-4f4f-ba3c-535e6a723443 None admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:10:39.892443 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c8e3a4-6fbe-47c6-9da6-3f661a37a4db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:10:39.893064 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2af50f-e75c-4ee2-a8ce-146d4571a3ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:10:39.893155 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c8e3a4-6fbe-47c6-9da6-3f661a37a4db None admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:10:39.893401 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c8e3a4-6fbe-47c6-9da6-3f661a37a4db None admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:10:39.893633 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c8e3a4-6fbe-47c6-9da6-3f661a37a4db None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:10:39.893790 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2af50f-e75c-4ee2-a8ce-146d4571a3ea None admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:10:39.894038 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2af50f-e75c-4ee2-a8ce-146d4571a3ea None admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:10:39.894313 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2af50f-e75c-4ee2-a8ce-146d4571a3ea None admin] PATH_INFO: `/v3/projects/c3c877aea85b47dea9daa6ab598d831f` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:10:39.894476 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c8e3a4-6fbe-47c6-9da6-3f661a37a4db None admin] RBAC: Adding query filter params (group.id=179d57b113554c28816eda00a2f83a37, role.id=91b8526a43a4426a883870ad97362652, scope.project.id=c1c61577200842b7bf6af16defd5fcbc) {{(pid=79744) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 07:10:39.894757 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c8e3a4-6fbe-47c6-9da6-3f661a37a4db None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:10:39.895543 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2af50f-e75c-4ee2-a8ce-146d4571a3ea None admin] RBAC: Authorizing `identity:get_project(project_id=c3c877aea85b47dea9daa6ab598d831f)` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:10:39.896214 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c8e3a4-6fbe-47c6-9da6-3f661a37a4db None admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:10:39.896966 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2af50f-e75c-4ee2-a8ce-146d4571a3ea None admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:10:39.899559 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 216/440] 10.222.0.21 () {56 vars in 1186 bytes} [Wed May 4 07:10:39 2022] GET /identity/v3/projects/c3c877aea85b47dea9daa6ab598d831f => generated 302 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 07:10:39.900272 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2af50f-e75c-4ee2-a8ce-146d4571a3ea None admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:10:39.903764 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 225/441] 10.222.0.21 () {56 vars in 1376 bytes} [Wed May 4 07:10:39 2022] GET /identity/v3/role_assignments?group.id=179d57b113554c28816eda00a2f83a37&scope.project.id=c1c61577200842b7bf6af16defd5fcbc&role.id=91b8526a43a4426a883870ad97362652 => generated 611 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 07:10:39.909595 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c8e3a4-6fbe-47c6-9da6-3f661a37a4db None admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:10:40.013237 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2af50f-e75c-4ee2-a8ce-146d4571a3ea None admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:10:40.051253 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00803c6-e961-4147-adac-34ba66b79e07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:10:40.051767 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c8e3a4-6fbe-47c6-9da6-3f661a37a4db None admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:10:40.052078 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00803c6-e961-4147-adac-34ba66b79e07 None admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:10:40.052431 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00803c6-e961-4147-adac-34ba66b79e07 None admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:10:40.052777 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00803c6-e961-4147-adac-34ba66b79e07 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:10:40.096838 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20fa318-331b-4c1c-98da-d339e959be65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:10:40.098914 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20fa318-331b-4c1c-98da-d339e959be65 None admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:10:40.099438 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20fa318-331b-4c1c-98da-d339e959be65 None admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:10:40.099935 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20fa318-331b-4c1c-98da-d339e959be65 None admin] PATH_INFO: `/v3/groups/179d57b113554c28816eda00a2f83a37` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:10:40.101479 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20fa318-331b-4c1c-98da-d339e959be65 None admin] RBAC: Authorizing `identity:get_group(group_id=179d57b113554c28816eda00a2f83a37)` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:10:40.103785 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20fa318-331b-4c1c-98da-d339e959be65 None admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:10:40.106888 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 226/442] 10.222.0.21 () {56 vars in 1180 bytes} [Wed May 4 07:10:39 2022] GET /identity/v3/groups/179d57b113554c28816eda00a2f83a37 => generated 226 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 07:10:40.108463 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcc4424-84f1-497f-94b3-a80ae62f0693 None None] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:10:40.108929 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcc4424-84f1-497f-94b3-a80ae62f0693 None None] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:10:40.109382 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcc4424-84f1-497f-94b3-a80ae62f0693 None None] PATH_INFO: `/` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:10:40.110942 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 227/443] 10.222.0.21 () {54 vars in 926 bytes} [Wed May 4 07:10:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 07:10:40.112876 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fcc4424-84f1-497f-94b3-a80ae62f0693 None None] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:10:40.143984 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00803c6-e961-4147-adac-34ba66b79e07 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:10:40.145448 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00803c6-e961-4147-adac-34ba66b79e07 None admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:10:40.227238 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fcc4424-84f1-497f-94b3-a80ae62f0693 None None] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:10:40.257688 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 217/444] 10.222.0.21 () {58 vars in 1282 bytes} [Wed May 4 07:10:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 04 07:10:40.257688 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d708ae5-ed82-4672-898a-b743217419c0 None None] REQUEST_METHOD: `POST` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:10:40.257688 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d708ae5-ed82-4672-898a-b743217419c0 None None] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:10:40.257688 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d708ae5-ed82-4672-898a-b743217419c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:10:40.265556 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b58087-f37c-4306-9743-7b3481e474f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:10:40.266147 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b58087-f37c-4306-9743-7b3481e474f3 None admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:10:40.266425 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b58087-f37c-4306-9743-7b3481e474f3 None admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:10:40.266699 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b58087-f37c-4306-9743-7b3481e474f3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:10:40.267561 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b58087-f37c-4306-9743-7b3481e474f3 None admin] RBAC: Adding query filter params (group.id=179d57b113554c28816eda00a2f83a37, role.id=91b8526a43a4426a883870ad97362652, scope.project.id=c3c877aea85b47dea9daa6ab598d831f) {{(pid=79744) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 07:10:40.267872 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b58087-f37c-4306-9743-7b3481e474f3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:10:40.269312 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b58087-f37c-4306-9743-7b3481e474f3 None admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:10:40.276021 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.auth.core [None req-2d708ae5-ed82-4672-898a-b743217419c0 None None] MFA Rules not processed for user `83c5e0dcb991496ea6dee38384514508`. Rule list: `[]` (Enabled: `True`). {{(pid=79745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:10:40.276175 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 228/445] 10.222.0.21 () {56 vars in 1376 bytes} [Wed May 4 07:10:40 2022] GET /identity/v3/role_assignments?group.id=179d57b113554c28816eda00a2f83a37&scope.project.id=c3c877aea85b47dea9daa6ab598d831f&role.id=91b8526a43a4426a883870ad97362652 => generated 611 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 07:10:40.276254 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.fernet_utils [None req-2d708ae5-ed82-4672-898a-b743217419c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:10:40.276325 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b58087-f37c-4306-9743-7b3481e474f3 None admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:10:40.351778 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 218/446] 10.222.0.21 () {58 vars in 1023 bytes} [Wed May 4 07:10:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 07:10:40.375922 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d708ae5-ed82-4672-898a-b743217419c0 None None] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:10:40.406405 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b58087-f37c-4306-9743-7b3481e474f3 None admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:10:40.440870 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa723e7-b0d0-4954-b5ca-820114c77d11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:10:40.441739 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa723e7-b0d0-4954-b5ca-820114c77d11 None admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:10:40.442018 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa723e7-b0d0-4954-b5ca-820114c77d11 None admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:10:40.442283 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa723e7-b0d0-4954-b5ca-820114c77d11 None admin] PATH_INFO: `/v3/projects/c3c877aea85b47dea9daa6ab598d831f` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:10:40.446236 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa723e7-b0d0-4954-b5ca-820114c77d11 None admin] RBAC: Authorizing `identity:get_project(project_id=c3c877aea85b47dea9daa6ab598d831f)` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:10:40.446236 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa723e7-b0d0-4954-b5ca-820114c77d11 None admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:10:40.452734 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 229/447] 10.222.0.21 () {56 vars in 1186 bytes} [Wed May 4 07:10:40 2022] GET /identity/v3/projects/c3c877aea85b47dea9daa6ab598d831f => generated 302 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 07:10:40.453704 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa723e7-b0d0-4954-b5ca-820114c77d11 None admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:10:40.486344 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d708ae5-ed82-4672-898a-b743217419c0 None None] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:10:40.525260 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a20d5d-d515-4c90-bd1c-2d80ded9258b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:10:40.526273 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a20d5d-d515-4c90-bd1c-2d80ded9258b None admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:10:40.526273 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a20d5d-d515-4c90-bd1c-2d80ded9258b None admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:10:40.526557 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a20d5d-d515-4c90-bd1c-2d80ded9258b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:10:40.541158 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a20d5d-d515-4c90-bd1c-2d80ded9258b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 07:10:40.549606 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application [None req-58a20d5d-d515-4c90-bd1c-2d80ded9258b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 04 07:10:40.549606 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 07:10:40.549606 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 07:10:40.549606 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 07:10:40.549606 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 07:10:40.549606 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 07:10:40.549606 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 07:10:40.549606 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 07:10:40.549606 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 07:10:40.549606 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 07:10:40.549606 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 07:10:40.549606 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 07:10:40.549606 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 07:10:40.549606 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 07:10:40.549606 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 07:10:40.549606 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 07:10:40.550525 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 07:10:40.550525 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 07:10:40.550525 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 07:10:40.550525 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 07:10:40.550525 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 07:10:40.550525 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 07:10:40.550525 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 07:10:40.550525 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 07:10:40.550525 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 07:10:40.550525 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self.get_or_create( May 04 07:10:40.550525 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 07:10:40.550525 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application with Lock( May 04 07:10:40.550525 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 07:10:40.550525 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self._enter() May 04 07:10:40.550525 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 07:10:40.550525 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 07:10:40.551503 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 07:10:40.551503 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self.creator() May 04 07:10:40.551503 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 07:10:40.551503 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application created_value = creator( May 04 07:10:40.551503 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 07:10:40.551503 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 07:10:40.551503 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 07:10:40.551503 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 07:10:40.551503 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 07:10:40.551503 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 07:10:40.551503 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 04 07:10:40.551503 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application May 04 07:10:40.551503 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 219/448] 10.222.0.21 () {56 vars in 1096 bytes} [Wed May 4 07:10:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 07:10:40.556432 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a20d5d-d515-4c90-bd1c-2d80ded9258b None admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:10:40.558156 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa723e7-b0d0-4954-b5ca-820114c77d11 None admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:10:40.589851 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0420d1-30dc-4340-842c-44e8d0b4715b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:10:40.590806 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0420d1-30dc-4340-842c-44e8d0b4715b None admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:10:40.591084 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0420d1-30dc-4340-842c-44e8d0b4715b None admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:10:40.591388 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0420d1-30dc-4340-842c-44e8d0b4715b None admin] PATH_INFO: `/v3/groups/179d57b113554c28816eda00a2f83a37` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:10:40.592583 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0420d1-30dc-4340-842c-44e8d0b4715b None admin] RBAC: Authorizing `identity:get_group(group_id=179d57b113554c28816eda00a2f83a37)` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:10:40.594019 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0420d1-30dc-4340-842c-44e8d0b4715b None admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:10:40.595647 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 230/449] 10.222.0.21 () {56 vars in 1180 bytes} [Wed May 4 07:10:40 2022] GET /identity/v3/groups/179d57b113554c28816eda00a2f83a37 => generated 226 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 07:10:40.601222 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0420d1-30dc-4340-842c-44e8d0b4715b None admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:10:40.649796 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a20d5d-d515-4c90-bd1c-2d80ded9258b None admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:10:40.681107 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b94a51b-df57-4d90-817e-ab85c74e53b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:10:40.681755 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b94a51b-df57-4d90-817e-ab85c74e53b2 None admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:10:40.682030 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b94a51b-df57-4d90-817e-ab85c74e53b2 None admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:10:40.682300 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b94a51b-df57-4d90-817e-ab85c74e53b2 None admin] PATH_INFO: `/v3/roles` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:10:40.683029 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b94a51b-df57-4d90-817e-ab85c74e53b2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 07:10:40.683365 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b94a51b-df57-4d90-817e-ab85c74e53b2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:10:40.685270 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b94a51b-df57-4d90-817e-ab85c74e53b2 None admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:10:40.692825 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 220/450] 10.222.0.21 () {56 vars in 1099 bytes} [Wed May 4 07:10:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 07:10:40.693773 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0420d1-30dc-4340-842c-44e8d0b4715b None admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:10:40.698202 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b94a51b-df57-4d90-817e-ab85c74e53b2 None admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:10:40.725226 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b74b5d7-2a98-4de3-9fdb-7faacffc9ed5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:10:40.725869 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b74b5d7-2a98-4de3-9fdb-7faacffc9ed5 None admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:10:40.726159 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b74b5d7-2a98-4de3-9fdb-7faacffc9ed5 None admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:10:40.726424 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b74b5d7-2a98-4de3-9fdb-7faacffc9ed5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:10:40.727269 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b74b5d7-2a98-4de3-9fdb-7faacffc9ed5 None admin] RBAC: Adding query filter params (group.id=179d57b113554c28816eda00a2f83a37, role.id=9f89c07b05a14f18836116af22cba5f6, scope.project.id=c3c877aea85b47dea9daa6ab598d831f) {{(pid=79744) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 07:10:40.727577 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b74b5d7-2a98-4de3-9fdb-7faacffc9ed5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:10:40.728981 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b74b5d7-2a98-4de3-9fdb-7faacffc9ed5 None admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:10:40.735305 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 231/451] 10.222.0.21 () {56 vars in 1376 bytes} [Wed May 4 07:10:40 2022] GET /identity/v3/role_assignments?group.id=179d57b113554c28816eda00a2f83a37&scope.project.id=c3c877aea85b47dea9daa6ab598d831f&role.id=9f89c07b05a14f18836116af22cba5f6 => generated 611 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 07:10:40.797216 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b94a51b-df57-4d90-817e-ab85c74e53b2 None admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:10:40.832004 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b6e7eb-cf93-4db0-b455-121b4ddc21c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:10:40.832665 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b6e7eb-cf93-4db0-b455-121b4ddc21c6 None admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:10:40.832948 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b6e7eb-cf93-4db0-b455-121b4ddc21c6 None admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:10:40.833222 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b6e7eb-cf93-4db0-b455-121b4ddc21c6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:10:40.901825 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b6e7eb-cf93-4db0-b455-121b4ddc21c6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:10:40.903857 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b6e7eb-cf93-4db0-b455-121b4ddc21c6 None admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:10:40.998480 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 221/452] 10.222.0.21 () {58 vars in 1282 bytes} [Wed May 4 07:10:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 04 07:10:41.004011 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b74b5d7-2a98-4de3-9fdb-7faacffc9ed5 None admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:10:41.103661 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b74b5d7-2a98-4de3-9fdb-7faacffc9ed5 None admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:10:41.136946 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc9103e-df24-4084-b391-2044e40f804e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:10:41.137789 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc9103e-df24-4084-b391-2044e40f804e None admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:10:41.138061 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc9103e-df24-4084-b391-2044e40f804e None admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:10:41.138333 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc9103e-df24-4084-b391-2044e40f804e None admin] PATH_INFO: `/v3/projects/42382f8dc1ee4162906b55d85040da7b` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:10:41.139524 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc9103e-df24-4084-b391-2044e40f804e None admin] RBAC: Authorizing `identity:get_project(project_id=42382f8dc1ee4162906b55d85040da7b)` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:10:41.140943 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc9103e-df24-4084-b391-2044e40f804e None admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:10:41.142633 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 232/453] 10.222.0.21 () {56 vars in 1186 bytes} [Wed May 4 07:10:41 2022] GET /identity/v3/projects/42382f8dc1ee4162906b55d85040da7b => generated 344 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 07:10:41.148310 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b6e7eb-cf93-4db0-b455-121b4ddc21c6 None admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:10:41.246692 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b6e7eb-cf93-4db0-b455-121b4ddc21c6 None admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:10:41.279681 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521b0395-76b8-4ee5-9fa3-b6df57b4f83e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:10:41.280521 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521b0395-76b8-4ee5-9fa3-b6df57b4f83e None admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:10:41.280819 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521b0395-76b8-4ee5-9fa3-b6df57b4f83e None admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:10:41.281085 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521b0395-76b8-4ee5-9fa3-b6df57b4f83e None admin] PATH_INFO: `/v3/groups/4d59d0196e0d45d4a737dc3e0c320743` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:10:41.282234 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521b0395-76b8-4ee5-9fa3-b6df57b4f83e None admin] RBAC: Authorizing `identity:get_group(group_id=4d59d0196e0d45d4a737dc3e0c320743)` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:10:41.283688 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521b0395-76b8-4ee5-9fa3-b6df57b4f83e None admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:10:41.285291 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 222/454] 10.222.0.21 () {56 vars in 1180 bytes} [Wed May 4 07:10:41 2022] GET /identity/v3/groups/4d59d0196e0d45d4a737dc3e0c320743 => generated 229 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 07:10:41.291195 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc9103e-df24-4084-b391-2044e40f804e None admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:10:41.383527 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc9103e-df24-4084-b391-2044e40f804e None admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:10:41.416735 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d8f9a6-2b6a-4fca-af71-a2aefaa49fa0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:10:41.417367 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d8f9a6-2b6a-4fca-af71-a2aefaa49fa0 None admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:10:41.417645 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d8f9a6-2b6a-4fca-af71-a2aefaa49fa0 None admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:10:41.417916 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d8f9a6-2b6a-4fca-af71-a2aefaa49fa0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:10:41.418980 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d8f9a6-2b6a-4fca-af71-a2aefaa49fa0 None admin] RBAC: Adding query filter params (group.id=4d59d0196e0d45d4a737dc3e0c320743, role.id=eb54c9cea2774a25b1fe8c79724408ee, scope.project.id=42382f8dc1ee4162906b55d85040da7b) {{(pid=79744) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 07:10:41.419322 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d8f9a6-2b6a-4fca-af71-a2aefaa49fa0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:10:41.420753 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d8f9a6-2b6a-4fca-af71-a2aefaa49fa0 None admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:10:41.426239 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 233/455] 10.222.0.21 () {56 vars in 1376 bytes} [Wed May 4 07:10:41 2022] GET /identity/v3/role_assignments?group.id=4d59d0196e0d45d4a737dc3e0c320743&scope.project.id=42382f8dc1ee4162906b55d85040da7b&role.id=eb54c9cea2774a25b1fe8c79724408ee => generated 611 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 07:10:44.340540 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691532ad-9000-427b-af47-5c561a59f74d None None] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:10:44.341563 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691532ad-9000-427b-af47-5c561a59f74d None None] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:10:44.342048 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691532ad-9000-427b-af47-5c561a59f74d None None] PATH_INFO: `/` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:10:44.343886 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 223/456] 10.222.0.21 () {54 vars in 926 bytes} [Wed May 4 07:10:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 07:10:44.349641 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe75007b-f036-4a51-9575-6cb2655306ab None None] REQUEST_METHOD: `POST` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:10:44.350467 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe75007b-f036-4a51-9575-6cb2655306ab None None] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:10:44.350940 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe75007b-f036-4a51-9575-6cb2655306ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:10:44.380386 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.auth.core [None req-fe75007b-f036-4a51-9575-6cb2655306ab None None] MFA Rules not processed for user `83c5e0dcb991496ea6dee38384514508`. Rule list: `[]` (Enabled: `True`). {{(pid=79744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:10:44.382248 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.fernet_utils [None req-fe75007b-f036-4a51-9575-6cb2655306ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:10:44.384983 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fb109d-e6ee-4235-9b12-8f353c759ce8 None None] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:10:44.385551 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fb109d-e6ee-4235-9b12-8f353c759ce8 None None] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:10:44.386019 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fb109d-e6ee-4235-9b12-8f353c759ce8 None None] PATH_INFO: `/` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:10:44.388422 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 224/457] 10.222.0.21 () {54 vars in 926 bytes} [Wed May 4 07:10:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 07:10:44.393811 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1179b811-2439-4590-8a3d-e66fa3a230f7 None None] REQUEST_METHOD: `POST` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:10:44.394468 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1179b811-2439-4590-8a3d-e66fa3a230f7 None None] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:10:44.394966 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1179b811-2439-4590-8a3d-e66fa3a230f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:10:44.425530 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.auth.core [None req-1179b811-2439-4590-8a3d-e66fa3a230f7 None None] MFA Rules not processed for user `83c5e0dcb991496ea6dee38384514508`. Rule list: `[]` (Enabled: `True`). {{(pid=79745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:10:44.427296 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.fernet_utils [None req-1179b811-2439-4590-8a3d-e66fa3a230f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:10:44.489832 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 234/458] 10.222.0.21 () {58 vars in 1023 bytes} [Wed May 4 07:10:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 04 07:10:44.503379 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 225/459] 10.222.0.21 () {58 vars in 1023 bytes} [Wed May 4 07:10:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 07:10:44.526410 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe75007b-f036-4a51-9575-6cb2655306ab None None] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:10:44.528567 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1179b811-2439-4590-8a3d-e66fa3a230f7 None None] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:10:44.643106 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1179b811-2439-4590-8a3d-e66fa3a230f7 None None] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:10:44.681679 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb6be80-ae32-43dd-ab1c-e4f541d9e77a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:10:44.682716 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb6be80-ae32-43dd-ab1c-e4f541d9e77a None admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:10:44.683162 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb6be80-ae32-43dd-ab1c-e4f541d9e77a None admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:10:44.683641 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb6be80-ae32-43dd-ab1c-e4f541d9e77a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:10:44.694607 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb6be80-ae32-43dd-ab1c-e4f541d9e77a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:10:44.696278 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb6be80-ae32-43dd-ab1c-e4f541d9e77a None admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:10:44.714677 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application [None req-7cb6be80-ae32-43dd-ab1c-e4f541d9e77a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 07:10:44.714677 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 07:10:44.714677 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 07:10:44.714677 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 07:10:44.714677 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 07:10:44.714677 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 07:10:44.714677 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 07:10:44.714677 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 07:10:44.714677 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 07:10:44.714677 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 07:10:44.714677 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 07:10:44.714677 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 07:10:44.714677 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 07:10:44.714677 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 07:10:44.714677 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 07:10:44.716863 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 07:10:44.716863 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 07:10:44.716863 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 07:10:44.716863 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 07:10:44.716863 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 07:10:44.716863 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 07:10:44.716863 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self.get_or_create( May 04 07:10:44.716863 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 07:10:44.716863 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application with Lock( May 04 07:10:44.716863 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 07:10:44.716863 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self._enter() May 04 07:10:44.716863 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 07:10:44.716863 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 07:10:44.716863 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 07:10:44.716863 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self.creator() May 04 07:10:44.716863 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 07:10:44.716863 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application created_value = creator( May 04 07:10:44.717910 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 07:10:44.717910 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 07:10:44.717910 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 07:10:44.717910 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application May 04 07:10:44.719784 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 226/460] 10.222.0.21 () {56 vars in 1108 bytes} [Wed May 4 07:10:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 07:10:44.721188 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e69be7-f277-4d74-bab0-5486a9d5d481 None None] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:10:44.721620 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e69be7-f277-4d74-bab0-5486a9d5d481 None None] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:10:44.722099 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e69be7-f277-4d74-bab0-5486a9d5d481 None None] PATH_INFO: `/` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:10:44.723821 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 227/461] 10.222.0.21 () {54 vars in 926 bytes} [Wed May 4 07:10:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 07:10:44.726470 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e69be7-f277-4d74-bab0-5486a9d5d481 None None] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:10:44.741151 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe75007b-f036-4a51-9575-6cb2655306ab None None] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:10:44.776264 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39756a6e-4d06-41f2-ae68-87582d79f683 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:10:44.777504 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39756a6e-4d06-41f2-ae68-87582d79f683 None admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:10:44.778012 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39756a6e-4d06-41f2-ae68-87582d79f683 None admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:10:44.778495 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39756a6e-4d06-41f2-ae68-87582d79f683 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:10:44.788666 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39756a6e-4d06-41f2-ae68-87582d79f683 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:10:44.790379 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39756a6e-4d06-41f2-ae68-87582d79f683 None admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:10:44.813018 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application [None req-39756a6e-4d06-41f2-ae68-87582d79f683 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 07:10:44.813018 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 07:10:44.813018 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 07:10:44.813018 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 07:10:44.813018 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 07:10:44.813018 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 07:10:44.813018 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 07:10:44.813018 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 07:10:44.813018 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 07:10:44.813018 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 07:10:44.813018 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 07:10:44.813018 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 07:10:44.813018 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 07:10:44.813018 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 07:10:44.813018 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 07:10:44.813946 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 07:10:44.813946 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 07:10:44.813946 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 07:10:44.813946 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 07:10:44.813946 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 07:10:44.813946 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 07:10:44.813946 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.get_or_create( May 04 07:10:44.813946 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 07:10:44.813946 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application with Lock( May 04 07:10:44.813946 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 07:10:44.813946 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self._enter() May 04 07:10:44.813946 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 07:10:44.813946 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 07:10:44.813946 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 07:10:44.813946 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.creator() May 04 07:10:44.813946 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 07:10:44.813946 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application created_value = creator( May 04 07:10:44.814789 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 07:10:44.814789 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 07:10:44.814789 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 07:10:44.814789 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application May 04 07:10:44.814789 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 235/462] 10.222.0.21 () {56 vars in 1108 bytes} [Wed May 4 07:10:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 289 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 07:10:44.815868 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3636f46c-e9ff-42cb-8b44-cdcce58e68cf None None] REQUEST_METHOD: `POST` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:10:44.816152 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3636f46c-e9ff-42cb-8b44-cdcce58e68cf None None] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:10:44.816428 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3636f46c-e9ff-42cb-8b44-cdcce58e68cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:10:44.838548 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.auth.core [None req-3636f46c-e9ff-42cb-8b44-cdcce58e68cf None None] MFA Rules not processed for user `83c5e0dcb991496ea6dee38384514508`. Rule list: `[]` (Enabled: `True`). {{(pid=79744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:10:44.840682 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.fernet_utils [None req-3636f46c-e9ff-42cb-8b44-cdcce58e68cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:10:44.850888 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e69be7-f277-4d74-bab0-5486a9d5d481 None None] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:10:44.886084 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8bf3d8-2f10-45ca-aa72-1b27ae41dcbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:10:44.886793 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8bf3d8-2f10-45ca-aa72-1b27ae41dcbb None admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:10:44.887614 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8bf3d8-2f10-45ca-aa72-1b27ae41dcbb None admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:10:44.887614 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8bf3d8-2f10-45ca-aa72-1b27ae41dcbb None admin] PATH_INFO: `/v3/domains` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:10:44.888610 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8bf3d8-2f10-45ca-aa72-1b27ae41dcbb None admin] RBAC: Adding query filter params (name=Default) {{(pid=79745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 07:10:44.888917 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8bf3d8-2f10-45ca-aa72-1b27ae41dcbb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:10:44.890315 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8bf3d8-2f10-45ca-aa72-1b27ae41dcbb None admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:10:44.909539 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 228/463] 10.222.0.21 () {56 vars in 1109 bytes} [Wed May 4 07:10:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 07:10:44.909539 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8bf3d8-2f10-45ca-aa72-1b27ae41dcbb None admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:10:44.919570 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 236/464] 10.222.0.21 () {58 vars in 1023 bytes} [Wed May 4 07:10:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 07:10:44.920872 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c069d87-668b-432d-a4d6-adec39830a42 None None] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:10:44.921165 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c069d87-668b-432d-a4d6-adec39830a42 None None] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:10:44.921441 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c069d87-668b-432d-a4d6-adec39830a42 None None] PATH_INFO: `/` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:10:44.922824 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 237/465] 10.222.0.21 () {54 vars in 926 bytes} [Wed May 4 07:10:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 07:10:44.923422 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c069d87-668b-432d-a4d6-adec39830a42 None None] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:10:45.020233 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8bf3d8-2f10-45ca-aa72-1b27ae41dcbb None admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:10:45.024854 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c069d87-668b-432d-a4d6-adec39830a42 None None] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:10:45.053457 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8381d541-c62b-49c5-b7b3-d71f0e2bf557 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:10:45.054431 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8381d541-c62b-49c5-b7b3-d71f0e2bf557 None admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:10:45.054899 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8381d541-c62b-49c5-b7b3-d71f0e2bf557 None admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:10:45.055392 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8381d541-c62b-49c5-b7b3-d71f0e2bf557 None admin] PATH_INFO: `/v3/domains` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:10:45.056308 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8381d541-c62b-49c5-b7b3-d71f0e2bf557 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 07:10:45.056833 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8381d541-c62b-49c5-b7b3-d71f0e2bf557 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:10:45.058320 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ea1979-2fa7-4766-9881-c54b4a95b8d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:10:45.058701 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8381d541-c62b-49c5-b7b3-d71f0e2bf557 None admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:10:45.059756 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ea1979-2fa7-4766-9881-c54b4a95b8d8 None admin] REQUEST_METHOD: `POST` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:10:45.060125 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ea1979-2fa7-4766-9881-c54b4a95b8d8 None admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:10:45.060402 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ea1979-2fa7-4766-9881-c54b4a95b8d8 None admin] PATH_INFO: `/v3/users` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:10:45.061105 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ea1979-2fa7-4766-9881-c54b4a95b8d8 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:10:45.062510 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ea1979-2fa7-4766-9881-c54b4a95b8d8 None admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:10:45.071493 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 229/466] 10.222.0.21 () {56 vars in 1109 bytes} [Wed May 4 07:10:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 07:10:45.073113 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be71361b-2f27-40ff-af74-cb2e2db4cd27 None None] REQUEST_METHOD: `POST` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:10:45.073456 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be71361b-2f27-40ff-af74-cb2e2db4cd27 None None] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:10:45.073736 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be71361b-2f27-40ff-af74-cb2e2db4cd27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:10:45.086844 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 238/467] 10.222.0.21 () {60 vars in 1132 bytes} [Wed May 4 07:10:44 2022] POST /identity/v3/users => generated 246 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 07:10:45.087931 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ea1979-2fa7-4766-9881-c54b4a95b8d8 None admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:10:45.103080 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.auth.core [None req-be71361b-2f27-40ff-af74-cb2e2db4cd27 None None] MFA Rules not processed for user `83c5e0dcb991496ea6dee38384514508`. Rule list: `[]` (Enabled: `True`). {{(pid=79745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:10:45.104847 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.fernet_utils [None req-be71361b-2f27-40ff-af74-cb2e2db4cd27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:10:45.204091 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 230/468] 10.222.0.21 () {58 vars in 1023 bytes} [Wed May 4 07:10:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 07:10:45.204486 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ea1979-2fa7-4766-9881-c54b4a95b8d8 None admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:10:45.205056 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be71361b-2f27-40ff-af74-cb2e2db4cd27 None None] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:10:45.241296 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82423069-f499-4766-ba72-fc5fd7cd4dcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:10:45.242388 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82423069-f499-4766-ba72-fc5fd7cd4dcd None admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:10:45.242830 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82423069-f499-4766-ba72-fc5fd7cd4dcd None admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:10:45.243574 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82423069-f499-4766-ba72-fc5fd7cd4dcd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:10:45.256209 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82423069-f499-4766-ba72-fc5fd7cd4dcd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:10:45.258293 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82423069-f499-4766-ba72-fc5fd7cd4dcd None admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:10:45.279010 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application [None req-82423069-f499-4766-ba72-fc5fd7cd4dcd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 07:10:45.279010 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 07:10:45.279010 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 07:10:45.279010 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 07:10:45.279010 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 07:10:45.279010 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 07:10:45.279010 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 07:10:45.279010 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 07:10:45.279010 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 07:10:45.279010 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 07:10:45.279010 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 07:10:45.279010 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 07:10:45.279010 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 07:10:45.279010 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 07:10:45.279010 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 07:10:45.280149 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 07:10:45.280149 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 07:10:45.280149 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 07:10:45.280149 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 07:10:45.280149 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 07:10:45.280149 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 07:10:45.280149 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.get_or_create( May 04 07:10:45.280149 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 07:10:45.280149 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application with Lock( May 04 07:10:45.280149 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 07:10:45.280149 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self._enter() May 04 07:10:45.280149 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 07:10:45.280149 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 07:10:45.280149 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 07:10:45.280149 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.creator() May 04 07:10:45.280149 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 07:10:45.280149 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application created_value = creator( May 04 07:10:45.281081 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 07:10:45.281081 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 07:10:45.281081 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 07:10:45.281081 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application May 04 07:10:45.283186 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 239/469] 10.222.0.21 () {56 vars in 1108 bytes} [Wed May 4 07:10:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 07:10:45.284437 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82423069-f499-4766-ba72-fc5fd7cd4dcd None admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:10:45.314088 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be71361b-2f27-40ff-af74-cb2e2db4cd27 None None] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:10:45.358284 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935aa866-af05-46b9-8d94-0dd7cb2b444a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:10:45.359721 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935aa866-af05-46b9-8d94-0dd7cb2b444a None admin] REQUEST_METHOD: `POST` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:10:45.360158 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935aa866-af05-46b9-8d94-0dd7cb2b444a None admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:10:45.360436 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935aa866-af05-46b9-8d94-0dd7cb2b444a None admin] PATH_INFO: `/v3/users` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:10:45.361169 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935aa866-af05-46b9-8d94-0dd7cb2b444a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:10:45.362918 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935aa866-af05-46b9-8d94-0dd7cb2b444a None admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:10:45.389225 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 231/470] 10.222.0.21 () {60 vars in 1132 bytes} [Wed May 4 07:10:45 2022] POST /identity/v3/users => generated 248 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 07:10:45.389427 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935aa866-af05-46b9-8d94-0dd7cb2b444a None admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:10:45.403489 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82423069-f499-4766-ba72-fc5fd7cd4dcd None admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:10:45.443113 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8d1684-0d0c-4406-aecc-6f2365319ffa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:10:45.447277 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8d1684-0d0c-4406-aecc-6f2365319ffa None admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:10:45.447277 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8d1684-0d0c-4406-aecc-6f2365319ffa None admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:10:45.447277 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8d1684-0d0c-4406-aecc-6f2365319ffa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:10:45.456513 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8d1684-0d0c-4406-aecc-6f2365319ffa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:10:45.457920 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8d1684-0d0c-4406-aecc-6f2365319ffa None admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:10:45.476489 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application [None req-aa8d1684-0d0c-4406-aecc-6f2365319ffa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 07:10:45.476489 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 07:10:45.476489 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 07:10:45.476489 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 07:10:45.476489 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 07:10:45.476489 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 07:10:45.476489 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 07:10:45.476489 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 07:10:45.476489 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 07:10:45.476489 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 07:10:45.476489 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 07:10:45.476489 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 07:10:45.476489 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 07:10:45.476489 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 07:10:45.476489 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 07:10:45.477429 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 07:10:45.477429 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 07:10:45.477429 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 07:10:45.477429 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 07:10:45.477429 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 07:10:45.477429 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 07:10:45.477429 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.get_or_create( May 04 07:10:45.477429 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 07:10:45.477429 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application with Lock( May 04 07:10:45.477429 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 07:10:45.477429 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self._enter() May 04 07:10:45.477429 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 07:10:45.477429 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 07:10:45.477429 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 07:10:45.477429 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.creator() May 04 07:10:45.477429 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 07:10:45.477429 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application created_value = creator( May 04 07:10:45.478282 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 07:10:45.478282 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 07:10:45.478282 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 07:10:45.478282 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application May 04 07:10:45.478282 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 240/471] 10.222.0.21 () {56 vars in 1108 bytes} [Wed May 4 07:10:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 07:10:45.483923 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8d1684-0d0c-4406-aecc-6f2365319ffa None admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:10:45.510873 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935aa866-af05-46b9-8d94-0dd7cb2b444a None admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:10:45.554466 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836a9fb8-8386-482d-a41d-5b4c9e4fe4a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:10:45.555228 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836a9fb8-8386-482d-a41d-5b4c9e4fe4a8 None admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:10:45.555513 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836a9fb8-8386-482d-a41d-5b4c9e4fe4a8 None admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:10:45.555787 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836a9fb8-8386-482d-a41d-5b4c9e4fe4a8 None admin] PATH_INFO: `/v3/domains` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:10:45.557870 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836a9fb8-8386-482d-a41d-5b4c9e4fe4a8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 07:10:45.559526 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836a9fb8-8386-482d-a41d-5b4c9e4fe4a8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:10:45.561232 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836a9fb8-8386-482d-a41d-5b4c9e4fe4a8 None admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:10:45.579957 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 232/472] 10.222.0.21 () {56 vars in 1109 bytes} [Wed May 4 07:10:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 07:10:45.581449 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75762878-ce4f-47e9-b069-b6cb3a522a81 None None] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:10:45.581725 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75762878-ce4f-47e9-b069-b6cb3a522a81 None None] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:10:45.581995 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75762878-ce4f-47e9-b069-b6cb3a522a81 None None] PATH_INFO: `/` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:10:45.583355 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 233/473] 10.222.0.21 () {54 vars in 926 bytes} [Wed May 4 07:10:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 07:10:45.588204 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75762878-ce4f-47e9-b069-b6cb3a522a81 None None] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:10:45.619950 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8d1684-0d0c-4406-aecc-6f2365319ffa None admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:10:45.666248 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f8240e-80eb-40d1-9f2c-14da8fc465f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:10:45.666248 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f8240e-80eb-40d1-9f2c-14da8fc465f0 None admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:10:45.666535 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f8240e-80eb-40d1-9f2c-14da8fc465f0 None admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:10:45.666863 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f8240e-80eb-40d1-9f2c-14da8fc465f0 None admin] PATH_INFO: `/v3/domains` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:10:45.667686 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f8240e-80eb-40d1-9f2c-14da8fc465f0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79744) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 07:10:45.668207 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f8240e-80eb-40d1-9f2c-14da8fc465f0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:10:45.669576 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f8240e-80eb-40d1-9f2c-14da8fc465f0 None admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:10:45.682114 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 241/474] 10.222.0.21 () {56 vars in 1109 bytes} [Wed May 4 07:10:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 07:10:45.683439 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d041d4-5027-480a-960c-0f93f88a45cd None None] REQUEST_METHOD: `POST` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:10:45.683765 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d041d4-5027-480a-960c-0f93f88a45cd None None] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:10:45.684028 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d041d4-5027-480a-960c-0f93f88a45cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:10:45.704308 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.auth.core [None req-72d041d4-5027-480a-960c-0f93f88a45cd None None] MFA Rules not processed for user `83c5e0dcb991496ea6dee38384514508`. Rule list: `[]` (Enabled: `True`). {{(pid=79744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:10:45.705490 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.fernet_utils [None req-72d041d4-5027-480a-960c-0f93f88a45cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:10:45.713701 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75762878-ce4f-47e9-b069-b6cb3a522a81 None None] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:10:45.760231 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1174036e-de29-40b9-bd8d-ef81227c73c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:10:45.761065 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1174036e-de29-40b9-bd8d-ef81227c73c2 None admin] REQUEST_METHOD: `POST` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:10:45.761406 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1174036e-de29-40b9-bd8d-ef81227c73c2 None admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:10:45.762295 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1174036e-de29-40b9-bd8d-ef81227c73c2 None admin] PATH_INFO: `/v3/users` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:10:45.763243 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1174036e-de29-40b9-bd8d-ef81227c73c2 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:10:45.765455 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1174036e-de29-40b9-bd8d-ef81227c73c2 None admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:10:45.777584 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 242/475] 10.222.0.21 () {58 vars in 1023 bytes} [Wed May 4 07:10:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 07:10:45.779064 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d041d4-5027-480a-960c-0f93f88a45cd None None] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:10:45.797618 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 234/476] 10.222.0.21 () {60 vars in 1132 bytes} [Wed May 4 07:10:45 2022] POST /identity/v3/users => generated 248 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 07:10:45.809997 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1174036e-de29-40b9-bd8d-ef81227c73c2 None admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:10:45.889761 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d041d4-5027-480a-960c-0f93f88a45cd None None] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:10:45.913353 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1174036e-de29-40b9-bd8d-ef81227c73c2 None admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:10:45.926353 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e16084-ff50-4099-add7-f1575f31199f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:10:45.927362 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e16084-ff50-4099-add7-f1575f31199f None admin] REQUEST_METHOD: `POST` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:10:45.927792 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e16084-ff50-4099-add7-f1575f31199f None admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:10:45.928228 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e16084-ff50-4099-add7-f1575f31199f None admin] PATH_INFO: `/v3/users` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:10:45.929113 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e16084-ff50-4099-add7-f1575f31199f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:10:45.930748 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e16084-ff50-4099-add7-f1575f31199f None admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:10:45.951282 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f1bb4d-be8e-420e-99c6-64c6e89952af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:10:45.952203 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f1bb4d-be8e-420e-99c6-64c6e89952af None admin] REQUEST_METHOD: `POST` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:10:45.952526 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f1bb4d-be8e-420e-99c6-64c6e89952af None admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:10:45.952922 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f1bb4d-be8e-420e-99c6-64c6e89952af None admin] PATH_INFO: `/v3/roles` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:10:45.953818 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f1bb4d-be8e-420e-99c6-64c6e89952af None admin] RBAC: Authorizing `identity:create_role()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:10:45.955316 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f1bb4d-be8e-420e-99c6-64c6e89952af None admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:10:45.956833 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 243/477] 10.222.0.21 () {60 vars in 1132 bytes} [Wed May 4 07:10:45 2022] POST /identity/v3/users => generated 249 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 07:10:45.962438 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.sql.core [None req-d9f1bb4d-be8e-420e-99c6-64c6e89952af None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") May 04 07:10:45.962438 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] May 04 07:10:45.962438 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [parameters: {'id': '7d718f18facf448687df7b834234e8e9', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] May 04 07:10:45.962438 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=79745) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} May 04 07:10:45.979409 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application [None req-d9f1bb4d-be8e-420e-99c6-64c6e89952af None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. May 04 07:10:45.979409 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 07:10:45.979409 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 04 07:10:45.979409 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application self.dialect.do_execute( May 04 07:10:45.979409 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 04 07:10:45.979409 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 04 07:10:45.979409 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 04 07:10:45.979409 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application result = self._query(query) May 04 07:10:45.979409 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 04 07:10:45.979409 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application conn.query(q) May 04 07:10:45.979409 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 04 07:10:45.979409 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 04 07:10:45.979409 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 04 07:10:45.979409 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application result.read() May 04 07:10:45.979409 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 04 07:10:45.981045 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 04 07:10:45.981045 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 04 07:10:45.981045 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application packet.raise_for_error() May 04 07:10:45.981045 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 04 07:10:45.981045 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 04 07:10:45.981045 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 04 07:10:45.981045 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 04 07:10:45.981045 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") May 04 07:10:45.981045 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application May 04 07:10:45.981045 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: May 04 07:10:45.981045 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application May 04 07:10:45.981045 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 07:10:45.981045 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper May 04 07:10:45.981045 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return method(*args, **kwargs) May 04 07:10:45.981045 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role May 04 07:10:45.981045 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return ref.to_dict() May 04 07:10:45.981045 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 04 07:10:45.981045 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application next(self.gen) May 04 07:10:45.982336 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope May 04 07:10:45.982336 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application yield resource May 04 07:10:45.982336 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 04 07:10:45.982336 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application next(self.gen) May 04 07:10:45.982336 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session May 04 07:10:45.982336 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application self.session.rollback() May 04 07:10:45.982336 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 04 07:10:45.982336 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application self.force_reraise() May 04 07:10:45.982336 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 04 07:10:45.982336 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application raise self.value May 04 07:10:45.982336 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session May 04 07:10:45.982336 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) May 04 07:10:45.982336 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction May 04 07:10:45.982336 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application session.commit() May 04 07:10:45.982336 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit May 04 07:10:45.982336 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) May 04 07:10:45.982336 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit May 04 07:10:45.983545 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application self._prepare_impl() May 04 07:10:45.983545 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl May 04 07:10:45.983545 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application self.session.flush() May 04 07:10:45.983545 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 04 07:10:45.983545 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application self._flush(objects) May 04 07:10:45.983545 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 04 07:10:45.983545 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) May 04 07:10:45.983545 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 04 07:10:45.983545 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application compat.raise_( May 04 07:10:45.983545 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 04 07:10:45.983545 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application raise exception May 04 07:10:45.983545 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 04 07:10:45.983545 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application flush_context.execute() May 04 07:10:45.983545 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 04 07:10:45.983545 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application rec.execute(self) May 04 07:10:45.983545 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 04 07:10:45.983545 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( May 04 07:10:45.984632 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 04 07:10:45.984632 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application _emit_insert_statements( May 04 07:10:45.984632 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements May 04 07:10:45.984632 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application c = connection._execute_20( May 04 07:10:45.984632 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 04 07:10:45.984632 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) May 04 07:10:45.984632 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 04 07:10:45.984632 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return connection._execute_clauseelement( May 04 07:10:45.984632 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 04 07:10:45.984632 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application ret = self._execute_context( May 04 07:10:45.984632 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 04 07:10:45.984632 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application self._handle_dbapi_exception( May 04 07:10:45.984632 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 04 07:10:45.984632 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 04 07:10:45.984632 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 04 07:10:45.984632 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application raise exception May 04 07:10:45.985682 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 04 07:10:45.985682 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application self.dialect.do_execute( May 04 07:10:45.985682 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 04 07:10:45.985682 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 04 07:10:45.985682 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 04 07:10:45.985682 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application result = self._query(query) May 04 07:10:45.985682 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 04 07:10:45.985682 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application conn.query(q) May 04 07:10:45.985682 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 04 07:10:45.985682 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 04 07:10:45.985682 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 04 07:10:45.985682 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application result.read() May 04 07:10:45.985682 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 04 07:10:45.985682 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 04 07:10:45.985682 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 04 07:10:45.985682 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application packet.raise_for_error() May 04 07:10:45.986702 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 04 07:10:45.986702 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 04 07:10:45.986702 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 04 07:10:45.986702 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 04 07:10:45.986702 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") May 04 07:10:45.986702 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] May 04 07:10:45.986702 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application [parameters: {'id': '7d718f18facf448687df7b834234e8e9', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] May 04 07:10:45.986702 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) May 04 07:10:45.986702 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application May 04 07:10:45.986702 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 04 07:10:45.986702 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application May 04 07:10:45.986702 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 07:10:45.986702 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 07:10:45.986702 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 07:10:45.986702 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 07:10:45.986702 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 07:10:45.990780 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 07:10:45.990780 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 07:10:45.990780 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 07:10:45.990780 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 07:10:45.990780 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 07:10:45.990780 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 07:10:45.990780 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post May 04 07:10:45.990780 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( May 04 07:10:45.990780 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 07:10:45.990780 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 07:10:45.990780 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role May 04 07:10:45.990780 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) May 04 07:10:45.990780 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper May 04 07:10:45.990780 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, May 04 07:10:45.990780 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. May 04 07:10:45.990780 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application May 04 07:10:45.991714 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 235/478] 10.222.0.21 () {60 vars in 1131 bytes} [Wed May 4 07:10:45 2022] POST /identity/v3/roles => generated 144 bytes in 178 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) May 04 07:10:45.994983 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e16084-ff50-4099-add7-f1575f31199f None admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:10:46.108928 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e16084-ff50-4099-add7-f1575f31199f None admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:10:46.147107 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c90481d-f376-42f4-a7e7-d56b14007e8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:10:46.148204 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c90481d-f376-42f4-a7e7-d56b14007e8b None admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:10:46.148633 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c90481d-f376-42f4-a7e7-d56b14007e8b None admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:10:46.149056 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c90481d-f376-42f4-a7e7-d56b14007e8b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:10:46.161338 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c90481d-f376-42f4-a7e7-d56b14007e8b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 07:10:46.169921 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application [None req-3c90481d-f376-42f4-a7e7-d56b14007e8b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 04 07:10:46.169921 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 07:10:46.169921 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 07:10:46.169921 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 07:10:46.169921 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 07:10:46.169921 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 07:10:46.169921 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 07:10:46.169921 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 07:10:46.169921 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 07:10:46.169921 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 07:10:46.169921 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 07:10:46.169921 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 07:10:46.169921 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 07:10:46.169921 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 07:10:46.169921 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 07:10:46.169921 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 07:10:46.171073 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 07:10:46.171073 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 07:10:46.171073 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 07:10:46.171073 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 07:10:46.171073 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 07:10:46.171073 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 07:10:46.171073 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 07:10:46.171073 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 07:10:46.171073 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 07:10:46.171073 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.get_or_create( May 04 07:10:46.171073 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 07:10:46.171073 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application with Lock( May 04 07:10:46.171073 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 07:10:46.171073 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self._enter() May 04 07:10:46.171073 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 07:10:46.171073 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 07:10:46.172075 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 07:10:46.172075 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.creator() May 04 07:10:46.172075 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 07:10:46.172075 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application created_value = creator( May 04 07:10:46.172075 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 07:10:46.172075 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 07:10:46.172075 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 07:10:46.172075 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 07:10:46.172075 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 07:10:46.172075 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 07:10:46.172075 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 04 07:10:46.172075 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application May 04 07:10:46.174522 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 244/479] 10.222.0.21 () {56 vars in 1114 bytes} [Wed May 4 07:10:45 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 07:10:46.180517 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f1bb4d-be8e-420e-99c6-64c6e89952af None admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:10:46.299564 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f1bb4d-be8e-420e-99c6-64c6e89952af None admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:10:46.333965 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79e2191-d4f5-47bc-b991-49e497df565a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:10:46.334722 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79e2191-d4f5-47bc-b991-49e497df565a None admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:10:46.335070 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79e2191-d4f5-47bc-b991-49e497df565a None admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:10:46.335429 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79e2191-d4f5-47bc-b991-49e497df565a None admin] PATH_INFO: `/v3/roles` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:10:46.336239 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79e2191-d4f5-47bc-b991-49e497df565a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 07:10:46.336610 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79e2191-d4f5-47bc-b991-49e497df565a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:10:46.338034 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79e2191-d4f5-47bc-b991-49e497df565a None admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:10:46.348331 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 236/480] 10.222.0.21 () {56 vars in 1111 bytes} [Wed May 4 07:10:46 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 07:10:48.122358 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35156b33-ec06-4703-91d1-2693bb98f8fb None None] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:10:48.122889 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35156b33-ec06-4703-91d1-2693bb98f8fb None None] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:10:48.123067 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35156b33-ec06-4703-91d1-2693bb98f8fb None None] PATH_INFO: `/` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:10:48.124806 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 245/481] 10.222.0.21 () {54 vars in 926 bytes} [Wed May 4 07:10:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 07:10:48.129992 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d472f332-a65f-4e95-86aa-afb118f87689 None None] REQUEST_METHOD: `POST` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:10:48.130444 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d472f332-a65f-4e95-86aa-afb118f87689 None None] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:10:48.130617 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d472f332-a65f-4e95-86aa-afb118f87689 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:10:48.152410 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.auth.core [None req-d472f332-a65f-4e95-86aa-afb118f87689 None None] MFA Rules not processed for user `83c5e0dcb991496ea6dee38384514508`. Rule list: `[]` (Enabled: `True`). {{(pid=79745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:10:48.153597 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.fernet_utils [None req-d472f332-a65f-4e95-86aa-afb118f87689 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:10:48.203619 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cb81d1-1328-4b52-b8cd-9016abb5dca9 None None] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:10:48.203915 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cb81d1-1328-4b52-b8cd-9016abb5dca9 None None] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:10:48.204166 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cb81d1-1328-4b52-b8cd-9016abb5dca9 None None] PATH_INFO: `/` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:10:48.205764 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 246/482] 10.222.0.21 () {54 vars in 926 bytes} [Wed May 4 07:10:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 07:10:48.211045 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf72c05f-bb90-4103-9959-b2349967bf8d None None] REQUEST_METHOD: `POST` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:10:48.211373 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf72c05f-bb90-4103-9959-b2349967bf8d None None] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:10:48.211650 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf72c05f-bb90-4103-9959-b2349967bf8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:10:48.240072 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 237/483] 10.222.0.21 () {58 vars in 1023 bytes} [Wed May 4 07:10:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 07:10:48.241080 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.auth.core [None req-bf72c05f-bb90-4103-9959-b2349967bf8d None None] MFA Rules not processed for user `83c5e0dcb991496ea6dee38384514508`. Rule list: `[]` (Enabled: `True`). {{(pid=79744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:10:48.242327 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.fernet_utils [None req-bf72c05f-bb90-4103-9959-b2349967bf8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:10:48.264611 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d472f332-a65f-4e95-86aa-afb118f87689 None None] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:10:48.371589 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d472f332-a65f-4e95-86aa-afb118f87689 None None] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:10:48.414186 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733de45f-7d08-4aec-8d88-3f403ec1ebbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:10:48.414907 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733de45f-7d08-4aec-8d88-3f403ec1ebbc None admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:10:48.415204 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733de45f-7d08-4aec-8d88-3f403ec1ebbc None admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:10:48.415479 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733de45f-7d08-4aec-8d88-3f403ec1ebbc None admin] PATH_INFO: `/v3/roles/service` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:10:48.434707 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 247/484] 10.222.0.21 () {58 vars in 1023 bytes} [Wed May 4 07:10:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 07:10:48.443168 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733de45f-7d08-4aec-8d88-3f403ec1ebbc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 07:10:48.448890 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application [None req-733de45f-7d08-4aec-8d88-3f403ec1ebbc None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 04 07:10:48.448890 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 07:10:48.448890 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 07:10:48.448890 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 07:10:48.448890 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 07:10:48.448890 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 07:10:48.448890 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 07:10:48.448890 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 07:10:48.448890 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 07:10:48.448890 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 07:10:48.448890 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 07:10:48.448890 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 07:10:48.448890 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 07:10:48.448890 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 07:10:48.448890 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 07:10:48.448890 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 07:10:48.449862 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 07:10:48.449862 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 07:10:48.449862 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 07:10:48.449862 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 07:10:48.449862 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 07:10:48.449862 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 07:10:48.449862 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 07:10:48.449862 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 07:10:48.449862 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 07:10:48.449862 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self.get_or_create( May 04 07:10:48.449862 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 07:10:48.449862 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application with Lock( May 04 07:10:48.449862 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 07:10:48.449862 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self._enter() May 04 07:10:48.449862 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 07:10:48.449862 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 07:10:48.450778 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 07:10:48.450778 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self.creator() May 04 07:10:48.450778 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 07:10:48.450778 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application created_value = creator( May 04 07:10:48.450778 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 07:10:48.450778 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 07:10:48.450778 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 07:10:48.450778 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 07:10:48.450778 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 07:10:48.450778 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 07:10:48.450778 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 04 07:10:48.450778 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application May 04 07:10:48.450778 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 238/485] 10.222.0.21 () {56 vars in 1102 bytes} [Wed May 4 07:10:48 2022] GET /identity/v3/roles/service => generated 85 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 07:10:48.460652 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf72c05f-bb90-4103-9959-b2349967bf8d None None] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:10:48.467994 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733de45f-7d08-4aec-8d88-3f403ec1ebbc None admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:10:48.611999 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733de45f-7d08-4aec-8d88-3f403ec1ebbc None admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:10:48.650063 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8963e265-db8e-46ff-a8cb-35fd0ea96381 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:10:48.650853 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8963e265-db8e-46ff-a8cb-35fd0ea96381 None admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:10:48.651128 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8963e265-db8e-46ff-a8cb-35fd0ea96381 None admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:10:48.651425 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8963e265-db8e-46ff-a8cb-35fd0ea96381 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:10:48.665460 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf72c05f-bb90-4103-9959-b2349967bf8d None None] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:10:48.678608 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8963e265-db8e-46ff-a8cb-35fd0ea96381 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 07:10:48.686857 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application [None req-8963e265-db8e-46ff-a8cb-35fd0ea96381 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 04 07:10:48.686857 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 07:10:48.686857 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 07:10:48.686857 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 07:10:48.686857 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 07:10:48.686857 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 07:10:48.686857 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 07:10:48.686857 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 07:10:48.686857 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 07:10:48.686857 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 07:10:48.686857 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 07:10:48.686857 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 07:10:48.686857 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 07:10:48.686857 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 07:10:48.686857 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 07:10:48.686857 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 07:10:48.687751 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 07:10:48.687751 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 07:10:48.687751 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 07:10:48.687751 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 07:10:48.687751 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 07:10:48.687751 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 07:10:48.687751 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 07:10:48.687751 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 07:10:48.687751 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 07:10:48.687751 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self.get_or_create( May 04 07:10:48.687751 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 07:10:48.687751 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application with Lock( May 04 07:10:48.687751 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 07:10:48.687751 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self._enter() May 04 07:10:48.687751 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 07:10:48.687751 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 07:10:48.688564 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 07:10:48.688564 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self.creator() May 04 07:10:48.688564 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 07:10:48.688564 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application created_value = creator( May 04 07:10:48.688564 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 07:10:48.688564 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 07:10:48.688564 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 07:10:48.688564 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 07:10:48.688564 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 07:10:48.688564 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 07:10:48.688564 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 04 07:10:48.688564 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application May 04 07:10:48.697227 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 239/486] 10.222.0.21 () {56 vars in 1102 bytes} [Wed May 4 07:10:48 2022] GET /identity/v3/roles/service => generated 85 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 07:10:48.703947 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8963e265-db8e-46ff-a8cb-35fd0ea96381 None admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:10:48.733415 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c6dd66-7c8b-4e0c-9115-394554711694 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:10:48.734479 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c6dd66-7c8b-4e0c-9115-394554711694 None admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:10:48.734951 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c6dd66-7c8b-4e0c-9115-394554711694 None admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:10:48.735439 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c6dd66-7c8b-4e0c-9115-394554711694 None admin] PATH_INFO: `/v3/roles` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:10:48.736429 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c6dd66-7c8b-4e0c-9115-394554711694 None admin] RBAC: Adding query filter params (name=service) {{(pid=79744) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 07:10:48.736958 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c6dd66-7c8b-4e0c-9115-394554711694 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:10:48.738610 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c6dd66-7c8b-4e0c-9115-394554711694 None admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:10:48.759104 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 248/487] 10.222.0.21 () {56 vars in 1103 bytes} [Wed May 4 07:10:48 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 07:10:48.778412 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c6dd66-7c8b-4e0c-9115-394554711694 None admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:10:48.825676 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8963e265-db8e-46ff-a8cb-35fd0ea96381 None admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:10:48.867110 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a335a3-a3fd-445b-8ffb-5363090e6d58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:10:48.868155 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a335a3-a3fd-445b-8ffb-5363090e6d58 None admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:10:48.868459 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a335a3-a3fd-445b-8ffb-5363090e6d58 None admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:10:48.868737 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a335a3-a3fd-445b-8ffb-5363090e6d58 None admin] PATH_INFO: `/v3/roles` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:10:48.869765 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a335a3-a3fd-445b-8ffb-5363090e6d58 None admin] RBAC: Adding query filter params (name=service) {{(pid=79745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 07:10:48.870079 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a335a3-a3fd-445b-8ffb-5363090e6d58 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:10:48.871552 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a335a3-a3fd-445b-8ffb-5363090e6d58 None admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:10:48.890521 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 240/488] 10.222.0.21 () {56 vars in 1103 bytes} [Wed May 4 07:10:48 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 07:10:48.890521 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66218960-9c2f-4cb4-9614-3c7dda398d01 None None] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:10:48.890521 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66218960-9c2f-4cb4-9614-3c7dda398d01 None None] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:10:48.890521 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66218960-9c2f-4cb4-9614-3c7dda398d01 None None] PATH_INFO: `/` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:10:48.890521 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 241/489] 10.222.0.21 () {54 vars in 926 bytes} [Wed May 4 07:10:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 07:10:48.890521 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66218960-9c2f-4cb4-9614-3c7dda398d01 None None] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:10:48.925948 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c6dd66-7c8b-4e0c-9115-394554711694 None admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:10:48.961316 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e54d550-3305-4b62-84aa-e69b48466718 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:10:48.962103 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e54d550-3305-4b62-84aa-e69b48466718 None admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:10:48.962377 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e54d550-3305-4b62-84aa-e69b48466718 None admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:10:48.962650 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e54d550-3305-4b62-84aa-e69b48466718 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:10:48.973161 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e54d550-3305-4b62-84aa-e69b48466718 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:10:48.974585 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e54d550-3305-4b62-84aa-e69b48466718 None admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:10:48.992322 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application [None req-2e54d550-3305-4b62-84aa-e69b48466718 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 07:10:48.992322 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 07:10:48.992322 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 07:10:48.992322 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 07:10:48.992322 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 07:10:48.992322 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 07:10:48.992322 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 07:10:48.992322 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 07:10:48.992322 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 07:10:48.992322 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 07:10:48.992322 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 07:10:48.992322 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 07:10:48.992322 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 07:10:48.992322 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 07:10:48.992322 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 07:10:48.993201 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 07:10:48.993201 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 07:10:48.993201 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 07:10:48.993201 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 07:10:48.993201 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 07:10:48.993201 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 07:10:48.993201 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.get_or_create( May 04 07:10:48.993201 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 07:10:48.993201 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application with Lock( May 04 07:10:48.993201 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 07:10:48.993201 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self._enter() May 04 07:10:48.993201 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 07:10:48.993201 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 07:10:48.993201 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 07:10:48.993201 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.creator() May 04 07:10:48.993201 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 07:10:48.993201 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application created_value = creator( May 04 07:10:48.994070 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 07:10:48.994070 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 07:10:48.994070 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 07:10:48.994070 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application May 04 07:10:48.994070 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 249/490] 10.222.0.21 () {56 vars in 1108 bytes} [Wed May 4 07:10:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 07:10:48.994756 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8a326d-2e89-4dfc-bdf9-fecaaf6a6965 None None] REQUEST_METHOD: `POST` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:10:48.995206 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8a326d-2e89-4dfc-bdf9-fecaaf6a6965 None None] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:10:48.995319 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8a326d-2e89-4dfc-bdf9-fecaaf6a6965 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:10:49.004138 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66218960-9c2f-4cb4-9614-3c7dda398d01 None None] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:10:49.012933 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.auth.core [None req-2b8a326d-2e89-4dfc-bdf9-fecaaf6a6965 None None] MFA Rules not processed for user `83c5e0dcb991496ea6dee38384514508`. Rule list: `[]` (Enabled: `True`). {{(pid=79744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:10:49.014097 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.fernet_utils [None req-2b8a326d-2e89-4dfc-bdf9-fecaaf6a6965 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:10:49.045970 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4e3756-e866-4719-bc72-b8d5ecb6b128 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:10:49.046765 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4e3756-e866-4719-bc72-b8d5ecb6b128 None admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:10:49.047074 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4e3756-e866-4719-bc72-b8d5ecb6b128 None admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:10:49.047374 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4e3756-e866-4719-bc72-b8d5ecb6b128 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:10:49.057732 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4e3756-e866-4719-bc72-b8d5ecb6b128 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:10:49.059986 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4e3756-e866-4719-bc72-b8d5ecb6b128 None admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:10:49.077615 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application [None req-1e4e3756-e866-4719-bc72-b8d5ecb6b128 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 07:10:49.077615 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 07:10:49.077615 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 07:10:49.077615 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 07:10:49.077615 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 07:10:49.077615 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 07:10:49.077615 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 07:10:49.077615 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 07:10:49.077615 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 07:10:49.077615 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 07:10:49.077615 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 07:10:49.077615 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 07:10:49.077615 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 07:10:49.077615 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 07:10:49.077615 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 07:10:49.078483 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 07:10:49.078483 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 07:10:49.078483 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 07:10:49.078483 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 07:10:49.078483 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 07:10:49.078483 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 07:10:49.078483 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self.get_or_create( May 04 07:10:49.078483 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 07:10:49.078483 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application with Lock( May 04 07:10:49.078483 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 07:10:49.078483 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self._enter() May 04 07:10:49.078483 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 07:10:49.078483 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 07:10:49.078483 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 07:10:49.078483 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self.creator() May 04 07:10:49.078483 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 07:10:49.078483 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application created_value = creator( May 04 07:10:49.079391 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 07:10:49.079391 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 07:10:49.079391 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 07:10:49.079391 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application May 04 07:10:49.079391 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 242/491] 10.222.0.21 () {56 vars in 1108 bytes} [Wed May 4 07:10:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 07:10:49.080243 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7c9bc3-3bef-4a30-a424-47c03112ff8e None None] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:10:49.080243 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7c9bc3-3bef-4a30-a424-47c03112ff8e None None] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:10:49.080528 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7c9bc3-3bef-4a30-a424-47c03112ff8e None None] PATH_INFO: `/` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:10:49.081873 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 243/492] 10.222.0.21 () {54 vars in 926 bytes} [Wed May 4 07:10:49 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 07:10:49.082423 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7c9bc3-3bef-4a30-a424-47c03112ff8e None None] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:10:49.095855 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 250/493] 10.222.0.21 () {58 vars in 1023 bytes} [Wed May 4 07:10:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 07:10:49.096937 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8a326d-2e89-4dfc-bdf9-fecaaf6a6965 None None] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:10:49.188528 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7c9bc3-3bef-4a30-a424-47c03112ff8e None None] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:10:49.206127 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8a326d-2e89-4dfc-bdf9-fecaaf6a6965 None None] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:10:49.223506 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d28be87-5f7e-4827-9074-3d0e4286a155 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:10:49.224248 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d28be87-5f7e-4827-9074-3d0e4286a155 None admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:10:49.224532 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d28be87-5f7e-4827-9074-3d0e4286a155 None admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:10:49.224804 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d28be87-5f7e-4827-9074-3d0e4286a155 None admin] PATH_INFO: `/v3/domains` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:10:49.225524 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d28be87-5f7e-4827-9074-3d0e4286a155 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 07:10:49.225831 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d28be87-5f7e-4827-9074-3d0e4286a155 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:10:49.227370 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d28be87-5f7e-4827-9074-3d0e4286a155 None admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:10:49.239399 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 244/494] 10.222.0.21 () {56 vars in 1109 bytes} [Wed May 4 07:10:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 07:10:49.240747 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22ed9ee-7709-4add-9ecd-6281ba71ee65 None None] REQUEST_METHOD: `POST` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:10:49.241096 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22ed9ee-7709-4add-9ecd-6281ba71ee65 None None] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:10:49.241437 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22ed9ee-7709-4add-9ecd-6281ba71ee65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:10:49.244504 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a90421-c7ed-46d1-9428-c40ef5dd20c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:10:49.245168 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a90421-c7ed-46d1-9428-c40ef5dd20c1 None admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:10:49.245445 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a90421-c7ed-46d1-9428-c40ef5dd20c1 None admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:10:49.245712 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a90421-c7ed-46d1-9428-c40ef5dd20c1 None admin] PATH_INFO: `/v3/domains` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:10:49.247005 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a90421-c7ed-46d1-9428-c40ef5dd20c1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79744) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 07:10:49.247379 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a90421-c7ed-46d1-9428-c40ef5dd20c1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:10:49.249501 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a90421-c7ed-46d1-9428-c40ef5dd20c1 None admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:10:49.259592 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.auth.core [None req-f22ed9ee-7709-4add-9ecd-6281ba71ee65 None None] MFA Rules not processed for user `83c5e0dcb991496ea6dee38384514508`. Rule list: `[]` (Enabled: `True`). {{(pid=79745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:10:49.264789 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 251/495] 10.222.0.21 () {56 vars in 1109 bytes} [Wed May 4 07:10:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 07:10:49.264923 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.fernet_utils [None req-f22ed9ee-7709-4add-9ecd-6281ba71ee65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:10:49.265036 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a90421-c7ed-46d1-9428-c40ef5dd20c1 None admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:10:49.331313 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 245/496] 10.222.0.21 () {58 vars in 1023 bytes} [Wed May 4 07:10:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 07:10:49.332920 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22ed9ee-7709-4add-9ecd-6281ba71ee65 None None] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:10:49.361913 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a90421-c7ed-46d1-9428-c40ef5dd20c1 None admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:10:49.393453 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003d30b7-20f7-4b05-a5ba-666f361baf42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:10:49.394237 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003d30b7-20f7-4b05-a5ba-666f361baf42 None admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:10:49.394513 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003d30b7-20f7-4b05-a5ba-666f361baf42 None admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:10:49.394784 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003d30b7-20f7-4b05-a5ba-666f361baf42 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:10:49.404992 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003d30b7-20f7-4b05-a5ba-666f361baf42 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 07:10:49.412629 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application [None req-003d30b7-20f7-4b05-a5ba-666f361baf42 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 04 07:10:49.412629 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 07:10:49.412629 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 07:10:49.412629 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 07:10:49.412629 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 07:10:49.412629 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 07:10:49.412629 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 07:10:49.412629 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 07:10:49.412629 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 07:10:49.412629 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 07:10:49.412629 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 07:10:49.412629 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 07:10:49.412629 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 07:10:49.412629 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 07:10:49.412629 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 07:10:49.412629 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 07:10:49.413601 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 07:10:49.413601 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 07:10:49.413601 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 07:10:49.413601 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 07:10:49.413601 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 07:10:49.413601 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 07:10:49.413601 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 07:10:49.413601 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 07:10:49.413601 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 07:10:49.413601 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.get_or_create( May 04 07:10:49.413601 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 07:10:49.413601 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application with Lock( May 04 07:10:49.413601 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 07:10:49.413601 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self._enter() May 04 07:10:49.413601 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 07:10:49.413601 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 07:10:49.414457 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 07:10:49.414457 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.creator() May 04 07:10:49.414457 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 07:10:49.414457 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application created_value = creator( May 04 07:10:49.414457 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 07:10:49.414457 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 07:10:49.414457 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 07:10:49.414457 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 07:10:49.414457 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 07:10:49.414457 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 07:10:49.414457 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 04 07:10:49.414457 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application May 04 07:10:49.414457 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 252/497] 10.222.0.21 () {56 vars in 1102 bytes} [Wed May 4 07:10:49 2022] GET /identity/v3/roles/service => generated 85 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 07:10:49.415117 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003d30b7-20f7-4b05-a5ba-666f361baf42 None admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:10:49.430986 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22ed9ee-7709-4add-9ecd-6281ba71ee65 None None] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:10:49.465936 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d59588-5dea-43ab-aae7-c61528d6d7ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:10:49.466720 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d59588-5dea-43ab-aae7-c61528d6d7ed None admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:10:49.466994 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d59588-5dea-43ab-aae7-c61528d6d7ed None admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:10:49.467307 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d59588-5dea-43ab-aae7-c61528d6d7ed None admin] PATH_INFO: `/v3/users/glance` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:10:49.475509 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d59588-5dea-43ab-aae7-c61528d6d7ed None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:10:49.476930 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d59588-5dea-43ab-aae7-c61528d6d7ed None admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:10:49.491978 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application [None req-e7d59588-5dea-43ab-aae7-c61528d6d7ed None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 04 07:10:49.491978 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 07:10:49.491978 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 07:10:49.491978 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 07:10:49.491978 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 07:10:49.491978 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 07:10:49.491978 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 07:10:49.491978 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 07:10:49.491978 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 07:10:49.491978 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 07:10:49.491978 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 07:10:49.491978 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 07:10:49.491978 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 04 07:10:49.491978 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self._get_user(user_id) May 04 07:10:49.491978 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 04 07:10:49.491978 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 04 07:10:49.492900 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 07:10:49.492900 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 07:10:49.492900 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 04 07:10:49.492900 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 07:10:49.492900 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 04 07:10:49.492900 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 07:10:49.492900 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 07:10:49.492900 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 07:10:49.492900 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 07:10:49.492900 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self.get_or_create( May 04 07:10:49.492900 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 07:10:49.492900 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application with Lock( May 04 07:10:49.492900 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 07:10:49.492900 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self._enter() May 04 07:10:49.492900 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 07:10:49.492900 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 07:10:49.492900 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 07:10:49.492900 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self.creator() May 04 07:10:49.499014 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 07:10:49.499014 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application created_value = creator( May 04 07:10:49.499014 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 04 07:10:49.499014 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 04 07:10:49.499014 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 04 07:10:49.499014 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 04 07:10:49.499014 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 04 07:10:49.499014 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 04 07:10:49.499014 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 04 07:10:49.499014 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application May 04 07:10:49.499014 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 246/498] 10.222.0.21 () {56 vars in 1099 bytes} [Wed May 4 07:10:49 2022] GET /identity/v3/users/glance => generated 84 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 07:10:49.499014 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0370b47c-10f7-480c-917a-13ecc1e0759e None None] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:10:49.499014 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0370b47c-10f7-480c-917a-13ecc1e0759e None None] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:10:49.499756 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0370b47c-10f7-480c-917a-13ecc1e0759e None None] PATH_INFO: `/` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:10:49.499756 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 247/499] 10.222.0.21 () {54 vars in 926 bytes} [Wed May 4 07:10:49 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 07:10:49.499756 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0370b47c-10f7-480c-917a-13ecc1e0759e None None] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:10:49.517151 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003d30b7-20f7-4b05-a5ba-666f361baf42 None admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:10:49.549194 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06426fa3-707a-461b-b036-238f45c3e442 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:10:49.549977 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06426fa3-707a-461b-b036-238f45c3e442 None admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:10:49.550254 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06426fa3-707a-461b-b036-238f45c3e442 None admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:10:49.550518 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06426fa3-707a-461b-b036-238f45c3e442 None admin] PATH_INFO: `/v3/users/nova` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:10:49.557785 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06426fa3-707a-461b-b036-238f45c3e442 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:10:49.559500 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06426fa3-707a-461b-b036-238f45c3e442 None admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:10:49.575131 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application [None req-06426fa3-707a-461b-b036-238f45c3e442 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 04 07:10:49.575131 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 07:10:49.575131 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 07:10:49.575131 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 07:10:49.575131 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 07:10:49.575131 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 07:10:49.575131 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 07:10:49.575131 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 07:10:49.575131 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 07:10:49.575131 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 07:10:49.575131 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 07:10:49.575131 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 07:10:49.575131 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 04 07:10:49.575131 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self._get_user(user_id) May 04 07:10:49.575131 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 04 07:10:49.575131 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 04 07:10:49.576074 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 07:10:49.576074 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 07:10:49.576074 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 04 07:10:49.576074 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 07:10:49.576074 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 04 07:10:49.576074 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 07:10:49.576074 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 07:10:49.576074 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 07:10:49.576074 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 07:10:49.576074 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.get_or_create( May 04 07:10:49.576074 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 07:10:49.576074 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application with Lock( May 04 07:10:49.576074 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 07:10:49.576074 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self._enter() May 04 07:10:49.576074 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 07:10:49.576074 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 07:10:49.576074 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 07:10:49.576074 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.creator() May 04 07:10:49.576989 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 07:10:49.576989 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application created_value = creator( May 04 07:10:49.576989 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 04 07:10:49.576989 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 04 07:10:49.576989 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 04 07:10:49.576989 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 04 07:10:49.576989 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 04 07:10:49.576989 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 04 07:10:49.576989 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 04 07:10:49.576989 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application May 04 07:10:49.576989 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 253/500] 10.222.0.21 () {56 vars in 1093 bytes} [Wed May 4 07:10:49 2022] GET /identity/v3/users/nova => generated 82 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 07:10:49.577557 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06426fa3-707a-461b-b036-238f45c3e442 None admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:10:49.611217 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0370b47c-10f7-480c-917a-13ecc1e0759e None None] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:10:49.643236 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9505ed27-e657-41e1-95d5-203e39b79009 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:10:49.644011 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9505ed27-e657-41e1-95d5-203e39b79009 None admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:10:49.644284 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9505ed27-e657-41e1-95d5-203e39b79009 None admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:10:49.644549 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9505ed27-e657-41e1-95d5-203e39b79009 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:10:49.654710 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9505ed27-e657-41e1-95d5-203e39b79009 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 07:10:49.662283 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application [None req-9505ed27-e657-41e1-95d5-203e39b79009 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 04 07:10:49.662283 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 07:10:49.662283 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 07:10:49.662283 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 07:10:49.662283 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 07:10:49.662283 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 07:10:49.662283 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 07:10:49.662283 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 07:10:49.662283 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 07:10:49.662283 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 07:10:49.662283 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 07:10:49.662283 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 07:10:49.662283 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 07:10:49.662283 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 07:10:49.662283 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 07:10:49.662283 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 07:10:49.663193 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 07:10:49.663193 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 07:10:49.663193 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 07:10:49.663193 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 07:10:49.663193 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 07:10:49.663193 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 07:10:49.663193 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 07:10:49.663193 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 07:10:49.663193 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 07:10:49.663193 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self.get_or_create( May 04 07:10:49.663193 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 07:10:49.663193 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application with Lock( May 04 07:10:49.663193 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 07:10:49.663193 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self._enter() May 04 07:10:49.663193 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 07:10:49.663193 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 07:10:49.664030 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 07:10:49.664030 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self.creator() May 04 07:10:49.664030 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 07:10:49.664030 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application created_value = creator( May 04 07:10:49.664030 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 07:10:49.664030 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 07:10:49.664030 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 07:10:49.664030 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 07:10:49.664030 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 07:10:49.664030 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 07:10:49.664030 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 04 07:10:49.664030 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application May 04 07:10:49.664632 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 248/501] 10.222.0.21 () {56 vars in 1102 bytes} [Wed May 4 07:10:49 2022] GET /identity/v3/roles/service => generated 85 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 07:10:49.665143 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9505ed27-e657-41e1-95d5-203e39b79009 None admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:10:49.674070 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06426fa3-707a-461b-b036-238f45c3e442 None admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:10:49.705641 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5909fd6b-26f2-4e3a-bea5-be8d7a54aadc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:10:49.706228 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5909fd6b-26f2-4e3a-bea5-be8d7a54aadc None admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:10:49.706503 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5909fd6b-26f2-4e3a-bea5-be8d7a54aadc None admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:10:49.706772 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5909fd6b-26f2-4e3a-bea5-be8d7a54aadc None admin] PATH_INFO: `/v3/roles` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:10:49.707532 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5909fd6b-26f2-4e3a-bea5-be8d7a54aadc None admin] RBAC: Adding query filter params (name=service) {{(pid=79744) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 07:10:49.707832 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5909fd6b-26f2-4e3a-bea5-be8d7a54aadc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:10:49.709189 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5909fd6b-26f2-4e3a-bea5-be8d7a54aadc None admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:10:49.721538 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 254/502] 10.222.0.21 () {56 vars in 1103 bytes} [Wed May 4 07:10:49 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 07:10:49.721538 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7bd1cd-ffee-4df3-bd82-4513fec2f48c None None] REQUEST_METHOD: `POST` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:10:49.721538 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7bd1cd-ffee-4df3-bd82-4513fec2f48c None None] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:10:49.721538 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7bd1cd-ffee-4df3-bd82-4513fec2f48c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:10:49.734644 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.auth.core [None req-6c7bd1cd-ffee-4df3-bd82-4513fec2f48c None None] MFA Rules not processed for user `83c5e0dcb991496ea6dee38384514508`. Rule list: `[]` (Enabled: `True`). {{(pid=79744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:10:49.735856 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.fernet_utils [None req-6c7bd1cd-ffee-4df3-bd82-4513fec2f48c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:10:49.758242 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9505ed27-e657-41e1-95d5-203e39b79009 None admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:10:49.789916 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22c0467-ba78-4506-a4c6-3e19fc7634ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:10:49.790563 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22c0467-ba78-4506-a4c6-3e19fc7634ed None admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:10:49.790838 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22c0467-ba78-4506-a4c6-3e19fc7634ed None admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:10:49.791114 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22c0467-ba78-4506-a4c6-3e19fc7634ed None admin] PATH_INFO: `/v3/users` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:10:49.791979 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22c0467-ba78-4506-a4c6-3e19fc7634ed None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=79745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 07:10:49.792281 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22c0467-ba78-4506-a4c6-3e19fc7634ed None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:10:49.793879 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22c0467-ba78-4506-a4c6-3e19fc7634ed None admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:10:49.798308 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 255/503] 10.222.0.21 () {58 vars in 1023 bytes} [Wed May 4 07:10:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 07:10:49.799135 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7bd1cd-ffee-4df3-bd82-4513fec2f48c None None] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:10:49.835250 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 249/504] 10.222.0.21 () {56 vars in 1137 bytes} [Wed May 4 07:10:49 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 07:10:49.835250 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22c0467-ba78-4506-a4c6-3e19fc7634ed None admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:10:49.904270 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7bd1cd-ffee-4df3-bd82-4513fec2f48c None None] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:10:49.931908 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22c0467-ba78-4506-a4c6-3e19fc7634ed None admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:10:49.935607 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b666268-7a76-4f40-8c1a-ab1f15a54c62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:10:49.936267 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b666268-7a76-4f40-8c1a-ab1f15a54c62 None admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:10:49.936542 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b666268-7a76-4f40-8c1a-ab1f15a54c62 None admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:10:49.936810 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b666268-7a76-4f40-8c1a-ab1f15a54c62 None admin] PATH_INFO: `/v3/users` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:10:49.937624 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b666268-7a76-4f40-8c1a-ab1f15a54c62 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79744) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 07:10:49.937924 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b666268-7a76-4f40-8c1a-ab1f15a54c62 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:10:49.939348 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b666268-7a76-4f40-8c1a-ab1f15a54c62 None admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:10:49.963770 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5be030f-90f0-49a9-a6ec-7799078e0981 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:10:49.964352 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5be030f-90f0-49a9-a6ec-7799078e0981 None admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:10:49.964624 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5be030f-90f0-49a9-a6ec-7799078e0981 None admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:10:49.965148 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5be030f-90f0-49a9-a6ec-7799078e0981 None admin] PATH_INFO: `/v3/roles` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:10:49.965877 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5be030f-90f0-49a9-a6ec-7799078e0981 None admin] RBAC: Adding query filter params (name=service) {{(pid=79745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 07:10:49.966178 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5be030f-90f0-49a9-a6ec-7799078e0981 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:10:49.967753 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5be030f-90f0-49a9-a6ec-7799078e0981 None admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:10:49.975344 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 250/505] 10.222.0.21 () {56 vars in 1103 bytes} [Wed May 4 07:10:49 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 07:10:49.979922 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 256/506] 10.222.0.21 () {56 vars in 1133 bytes} [Wed May 4 07:10:49 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 07:10:49.980021 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5be030f-90f0-49a9-a6ec-7799078e0981 None admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:10:49.980096 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b666268-7a76-4f40-8c1a-ab1f15a54c62 None admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:10:50.071055 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5be030f-90f0-49a9-a6ec-7799078e0981 None admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:10:50.073482 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b666268-7a76-4f40-8c1a-ab1f15a54c62 None admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:10:50.102196 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2071f64-b2b4-41fe-b4ff-dcd85641af38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:10:50.102968 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2071f64-b2b4-41fe-b4ff-dcd85641af38 None admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:10:50.103270 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2071f64-b2b4-41fe-b4ff-dcd85641af38 None admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:10:50.103536 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2071f64-b2b4-41fe-b4ff-dcd85641af38 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:10:50.105331 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7e8645-5cf5-4f46-9f90-d61b6f445f0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:10:50.106637 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7e8645-5cf5-4f46-9f90-d61b6f445f0f None admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:10:50.106912 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7e8645-5cf5-4f46-9f90-d61b6f445f0f None admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:10:50.107216 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7e8645-5cf5-4f46-9f90-d61b6f445f0f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:10:50.114235 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2071f64-b2b4-41fe-b4ff-dcd85641af38 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:10:50.115709 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2071f64-b2b4-41fe-b4ff-dcd85641af38 None admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:10:50.116768 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7e8645-5cf5-4f46-9f90-d61b6f445f0f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:10:50.118201 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7e8645-5cf5-4f46-9f90-d61b6f445f0f None admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:10:50.131791 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application [None req-c2071f64-b2b4-41fe-b4ff-dcd85641af38 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 07:10:50.131791 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 07:10:50.131791 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 07:10:50.131791 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 07:10:50.131791 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 07:10:50.131791 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 07:10:50.131791 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 07:10:50.131791 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 07:10:50.131791 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 07:10:50.131791 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 07:10:50.131791 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 07:10:50.131791 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 07:10:50.131791 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 07:10:50.131791 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 07:10:50.131791 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 07:10:50.133051 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 07:10:50.133051 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 07:10:50.133051 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 07:10:50.133051 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 07:10:50.133051 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 07:10:50.133051 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 07:10:50.133051 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self.get_or_create( May 04 07:10:50.133051 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 07:10:50.133051 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application with Lock( May 04 07:10:50.133051 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 07:10:50.133051 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self._enter() May 04 07:10:50.133051 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 07:10:50.133051 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 07:10:50.133051 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 07:10:50.133051 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self.creator() May 04 07:10:50.133051 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 07:10:50.133051 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application created_value = creator( May 04 07:10:50.138767 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 07:10:50.138767 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 07:10:50.138767 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 07:10:50.138767 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application May 04 07:10:50.138767 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 251/507] 10.222.0.21 () {56 vars in 1108 bytes} [Wed May 4 07:10:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 07:10:50.138767 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2071f64-b2b4-41fe-b4ff-dcd85641af38 None admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:10:50.139083 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application [None req-7f7e8645-5cf5-4f46-9f90-d61b6f445f0f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 07:10:50.139083 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 07:10:50.139083 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 07:10:50.139083 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 07:10:50.139083 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 07:10:50.139083 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 07:10:50.139083 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 07:10:50.139083 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 07:10:50.139083 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 07:10:50.139083 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 07:10:50.139083 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 07:10:50.139083 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 07:10:50.139083 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 07:10:50.139083 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 07:10:50.139083 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 07:10:50.140197 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 07:10:50.140197 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 07:10:50.140197 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 07:10:50.140197 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 07:10:50.140197 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 07:10:50.140197 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 07:10:50.140197 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.get_or_create( May 04 07:10:50.140197 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 07:10:50.140197 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application with Lock( May 04 07:10:50.140197 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 07:10:50.140197 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self._enter() May 04 07:10:50.140197 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 07:10:50.140197 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 07:10:50.140197 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 07:10:50.140197 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.creator() May 04 07:10:50.140197 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 07:10:50.140197 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application created_value = creator( May 04 07:10:50.141048 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 07:10:50.141048 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 07:10:50.141048 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 07:10:50.141048 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application May 04 07:10:50.141048 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 257/508] 10.222.0.21 () {56 vars in 1108 bytes} [Wed May 4 07:10:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 07:10:50.141048 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7e8645-5cf5-4f46-9f90-d61b6f445f0f None admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:10:50.226650 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2071f64-b2b4-41fe-b4ff-dcd85641af38 None admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:10:50.238273 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7e8645-5cf5-4f46-9f90-d61b6f445f0f None admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:10:50.259401 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1e0419-837c-4caf-97bb-f5b1cb5c281f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:10:50.260036 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1e0419-837c-4caf-97bb-f5b1cb5c281f None admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:10:50.260311 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1e0419-837c-4caf-97bb-f5b1cb5c281f None admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:10:50.260580 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1e0419-837c-4caf-97bb-f5b1cb5c281f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:10:50.270344 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba4371d-d41e-41c5-aade-44454d135f1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:10:50.271178 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba4371d-d41e-41c5-aade-44454d135f1d None admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:10:50.271453 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba4371d-d41e-41c5-aade-44454d135f1d None admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:10:50.271725 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba4371d-d41e-41c5-aade-44454d135f1d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:10:50.282372 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba4371d-d41e-41c5-aade-44454d135f1d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:10:50.283841 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba4371d-d41e-41c5-aade-44454d135f1d None admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:10:50.300102 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application [None req-9ba4371d-d41e-41c5-aade-44454d135f1d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 07:10:50.300102 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 07:10:50.300102 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 07:10:50.300102 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 07:10:50.300102 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 07:10:50.300102 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 07:10:50.300102 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 07:10:50.300102 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 07:10:50.300102 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 07:10:50.300102 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 07:10:50.300102 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 07:10:50.300102 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 07:10:50.300102 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 07:10:50.300102 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 07:10:50.300102 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 07:10:50.301148 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 07:10:50.301148 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 07:10:50.301148 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 07:10:50.301148 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 07:10:50.301148 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 07:10:50.301148 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 07:10:50.301148 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.get_or_create( May 04 07:10:50.301148 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 07:10:50.301148 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application with Lock( May 04 07:10:50.301148 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 07:10:50.301148 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self._enter() May 04 07:10:50.301148 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 07:10:50.301148 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 07:10:50.301148 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 07:10:50.301148 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.creator() May 04 07:10:50.301148 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 07:10:50.301148 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application created_value = creator( May 04 07:10:50.306815 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 07:10:50.306815 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 07:10:50.306815 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 07:10:50.306815 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application May 04 07:10:50.306815 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 258/509] 10.222.0.21 () {56 vars in 1108 bytes} [Wed May 4 07:10:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 07:10:50.306815 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba4371d-d41e-41c5-aade-44454d135f1d None admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:10:50.324707 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1e0419-837c-4caf-97bb-f5b1cb5c281f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:10:50.326149 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1e0419-837c-4caf-97bb-f5b1cb5c281f None admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:10:50.396076 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba4371d-d41e-41c5-aade-44454d135f1d None admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:10:50.417347 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 252/510] 10.222.0.21 () {58 vars in 1282 bytes} [Wed May 4 07:10:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 283 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 04 07:10:50.418193 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1e0419-837c-4caf-97bb-f5b1cb5c281f None admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:10:50.427719 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1720d0d-3c3e-4efc-b2b6-13750004f816 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:10:50.428359 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1720d0d-3c3e-4efc-b2b6-13750004f816 None admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:10:50.428638 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1720d0d-3c3e-4efc-b2b6-13750004f816 None admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:10:50.428910 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1720d0d-3c3e-4efc-b2b6-13750004f816 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:10:50.494658 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1720d0d-3c3e-4efc-b2b6-13750004f816 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:10:50.496100 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1720d0d-3c3e-4efc-b2b6-13750004f816 None admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:10:50.512079 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1e0419-837c-4caf-97bb-f5b1cb5c281f None admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:10:50.542697 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0e85f7-b887-432d-93d7-048f57bcf572 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:10:50.544216 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0e85f7-b887-432d-93d7-048f57bcf572 None admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:10:50.544505 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0e85f7-b887-432d-93d7-048f57bcf572 None admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:10:50.544770 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0e85f7-b887-432d-93d7-048f57bcf572 None admin] PATH_INFO: `/v3/domains` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:10:50.545480 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0e85f7-b887-432d-93d7-048f57bcf572 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 07:10:50.545779 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0e85f7-b887-432d-93d7-048f57bcf572 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:10:50.547128 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0e85f7-b887-432d-93d7-048f57bcf572 None admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:10:50.557481 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 253/511] 10.222.0.21 () {56 vars in 1109 bytes} [Wed May 4 07:10:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 07:10:50.558247 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0e85f7-b887-432d-93d7-048f57bcf572 None admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:10:50.594061 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 259/512] 10.222.0.21 () {58 vars in 1282 bytes} [Wed May 4 07:10:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 04 07:10:50.594885 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1720d0d-3c3e-4efc-b2b6-13750004f816 None admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:10:50.649830 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0e85f7-b887-432d-93d7-048f57bcf572 None admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:10:50.680967 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0cad1a-b221-463b-b35c-519be53d0daf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:10:50.681615 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0cad1a-b221-463b-b35c-519be53d0daf None admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:10:50.681895 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0cad1a-b221-463b-b35c-519be53d0daf None admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:10:50.682170 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0cad1a-b221-463b-b35c-519be53d0daf None admin] PATH_INFO: `/v3/domains` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:10:50.682883 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0cad1a-b221-463b-b35c-519be53d0daf None admin] RBAC: Adding query filter params (name=Default) {{(pid=79745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 07:10:50.683211 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0cad1a-b221-463b-b35c-519be53d0daf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:10:50.685200 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0cad1a-b221-463b-b35c-519be53d0daf None admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:10:50.688796 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1720d0d-3c3e-4efc-b2b6-13750004f816 None admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:10:50.696242 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 254/513] 10.222.0.21 () {56 vars in 1109 bytes} [Wed May 4 07:10:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 07:10:50.697026 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0cad1a-b221-463b-b35c-519be53d0daf None admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:10:50.721870 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1d4067-b377-4bef-8b12-dfada6573458 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:10:50.722514 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1d4067-b377-4bef-8b12-dfada6573458 None admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:10:50.722799 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1d4067-b377-4bef-8b12-dfada6573458 None admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:10:50.723065 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1d4067-b377-4bef-8b12-dfada6573458 None admin] PATH_INFO: `/v3/domains` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:10:50.723797 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1d4067-b377-4bef-8b12-dfada6573458 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79744) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 07:10:50.724095 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1d4067-b377-4bef-8b12-dfada6573458 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:10:50.725440 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1d4067-b377-4bef-8b12-dfada6573458 None admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:10:50.736055 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 260/514] 10.222.0.21 () {56 vars in 1109 bytes} [Wed May 4 07:10:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 07:10:50.736822 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1d4067-b377-4bef-8b12-dfada6573458 None admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:10:50.791929 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0cad1a-b221-463b-b35c-519be53d0daf None admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:10:50.823628 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095e36a1-17fd-4b9d-b3e6-9b145f645471 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:10:50.824962 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095e36a1-17fd-4b9d-b3e6-9b145f645471 None admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:10:50.825231 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095e36a1-17fd-4b9d-b3e6-9b145f645471 None admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:10:50.825484 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095e36a1-17fd-4b9d-b3e6-9b145f645471 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:10:50.830266 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1d4067-b377-4bef-8b12-dfada6573458 None admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:10:50.834856 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095e36a1-17fd-4b9d-b3e6-9b145f645471 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:10:50.836318 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095e36a1-17fd-4b9d-b3e6-9b145f645471 None admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:10:50.852849 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application [None req-095e36a1-17fd-4b9d-b3e6-9b145f645471 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 07:10:50.852849 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 07:10:50.852849 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 07:10:50.852849 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 07:10:50.852849 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 07:10:50.852849 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 07:10:50.852849 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 07:10:50.852849 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 07:10:50.852849 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 07:10:50.852849 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 07:10:50.852849 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 07:10:50.852849 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 07:10:50.852849 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 07:10:50.852849 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 07:10:50.852849 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 07:10:50.853732 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 07:10:50.853732 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 07:10:50.853732 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 07:10:50.853732 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 07:10:50.853732 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 07:10:50.853732 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 07:10:50.853732 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self.get_or_create( May 04 07:10:50.853732 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 07:10:50.853732 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application with Lock( May 04 07:10:50.853732 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 07:10:50.853732 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self._enter() May 04 07:10:50.853732 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 07:10:50.853732 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 07:10:50.853732 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 07:10:50.853732 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self.creator() May 04 07:10:50.853732 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 07:10:50.853732 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application created_value = creator( May 04 07:10:50.854821 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 07:10:50.854821 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 07:10:50.854821 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 07:10:50.854821 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application May 04 07:10:50.854821 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 255/515] 10.222.0.21 () {56 vars in 1108 bytes} [Wed May 4 07:10:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 07:10:50.854821 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095e36a1-17fd-4b9d-b3e6-9b145f645471 None admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:10:50.865287 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c943091-9be0-4e8f-9c7f-8f3edfea7368 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:10:50.866071 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c943091-9be0-4e8f-9c7f-8f3edfea7368 None admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:10:50.866342 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c943091-9be0-4e8f-9c7f-8f3edfea7368 None admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:10:50.866606 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c943091-9be0-4e8f-9c7f-8f3edfea7368 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:10:50.874353 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c943091-9be0-4e8f-9c7f-8f3edfea7368 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:10:50.875801 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c943091-9be0-4e8f-9c7f-8f3edfea7368 None admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:10:50.890225 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application [None req-8c943091-9be0-4e8f-9c7f-8f3edfea7368 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 04 07:10:50.890225 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 07:10:50.890225 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 07:10:50.890225 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 07:10:50.890225 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 07:10:50.890225 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 07:10:50.890225 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 07:10:50.890225 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 07:10:50.890225 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 07:10:50.890225 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 07:10:50.890225 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 07:10:50.890225 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 07:10:50.890225 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 04 07:10:50.890225 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self._get_user(user_id) May 04 07:10:50.890225 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 04 07:10:50.890225 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 04 07:10:50.891216 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 07:10:50.891216 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 07:10:50.891216 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 04 07:10:50.891216 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 07:10:50.891216 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 04 07:10:50.891216 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 07:10:50.891216 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 07:10:50.891216 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 07:10:50.891216 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 07:10:50.891216 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.get_or_create( May 04 07:10:50.891216 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 07:10:50.891216 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application with Lock( May 04 07:10:50.891216 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 07:10:50.891216 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self._enter() May 04 07:10:50.891216 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 07:10:50.891216 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 07:10:50.891216 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 07:10:50.891216 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.creator() May 04 07:10:50.892144 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 07:10:50.892144 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application created_value = creator( May 04 07:10:50.892144 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 04 07:10:50.892144 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 04 07:10:50.892144 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 04 07:10:50.892144 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 04 07:10:50.892144 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 04 07:10:50.892144 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 04 07:10:50.892144 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 04 07:10:50.892144 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application May 04 07:10:50.892144 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 261/516] 10.222.0.21 () {56 vars in 1099 bytes} [Wed May 4 07:10:50 2022] GET /identity/v3/users/cinder => generated 84 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 07:10:50.892144 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c943091-9be0-4e8f-9c7f-8f3edfea7368 None admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:10:50.952560 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095e36a1-17fd-4b9d-b3e6-9b145f645471 None admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:10:50.984649 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c500d21c-ad19-4393-8d79-6e808799bdc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:10:50.985430 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c500d21c-ad19-4393-8d79-6e808799bdc4 None admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:10:50.985709 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c500d21c-ad19-4393-8d79-6e808799bdc4 None admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:10:50.985994 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c500d21c-ad19-4393-8d79-6e808799bdc4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:10:50.987829 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c943091-9be0-4e8f-9c7f-8f3edfea7368 None admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:10:50.995890 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c500d21c-ad19-4393-8d79-6e808799bdc4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:10:50.997488 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c500d21c-ad19-4393-8d79-6e808799bdc4 None admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:10:51.014634 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application [None req-c500d21c-ad19-4393-8d79-6e808799bdc4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 07:10:51.014634 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 07:10:51.014634 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 07:10:51.014634 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 07:10:51.014634 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 07:10:51.014634 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 07:10:51.014634 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 07:10:51.014634 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 07:10:51.014634 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 07:10:51.014634 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 07:10:51.014634 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 07:10:51.014634 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 07:10:51.014634 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 07:10:51.014634 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 07:10:51.014634 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 07:10:51.015514 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 07:10:51.015514 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 07:10:51.015514 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 07:10:51.015514 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 07:10:51.015514 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 07:10:51.015514 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 07:10:51.015514 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self.get_or_create( May 04 07:10:51.015514 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 07:10:51.015514 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application with Lock( May 04 07:10:51.015514 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 07:10:51.015514 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self._enter() May 04 07:10:51.015514 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 07:10:51.015514 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 07:10:51.015514 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 07:10:51.015514 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self.creator() May 04 07:10:51.015514 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 07:10:51.015514 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application created_value = creator( May 04 07:10:51.016380 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 07:10:51.016380 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 07:10:51.016380 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 07:10:51.016380 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application May 04 07:10:51.016380 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 256/517] 10.222.0.21 () {56 vars in 1108 bytes} [Wed May 4 07:10:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 07:10:51.017225 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c500d21c-ad19-4393-8d79-6e808799bdc4 None admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:10:51.019980 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6ee047-5987-4eb7-8475-c96f1d1ee3d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:10:51.020639 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6ee047-5987-4eb7-8475-c96f1d1ee3d5 None admin] REQUEST_METHOD: `POST` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:10:51.020915 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6ee047-5987-4eb7-8475-c96f1d1ee3d5 None admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:10:51.021181 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6ee047-5987-4eb7-8475-c96f1d1ee3d5 None admin] PATH_INFO: `/v3/users` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:10:51.021861 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6ee047-5987-4eb7-8475-c96f1d1ee3d5 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:10:51.023285 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6ee047-5987-4eb7-8475-c96f1d1ee3d5 None admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:10:51.042690 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 262/518] 10.222.0.21 () {60 vars in 1132 bytes} [Wed May 4 07:10:50 2022] POST /identity/v3/users => generated 247 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 07:10:51.043699 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6ee047-5987-4eb7-8475-c96f1d1ee3d5 None admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:10:51.123115 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c500d21c-ad19-4393-8d79-6e808799bdc4 None admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:10:51.158950 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6ee047-5987-4eb7-8475-c96f1d1ee3d5 None admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:10:51.159562 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb097b7-a901-421f-aed2-26195ca9d05f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:10:51.160362 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb097b7-a901-421f-aed2-26195ca9d05f None admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:10:51.160645 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb097b7-a901-421f-aed2-26195ca9d05f None admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:10:51.160914 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb097b7-a901-421f-aed2-26195ca9d05f None admin] PATH_INFO: `/v3/users/neutron` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:10:51.169504 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb097b7-a901-421f-aed2-26195ca9d05f None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:10:51.170980 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb097b7-a901-421f-aed2-26195ca9d05f None admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:10:51.186216 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application [None req-dfb097b7-a901-421f-aed2-26195ca9d05f None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 04 07:10:51.186216 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 07:10:51.186216 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 07:10:51.186216 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 07:10:51.186216 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 07:10:51.186216 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 07:10:51.186216 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 07:10:51.186216 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 07:10:51.186216 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 07:10:51.186216 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 07:10:51.186216 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 07:10:51.186216 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 07:10:51.186216 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 04 07:10:51.186216 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self._get_user(user_id) May 04 07:10:51.186216 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 04 07:10:51.186216 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 04 07:10:51.187444 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 07:10:51.187444 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 07:10:51.187444 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 04 07:10:51.187444 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 07:10:51.187444 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 04 07:10:51.187444 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 07:10:51.187444 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 07:10:51.187444 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 07:10:51.187444 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 07:10:51.187444 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self.get_or_create( May 04 07:10:51.187444 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 07:10:51.187444 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application with Lock( May 04 07:10:51.187444 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 07:10:51.187444 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self._enter() May 04 07:10:51.187444 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 07:10:51.187444 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 07:10:51.187444 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 07:10:51.187444 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self.creator() May 04 07:10:51.188379 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 07:10:51.188379 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application created_value = creator( May 04 07:10:51.188379 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 04 07:10:51.188379 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 04 07:10:51.188379 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 04 07:10:51.188379 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 04 07:10:51.188379 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 04 07:10:51.188379 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 04 07:10:51.188379 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 04 07:10:51.188379 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application May 04 07:10:51.188379 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 257/519] 10.222.0.21 () {56 vars in 1102 bytes} [Wed May 4 07:10:51 2022] GET /identity/v3/users/neutron => generated 85 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 07:10:51.188379 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb097b7-a901-421f-aed2-26195ca9d05f None admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:10:51.198698 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18cc59dd-a88a-46ba-b111-7953f3b43209 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:10:51.199917 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cc59dd-a88a-46ba-b111-7953f3b43209 None admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:10:51.200192 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cc59dd-a88a-46ba-b111-7953f3b43209 None admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:10:51.200621 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cc59dd-a88a-46ba-b111-7953f3b43209 None admin] PATH_INFO: `/v3/domains` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:10:51.201355 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18cc59dd-a88a-46ba-b111-7953f3b43209 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79744) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 07:10:51.201657 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18cc59dd-a88a-46ba-b111-7953f3b43209 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:10:51.203053 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18cc59dd-a88a-46ba-b111-7953f3b43209 None admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:10:51.220391 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 263/520] 10.222.0.21 () {56 vars in 1109 bytes} [Wed May 4 07:10:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 07:10:51.220391 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18cc59dd-a88a-46ba-b111-7953f3b43209 None admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:10:51.295029 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb097b7-a901-421f-aed2-26195ca9d05f None admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:10:51.326613 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18cc59dd-a88a-46ba-b111-7953f3b43209 None admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:10:51.329819 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a9552f-6037-4080-919d-911c30a73312 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:10:51.330477 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a9552f-6037-4080-919d-911c30a73312 None admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:10:51.330752 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a9552f-6037-4080-919d-911c30a73312 None admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:10:51.331018 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a9552f-6037-4080-919d-911c30a73312 None admin] PATH_INFO: `/v3/users` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:10:51.331876 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a9552f-6037-4080-919d-911c30a73312 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=79745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 07:10:51.332180 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a9552f-6037-4080-919d-911c30a73312 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:10:51.333607 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a9552f-6037-4080-919d-911c30a73312 None admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:10:51.352542 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 258/521] 10.222.0.21 () {56 vars in 1137 bytes} [Wed May 4 07:10:51 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 07:10:51.353403 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a9552f-6037-4080-919d-911c30a73312 None admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:10:51.362801 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753b6f24-6cb1-4f09-9567-1eb2464ed1ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:10:51.363489 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753b6f24-6cb1-4f09-9567-1eb2464ed1ec None admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:10:51.363766 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753b6f24-6cb1-4f09-9567-1eb2464ed1ec None admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:10:51.364031 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753b6f24-6cb1-4f09-9567-1eb2464ed1ec None admin] PATH_INFO: `/v3/domains` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:10:51.364742 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753b6f24-6cb1-4f09-9567-1eb2464ed1ec None admin] RBAC: Adding query filter params (name=Default) {{(pid=79744) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 07:10:51.365036 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753b6f24-6cb1-4f09-9567-1eb2464ed1ec None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:10:51.366422 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753b6f24-6cb1-4f09-9567-1eb2464ed1ec None admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:10:51.377892 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 264/522] 10.222.0.21 () {56 vars in 1109 bytes} [Wed May 4 07:10:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 07:10:51.378692 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753b6f24-6cb1-4f09-9567-1eb2464ed1ec None admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:10:51.460262 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a9552f-6037-4080-919d-911c30a73312 None admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:10:51.486582 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753b6f24-6cb1-4f09-9567-1eb2464ed1ec None admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:10:51.495473 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e346d7-42e1-44ca-aa1a-179879db4f69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:10:51.496198 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e346d7-42e1-44ca-aa1a-179879db4f69 None admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:10:51.496475 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e346d7-42e1-44ca-aa1a-179879db4f69 None admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:10:51.496909 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e346d7-42e1-44ca-aa1a-179879db4f69 None admin] PATH_INFO: `/v3/users` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:10:51.497747 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e346d7-42e1-44ca-aa1a-179879db4f69 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=79745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 07:10:51.498052 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e346d7-42e1-44ca-aa1a-179879db4f69 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:10:51.499497 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e346d7-42e1-44ca-aa1a-179879db4f69 None admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:10:51.516365 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 259/523] 10.222.0.21 () {56 vars in 1139 bytes} [Wed May 4 07:10:51 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 07:10:51.517169 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e346d7-42e1-44ca-aa1a-179879db4f69 None admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:10:51.524789 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73de735c-ae3f-431a-bde8-465e5fb52161 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:10:51.525997 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73de735c-ae3f-431a-bde8-465e5fb52161 None admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:10:51.526277 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73de735c-ae3f-431a-bde8-465e5fb52161 None admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:10:51.526548 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73de735c-ae3f-431a-bde8-465e5fb52161 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:10:51.535789 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73de735c-ae3f-431a-bde8-465e5fb52161 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:10:51.537236 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73de735c-ae3f-431a-bde8-465e5fb52161 None admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:10:51.552532 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application [None req-73de735c-ae3f-431a-bde8-465e5fb52161 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 04 07:10:51.552532 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 07:10:51.552532 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 07:10:51.552532 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 07:10:51.552532 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 07:10:51.552532 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 07:10:51.552532 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 07:10:51.552532 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 07:10:51.552532 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 07:10:51.552532 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 07:10:51.552532 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 07:10:51.552532 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 07:10:51.552532 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 04 07:10:51.552532 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self._get_project(project_id) May 04 07:10:51.552532 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 04 07:10:51.553378 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 04 07:10:51.553378 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 07:10:51.553378 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 07:10:51.553378 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 07:10:51.553378 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 07:10:51.553378 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 07:10:51.553378 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.get_or_create( May 04 07:10:51.553378 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 07:10:51.553378 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application with Lock( May 04 07:10:51.553378 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 07:10:51.553378 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self._enter() May 04 07:10:51.553378 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 07:10:51.553378 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 07:10:51.553378 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 07:10:51.553378 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.creator() May 04 07:10:51.553378 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 07:10:51.553378 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application created_value = creator( May 04 07:10:51.554236 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 04 07:10:51.554236 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 04 07:10:51.554236 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 04 07:10:51.554236 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 04 07:10:51.554236 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 04 07:10:51.554236 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 04 07:10:51.554236 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 04 07:10:51.554236 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application May 04 07:10:51.554236 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 265/524] 10.222.0.21 () {56 vars in 1111 bytes} [Wed May 4 07:10:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 07:10:51.554723 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73de735c-ae3f-431a-bde8-465e5fb52161 None admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:10:51.613097 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e346d7-42e1-44ca-aa1a-179879db4f69 None admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:10:51.645852 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644c13a8-b15b-469d-bea2-aa021eb08dcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:10:51.646781 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644c13a8-b15b-469d-bea2-aa021eb08dcb None admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:10:51.647285 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644c13a8-b15b-469d-bea2-aa021eb08dcb None admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:10:51.647747 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644c13a8-b15b-469d-bea2-aa021eb08dcb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:10:51.650893 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73de735c-ae3f-431a-bde8-465e5fb52161 None admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:10:51.688998 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862d6709-ebe7-42e9-aeab-60f0c5771e78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:10:51.689782 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862d6709-ebe7-42e9-aeab-60f0c5771e78 None admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:10:51.690057 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862d6709-ebe7-42e9-aeab-60f0c5771e78 None admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:10:51.690328 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862d6709-ebe7-42e9-aeab-60f0c5771e78 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:10:51.697243 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862d6709-ebe7-42e9-aeab-60f0c5771e78 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:10:51.698675 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862d6709-ebe7-42e9-aeab-60f0c5771e78 None admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:10:51.712551 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application [None req-862d6709-ebe7-42e9-aeab-60f0c5771e78 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 04 07:10:51.712551 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 07:10:51.712551 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 07:10:51.712551 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 07:10:51.712551 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 07:10:51.712551 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 07:10:51.712551 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 07:10:51.712551 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 07:10:51.712551 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 07:10:51.712551 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 07:10:51.712551 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 07:10:51.712551 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 07:10:51.712551 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 04 07:10:51.712551 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self._get_project(project_id) May 04 07:10:51.712551 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 04 07:10:51.713427 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 04 07:10:51.713427 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 07:10:51.713427 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 07:10:51.713427 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 07:10:51.713427 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 07:10:51.713427 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 07:10:51.713427 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.get_or_create( May 04 07:10:51.713427 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 07:10:51.713427 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application with Lock( May 04 07:10:51.713427 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 07:10:51.713427 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self._enter() May 04 07:10:51.713427 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 07:10:51.713427 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 07:10:51.713427 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 07:10:51.713427 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.creator() May 04 07:10:51.713427 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 07:10:51.713427 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application created_value = creator( May 04 07:10:51.719737 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 04 07:10:51.719737 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 04 07:10:51.719737 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 04 07:10:51.719737 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 04 07:10:51.719737 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 04 07:10:51.719737 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 04 07:10:51.719737 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 04 07:10:51.719737 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application May 04 07:10:51.720165 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644c13a8-b15b-469d-bea2-aa021eb08dcb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:10:51.720238 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 266/525] 10.222.0.21 () {56 vars in 1111 bytes} [Wed May 4 07:10:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 07:10:51.720238 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862d6709-ebe7-42e9-aeab-60f0c5771e78 None admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:10:51.720366 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644c13a8-b15b-469d-bea2-aa021eb08dcb None admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:10:51.812529 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 260/526] 10.222.0.21 () {58 vars in 1282 bytes} [Wed May 4 07:10:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 04 07:10:51.813273 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644c13a8-b15b-469d-bea2-aa021eb08dcb None admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:10:51.823211 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862d6709-ebe7-42e9-aeab-60f0c5771e78 None admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:10:51.857948 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0b0404-b537-421b-a510-4730861c786e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:10:51.858973 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0b0404-b537-421b-a510-4730861c786e None admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:10:51.859455 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0b0404-b537-421b-a510-4730861c786e None admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:10:51.859905 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0b0404-b537-421b-a510-4730861c786e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:10:51.912172 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644c13a8-b15b-469d-bea2-aa021eb08dcb None admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:10:51.939924 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0b0404-b537-421b-a510-4730861c786e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:10:51.941370 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0b0404-b537-421b-a510-4730861c786e None admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:10:51.947078 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d912d8-1d91-452a-8831-eb06a935c5e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:10:51.947759 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d912d8-1d91-452a-8831-eb06a935c5e1 None admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:10:51.948033 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d912d8-1d91-452a-8831-eb06a935c5e1 None admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:10:51.948300 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d912d8-1d91-452a-8831-eb06a935c5e1 None admin] PATH_INFO: `/v3/projects` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:10:51.949588 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d912d8-1d91-452a-8831-eb06a935c5e1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 07:10:51.950112 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d912d8-1d91-452a-8831-eb06a935c5e1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:10:51.951583 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d912d8-1d91-452a-8831-eb06a935c5e1 None admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:10:51.969099 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 261/527] 10.222.0.21 () {56 vars in 1148 bytes} [Wed May 4 07:10:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 07:10:51.969811 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d912d8-1d91-452a-8831-eb06a935c5e1 None admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:10:52.045943 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 267/528] 10.222.0.21 () {58 vars in 1282 bytes} [Wed May 4 07:10:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 04 07:10:52.045943 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0b0404-b537-421b-a510-4730861c786e None admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:10:52.067184 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d912d8-1d91-452a-8831-eb06a935c5e1 None admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:10:52.100784 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57f8c9a-b87a-4310-a2b7-faa79664f686 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:10:52.101517 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57f8c9a-b87a-4310-a2b7-faa79664f686 None admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:10:52.101860 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57f8c9a-b87a-4310-a2b7-faa79664f686 None admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:10:52.102197 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57f8c9a-b87a-4310-a2b7-faa79664f686 None admin] PATH_INFO: `/v3/projects` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:10:52.103034 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57f8c9a-b87a-4310-a2b7-faa79664f686 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 07:10:52.103430 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57f8c9a-b87a-4310-a2b7-faa79664f686 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:10:52.104916 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57f8c9a-b87a-4310-a2b7-faa79664f686 None admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:10:52.116822 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 262/529] 10.222.0.21 () {56 vars in 1148 bytes} [Wed May 4 07:10:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 07:10:52.117874 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57f8c9a-b87a-4310-a2b7-faa79664f686 None admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:10:52.139660 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0b0404-b537-421b-a510-4730861c786e None admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:10:52.173352 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e9b823-6165-4cfb-882b-5c334f752c60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:10:52.174142 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e9b823-6165-4cfb-882b-5c334f752c60 None admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:10:52.174425 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e9b823-6165-4cfb-882b-5c334f752c60 None admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:10:52.174707 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e9b823-6165-4cfb-882b-5c334f752c60 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:10:52.185395 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e9b823-6165-4cfb-882b-5c334f752c60 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:10:52.187780 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e9b823-6165-4cfb-882b-5c334f752c60 None admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:10:52.211942 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application [None req-d8e9b823-6165-4cfb-882b-5c334f752c60 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 07:10:52.211942 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 07:10:52.211942 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 07:10:52.211942 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 07:10:52.211942 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 07:10:52.211942 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 07:10:52.211942 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 07:10:52.211942 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 07:10:52.211942 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 07:10:52.211942 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 07:10:52.211942 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 07:10:52.211942 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 07:10:52.211942 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 07:10:52.211942 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 07:10:52.211942 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 07:10:52.213052 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 07:10:52.213052 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 07:10:52.213052 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 07:10:52.213052 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 07:10:52.213052 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 07:10:52.213052 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 07:10:52.213052 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.get_or_create( May 04 07:10:52.213052 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 07:10:52.213052 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application with Lock( May 04 07:10:52.213052 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 07:10:52.213052 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self._enter() May 04 07:10:52.213052 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 07:10:52.213052 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 07:10:52.213052 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 07:10:52.213052 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.creator() May 04 07:10:52.213052 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 07:10:52.213052 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application created_value = creator( May 04 07:10:52.214081 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 07:10:52.214081 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 07:10:52.214081 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 07:10:52.214081 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application May 04 07:10:52.220200 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 268/530] 10.222.0.21 () {56 vars in 1108 bytes} [Wed May 4 07:10:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 07:10:52.220200 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e9b823-6165-4cfb-882b-5c334f752c60 None admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:10:52.224652 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57f8c9a-b87a-4310-a2b7-faa79664f686 None admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:10:52.257956 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05fa565-35ac-4564-88a0-35af21be2ef8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:10:52.258634 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05fa565-35ac-4564-88a0-35af21be2ef8 None admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:10:52.258918 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05fa565-35ac-4564-88a0-35af21be2ef8 None admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:10:52.259226 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05fa565-35ac-4564-88a0-35af21be2ef8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:10:52.260054 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05fa565-35ac-4564-88a0-35af21be2ef8 None admin] RBAC: Adding query filter params (role.id=14041215d0f7476a8e90241a49338706, scope.project.id=c9f9c44db4984653b8d4b5f6b3b949f5, user.id=7538f5cab3364625a3e909f5f117ef2d) {{(pid=79745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 07:10:52.260367 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05fa565-35ac-4564-88a0-35af21be2ef8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:10:52.262914 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05fa565-35ac-4564-88a0-35af21be2ef8 None admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:10:52.268703 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 263/531] 10.222.0.21 () {56 vars in 1374 bytes} [Wed May 4 07:10:52 2022] GET /identity/v3/role_assignments?user.id=7538f5cab3364625a3e909f5f117ef2d&scope.project.id=c9f9c44db4984653b8d4b5f6b3b949f5&role.id=14041215d0f7476a8e90241a49338706 => generated 259 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 07:10:52.269485 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05fa565-35ac-4564-88a0-35af21be2ef8 None admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:10:52.352363 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e9b823-6165-4cfb-882b-5c334f752c60 None admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:10:52.373458 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05fa565-35ac-4564-88a0-35af21be2ef8 None admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:10:52.405215 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c88bfa-1edd-4a26-958d-f9edb3ace968 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:10:52.406760 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c88bfa-1edd-4a26-958d-f9edb3ace968 None admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:10:52.407343 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c88bfa-1edd-4a26-958d-f9edb3ace968 None admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:10:52.407897 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c88bfa-1edd-4a26-958d-f9edb3ace968 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:10:52.409258 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e07d28-7e5b-41ea-92d1-6583679b9f00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:10:52.409984 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e07d28-7e5b-41ea-92d1-6583679b9f00 None admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:10:52.410336 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e07d28-7e5b-41ea-92d1-6583679b9f00 None admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:10:52.410678 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e07d28-7e5b-41ea-92d1-6583679b9f00 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:10:52.411622 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e07d28-7e5b-41ea-92d1-6583679b9f00 None admin] RBAC: Adding query filter params (role.id=14041215d0f7476a8e90241a49338706, scope.project.id=c9f9c44db4984653b8d4b5f6b3b949f5, user.id=1077289fedae43b6be47be7f716d573a) {{(pid=79745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 07:10:52.412006 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e07d28-7e5b-41ea-92d1-6583679b9f00 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:10:52.413671 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e07d28-7e5b-41ea-92d1-6583679b9f00 None admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:10:52.427183 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 264/532] 10.222.0.21 () {56 vars in 1374 bytes} [Wed May 4 07:10:52 2022] GET /identity/v3/role_assignments?user.id=1077289fedae43b6be47be7f716d573a&scope.project.id=c9f9c44db4984653b8d4b5f6b3b949f5&role.id=14041215d0f7476a8e90241a49338706 => generated 259 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 07:10:52.427183 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e07d28-7e5b-41ea-92d1-6583679b9f00 None admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:10:52.429375 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c88bfa-1edd-4a26-958d-f9edb3ace968 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:10:52.433104 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c88bfa-1edd-4a26-958d-f9edb3ace968 None admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:10:52.472443 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application [None req-c7c88bfa-1edd-4a26-958d-f9edb3ace968 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 07:10:52.472443 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 07:10:52.472443 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 07:10:52.472443 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 07:10:52.472443 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 07:10:52.472443 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 07:10:52.472443 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 07:10:52.472443 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 07:10:52.472443 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 07:10:52.472443 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 07:10:52.472443 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 07:10:52.472443 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 07:10:52.472443 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 07:10:52.472443 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 07:10:52.472443 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 07:10:52.473563 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 07:10:52.473563 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 07:10:52.473563 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 07:10:52.473563 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 07:10:52.473563 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 07:10:52.473563 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 07:10:52.473563 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.get_or_create( May 04 07:10:52.473563 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 07:10:52.473563 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application with Lock( May 04 07:10:52.473563 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 07:10:52.473563 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self._enter() May 04 07:10:52.473563 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 07:10:52.473563 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 07:10:52.473563 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 07:10:52.473563 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.creator() May 04 07:10:52.473563 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 07:10:52.473563 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application created_value = creator( May 04 07:10:52.474632 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 07:10:52.474632 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 07:10:52.474632 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 07:10:52.474632 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application May 04 07:10:52.477172 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 269/533] 10.222.0.21 () {56 vars in 1108 bytes} [Wed May 4 07:10:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 07:10:52.483810 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c88bfa-1edd-4a26-958d-f9edb3ace968 None admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:10:52.624815 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e07d28-7e5b-41ea-92d1-6583679b9f00 None admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:10:52.633992 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c88bfa-1edd-4a26-958d-f9edb3ace968 None admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:10:52.672005 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e187ce26-b151-48a9-b70b-556834f10864 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:10:52.672671 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e187ce26-b151-48a9-b70b-556834f10864 None admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:10:52.672953 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e187ce26-b151-48a9-b70b-556834f10864 None admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:10:52.673222 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e187ce26-b151-48a9-b70b-556834f10864 None admin] PATH_INFO: `/v3/domains` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:10:52.674317 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e187ce26-b151-48a9-b70b-556834f10864 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 07:10:52.674317 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e187ce26-b151-48a9-b70b-556834f10864 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:10:52.675275 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b110d135-a042-4a3b-b276-75f3c3eb1cf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:10:52.675661 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e187ce26-b151-48a9-b70b-556834f10864 None admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:10:52.676375 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b110d135-a042-4a3b-b276-75f3c3eb1cf5 None admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:10:52.676844 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b110d135-a042-4a3b-b276-75f3c3eb1cf5 None admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:10:52.677305 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b110d135-a042-4a3b-b276-75f3c3eb1cf5 None admin] PATH_INFO: `/v3/domains` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:10:52.678219 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b110d135-a042-4a3b-b276-75f3c3eb1cf5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79744) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 07:10:52.678734 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b110d135-a042-4a3b-b276-75f3c3eb1cf5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:10:52.680452 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b110d135-a042-4a3b-b276-75f3c3eb1cf5 None admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:10:52.689349 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 265/534] 10.222.0.21 () {56 vars in 1109 bytes} [Wed May 4 07:10:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 07:10:52.692645 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 270/535] 10.222.0.21 () {56 vars in 1109 bytes} [Wed May 4 07:10:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 07:10:52.699670 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e187ce26-b151-48a9-b70b-556834f10864 None admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:10:52.700856 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b110d135-a042-4a3b-b276-75f3c3eb1cf5 None admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:10:52.804811 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e187ce26-b151-48a9-b70b-556834f10864 None admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:10:52.867305 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d85f4e9-593b-474a-ae59-86568109d48f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:10:52.868109 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d85f4e9-593b-474a-ae59-86568109d48f None admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:10:52.868384 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d85f4e9-593b-474a-ae59-86568109d48f None admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:10:52.868652 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d85f4e9-593b-474a-ae59-86568109d48f None admin] PATH_INFO: `/v3/projects/service` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:10:52.882314 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d85f4e9-593b-474a-ae59-86568109d48f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:10:52.883722 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d85f4e9-593b-474a-ae59-86568109d48f None admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:10:52.908051 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b110d135-a042-4a3b-b276-75f3c3eb1cf5 None admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:10:52.910431 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application [None req-6d85f4e9-593b-474a-ae59-86568109d48f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 04 07:10:52.910431 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 07:10:52.910431 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 07:10:52.910431 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 07:10:52.910431 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 07:10:52.910431 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 07:10:52.910431 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 07:10:52.910431 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 07:10:52.910431 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 07:10:52.910431 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 07:10:52.910431 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 07:10:52.910431 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 07:10:52.910431 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 04 07:10:52.910431 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self._get_project(project_id) May 04 07:10:52.910431 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 04 07:10:52.911310 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 04 07:10:52.911310 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 07:10:52.911310 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 07:10:52.911310 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 07:10:52.911310 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 07:10:52.911310 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 07:10:52.911310 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self.get_or_create( May 04 07:10:52.911310 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 07:10:52.911310 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application with Lock( May 04 07:10:52.911310 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 07:10:52.911310 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self._enter() May 04 07:10:52.911310 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 07:10:52.911310 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 07:10:52.911310 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 07:10:52.911310 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self.creator() May 04 07:10:52.911310 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 07:10:52.911310 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application created_value = creator( May 04 07:10:52.912163 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 04 07:10:52.912163 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 04 07:10:52.912163 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 04 07:10:52.912163 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 04 07:10:52.912163 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 04 07:10:52.912163 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 04 07:10:52.912163 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 04 07:10:52.912163 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application May 04 07:10:52.915735 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 266/536] 10.222.0.21 () {56 vars in 1111 bytes} [Wed May 4 07:10:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 07:10:52.921410 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d85f4e9-593b-474a-ae59-86568109d48f None admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:10:52.967444 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3968ec1e-3157-4c34-8073-333720a3a4a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:10:52.968240 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3968ec1e-3157-4c34-8073-333720a3a4a9 None admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:10:52.968515 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3968ec1e-3157-4c34-8073-333720a3a4a9 None admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:10:52.968784 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3968ec1e-3157-4c34-8073-333720a3a4a9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:10:52.985194 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3968ec1e-3157-4c34-8073-333720a3a4a9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:10:52.986659 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3968ec1e-3157-4c34-8073-333720a3a4a9 None admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:10:53.017085 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application [None req-3968ec1e-3157-4c34-8073-333720a3a4a9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 04 07:10:53.017085 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 07:10:53.017085 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 07:10:53.017085 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 07:10:53.017085 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 07:10:53.017085 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 07:10:53.017085 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 07:10:53.017085 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 07:10:53.017085 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 07:10:53.017085 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 07:10:53.017085 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 07:10:53.017085 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 07:10:53.017085 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 04 07:10:53.017085 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self._get_project(project_id) May 04 07:10:53.017085 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 04 07:10:53.019224 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 04 07:10:53.019224 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 07:10:53.019224 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 07:10:53.019224 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 07:10:53.019224 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 07:10:53.019224 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 07:10:53.019224 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.get_or_create( May 04 07:10:53.019224 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 07:10:53.019224 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application with Lock( May 04 07:10:53.019224 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 07:10:53.019224 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self._enter() May 04 07:10:53.019224 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 07:10:53.019224 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 07:10:53.019224 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 07:10:53.019224 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.creator() May 04 07:10:53.019224 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 07:10:53.019224 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application created_value = creator( May 04 07:10:53.021913 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 04 07:10:53.021913 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 04 07:10:53.021913 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 04 07:10:53.021913 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 04 07:10:53.021913 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 04 07:10:53.021913 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 04 07:10:53.021913 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 04 07:10:53.021913 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application May 04 07:10:53.021913 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 271/537] 10.222.0.21 () {56 vars in 1111 bytes} [Wed May 4 07:10:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 318 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 07:10:53.029705 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3968ec1e-3157-4c34-8073-333720a3a4a9 None admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:10:53.101124 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d85f4e9-593b-474a-ae59-86568109d48f None admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:10:53.163499 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea19be1a-7fa2-40ea-84d9-ac5f6348fb54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:10:53.164137 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea19be1a-7fa2-40ea-84d9-ac5f6348fb54 None admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:10:53.164419 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea19be1a-7fa2-40ea-84d9-ac5f6348fb54 None admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:10:53.164697 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea19be1a-7fa2-40ea-84d9-ac5f6348fb54 None admin] PATH_INFO: `/v3/projects` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:10:53.165487 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea19be1a-7fa2-40ea-84d9-ac5f6348fb54 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 07:10:53.165795 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea19be1a-7fa2-40ea-84d9-ac5f6348fb54 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:10:53.167250 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea19be1a-7fa2-40ea-84d9-ac5f6348fb54 None admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:10:53.189934 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3968ec1e-3157-4c34-8073-333720a3a4a9 None admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:10:53.191382 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 267/538] 10.222.0.21 () {56 vars in 1148 bytes} [Wed May 4 07:10:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 07:10:53.195998 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea19be1a-7fa2-40ea-84d9-ac5f6348fb54 None admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:10:53.225213 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39812ded-2b7f-4764-a427-ffb2c57739d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:10:53.225878 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39812ded-2b7f-4764-a427-ffb2c57739d6 None admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:10:53.226158 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39812ded-2b7f-4764-a427-ffb2c57739d6 None admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:10:53.226475 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39812ded-2b7f-4764-a427-ffb2c57739d6 None admin] PATH_INFO: `/v3/projects` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:10:53.227365 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39812ded-2b7f-4764-a427-ffb2c57739d6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79744) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 07:10:53.227675 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39812ded-2b7f-4764-a427-ffb2c57739d6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:10:53.231169 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39812ded-2b7f-4764-a427-ffb2c57739d6 None admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:10:53.247704 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 272/539] 10.222.0.21 () {56 vars in 1148 bytes} [Wed May 4 07:10:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 07:10:53.254076 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39812ded-2b7f-4764-a427-ffb2c57739d6 None admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:10:53.377777 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea19be1a-7fa2-40ea-84d9-ac5f6348fb54 None admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:10:53.414157 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814c2ea9-cdd8-4ac1-a7f0-391009b55b70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:10:53.414742 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814c2ea9-cdd8-4ac1-a7f0-391009b55b70 None admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:10:53.415019 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814c2ea9-cdd8-4ac1-a7f0-391009b55b70 None admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:10:53.415337 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814c2ea9-cdd8-4ac1-a7f0-391009b55b70 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:10:53.416170 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814c2ea9-cdd8-4ac1-a7f0-391009b55b70 None admin] RBAC: Adding query filter params (role.id=14041215d0f7476a8e90241a49338706, scope.project.id=c9f9c44db4984653b8d4b5f6b3b949f5, user.id=bb341257aa8246b6847561e2fe1fa385) {{(pid=79745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 07:10:53.416479 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814c2ea9-cdd8-4ac1-a7f0-391009b55b70 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:10:53.418442 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814c2ea9-cdd8-4ac1-a7f0-391009b55b70 None admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:10:53.420368 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39812ded-2b7f-4764-a427-ffb2c57739d6 None admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:10:53.424425 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 268/540] 10.222.0.21 () {56 vars in 1374 bytes} [Wed May 4 07:10:53 2022] GET /identity/v3/role_assignments?user.id=bb341257aa8246b6847561e2fe1fa385&scope.project.id=c9f9c44db4984653b8d4b5f6b3b949f5&role.id=14041215d0f7476a8e90241a49338706 => generated 259 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 07:10:53.471770 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03322477-0095-4421-982f-4f7473547d0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:10:53.472839 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03322477-0095-4421-982f-4f7473547d0b None admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:10:53.473323 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03322477-0095-4421-982f-4f7473547d0b None admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:10:53.473805 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03322477-0095-4421-982f-4f7473547d0b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:10:53.474844 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03322477-0095-4421-982f-4f7473547d0b None admin] RBAC: Adding query filter params (role.id=14041215d0f7476a8e90241a49338706, scope.project.id=c9f9c44db4984653b8d4b5f6b3b949f5, user.id=91cb92d00273402b837cb29b37325101) {{(pid=79744) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 07:10:53.475407 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03322477-0095-4421-982f-4f7473547d0b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:10:53.477069 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03322477-0095-4421-982f-4f7473547d0b None admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:10:53.486246 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 273/541] 10.222.0.21 () {56 vars in 1374 bytes} [Wed May 4 07:10:53 2022] GET /identity/v3/role_assignments?user.id=91cb92d00273402b837cb29b37325101&scope.project.id=c9f9c44db4984653b8d4b5f6b3b949f5&role.id=14041215d0f7476a8e90241a49338706 => generated 259 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 07:10:53.566742 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da91e6ee-46c2-44bb-965b-fb8bd00f60c2 None None] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:10:53.567023 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da91e6ee-46c2-44bb-965b-fb8bd00f60c2 None None] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:10:53.567329 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da91e6ee-46c2-44bb-965b-fb8bd00f60c2 None None] PATH_INFO: `/` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:10:53.568957 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 269/542] 10.222.0.21 () {54 vars in 926 bytes} [Wed May 4 07:10:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 07:10:53.574050 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940ecbbc-0af7-4f99-a426-b276991b206f None None] REQUEST_METHOD: `POST` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:10:53.575870 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940ecbbc-0af7-4f99-a426-b276991b206f None None] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:10:53.576378 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940ecbbc-0af7-4f99-a426-b276991b206f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:10:53.601183 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.auth.core [None req-940ecbbc-0af7-4f99-a426-b276991b206f None None] MFA Rules not processed for user `83c5e0dcb991496ea6dee38384514508`. Rule list: `[]` (Enabled: `True`). {{(pid=79744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:10:53.602804 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.fernet_utils [None req-940ecbbc-0af7-4f99-a426-b276991b206f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:10:53.709549 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 274/543] 10.222.0.21 () {58 vars in 1023 bytes} [Wed May 4 07:10:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 07:10:53.744841 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da91e6ee-46c2-44bb-965b-fb8bd00f60c2 None None] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:10:53.872184 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da91e6ee-46c2-44bb-965b-fb8bd00f60c2 None None] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:10:53.916742 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277853be-cb64-432d-849c-e42dcc941aa1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:10:53.917540 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277853be-cb64-432d-849c-e42dcc941aa1 None admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:10:53.918398 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277853be-cb64-432d-849c-e42dcc941aa1 None admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:10:53.919008 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277853be-cb64-432d-849c-e42dcc941aa1 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:10:53.931939 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277853be-cb64-432d-849c-e42dcc941aa1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 07:10:53.939851 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application [None req-277853be-cb64-432d-849c-e42dcc941aa1 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 04 07:10:53.939851 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 07:10:53.939851 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 07:10:53.939851 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 07:10:53.939851 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 07:10:53.939851 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 07:10:53.939851 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 07:10:53.939851 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 07:10:53.939851 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 07:10:53.939851 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 07:10:53.939851 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 07:10:53.939851 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 07:10:53.939851 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 07:10:53.939851 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 07:10:53.939851 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 07:10:53.939851 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 07:10:53.940749 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 07:10:53.940749 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 07:10:53.940749 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 07:10:53.940749 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 07:10:53.940749 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 07:10:53.940749 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 07:10:53.940749 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 07:10:53.940749 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 07:10:53.940749 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 07:10:53.940749 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self.get_or_create( May 04 07:10:53.940749 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 07:10:53.940749 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application with Lock( May 04 07:10:53.940749 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 07:10:53.940749 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self._enter() May 04 07:10:53.940749 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 07:10:53.940749 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 07:10:53.941565 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 07:10:53.941565 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self.creator() May 04 07:10:53.941565 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 07:10:53.941565 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application created_value = creator( May 04 07:10:53.941565 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 07:10:53.941565 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 07:10:53.941565 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 07:10:53.941565 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 07:10:53.941565 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 07:10:53.941565 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 07:10:53.941565 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 04 07:10:53.941565 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application May 04 07:10:53.941565 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 270/544] 10.222.0.21 () {56 vars in 1102 bytes} [Wed May 4 07:10:53 2022] GET /identity/v3/roles/service => generated 85 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 07:10:53.948647 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940ecbbc-0af7-4f99-a426-b276991b206f None None] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:10:54.050901 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940ecbbc-0af7-4f99-a426-b276991b206f None None] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:10:54.085635 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02169e3-1137-4999-adc4-ec5ca789bc48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:10:54.086298 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02169e3-1137-4999-adc4-ec5ca789bc48 None admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:10:54.086579 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02169e3-1137-4999-adc4-ec5ca789bc48 None admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:10:54.086850 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02169e3-1137-4999-adc4-ec5ca789bc48 None admin] PATH_INFO: `/v3/roles` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:10:54.087621 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02169e3-1137-4999-adc4-ec5ca789bc48 None admin] RBAC: Adding query filter params (name=service) {{(pid=79744) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 07:10:54.087923 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02169e3-1137-4999-adc4-ec5ca789bc48 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:10:54.089285 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02169e3-1137-4999-adc4-ec5ca789bc48 None admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:10:54.097726 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 275/545] 10.222.0.21 () {56 vars in 1103 bytes} [Wed May 4 07:10:53 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 07:10:54.104199 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277853be-cb64-432d-849c-e42dcc941aa1 None admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:10:54.218492 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277853be-cb64-432d-849c-e42dcc941aa1 None admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:10:54.252271 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab57a3c-8e46-402a-942e-d956f93b0c62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:10:54.253114 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab57a3c-8e46-402a-942e-d956f93b0c62 None admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:10:54.253393 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab57a3c-8e46-402a-942e-d956f93b0c62 None admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:10:54.253715 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab57a3c-8e46-402a-942e-d956f93b0c62 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:10:54.264738 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab57a3c-8e46-402a-942e-d956f93b0c62 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:10:54.266205 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab57a3c-8e46-402a-942e-d956f93b0c62 None admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:10:54.283627 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application [None req-aab57a3c-8e46-402a-942e-d956f93b0c62 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 07:10:54.283627 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 07:10:54.283627 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 07:10:54.283627 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 07:10:54.283627 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 07:10:54.283627 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 07:10:54.283627 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 07:10:54.283627 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 07:10:54.283627 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 07:10:54.283627 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 07:10:54.283627 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 07:10:54.283627 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 07:10:54.283627 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 07:10:54.283627 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 07:10:54.283627 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 07:10:54.284495 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 07:10:54.284495 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 07:10:54.284495 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 07:10:54.284495 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 07:10:54.284495 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 07:10:54.284495 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 07:10:54.284495 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self.get_or_create( May 04 07:10:54.284495 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 07:10:54.284495 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application with Lock( May 04 07:10:54.284495 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 07:10:54.284495 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self._enter() May 04 07:10:54.284495 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 07:10:54.284495 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 07:10:54.284495 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 07:10:54.284495 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self.creator() May 04 07:10:54.284495 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 07:10:54.284495 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application created_value = creator( May 04 07:10:54.285368 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 07:10:54.285368 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 07:10:54.285368 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 07:10:54.285368 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application May 04 07:10:54.285368 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 271/546] 10.222.0.21 () {56 vars in 1108 bytes} [Wed May 4 07:10:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 07:10:54.292406 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02169e3-1137-4999-adc4-ec5ca789bc48 None admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:10:54.395183 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02169e3-1137-4999-adc4-ec5ca789bc48 None admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:10:54.430277 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53e5535-200a-46de-ba3e-f27f0b555508 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:10:54.431038 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53e5535-200a-46de-ba3e-f27f0b555508 None admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:10:54.431223 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53e5535-200a-46de-ba3e-f27f0b555508 None admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:10:54.431483 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53e5535-200a-46de-ba3e-f27f0b555508 None admin] PATH_INFO: `/v3/domains` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:10:54.432203 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53e5535-200a-46de-ba3e-f27f0b555508 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79744) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 07:10:54.432507 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53e5535-200a-46de-ba3e-f27f0b555508 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:10:54.434072 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53e5535-200a-46de-ba3e-f27f0b555508 None admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:10:54.448073 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 276/547] 10.222.0.21 () {56 vars in 1109 bytes} [Wed May 4 07:10:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 07:10:54.453304 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab57a3c-8e46-402a-942e-d956f93b0c62 None admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:10:54.554517 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab57a3c-8e46-402a-942e-d956f93b0c62 None admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:10:54.588328 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df7ef2b-d564-4312-9a3e-c6cd942259ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:10:54.589114 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df7ef2b-d564-4312-9a3e-c6cd942259ce None admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:10:54.589392 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df7ef2b-d564-4312-9a3e-c6cd942259ce None admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:10:54.589720 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df7ef2b-d564-4312-9a3e-c6cd942259ce None admin] PATH_INFO: `/v3/users/swift` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:10:54.597569 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df7ef2b-d564-4312-9a3e-c6cd942259ce None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:10:54.599015 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df7ef2b-d564-4312-9a3e-c6cd942259ce None admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:10:54.614065 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application [None req-7df7ef2b-d564-4312-9a3e-c6cd942259ce None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 04 07:10:54.614065 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 07:10:54.614065 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 07:10:54.614065 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 07:10:54.614065 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 07:10:54.614065 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 07:10:54.614065 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 07:10:54.614065 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 07:10:54.614065 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 07:10:54.614065 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 07:10:54.614065 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 07:10:54.614065 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 07:10:54.614065 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 04 07:10:54.614065 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self._get_user(user_id) May 04 07:10:54.614065 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 04 07:10:54.614065 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 04 07:10:54.616255 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 07:10:54.616255 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 07:10:54.616255 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 04 07:10:54.616255 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 07:10:54.616255 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 04 07:10:54.616255 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 07:10:54.616255 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 07:10:54.616255 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 07:10:54.616255 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 07:10:54.616255 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self.get_or_create( May 04 07:10:54.616255 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 07:10:54.616255 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application with Lock( May 04 07:10:54.616255 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 07:10:54.616255 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self._enter() May 04 07:10:54.616255 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 07:10:54.616255 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 07:10:54.616255 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 07:10:54.616255 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self.creator() May 04 07:10:54.617455 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 07:10:54.617455 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application created_value = creator( May 04 07:10:54.617455 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 04 07:10:54.617455 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 04 07:10:54.617455 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 04 07:10:54.617455 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 04 07:10:54.617455 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 04 07:10:54.617455 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 04 07:10:54.617455 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 04 07:10:54.617455 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application May 04 07:10:54.617455 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 272/548] 10.222.0.21 () {56 vars in 1096 bytes} [Wed May 4 07:10:54 2022] GET /identity/v3/users/swift => generated 83 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 07:10:54.624226 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53e5535-200a-46de-ba3e-f27f0b555508 None admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:10:54.739696 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53e5535-200a-46de-ba3e-f27f0b555508 None admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:10:54.775435 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924197f0-3ba1-428a-abaf-722916ec0af5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:10:54.776106 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924197f0-3ba1-428a-abaf-722916ec0af5 None admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:10:54.776385 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924197f0-3ba1-428a-abaf-722916ec0af5 None admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:10:54.776655 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924197f0-3ba1-428a-abaf-722916ec0af5 None admin] PATH_INFO: `/v3/users` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:10:54.778079 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924197f0-3ba1-428a-abaf-722916ec0af5 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79744) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 07:10:54.778276 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924197f0-3ba1-428a-abaf-722916ec0af5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:10:54.779559 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924197f0-3ba1-428a-abaf-722916ec0af5 None admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:10:54.798007 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 277/549] 10.222.0.21 () {56 vars in 1135 bytes} [Wed May 4 07:10:54 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 07:10:54.804501 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df7ef2b-d564-4312-9a3e-c6cd942259ce None admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:10:54.907118 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df7ef2b-d564-4312-9a3e-c6cd942259ce None admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:10:54.941608 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5bd0e31-6c45-4936-9e44-7f3ce84d1647 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:10:54.942259 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bd0e31-6c45-4936-9e44-7f3ce84d1647 None admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:10:54.942534 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bd0e31-6c45-4936-9e44-7f3ce84d1647 None admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:10:54.942806 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bd0e31-6c45-4936-9e44-7f3ce84d1647 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:10:55.021374 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5bd0e31-6c45-4936-9e44-7f3ce84d1647 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:10:55.021374 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5bd0e31-6c45-4936-9e44-7f3ce84d1647 None admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:10:55.125636 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 273/550] 10.222.0.21 () {58 vars in 1282 bytes} [Wed May 4 07:10:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 04 07:10:55.132708 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924197f0-3ba1-428a-abaf-722916ec0af5 None admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:10:55.245535 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfa4d26-0d7a-4f70-82d5-369cea4d688c None None] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:10:55.245905 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfa4d26-0d7a-4f70-82d5-369cea4d688c None None] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:10:55.246183 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfa4d26-0d7a-4f70-82d5-369cea4d688c None None] PATH_INFO: `/` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:10:55.248264 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 274/551] 10.222.0.21 () {54 vars in 926 bytes} [Wed May 4 07:10:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 07:10:55.254117 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674c4bd5-7990-40df-bffc-6f55fa6a1807 None None] REQUEST_METHOD: `POST` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:10:55.254934 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674c4bd5-7990-40df-bffc-6f55fa6a1807 None None] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:10:55.254934 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674c4bd5-7990-40df-bffc-6f55fa6a1807 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:10:55.260405 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924197f0-3ba1-428a-abaf-722916ec0af5 None admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:10:55.288937 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.auth.core [None req-674c4bd5-7990-40df-bffc-6f55fa6a1807 None None] MFA Rules not processed for user `83c5e0dcb991496ea6dee38384514508`. Rule list: `[]` (Enabled: `True`). {{(pid=79745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:10:55.290700 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.fernet_utils [None req-674c4bd5-7990-40df-bffc-6f55fa6a1807 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:10:55.305498 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e4e809-576b-492c-86a6-0d40b6cc1f59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:10:55.306805 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e4e809-576b-492c-86a6-0d40b6cc1f59 None admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:10:55.307271 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e4e809-576b-492c-86a6-0d40b6cc1f59 None admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:10:55.307878 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e4e809-576b-492c-86a6-0d40b6cc1f59 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:10:55.322742 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e4e809-576b-492c-86a6-0d40b6cc1f59 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:10:55.324897 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e4e809-576b-492c-86a6-0d40b6cc1f59 None admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:10:55.344728 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application [None req-63e4e809-576b-492c-86a6-0d40b6cc1f59 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 07:10:55.344728 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 07:10:55.344728 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 07:10:55.344728 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 07:10:55.344728 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 07:10:55.344728 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 07:10:55.344728 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 07:10:55.344728 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 07:10:55.344728 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 07:10:55.344728 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 07:10:55.344728 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 07:10:55.344728 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 07:10:55.344728 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 07:10:55.344728 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 07:10:55.344728 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 07:10:55.345701 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 07:10:55.345701 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 07:10:55.345701 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 07:10:55.345701 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 07:10:55.345701 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 07:10:55.345701 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 07:10:55.345701 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.get_or_create( May 04 07:10:55.345701 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 07:10:55.345701 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application with Lock( May 04 07:10:55.345701 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 07:10:55.345701 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self._enter() May 04 07:10:55.345701 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 07:10:55.345701 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 07:10:55.345701 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 07:10:55.345701 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.creator() May 04 07:10:55.345701 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 07:10:55.345701 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application created_value = creator( May 04 07:10:55.346581 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 07:10:55.346581 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 07:10:55.346581 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 07:10:55.346581 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application May 04 07:10:55.346581 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 278/552] 10.222.0.21 () {56 vars in 1108 bytes} [Wed May 4 07:10:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 07:10:55.348278 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fec6a25-e57c-4663-8a45-2206b3d30a88 None None] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:10:55.348683 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fec6a25-e57c-4663-8a45-2206b3d30a88 None None] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:10:55.349018 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fec6a25-e57c-4663-8a45-2206b3d30a88 None None] PATH_INFO: `/` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:10:55.350697 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 279/553] 10.222.0.21 () {54 vars in 926 bytes} [Wed May 4 07:10:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 07:10:55.355780 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fec6a25-e57c-4663-8a45-2206b3d30a88 None None] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:10:55.370430 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 275/554] 10.222.0.21 () {58 vars in 1023 bytes} [Wed May 4 07:10:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 04 07:10:55.373153 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763f1ca9-cafe-4421-a3b9-726f67c705c8 None None] REQUEST_METHOD: `POST` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:10:55.373606 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763f1ca9-cafe-4421-a3b9-726f67c705c8 None None] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:10:55.374183 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763f1ca9-cafe-4421-a3b9-726f67c705c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:10:55.394718 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.auth.core [None req-763f1ca9-cafe-4421-a3b9-726f67c705c8 None None] MFA Rules not processed for user `83c5e0dcb991496ea6dee38384514508`. Rule list: `[]` (Enabled: `True`). {{(pid=79745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:10:55.396100 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.fernet_utils [None req-763f1ca9-cafe-4421-a3b9-726f67c705c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:10:55.469778 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fec6a25-e57c-4663-8a45-2206b3d30a88 None None] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:10:55.476922 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 276/555] 10.222.0.21 () {58 vars in 1023 bytes} [Wed May 4 07:10:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 07:10:55.483880 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763f1ca9-cafe-4421-a3b9-726f67c705c8 None None] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:10:55.509818 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08dcc72-377a-4877-994b-d87a72606c73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:10:55.510708 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08dcc72-377a-4877-994b-d87a72606c73 None admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:10:55.511409 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08dcc72-377a-4877-994b-d87a72606c73 None admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:10:55.512338 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08dcc72-377a-4877-994b-d87a72606c73 None admin] PATH_INFO: `/v3/domains` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:10:55.513230 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08dcc72-377a-4877-994b-d87a72606c73 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79744) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 07:10:55.513676 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08dcc72-377a-4877-994b-d87a72606c73 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:10:55.515624 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08dcc72-377a-4877-994b-d87a72606c73 None admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:10:55.529231 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 280/556] 10.222.0.21 () {56 vars in 1109 bytes} [Wed May 4 07:10:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 07:10:55.530394 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08dcc72-377a-4877-994b-d87a72606c73 None admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:10:55.607462 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763f1ca9-cafe-4421-a3b9-726f67c705c8 None None] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:10:55.641951 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0bc073-f442-433c-b4a8-fcbcb5de6fa8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:10:55.642943 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0bc073-f442-433c-b4a8-fcbcb5de6fa8 None admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:10:55.643342 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0bc073-f442-433c-b4a8-fcbcb5de6fa8 None admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:10:55.643715 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0bc073-f442-433c-b4a8-fcbcb5de6fa8 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:10:55.652651 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08dcc72-377a-4877-994b-d87a72606c73 None admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:10:55.655946 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0bc073-f442-433c-b4a8-fcbcb5de6fa8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 07:10:55.663733 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application [None req-2f0bc073-f442-433c-b4a8-fcbcb5de6fa8 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 04 07:10:55.663733 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 07:10:55.663733 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 07:10:55.663733 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 07:10:55.663733 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 07:10:55.663733 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 07:10:55.663733 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 07:10:55.663733 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 07:10:55.663733 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 07:10:55.663733 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 07:10:55.663733 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 07:10:55.663733 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 07:10:55.663733 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 07:10:55.663733 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 07:10:55.663733 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 07:10:55.663733 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 07:10:55.664853 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 07:10:55.664853 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 07:10:55.664853 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 07:10:55.664853 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 07:10:55.664853 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 07:10:55.664853 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 07:10:55.664853 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 07:10:55.664853 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 07:10:55.664853 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 07:10:55.664853 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self.get_or_create( May 04 07:10:55.664853 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 07:10:55.664853 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application with Lock( May 04 07:10:55.664853 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 07:10:55.664853 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self._enter() May 04 07:10:55.664853 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 07:10:55.664853 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 07:10:55.665821 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 07:10:55.665821 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self.creator() May 04 07:10:55.665821 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 07:10:55.665821 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application created_value = creator( May 04 07:10:55.665821 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 07:10:55.665821 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 07:10:55.665821 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 07:10:55.665821 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 07:10:55.665821 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 07:10:55.665821 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 07:10:55.665821 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 04 07:10:55.665821 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application May 04 07:10:55.666965 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 277/557] 10.222.0.21 () {56 vars in 1102 bytes} [Wed May 4 07:10:55 2022] GET /identity/v3/roles/service => generated 85 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 07:10:55.668152 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0bc073-f442-433c-b4a8-fcbcb5de6fa8 None admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:10:55.697743 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0627bfb8-0a47-41bb-935a-aa69694aa382 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:10:55.699887 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0627bfb8-0a47-41bb-935a-aa69694aa382 None admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:10:55.700182 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0627bfb8-0a47-41bb-935a-aa69694aa382 None admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:10:55.700457 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0627bfb8-0a47-41bb-935a-aa69694aa382 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:10:55.713597 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0627bfb8-0a47-41bb-935a-aa69694aa382 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 07:10:55.721528 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application [None req-0627bfb8-0a47-41bb-935a-aa69694aa382 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 04 07:10:55.721528 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 07:10:55.721528 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 07:10:55.721528 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 07:10:55.721528 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 07:10:55.721528 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 07:10:55.721528 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 07:10:55.721528 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 07:10:55.721528 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 07:10:55.721528 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 07:10:55.721528 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 07:10:55.721528 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 07:10:55.721528 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 07:10:55.721528 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 07:10:55.721528 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 07:10:55.721528 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 07:10:55.722436 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 07:10:55.722436 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 07:10:55.722436 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 07:10:55.722436 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 07:10:55.722436 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 07:10:55.722436 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 07:10:55.722436 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 07:10:55.722436 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 07:10:55.722436 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 07:10:55.722436 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.get_or_create( May 04 07:10:55.722436 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 07:10:55.722436 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application with Lock( May 04 07:10:55.722436 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 07:10:55.722436 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self._enter() May 04 07:10:55.722436 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 07:10:55.722436 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 07:10:55.723359 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 07:10:55.723359 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.creator() May 04 07:10:55.723359 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 07:10:55.723359 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application created_value = creator( May 04 07:10:55.723359 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 07:10:55.723359 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 07:10:55.723359 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 07:10:55.723359 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 07:10:55.723359 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 07:10:55.723359 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 07:10:55.723359 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 04 07:10:55.723359 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application May 04 07:10:55.727451 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 281/558] 10.222.0.21 () {56 vars in 1102 bytes} [Wed May 4 07:10:55 2022] GET /identity/v3/roles/service => generated 85 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 07:10:55.728959 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0627bfb8-0a47-41bb-935a-aa69694aa382 None admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:10:55.780086 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0bc073-f442-433c-b4a8-fcbcb5de6fa8 None admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:10:55.827139 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44311431-88a8-40c1-a81f-5c97ebd78c9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:10:55.827967 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44311431-88a8-40c1-a81f-5c97ebd78c9e None admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:10:55.828249 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44311431-88a8-40c1-a81f-5c97ebd78c9e None admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:10:55.828526 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44311431-88a8-40c1-a81f-5c97ebd78c9e None admin] PATH_INFO: `/v3/projects/service` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:10:55.836030 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44311431-88a8-40c1-a81f-5c97ebd78c9e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:10:55.837494 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44311431-88a8-40c1-a81f-5c97ebd78c9e None admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:10:55.852673 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application [None req-44311431-88a8-40c1-a81f-5c97ebd78c9e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 04 07:10:55.852673 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 07:10:55.852673 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 07:10:55.852673 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 07:10:55.852673 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 07:10:55.852673 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 07:10:55.852673 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 07:10:55.852673 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 07:10:55.852673 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 07:10:55.852673 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 07:10:55.852673 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 07:10:55.852673 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 07:10:55.852673 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 04 07:10:55.852673 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self._get_project(project_id) May 04 07:10:55.852673 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 04 07:10:55.853552 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 04 07:10:55.853552 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 07:10:55.853552 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 07:10:55.853552 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 07:10:55.853552 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 07:10:55.853552 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 07:10:55.853552 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self.get_or_create( May 04 07:10:55.853552 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 07:10:55.853552 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application with Lock( May 04 07:10:55.853552 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 07:10:55.853552 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self._enter() May 04 07:10:55.853552 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 07:10:55.853552 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 07:10:55.853552 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 07:10:55.853552 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self.creator() May 04 07:10:55.853552 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 07:10:55.853552 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application created_value = creator( May 04 07:10:55.854389 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 04 07:10:55.854389 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 04 07:10:55.854389 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 04 07:10:55.854389 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 04 07:10:55.854389 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 04 07:10:55.854389 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 04 07:10:55.854389 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 04 07:10:55.854389 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application May 04 07:10:55.854389 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 278/559] 10.222.0.21 () {56 vars in 1111 bytes} [Wed May 4 07:10:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 07:10:55.855974 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44311431-88a8-40c1-a81f-5c97ebd78c9e None admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:10:55.860547 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0627bfb8-0a47-41bb-935a-aa69694aa382 None admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:10:55.897979 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763e8086-fdac-4e9e-b4b0-db31ff51c8e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:10:55.898254 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763e8086-fdac-4e9e-b4b0-db31ff51c8e8 None admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:10:55.898658 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763e8086-fdac-4e9e-b4b0-db31ff51c8e8 None admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:10:55.898998 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763e8086-fdac-4e9e-b4b0-db31ff51c8e8 None admin] PATH_INFO: `/v3/roles` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:10:55.899916 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763e8086-fdac-4e9e-b4b0-db31ff51c8e8 None admin] RBAC: Adding query filter params (name=service) {{(pid=79744) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 07:10:55.900292 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763e8086-fdac-4e9e-b4b0-db31ff51c8e8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:10:55.903011 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763e8086-fdac-4e9e-b4b0-db31ff51c8e8 None admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:10:55.912220 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 282/560] 10.222.0.21 () {56 vars in 1103 bytes} [Wed May 4 07:10:55 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 07:10:55.913312 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763e8086-fdac-4e9e-b4b0-db31ff51c8e8 None admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:10:55.979437 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44311431-88a8-40c1-a81f-5c97ebd78c9e None admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:10:56.015683 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59845d6-64c0-4814-a3c9-2cbdae7e9104 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:10:56.016492 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59845d6-64c0-4814-a3c9-2cbdae7e9104 None admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:10:56.017034 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59845d6-64c0-4814-a3c9-2cbdae7e9104 None admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:10:56.017305 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59845d6-64c0-4814-a3c9-2cbdae7e9104 None admin] PATH_INFO: `/v3/roles` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:10:56.018509 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59845d6-64c0-4814-a3c9-2cbdae7e9104 None admin] RBAC: Adding query filter params (name=service) {{(pid=79745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 07:10:56.018619 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59845d6-64c0-4814-a3c9-2cbdae7e9104 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:10:56.020456 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59845d6-64c0-4814-a3c9-2cbdae7e9104 None admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:10:56.035606 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 279/561] 10.222.0.21 () {56 vars in 1103 bytes} [Wed May 4 07:10:55 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 07:10:56.037692 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59845d6-64c0-4814-a3c9-2cbdae7e9104 None admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:10:56.038827 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763e8086-fdac-4e9e-b4b0-db31ff51c8e8 None admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:10:56.083252 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bec9d6a-e81d-4ba1-9472-51cde7cc5992 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:10:56.084030 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bec9d6a-e81d-4ba1-9472-51cde7cc5992 None admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:10:56.084371 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bec9d6a-e81d-4ba1-9472-51cde7cc5992 None admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:10:56.084711 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bec9d6a-e81d-4ba1-9472-51cde7cc5992 None admin] PATH_INFO: `/v3/projects` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:10:56.085622 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bec9d6a-e81d-4ba1-9472-51cde7cc5992 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79744) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 07:10:56.086042 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bec9d6a-e81d-4ba1-9472-51cde7cc5992 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:10:56.087574 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bec9d6a-e81d-4ba1-9472-51cde7cc5992 None admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:10:56.100604 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 283/562] 10.222.0.21 () {56 vars in 1148 bytes} [Wed May 4 07:10:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 07:10:56.101650 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bec9d6a-e81d-4ba1-9472-51cde7cc5992 None admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:10:56.149029 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59845d6-64c0-4814-a3c9-2cbdae7e9104 None admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:10:56.186362 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d08fb8a-f8b1-4ae7-95e3-347148dabe05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:10:56.187211 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d08fb8a-f8b1-4ae7-95e3-347148dabe05 None admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:10:56.187450 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d08fb8a-f8b1-4ae7-95e3-347148dabe05 None admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:10:56.187864 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d08fb8a-f8b1-4ae7-95e3-347148dabe05 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:10:56.196947 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bec9d6a-e81d-4ba1-9472-51cde7cc5992 None admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:10:56.198083 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d08fb8a-f8b1-4ae7-95e3-347148dabe05 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:10:56.200354 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d08fb8a-f8b1-4ae7-95e3-347148dabe05 None admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:10:56.216777 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application [None req-7d08fb8a-f8b1-4ae7-95e3-347148dabe05 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 07:10:56.216777 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 07:10:56.216777 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 07:10:56.216777 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 07:10:56.216777 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 07:10:56.216777 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 07:10:56.216777 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 07:10:56.216777 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 07:10:56.216777 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 07:10:56.216777 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 07:10:56.216777 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 07:10:56.216777 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 07:10:56.216777 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 07:10:56.216777 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 07:10:56.216777 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 07:10:56.218162 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 07:10:56.218162 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 07:10:56.218162 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 07:10:56.218162 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 07:10:56.218162 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 07:10:56.218162 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 07:10:56.218162 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self.get_or_create( May 04 07:10:56.218162 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 07:10:56.218162 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application with Lock( May 04 07:10:56.218162 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 07:10:56.218162 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self._enter() May 04 07:10:56.218162 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 07:10:56.218162 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 07:10:56.218162 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 07:10:56.218162 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self.creator() May 04 07:10:56.218162 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 07:10:56.218162 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application created_value = creator( May 04 07:10:56.219714 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 07:10:56.219714 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 07:10:56.219714 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 07:10:56.219714 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application May 04 07:10:56.219714 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 280/563] 10.222.0.21 () {56 vars in 1108 bytes} [Wed May 4 07:10:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 07:10:56.219714 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d08fb8a-f8b1-4ae7-95e3-347148dabe05 None admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:10:56.236644 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7990d23-4872-4d5f-85cf-dab04954db53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:10:56.237677 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7990d23-4872-4d5f-85cf-dab04954db53 None admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:10:56.238129 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7990d23-4872-4d5f-85cf-dab04954db53 None admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:10:56.238385 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7990d23-4872-4d5f-85cf-dab04954db53 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:10:56.248497 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7990d23-4872-4d5f-85cf-dab04954db53 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:10:56.249945 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7990d23-4872-4d5f-85cf-dab04954db53 None admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:10:56.268615 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application [None req-f7990d23-4872-4d5f-85cf-dab04954db53 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 07:10:56.268615 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 07:10:56.268615 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 07:10:56.268615 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 07:10:56.268615 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 07:10:56.268615 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 07:10:56.268615 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 07:10:56.268615 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 07:10:56.268615 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 07:10:56.268615 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 07:10:56.268615 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 07:10:56.268615 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 07:10:56.268615 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 07:10:56.268615 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 07:10:56.268615 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 07:10:56.269718 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 07:10:56.269718 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 07:10:56.269718 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 07:10:56.269718 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 07:10:56.269718 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 07:10:56.269718 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 07:10:56.269718 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.get_or_create( May 04 07:10:56.269718 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 07:10:56.269718 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application with Lock( May 04 07:10:56.269718 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 07:10:56.269718 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self._enter() May 04 07:10:56.269718 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 07:10:56.269718 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 07:10:56.269718 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 07:10:56.269718 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.creator() May 04 07:10:56.269718 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 07:10:56.269718 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application created_value = creator( May 04 07:10:56.270727 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 07:10:56.270727 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 07:10:56.270727 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 07:10:56.270727 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application May 04 07:10:56.270727 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 284/564] 10.222.0.21 () {56 vars in 1108 bytes} [Wed May 4 07:10:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 07:10:56.271663 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45378dc8-eac6-452e-b8c8-9e1084512d0b None None] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:10:56.271945 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45378dc8-eac6-452e-b8c8-9e1084512d0b None None] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:10:56.272217 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45378dc8-eac6-452e-b8c8-9e1084512d0b None None] PATH_INFO: `/` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:10:56.275195 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 285/565] 10.222.0.21 () {54 vars in 926 bytes} [Wed May 4 07:10:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 07:10:56.275195 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45378dc8-eac6-452e-b8c8-9e1084512d0b None None] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:10:56.326202 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d08fb8a-f8b1-4ae7-95e3-347148dabe05 None admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:10:56.359690 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ea9631-b9b2-4f2a-8151-8604f68cabfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:10:56.360363 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ea9631-b9b2-4f2a-8151-8604f68cabfb None admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:10:56.360640 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ea9631-b9b2-4f2a-8151-8604f68cabfb None admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:10:56.360911 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ea9631-b9b2-4f2a-8151-8604f68cabfb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:10:56.361734 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ea9631-b9b2-4f2a-8151-8604f68cabfb None admin] RBAC: Adding query filter params (role.id=14041215d0f7476a8e90241a49338706, scope.project.id=c9f9c44db4984653b8d4b5f6b3b949f5, user.id=084c9245d1da4e698c9c3945fa089e85) {{(pid=79745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 07:10:56.362042 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ea9631-b9b2-4f2a-8151-8604f68cabfb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:10:56.363495 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ea9631-b9b2-4f2a-8151-8604f68cabfb None admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:10:56.369087 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 281/566] 10.222.0.21 () {56 vars in 1374 bytes} [Wed May 4 07:10:56 2022] GET /identity/v3/role_assignments?user.id=084c9245d1da4e698c9c3945fa089e85&scope.project.id=c9f9c44db4984653b8d4b5f6b3b949f5&role.id=14041215d0f7476a8e90241a49338706 => generated 259 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 07:10:56.369692 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ea9631-b9b2-4f2a-8151-8604f68cabfb None admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:10:56.382240 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45378dc8-eac6-452e-b8c8-9e1084512d0b None None] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:10:56.429204 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4274d87a-b1db-403e-91ef-f4ffc98dc922 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:10:56.430219 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4274d87a-b1db-403e-91ef-f4ffc98dc922 None admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:10:56.430697 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4274d87a-b1db-403e-91ef-f4ffc98dc922 None admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:10:56.431190 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4274d87a-b1db-403e-91ef-f4ffc98dc922 None admin] PATH_INFO: `/v3/domains` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:10:56.432162 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4274d87a-b1db-403e-91ef-f4ffc98dc922 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79744) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 07:10:56.432680 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4274d87a-b1db-403e-91ef-f4ffc98dc922 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:10:56.435042 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4274d87a-b1db-403e-91ef-f4ffc98dc922 None admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:10:56.454694 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 286/567] 10.222.0.21 () {56 vars in 1109 bytes} [Wed May 4 07:10:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 07:10:56.456379 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be77350-516a-4848-9575-8cd0daeb22e6 None None] REQUEST_METHOD: `POST` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:10:56.456891 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be77350-516a-4848-9575-8cd0daeb22e6 None None] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:10:56.457358 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be77350-516a-4848-9575-8cd0daeb22e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:10:56.476384 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.auth.core [None req-7be77350-516a-4848-9575-8cd0daeb22e6 None None] MFA Rules not processed for user `83c5e0dcb991496ea6dee38384514508`. Rule list: `[]` (Enabled: `True`). {{(pid=79744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:10:56.477627 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.fernet_utils [None req-7be77350-516a-4848-9575-8cd0daeb22e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:10:56.490721 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ea9631-b9b2-4f2a-8151-8604f68cabfb None admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:10:56.527812 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f30a049-4407-45b5-9533-a9d88a979236 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:10:56.528546 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f30a049-4407-45b5-9533-a9d88a979236 None admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:10:56.528876 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f30a049-4407-45b5-9533-a9d88a979236 None admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:10:56.529159 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f30a049-4407-45b5-9533-a9d88a979236 None admin] PATH_INFO: `/v3/domains` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:10:56.529901 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f30a049-4407-45b5-9533-a9d88a979236 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 07:10:56.530209 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f30a049-4407-45b5-9533-a9d88a979236 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:10:56.531639 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f30a049-4407-45b5-9533-a9d88a979236 None admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:10:56.545264 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 282/568] 10.222.0.21 () {56 vars in 1109 bytes} [Wed May 4 07:10:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 07:10:56.546126 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f30a049-4407-45b5-9533-a9d88a979236 None admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:10:56.560175 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 287/569] 10.222.0.21 () {58 vars in 1023 bytes} [Wed May 4 07:10:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 07:10:56.560978 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fc3cbc-686b-49b9-9b48-b72ff877b11f None None] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:10:56.561264 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fc3cbc-686b-49b9-9b48-b72ff877b11f None None] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:10:56.561536 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fc3cbc-686b-49b9-9b48-b72ff877b11f None None] PATH_INFO: `/` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:10:56.562833 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 288/570] 10.222.0.21 () {54 vars in 926 bytes} [Wed May 4 07:10:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 07:10:56.563606 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57fc3cbc-686b-49b9-9b48-b72ff877b11f None None] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:10:56.652652 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f30a049-4407-45b5-9533-a9d88a979236 None admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:10:56.663721 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57fc3cbc-686b-49b9-9b48-b72ff877b11f None None] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:10:56.685935 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c0e596-ae8b-42b2-b4d0-7defd5250b48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:10:56.686646 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c0e596-ae8b-42b2-b4d0-7defd5250b48 None admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:10:56.686924 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c0e596-ae8b-42b2-b4d0-7defd5250b48 None admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:10:56.687221 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c0e596-ae8b-42b2-b4d0-7defd5250b48 None admin] PATH_INFO: `/v3/users/glance` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:10:56.694336 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c0e596-ae8b-42b2-b4d0-7defd5250b48 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:10:56.696271 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c0e596-ae8b-42b2-b4d0-7defd5250b48 None admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:10:56.697814 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c3ec24-816f-4bbc-8f0e-ce7fcfc520bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:10:56.698594 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c3ec24-816f-4bbc-8f0e-ce7fcfc520bc None admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:10:56.698869 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c3ec24-816f-4bbc-8f0e-ce7fcfc520bc None admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:10:56.699373 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c3ec24-816f-4bbc-8f0e-ce7fcfc520bc None admin] PATH_INFO: `/v3/users/nova` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:10:56.706440 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c3ec24-816f-4bbc-8f0e-ce7fcfc520bc None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:10:56.707894 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c3ec24-816f-4bbc-8f0e-ce7fcfc520bc None admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:10:56.715839 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application [None req-65c0e596-ae8b-42b2-b4d0-7defd5250b48 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 04 07:10:56.715839 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 07:10:56.715839 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 07:10:56.715839 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 07:10:56.715839 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 07:10:56.715839 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 07:10:56.715839 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 07:10:56.715839 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 07:10:56.715839 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 07:10:56.715839 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 07:10:56.715839 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 07:10:56.715839 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 07:10:56.715839 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 04 07:10:56.715839 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self._get_user(user_id) May 04 07:10:56.715839 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 04 07:10:56.715839 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 04 07:10:56.716924 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 07:10:56.716924 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 07:10:56.716924 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 04 07:10:56.716924 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 07:10:56.716924 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 04 07:10:56.716924 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 07:10:56.716924 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 07:10:56.716924 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 07:10:56.716924 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 07:10:56.716924 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self.get_or_create( May 04 07:10:56.716924 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 07:10:56.716924 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application with Lock( May 04 07:10:56.716924 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 07:10:56.716924 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self._enter() May 04 07:10:56.716924 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 07:10:56.716924 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 07:10:56.716924 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 07:10:56.716924 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self.creator() May 04 07:10:56.718137 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 07:10:56.718137 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application created_value = creator( May 04 07:10:56.718137 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 04 07:10:56.718137 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 04 07:10:56.718137 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 04 07:10:56.718137 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 04 07:10:56.718137 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 04 07:10:56.718137 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 04 07:10:56.718137 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 04 07:10:56.718137 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application May 04 07:10:56.724890 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application [None req-04c3ec24-816f-4bbc-8f0e-ce7fcfc520bc None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 04 07:10:56.724890 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 07:10:56.724890 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 07:10:56.724890 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 07:10:56.724890 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 07:10:56.724890 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 07:10:56.724890 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 07:10:56.724890 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 07:10:56.724890 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 07:10:56.724890 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 07:10:56.724890 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 07:10:56.724890 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 07:10:56.724890 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 04 07:10:56.724890 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self._get_user(user_id) May 04 07:10:56.724890 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 04 07:10:56.724890 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 04 07:10:56.725931 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 07:10:56.725931 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 07:10:56.725931 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 04 07:10:56.725931 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 07:10:56.725931 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 04 07:10:56.725931 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 07:10:56.725931 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 07:10:56.725931 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 07:10:56.725931 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 07:10:56.725931 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.get_or_create( May 04 07:10:56.725931 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 07:10:56.725931 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application with Lock( May 04 07:10:56.725931 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 07:10:56.725931 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self._enter() May 04 07:10:56.725931 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 07:10:56.725931 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 07:10:56.725931 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 07:10:56.725931 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.creator() May 04 07:10:56.727361 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 07:10:56.727361 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application created_value = creator( May 04 07:10:56.727361 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 04 07:10:56.727361 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 04 07:10:56.727361 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 04 07:10:56.727361 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 04 07:10:56.727361 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 04 07:10:56.727361 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 04 07:10:56.727361 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 04 07:10:56.727361 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application May 04 07:10:56.727361 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 289/571] 10.222.0.21 () {56 vars in 1093 bytes} [Wed May 4 07:10:56 2022] GET /identity/v3/users/nova => generated 82 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 07:10:56.727361 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c818d6-7af6-4cff-981b-549b4f4c6419 None None] REQUEST_METHOD: `POST` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:10:56.727361 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c818d6-7af6-4cff-981b-549b4f4c6419 None None] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:10:56.728052 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c818d6-7af6-4cff-981b-549b4f4c6419 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:10:56.728127 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 283/572] 10.222.0.21 () {56 vars in 1099 bytes} [Wed May 4 07:10:56 2022] GET /identity/v3/users/glance => generated 84 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 07:10:56.728779 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c0e596-ae8b-42b2-b4d0-7defd5250b48 None admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:10:56.745565 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.auth.core [None req-72c818d6-7af6-4cff-981b-549b4f4c6419 None None] MFA Rules not processed for user `83c5e0dcb991496ea6dee38384514508`. Rule list: `[]` (Enabled: `True`). {{(pid=79744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:10:56.746908 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.fernet_utils [None req-72c818d6-7af6-4cff-981b-549b4f4c6419 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:10:56.812832 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 290/573] 10.222.0.21 () {58 vars in 1023 bytes} [Wed May 4 07:10:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 07:10:56.814048 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c818d6-7af6-4cff-981b-549b4f4c6419 None None] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:10:56.842605 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c0e596-ae8b-42b2-b4d0-7defd5250b48 None admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:10:56.881806 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89188807-dc58-4083-bf7b-576fe47cd349 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:10:56.883583 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89188807-dc58-4083-bf7b-576fe47cd349 None admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:10:56.883860 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89188807-dc58-4083-bf7b-576fe47cd349 None admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:10:56.884129 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89188807-dc58-4083-bf7b-576fe47cd349 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:10:56.896601 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89188807-dc58-4083-bf7b-576fe47cd349 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 07:10:56.907243 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application [None req-89188807-dc58-4083-bf7b-576fe47cd349 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 04 07:10:56.907243 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 07:10:56.907243 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 07:10:56.907243 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 07:10:56.907243 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 07:10:56.907243 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 07:10:56.907243 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 07:10:56.907243 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 07:10:56.907243 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 07:10:56.907243 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 07:10:56.907243 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 07:10:56.907243 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 07:10:56.907243 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 07:10:56.907243 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 07:10:56.907243 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 07:10:56.907243 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 07:10:56.908206 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 07:10:56.908206 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 07:10:56.908206 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 07:10:56.908206 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 07:10:56.908206 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 07:10:56.908206 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 07:10:56.908206 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 07:10:56.908206 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 07:10:56.908206 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 07:10:56.908206 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self.get_or_create( May 04 07:10:56.908206 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 07:10:56.908206 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application with Lock( May 04 07:10:56.908206 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 07:10:56.908206 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self._enter() May 04 07:10:56.908206 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 07:10:56.908206 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 07:10:56.914342 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 07:10:56.914342 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self.creator() May 04 07:10:56.914342 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 07:10:56.914342 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application created_value = creator( May 04 07:10:56.914342 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 07:10:56.914342 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 07:10:56.914342 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 07:10:56.914342 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 07:10:56.914342 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 07:10:56.914342 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 07:10:56.914342 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 04 07:10:56.914342 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application May 04 07:10:56.914342 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 284/574] 10.222.0.21 () {56 vars in 1102 bytes} [Wed May 4 07:10:56 2022] GET /identity/v3/roles/service => generated 85 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 07:10:56.914342 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89188807-dc58-4083-bf7b-576fe47cd349 None admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:10:56.915180 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c818d6-7af6-4cff-981b-549b4f4c6419 None None] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:10:56.945234 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a8d3d3-b736-4134-ab61-7be8e6946c24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:10:56.945836 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a8d3d3-b736-4134-ab61-7be8e6946c24 None admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:10:56.946110 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a8d3d3-b736-4134-ab61-7be8e6946c24 None admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:10:56.946378 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a8d3d3-b736-4134-ab61-7be8e6946c24 None admin] PATH_INFO: `/v3/users` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:10:56.947231 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a8d3d3-b736-4134-ab61-7be8e6946c24 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=79744) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 07:10:56.947536 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a8d3d3-b736-4134-ab61-7be8e6946c24 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:10:56.949464 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a8d3d3-b736-4134-ab61-7be8e6946c24 None admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:10:56.971227 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 291/575] 10.222.0.21 () {56 vars in 1137 bytes} [Wed May 4 07:10:56 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 07:10:56.971227 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a8d3d3-b736-4134-ab61-7be8e6946c24 None admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:10:57.019784 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89188807-dc58-4083-bf7b-576fe47cd349 None admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:10:57.054054 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99ccbf5-b103-4dee-ab79-903769d83190 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:10:57.055014 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99ccbf5-b103-4dee-ab79-903769d83190 None admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:10:57.055356 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99ccbf5-b103-4dee-ab79-903769d83190 None admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:10:57.055628 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99ccbf5-b103-4dee-ab79-903769d83190 None admin] PATH_INFO: `/v3/users` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:10:57.056455 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99ccbf5-b103-4dee-ab79-903769d83190 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 07:10:57.056756 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99ccbf5-b103-4dee-ab79-903769d83190 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:10:57.058181 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99ccbf5-b103-4dee-ab79-903769d83190 None admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:10:57.065708 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a8d3d3-b736-4134-ab61-7be8e6946c24 None admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:10:57.079652 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 285/576] 10.222.0.21 () {56 vars in 1133 bytes} [Wed May 4 07:10:56 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 07:10:57.079652 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99ccbf5-b103-4dee-ab79-903769d83190 None admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:10:57.107003 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68113e75-7830-4ab1-a222-5d0f166f9f70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:10:57.107824 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68113e75-7830-4ab1-a222-5d0f166f9f70 None admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:10:57.108099 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68113e75-7830-4ab1-a222-5d0f166f9f70 None admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:10:57.108530 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68113e75-7830-4ab1-a222-5d0f166f9f70 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:10:57.120404 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68113e75-7830-4ab1-a222-5d0f166f9f70 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 07:10:57.130787 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application [None req-68113e75-7830-4ab1-a222-5d0f166f9f70 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 04 07:10:57.130787 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 07:10:57.130787 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 07:10:57.130787 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 07:10:57.130787 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 07:10:57.130787 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 07:10:57.130787 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 07:10:57.130787 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 07:10:57.130787 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 07:10:57.130787 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 07:10:57.130787 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 07:10:57.130787 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 07:10:57.130787 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 07:10:57.130787 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 07:10:57.130787 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 07:10:57.130787 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 07:10:57.132257 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 07:10:57.132257 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 07:10:57.132257 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 07:10:57.132257 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 07:10:57.132257 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 07:10:57.132257 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 07:10:57.132257 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 07:10:57.132257 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 07:10:57.132257 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 07:10:57.132257 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.get_or_create( May 04 07:10:57.132257 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 07:10:57.132257 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application with Lock( May 04 07:10:57.132257 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 07:10:57.132257 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self._enter() May 04 07:10:57.132257 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 07:10:57.132257 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 07:10:57.138310 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 07:10:57.138310 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.creator() May 04 07:10:57.138310 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 07:10:57.138310 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application created_value = creator( May 04 07:10:57.138310 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 07:10:57.138310 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 07:10:57.138310 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 07:10:57.138310 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 07:10:57.138310 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 07:10:57.138310 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 07:10:57.138310 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 04 07:10:57.138310 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application May 04 07:10:57.138310 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 292/577] 10.222.0.21 () {56 vars in 1102 bytes} [Wed May 4 07:10:56 2022] GET /identity/v3/roles/service => generated 85 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 07:10:57.138310 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68113e75-7830-4ab1-a222-5d0f166f9f70 None admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:10:57.172020 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99ccbf5-b103-4dee-ab79-903769d83190 None admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:10:57.206768 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0af51a-bbd4-4e1d-8aa0-d5272ba69afe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:10:57.207390 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0af51a-bbd4-4e1d-8aa0-d5272ba69afe None admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:10:57.207734 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0af51a-bbd4-4e1d-8aa0-d5272ba69afe None admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:10:57.208011 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0af51a-bbd4-4e1d-8aa0-d5272ba69afe None admin] PATH_INFO: `/v3/roles` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:10:57.208805 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0af51a-bbd4-4e1d-8aa0-d5272ba69afe None admin] RBAC: Adding query filter params (name=service) {{(pid=79745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 07:10:57.209114 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0af51a-bbd4-4e1d-8aa0-d5272ba69afe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:10:57.210488 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0af51a-bbd4-4e1d-8aa0-d5272ba69afe None admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:10:57.219369 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 286/578] 10.222.0.21 () {56 vars in 1103 bytes} [Wed May 4 07:10:57 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 07:10:57.220012 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0af51a-bbd4-4e1d-8aa0-d5272ba69afe None admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:10:57.240673 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68113e75-7830-4ab1-a222-5d0f166f9f70 None admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:10:57.273576 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18be659-277e-46e4-ba22-009d9d1d0f93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:10:57.274369 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18be659-277e-46e4-ba22-009d9d1d0f93 None admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:10:57.274640 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18be659-277e-46e4-ba22-009d9d1d0f93 None admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:10:57.274903 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18be659-277e-46e4-ba22-009d9d1d0f93 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:10:57.285836 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18be659-277e-46e4-ba22-009d9d1d0f93 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:10:57.287304 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18be659-277e-46e4-ba22-009d9d1d0f93 None admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:10:57.304352 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application [None req-c18be659-277e-46e4-ba22-009d9d1d0f93 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 07:10:57.304352 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 07:10:57.304352 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 07:10:57.304352 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 07:10:57.304352 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 07:10:57.304352 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 07:10:57.304352 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 07:10:57.304352 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 07:10:57.304352 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 07:10:57.304352 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 07:10:57.304352 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 07:10:57.304352 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 07:10:57.304352 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 07:10:57.304352 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 07:10:57.304352 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 07:10:57.305291 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 07:10:57.305291 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 07:10:57.305291 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 07:10:57.305291 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 07:10:57.305291 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 07:10:57.305291 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 07:10:57.305291 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.get_or_create( May 04 07:10:57.305291 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 07:10:57.305291 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application with Lock( May 04 07:10:57.305291 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 07:10:57.305291 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self._enter() May 04 07:10:57.305291 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 07:10:57.305291 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 07:10:57.305291 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 07:10:57.305291 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.creator() May 04 07:10:57.305291 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 07:10:57.305291 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application created_value = creator( May 04 07:10:57.306184 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 07:10:57.306184 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 07:10:57.306184 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 07:10:57.306184 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application May 04 07:10:57.306184 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 293/579] 10.222.0.21 () {56 vars in 1108 bytes} [Wed May 4 07:10:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 07:10:57.306479 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18be659-277e-46e4-ba22-009d9d1d0f93 None admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:10:57.325766 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0af51a-bbd4-4e1d-8aa0-d5272ba69afe None admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:10:57.358730 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7fd0aa-069e-47b8-a71c-71e113fe3392 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:10:57.359538 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7fd0aa-069e-47b8-a71c-71e113fe3392 None admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:10:57.359818 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7fd0aa-069e-47b8-a71c-71e113fe3392 None admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:10:57.360087 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7fd0aa-069e-47b8-a71c-71e113fe3392 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:10:57.370131 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7fd0aa-069e-47b8-a71c-71e113fe3392 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:10:57.372328 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7fd0aa-069e-47b8-a71c-71e113fe3392 None admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:10:57.389055 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application [None req-cb7fd0aa-069e-47b8-a71c-71e113fe3392 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 07:10:57.389055 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 07:10:57.389055 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 07:10:57.389055 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 07:10:57.389055 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 07:10:57.389055 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 07:10:57.389055 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 07:10:57.389055 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 07:10:57.389055 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 07:10:57.389055 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 07:10:57.389055 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 07:10:57.389055 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 07:10:57.389055 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 07:10:57.389055 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 07:10:57.389055 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 07:10:57.390063 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 07:10:57.390063 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 07:10:57.390063 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 07:10:57.390063 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 07:10:57.390063 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 07:10:57.390063 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 07:10:57.390063 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self.get_or_create( May 04 07:10:57.390063 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 07:10:57.390063 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application with Lock( May 04 07:10:57.390063 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 07:10:57.390063 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self._enter() May 04 07:10:57.390063 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 07:10:57.390063 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 07:10:57.390063 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 07:10:57.390063 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self.creator() May 04 07:10:57.390063 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 07:10:57.390063 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application created_value = creator( May 04 07:10:57.390980 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 07:10:57.390980 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 07:10:57.390980 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 07:10:57.390980 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application May 04 07:10:57.390980 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 287/580] 10.222.0.21 () {56 vars in 1108 bytes} [Wed May 4 07:10:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 07:10:57.391292 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7fd0aa-069e-47b8-a71c-71e113fe3392 None admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:10:57.412251 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18be659-277e-46e4-ba22-009d9d1d0f93 None admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:10:57.454026 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f67a3de-bd7a-42e6-8f5f-edf31bd3acb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:10:57.455567 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f67a3de-bd7a-42e6-8f5f-edf31bd3acb8 None admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:10:57.456030 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f67a3de-bd7a-42e6-8f5f-edf31bd3acb8 None admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:10:57.456464 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f67a3de-bd7a-42e6-8f5f-edf31bd3acb8 None admin] PATH_INFO: `/v3/roles` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:10:57.457408 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f67a3de-bd7a-42e6-8f5f-edf31bd3acb8 None admin] RBAC: Adding query filter params (name=service) {{(pid=79744) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 07:10:57.457866 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f67a3de-bd7a-42e6-8f5f-edf31bd3acb8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:10:57.459258 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f67a3de-bd7a-42e6-8f5f-edf31bd3acb8 None admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:10:57.467711 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 294/581] 10.222.0.21 () {56 vars in 1103 bytes} [Wed May 4 07:10:57 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 07:10:57.472701 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f67a3de-bd7a-42e6-8f5f-edf31bd3acb8 None admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:10:57.498640 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7fd0aa-069e-47b8-a71c-71e113fe3392 None admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:10:57.533760 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1820a021-5254-4859-abe1-d50c9ce3892c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:10:57.534678 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1820a021-5254-4859-abe1-d50c9ce3892c None admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:10:57.535019 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1820a021-5254-4859-abe1-d50c9ce3892c None admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:10:57.535418 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1820a021-5254-4859-abe1-d50c9ce3892c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:10:57.546397 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1820a021-5254-4859-abe1-d50c9ce3892c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:10:57.547952 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1820a021-5254-4859-abe1-d50c9ce3892c None admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:10:57.565418 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application [None req-1820a021-5254-4859-abe1-d50c9ce3892c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 07:10:57.565418 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 07:10:57.565418 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 07:10:57.565418 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 07:10:57.565418 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 07:10:57.565418 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 07:10:57.565418 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 07:10:57.565418 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 07:10:57.565418 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 07:10:57.565418 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 07:10:57.565418 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 07:10:57.565418 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 07:10:57.565418 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 07:10:57.565418 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 07:10:57.565418 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 07:10:57.566528 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 07:10:57.566528 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 07:10:57.566528 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 07:10:57.566528 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 07:10:57.566528 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 07:10:57.566528 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 07:10:57.566528 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self.get_or_create( May 04 07:10:57.566528 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 07:10:57.566528 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application with Lock( May 04 07:10:57.566528 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 07:10:57.566528 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self._enter() May 04 07:10:57.566528 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 07:10:57.566528 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 07:10:57.566528 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 07:10:57.566528 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self.creator() May 04 07:10:57.566528 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 07:10:57.566528 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application created_value = creator( May 04 07:10:57.567618 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 07:10:57.567618 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 07:10:57.567618 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 07:10:57.567618 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application May 04 07:10:57.568369 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 288/582] 10.222.0.21 () {56 vars in 1108 bytes} [Wed May 4 07:10:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 07:10:57.568979 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1820a021-5254-4859-abe1-d50c9ce3892c None admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:10:57.579858 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f67a3de-bd7a-42e6-8f5f-edf31bd3acb8 None admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:10:57.612029 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f204484c-99d8-4719-a461-b2cba5c19c29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:10:57.612684 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f204484c-99d8-4719-a461-b2cba5c19c29 None admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:10:57.612961 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f204484c-99d8-4719-a461-b2cba5c19c29 None admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:10:57.613236 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f204484c-99d8-4719-a461-b2cba5c19c29 None admin] PATH_INFO: `/v3/domains` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:10:57.613943 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f204484c-99d8-4719-a461-b2cba5c19c29 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79744) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 07:10:57.614250 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f204484c-99d8-4719-a461-b2cba5c19c29 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:10:57.615633 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f204484c-99d8-4719-a461-b2cba5c19c29 None admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:10:57.626937 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 295/583] 10.222.0.21 () {56 vars in 1109 bytes} [Wed May 4 07:10:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 07:10:57.627755 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f204484c-99d8-4719-a461-b2cba5c19c29 None admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:10:57.672840 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1820a021-5254-4859-abe1-d50c9ce3892c None admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:10:57.705425 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c397b79-06d2-4539-be6b-60287648c49d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:10:57.706077 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c397b79-06d2-4539-be6b-60287648c49d None admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:10:57.706357 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c397b79-06d2-4539-be6b-60287648c49d None admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:10:57.706631 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c397b79-06d2-4539-be6b-60287648c49d None admin] PATH_INFO: `/v3/domains` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:10:57.707736 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c397b79-06d2-4539-be6b-60287648c49d None admin] RBAC: Adding query filter params (name=Default) {{(pid=79745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 07:10:57.707736 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c397b79-06d2-4539-be6b-60287648c49d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:10:57.709042 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c397b79-06d2-4539-be6b-60287648c49d None admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:10:57.720250 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 289/584] 10.222.0.21 () {56 vars in 1109 bytes} [Wed May 4 07:10:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 07:10:57.721044 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c397b79-06d2-4539-be6b-60287648c49d None admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:10:57.732801 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f204484c-99d8-4719-a461-b2cba5c19c29 None admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:10:57.769264 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03386a0d-baeb-4130-9372-b4a6f7f6a31c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:10:57.770051 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03386a0d-baeb-4130-9372-b4a6f7f6a31c None admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:10:57.770332 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03386a0d-baeb-4130-9372-b4a6f7f6a31c None admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:10:57.770606 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03386a0d-baeb-4130-9372-b4a6f7f6a31c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:10:57.781050 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03386a0d-baeb-4130-9372-b4a6f7f6a31c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:10:57.782509 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03386a0d-baeb-4130-9372-b4a6f7f6a31c None admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:10:57.800396 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application [None req-03386a0d-baeb-4130-9372-b4a6f7f6a31c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 07:10:57.800396 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 07:10:57.800396 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 07:10:57.800396 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 07:10:57.800396 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 07:10:57.800396 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 07:10:57.800396 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 07:10:57.800396 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 07:10:57.800396 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 07:10:57.800396 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 07:10:57.800396 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 07:10:57.800396 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 07:10:57.800396 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 07:10:57.800396 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 07:10:57.800396 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 07:10:57.801304 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 07:10:57.801304 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 07:10:57.801304 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 07:10:57.801304 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 07:10:57.801304 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 07:10:57.801304 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 07:10:57.801304 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.get_or_create( May 04 07:10:57.801304 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 07:10:57.801304 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application with Lock( May 04 07:10:57.801304 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 07:10:57.801304 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self._enter() May 04 07:10:57.801304 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 07:10:57.801304 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 07:10:57.801304 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 07:10:57.801304 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.creator() May 04 07:10:57.801304 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 07:10:57.801304 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application created_value = creator( May 04 07:10:57.802293 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 07:10:57.802293 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 07:10:57.802293 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 07:10:57.802293 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application May 04 07:10:57.802293 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 296/585] 10.222.0.21 () {56 vars in 1108 bytes} [Wed May 4 07:10:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 07:10:57.802293 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03386a0d-baeb-4130-9372-b4a6f7f6a31c None admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:10:57.831424 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c397b79-06d2-4539-be6b-60287648c49d None admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:10:57.865316 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a654e1c-b461-4ea4-aaac-09dd52918c4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:10:57.865978 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a654e1c-b461-4ea4-aaac-09dd52918c4c None admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:10:57.866255 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a654e1c-b461-4ea4-aaac-09dd52918c4c None admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:10:57.866526 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a654e1c-b461-4ea4-aaac-09dd52918c4c None admin] PATH_INFO: `/v3/domains` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:10:57.867421 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a654e1c-b461-4ea4-aaac-09dd52918c4c None admin] RBAC: Adding query filter params (name=Default) {{(pid=79745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 07:10:57.867732 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a654e1c-b461-4ea4-aaac-09dd52918c4c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:10:57.869842 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a654e1c-b461-4ea4-aaac-09dd52918c4c None admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:10:57.888718 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 290/586] 10.222.0.21 () {56 vars in 1109 bytes} [Wed May 4 07:10:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 07:10:57.888718 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a654e1c-b461-4ea4-aaac-09dd52918c4c None admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:10:57.900424 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03386a0d-baeb-4130-9372-b4a6f7f6a31c None admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:10:57.935823 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477d3575-4656-4a76-97c3-5bd627882bee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:10:57.937018 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477d3575-4656-4a76-97c3-5bd627882bee None admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:10:57.937382 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477d3575-4656-4a76-97c3-5bd627882bee None admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:10:57.937810 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477d3575-4656-4a76-97c3-5bd627882bee None admin] PATH_INFO: `/v3/projects/service` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:10:57.945841 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477d3575-4656-4a76-97c3-5bd627882bee None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:10:57.947294 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477d3575-4656-4a76-97c3-5bd627882bee None admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:10:57.961021 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application [None req-477d3575-4656-4a76-97c3-5bd627882bee None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 04 07:10:57.961021 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 07:10:57.961021 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 07:10:57.961021 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 07:10:57.961021 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 07:10:57.961021 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 07:10:57.961021 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 07:10:57.961021 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 07:10:57.961021 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 07:10:57.961021 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 07:10:57.961021 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 07:10:57.961021 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 07:10:57.961021 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 04 07:10:57.961021 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self._get_project(project_id) May 04 07:10:57.961021 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 04 07:10:57.961931 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 04 07:10:57.961931 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 07:10:57.961931 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 07:10:57.961931 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 07:10:57.961931 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 07:10:57.961931 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 07:10:57.961931 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.get_or_create( May 04 07:10:57.961931 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 07:10:57.961931 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application with Lock( May 04 07:10:57.961931 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 07:10:57.961931 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self._enter() May 04 07:10:57.961931 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 07:10:57.961931 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 07:10:57.961931 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 07:10:57.961931 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.creator() May 04 07:10:57.961931 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 07:10:57.961931 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application created_value = creator( May 04 07:10:57.962879 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 04 07:10:57.962879 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 04 07:10:57.962879 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 04 07:10:57.962879 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 04 07:10:57.962879 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 04 07:10:57.962879 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 04 07:10:57.962879 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 04 07:10:57.962879 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application May 04 07:10:57.962879 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 297/587] 10.222.0.21 () {56 vars in 1111 bytes} [Wed May 4 07:10:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 07:10:57.962879 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477d3575-4656-4a76-97c3-5bd627882bee None admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:10:57.998556 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a654e1c-b461-4ea4-aaac-09dd52918c4c None admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:10:58.031609 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559048d0-975c-4109-9ee3-f2ad9aa16506 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:10:58.032395 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559048d0-975c-4109-9ee3-f2ad9aa16506 None admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:10:58.032673 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559048d0-975c-4109-9ee3-f2ad9aa16506 None admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:10:58.032942 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559048d0-975c-4109-9ee3-f2ad9aa16506 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:10:58.040049 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559048d0-975c-4109-9ee3-f2ad9aa16506 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:10:58.041494 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559048d0-975c-4109-9ee3-f2ad9aa16506 None admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:10:58.056194 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application [None req-559048d0-975c-4109-9ee3-f2ad9aa16506 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 04 07:10:58.056194 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 07:10:58.056194 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 07:10:58.056194 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 07:10:58.056194 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 07:10:58.056194 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 07:10:58.056194 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 07:10:58.056194 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 07:10:58.056194 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 07:10:58.056194 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 07:10:58.056194 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 07:10:58.056194 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 07:10:58.056194 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 04 07:10:58.056194 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self._get_project(project_id) May 04 07:10:58.056194 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 04 07:10:58.057098 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 04 07:10:58.057098 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 07:10:58.057098 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 07:10:58.057098 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 07:10:58.057098 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 07:10:58.057098 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 07:10:58.057098 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self.get_or_create( May 04 07:10:58.057098 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 07:10:58.057098 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application with Lock( May 04 07:10:58.057098 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 07:10:58.057098 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self._enter() May 04 07:10:58.057098 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 07:10:58.057098 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 07:10:58.057098 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 07:10:58.057098 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self.creator() May 04 07:10:58.057098 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 07:10:58.057098 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application created_value = creator( May 04 07:10:58.057980 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 04 07:10:58.057980 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 04 07:10:58.057980 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 04 07:10:58.057980 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 04 07:10:58.057980 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 04 07:10:58.057980 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 04 07:10:58.057980 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 04 07:10:58.057980 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application May 04 07:10:58.057980 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 291/588] 10.222.0.21 () {56 vars in 1111 bytes} [Wed May 4 07:10:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 07:10:58.058501 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559048d0-975c-4109-9ee3-f2ad9aa16506 None admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:10:58.070656 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477d3575-4656-4a76-97c3-5bd627882bee None admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:10:58.104781 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5810f48d-0bbf-4b15-b02b-53fee771fc39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:10:58.105643 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5810f48d-0bbf-4b15-b02b-53fee771fc39 None admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:10:58.105958 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5810f48d-0bbf-4b15-b02b-53fee771fc39 None admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:10:58.106293 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5810f48d-0bbf-4b15-b02b-53fee771fc39 None admin] PATH_INFO: `/v3/domains` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:10:58.107004 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5810f48d-0bbf-4b15-b02b-53fee771fc39 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79744) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 07:10:58.107339 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5810f48d-0bbf-4b15-b02b-53fee771fc39 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:10:58.108681 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5810f48d-0bbf-4b15-b02b-53fee771fc39 None admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:10:58.125049 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 298/589] 10.222.0.21 () {56 vars in 1109 bytes} [Wed May 4 07:10:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 07:10:58.125049 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5810f48d-0bbf-4b15-b02b-53fee771fc39 None admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:10:58.167238 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559048d0-975c-4109-9ee3-f2ad9aa16506 None admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:10:58.201223 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad54329-cf71-4b93-baa7-69c00f168949 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:10:58.202013 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad54329-cf71-4b93-baa7-69c00f168949 None admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:10:58.202288 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad54329-cf71-4b93-baa7-69c00f168949 None admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:10:58.202559 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad54329-cf71-4b93-baa7-69c00f168949 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:10:58.209646 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad54329-cf71-4b93-baa7-69c00f168949 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:10:58.211122 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad54329-cf71-4b93-baa7-69c00f168949 None admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:10:58.224504 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5810f48d-0bbf-4b15-b02b-53fee771fc39 None admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:10:58.226341 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application [None req-cad54329-cf71-4b93-baa7-69c00f168949 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 04 07:10:58.226341 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 07:10:58.226341 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 07:10:58.226341 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 07:10:58.226341 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 07:10:58.226341 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 07:10:58.226341 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 07:10:58.226341 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 07:10:58.226341 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 07:10:58.226341 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 07:10:58.226341 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 07:10:58.226341 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 07:10:58.226341 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 04 07:10:58.226341 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self._get_user(user_id) May 04 07:10:58.226341 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 04 07:10:58.226341 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 04 07:10:58.227525 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 07:10:58.227525 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 07:10:58.227525 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 04 07:10:58.227525 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 07:10:58.227525 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 04 07:10:58.227525 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 07:10:58.227525 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 07:10:58.227525 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 07:10:58.227525 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 07:10:58.227525 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self.get_or_create( May 04 07:10:58.227525 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 07:10:58.227525 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application with Lock( May 04 07:10:58.227525 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 07:10:58.227525 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self._enter() May 04 07:10:58.227525 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 07:10:58.227525 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 07:10:58.227525 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 07:10:58.227525 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self.creator() May 04 07:10:58.228715 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 07:10:58.228715 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application created_value = creator( May 04 07:10:58.228715 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 04 07:10:58.228715 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 04 07:10:58.228715 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 04 07:10:58.228715 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 04 07:10:58.228715 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 04 07:10:58.228715 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 04 07:10:58.228715 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 04 07:10:58.228715 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application May 04 07:10:58.230786 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 292/590] 10.222.0.21 () {56 vars in 1099 bytes} [Wed May 4 07:10:58 2022] GET /identity/v3/users/cinder => generated 84 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 07:10:58.230930 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad54329-cf71-4b93-baa7-69c00f168949 None admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:10:58.267798 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd26491-e71f-4254-9ca4-26f287fe1b58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:10:58.268874 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd26491-e71f-4254-9ca4-26f287fe1b58 None admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:10:58.269416 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd26491-e71f-4254-9ca4-26f287fe1b58 None admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:10:58.269943 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd26491-e71f-4254-9ca4-26f287fe1b58 None admin] PATH_INFO: `/v3/projects` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:10:58.270860 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd26491-e71f-4254-9ca4-26f287fe1b58 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79744) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 07:10:58.271318 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd26491-e71f-4254-9ca4-26f287fe1b58 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:10:58.272846 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd26491-e71f-4254-9ca4-26f287fe1b58 None admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:10:58.290068 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 299/591] 10.222.0.21 () {56 vars in 1148 bytes} [Wed May 4 07:10:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 07:10:58.291067 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd26491-e71f-4254-9ca4-26f287fe1b58 None admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:10:58.327418 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad54329-cf71-4b93-baa7-69c00f168949 None admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:10:58.361958 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee06e1c7-303a-4876-828c-79ed24517578 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:10:58.362798 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee06e1c7-303a-4876-828c-79ed24517578 None admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:10:58.363202 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee06e1c7-303a-4876-828c-79ed24517578 None admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:10:58.363578 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee06e1c7-303a-4876-828c-79ed24517578 None admin] PATH_INFO: `/v3/projects` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:10:58.364468 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee06e1c7-303a-4876-828c-79ed24517578 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 07:10:58.364878 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee06e1c7-303a-4876-828c-79ed24517578 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:10:58.366422 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee06e1c7-303a-4876-828c-79ed24517578 None admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:10:58.378414 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 293/592] 10.222.0.21 () {56 vars in 1148 bytes} [Wed May 4 07:10:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 07:10:58.379408 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee06e1c7-303a-4876-828c-79ed24517578 None admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:10:58.392067 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd26491-e71f-4254-9ca4-26f287fe1b58 None admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:10:58.426722 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383e8b2e-2f14-4f5b-aea1-44390f52c3f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:10:58.427556 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383e8b2e-2f14-4f5b-aea1-44390f52c3f8 None admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:10:58.427832 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383e8b2e-2f14-4f5b-aea1-44390f52c3f8 None admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:10:58.428099 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383e8b2e-2f14-4f5b-aea1-44390f52c3f8 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:10:58.436359 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383e8b2e-2f14-4f5b-aea1-44390f52c3f8 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:10:58.437802 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383e8b2e-2f14-4f5b-aea1-44390f52c3f8 None admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:10:58.452474 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application [None req-383e8b2e-2f14-4f5b-aea1-44390f52c3f8 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 04 07:10:58.452474 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 07:10:58.452474 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 07:10:58.452474 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 07:10:58.452474 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 07:10:58.452474 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 07:10:58.452474 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 07:10:58.452474 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 07:10:58.452474 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 07:10:58.452474 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 07:10:58.452474 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 07:10:58.452474 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 07:10:58.452474 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 04 07:10:58.452474 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self._get_user(user_id) May 04 07:10:58.452474 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 04 07:10:58.452474 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 04 07:10:58.453459 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 07:10:58.453459 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 07:10:58.453459 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 04 07:10:58.453459 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 07:10:58.453459 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 04 07:10:58.453459 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 07:10:58.453459 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 07:10:58.453459 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 07:10:58.453459 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 07:10:58.453459 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.get_or_create( May 04 07:10:58.453459 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 07:10:58.453459 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application with Lock( May 04 07:10:58.453459 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 07:10:58.453459 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self._enter() May 04 07:10:58.453459 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 07:10:58.453459 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 07:10:58.453459 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 07:10:58.453459 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.creator() May 04 07:10:58.454553 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 07:10:58.454553 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application created_value = creator( May 04 07:10:58.454553 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 04 07:10:58.454553 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 04 07:10:58.454553 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 04 07:10:58.454553 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 04 07:10:58.454553 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 04 07:10:58.454553 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 04 07:10:58.454553 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 04 07:10:58.454553 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application May 04 07:10:58.458715 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 300/593] 10.222.0.21 () {56 vars in 1102 bytes} [Wed May 4 07:10:58 2022] GET /identity/v3/users/neutron => generated 85 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 07:10:58.459630 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383e8b2e-2f14-4f5b-aea1-44390f52c3f8 None admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:10:58.490071 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee06e1c7-303a-4876-828c-79ed24517578 None admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:10:58.523840 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db2c12b-89e3-4e63-b0a1-08cec9f639d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:10:58.524517 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db2c12b-89e3-4e63-b0a1-08cec9f639d9 None admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:10:58.524775 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db2c12b-89e3-4e63-b0a1-08cec9f639d9 None admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:10:58.525048 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db2c12b-89e3-4e63-b0a1-08cec9f639d9 None admin] PATH_INFO: `/v3/users` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:10:58.525886 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db2c12b-89e3-4e63-b0a1-08cec9f639d9 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=79745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 07:10:58.526195 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db2c12b-89e3-4e63-b0a1-08cec9f639d9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:10:58.528553 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db2c12b-89e3-4e63-b0a1-08cec9f639d9 None admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:10:58.550191 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 294/594] 10.222.0.21 () {56 vars in 1137 bytes} [Wed May 4 07:10:58 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 07:10:58.550191 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db2c12b-89e3-4e63-b0a1-08cec9f639d9 None admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:10:58.577434 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383e8b2e-2f14-4f5b-aea1-44390f52c3f8 None admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:10:58.609824 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f5dba2-2e7e-4aa6-87c4-b5fde63c27d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:10:58.610701 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f5dba2-2e7e-4aa6-87c4-b5fde63c27d5 None admin] REQUEST_METHOD: `PUT` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:10:58.610974 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f5dba2-2e7e-4aa6-87c4-b5fde63c27d5 None admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:10:58.611269 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f5dba2-2e7e-4aa6-87c4-b5fde63c27d5 None admin] PATH_INFO: `/v3/projects/c9f9c44db4984653b8d4b5f6b3b949f5/users/7538f5cab3364625a3e909f5f117ef2d/roles/14041215d0f7476a8e90241a49338706` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:10:58.625793 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f5dba2-2e7e-4aa6-87c4-b5fde63c27d5 None admin] RBAC: Authorizing `identity:create_grant(project_id=c9f9c44db4984653b8d4b5f6b3b949f5, user_id=7538f5cab3364625a3e909f5f117ef2d, role_id=14041215d0f7476a8e90241a49338706)` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:10:58.627512 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f5dba2-2e7e-4aa6-87c4-b5fde63c27d5 None admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:10:58.641979 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 301/595] 10.222.0.21 () {58 vars in 1439 bytes} [Wed May 4 07:10:58 2022] PUT /identity/v3/projects/c9f9c44db4984653b8d4b5f6b3b949f5/users/7538f5cab3364625a3e909f5f117ef2d/roles/14041215d0f7476a8e90241a49338706 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 07:10:58.643350 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db2c12b-89e3-4e63-b0a1-08cec9f639d9 None admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:10:58.649335 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f5dba2-2e7e-4aa6-87c4-b5fde63c27d5 None admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:10:58.682915 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c05716-9dd0-49cd-bbfe-e87883312057 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:10:58.684707 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c05716-9dd0-49cd-bbfe-e87883312057 None admin] REQUEST_METHOD: `PUT` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:10:58.684979 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c05716-9dd0-49cd-bbfe-e87883312057 None admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:10:58.685244 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c05716-9dd0-49cd-bbfe-e87883312057 None admin] PATH_INFO: `/v3/projects/c9f9c44db4984653b8d4b5f6b3b949f5/users/1077289fedae43b6be47be7f716d573a/roles/14041215d0f7476a8e90241a49338706` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:10:58.700890 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c05716-9dd0-49cd-bbfe-e87883312057 None admin] RBAC: Authorizing `identity:create_grant(project_id=c9f9c44db4984653b8d4b5f6b3b949f5, user_id=1077289fedae43b6be47be7f716d573a, role_id=14041215d0f7476a8e90241a49338706)` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:10:58.702366 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c05716-9dd0-49cd-bbfe-e87883312057 None admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:10:58.717432 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 295/596] 10.222.0.21 () {58 vars in 1439 bytes} [Wed May 4 07:10:58 2022] PUT /identity/v3/projects/c9f9c44db4984653b8d4b5f6b3b949f5/users/1077289fedae43b6be47be7f716d573a/roles/14041215d0f7476a8e90241a49338706 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 07:10:58.718630 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c05716-9dd0-49cd-bbfe-e87883312057 None admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:10:58.792133 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f5dba2-2e7e-4aa6-87c4-b5fde63c27d5 None admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:10:58.834212 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01a58bb-73c2-4ec7-a466-28e5e20b92b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:10:58.835556 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01a58bb-73c2-4ec7-a466-28e5e20b92b4 None admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:10:58.836222 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01a58bb-73c2-4ec7-a466-28e5e20b92b4 None admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:10:58.836769 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01a58bb-73c2-4ec7-a466-28e5e20b92b4 None admin] PATH_INFO: `/v3/users` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:10:58.838592 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01a58bb-73c2-4ec7-a466-28e5e20b92b4 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=79744) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 07:10:58.839121 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01a58bb-73c2-4ec7-a466-28e5e20b92b4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:10:58.840305 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c05716-9dd0-49cd-bbfe-e87883312057 None admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:10:58.841261 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01a58bb-73c2-4ec7-a466-28e5e20b92b4 None admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:10:58.872986 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 302/597] 10.222.0.21 () {56 vars in 1139 bytes} [Wed May 4 07:10:58 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 07:10:58.876474 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f74d06-3868-491b-8a2e-ab2446f1296f None None] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:10:58.877096 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f74d06-3868-491b-8a2e-ab2446f1296f None None] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:10:58.877596 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f74d06-3868-491b-8a2e-ab2446f1296f None None] PATH_INFO: `/` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:10:58.879645 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 303/598] 10.222.0.21 () {54 vars in 926 bytes} [Wed May 4 07:10:58 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 07:10:58.880717 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f74d06-3868-491b-8a2e-ab2446f1296f None None] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:10:58.906225 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67793f05-6a55-42f0-b5fb-508398be2232 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:10:58.907089 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67793f05-6a55-42f0-b5fb-508398be2232 None admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:10:58.907967 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67793f05-6a55-42f0-b5fb-508398be2232 None admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:10:58.908247 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67793f05-6a55-42f0-b5fb-508398be2232 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:10:58.923034 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67793f05-6a55-42f0-b5fb-508398be2232 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:10:58.924539 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67793f05-6a55-42f0-b5fb-508398be2232 None admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:10:58.946721 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application [None req-67793f05-6a55-42f0-b5fb-508398be2232 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 07:10:58.946721 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 07:10:58.946721 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 07:10:58.946721 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 07:10:58.946721 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 07:10:58.946721 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 07:10:58.946721 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 07:10:58.946721 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 07:10:58.946721 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 07:10:58.946721 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 07:10:58.946721 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 07:10:58.946721 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 07:10:58.946721 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 07:10:58.946721 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 07:10:58.946721 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 07:10:58.947712 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 07:10:58.947712 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 07:10:58.947712 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 07:10:58.947712 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 07:10:58.947712 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 07:10:58.947712 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 07:10:58.947712 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self.get_or_create( May 04 07:10:58.947712 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 07:10:58.947712 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application with Lock( May 04 07:10:58.947712 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 07:10:58.947712 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self._enter() May 04 07:10:58.947712 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 07:10:58.947712 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 07:10:58.947712 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 07:10:58.947712 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self.creator() May 04 07:10:58.947712 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 07:10:58.947712 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application created_value = creator( May 04 07:10:58.948625 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 07:10:58.948625 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 07:10:58.948625 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 07:10:58.948625 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application May 04 07:10:58.948625 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 296/599] 10.222.0.21 () {56 vars in 1108 bytes} [Wed May 4 07:10:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 07:10:58.950145 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b543d31b-98fb-4fcf-b2f8-189ac6945610 None None] REQUEST_METHOD: `POST` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:10:58.950427 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b543d31b-98fb-4fcf-b2f8-189ac6945610 None None] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:10:58.950699 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b543d31b-98fb-4fcf-b2f8-189ac6945610 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:10:58.968972 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.auth.core [None req-b543d31b-98fb-4fcf-b2f8-189ac6945610 None None] MFA Rules not processed for user `83c5e0dcb991496ea6dee38384514508`. Rule list: `[]` (Enabled: `True`). {{(pid=79745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:10:58.970184 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.fernet_utils [None req-b543d31b-98fb-4fcf-b2f8-189ac6945610 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:10:59.004209 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f74d06-3868-491b-8a2e-ab2446f1296f None None] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:10:59.040225 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c733aa5a-683c-401e-a894-68ac614db4cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:10:59.041000 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c733aa5a-683c-401e-a894-68ac614db4cc None admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:10:59.041275 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c733aa5a-683c-401e-a894-68ac614db4cc None admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:10:59.041543 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c733aa5a-683c-401e-a894-68ac614db4cc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:10:59.052064 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c733aa5a-683c-401e-a894-68ac614db4cc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:10:59.053086 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 297/600] 10.222.0.21 () {58 vars in 1023 bytes} [Wed May 4 07:10:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 07:10:59.053546 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c733aa5a-683c-401e-a894-68ac614db4cc None admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:10:59.054482 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b543d31b-98fb-4fcf-b2f8-189ac6945610 None None] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:10:59.071899 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application [None req-c733aa5a-683c-401e-a894-68ac614db4cc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 07:10:59.071899 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 07:10:59.071899 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 07:10:59.071899 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 07:10:59.071899 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 07:10:59.071899 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 07:10:59.071899 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 07:10:59.071899 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 07:10:59.071899 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 07:10:59.071899 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 07:10:59.071899 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 07:10:59.071899 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 07:10:59.071899 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 07:10:59.071899 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 07:10:59.071899 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 07:10:59.073054 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 07:10:59.073054 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 07:10:59.073054 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 07:10:59.073054 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 07:10:59.073054 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 07:10:59.073054 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 07:10:59.073054 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.get_or_create( May 04 07:10:59.073054 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 07:10:59.073054 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application with Lock( May 04 07:10:59.073054 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 07:10:59.073054 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self._enter() May 04 07:10:59.073054 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 07:10:59.073054 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 07:10:59.073054 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 07:10:59.073054 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.creator() May 04 07:10:59.073054 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 07:10:59.073054 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application created_value = creator( May 04 07:10:59.074664 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 07:10:59.074664 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 07:10:59.074664 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 07:10:59.074664 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application May 04 07:10:59.074664 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 304/601] 10.222.0.21 () {56 vars in 1108 bytes} [Wed May 4 07:10:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 07:10:59.083217 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c733aa5a-683c-401e-a894-68ac614db4cc None admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:10:59.161266 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b543d31b-98fb-4fcf-b2f8-189ac6945610 None None] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:10:59.199857 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae0ee49-f0a4-4cba-a69c-81763f71bcb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:10:59.200670 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae0ee49-f0a4-4cba-a69c-81763f71bcb4 None admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:10:59.200952 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae0ee49-f0a4-4cba-a69c-81763f71bcb4 None admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:10:59.201226 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae0ee49-f0a4-4cba-a69c-81763f71bcb4 None admin] PATH_INFO: `/v3/domains` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:10:59.201945 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae0ee49-f0a4-4cba-a69c-81763f71bcb4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 07:10:59.202250 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae0ee49-f0a4-4cba-a69c-81763f71bcb4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:10:59.203659 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae0ee49-f0a4-4cba-a69c-81763f71bcb4 None admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:10:59.205517 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c733aa5a-683c-401e-a894-68ac614db4cc None admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:10:59.215204 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 298/602] 10.222.0.21 () {56 vars in 1109 bytes} [Wed May 4 07:10:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 07:10:59.216027 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae0ee49-f0a4-4cba-a69c-81763f71bcb4 None admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:10:59.239881 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2584d2-5dc9-4d8b-8482-0d3a292b4780 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:10:59.240674 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2584d2-5dc9-4d8b-8482-0d3a292b4780 None admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:10:59.241050 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2584d2-5dc9-4d8b-8482-0d3a292b4780 None admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:10:59.241418 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2584d2-5dc9-4d8b-8482-0d3a292b4780 None admin] PATH_INFO: `/v3/domains` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:10:59.242225 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2584d2-5dc9-4d8b-8482-0d3a292b4780 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79744) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 07:10:59.242625 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2584d2-5dc9-4d8b-8482-0d3a292b4780 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:10:59.244087 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2584d2-5dc9-4d8b-8482-0d3a292b4780 None admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:10:59.255832 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 305/603] 10.222.0.21 () {56 vars in 1109 bytes} [Wed May 4 07:10:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 07:10:59.256802 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2584d2-5dc9-4d8b-8482-0d3a292b4780 None admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:10:59.315809 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae0ee49-f0a4-4cba-a69c-81763f71bcb4 None admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:10:59.350755 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ff99da-68ee-4cca-bd65-746e1adc05b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:10:59.351596 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ff99da-68ee-4cca-bd65-746e1adc05b8 None admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:10:59.351882 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ff99da-68ee-4cca-bd65-746e1adc05b8 None admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:10:59.352158 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ff99da-68ee-4cca-bd65-746e1adc05b8 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:10:59.356078 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2584d2-5dc9-4d8b-8482-0d3a292b4780 None admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:10:59.362168 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ff99da-68ee-4cca-bd65-746e1adc05b8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 07:10:59.369859 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application [None req-f4ff99da-68ee-4cca-bd65-746e1adc05b8 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 04 07:10:59.369859 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 07:10:59.369859 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 07:10:59.369859 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 07:10:59.369859 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 07:10:59.369859 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 07:10:59.369859 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 07:10:59.369859 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 07:10:59.369859 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 07:10:59.369859 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 07:10:59.369859 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 07:10:59.369859 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 07:10:59.369859 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 07:10:59.369859 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 07:10:59.369859 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 07:10:59.369859 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 07:10:59.372473 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 07:10:59.372473 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 07:10:59.372473 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 07:10:59.372473 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 07:10:59.372473 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 07:10:59.372473 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 07:10:59.372473 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 07:10:59.372473 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 07:10:59.372473 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 07:10:59.372473 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self.get_or_create( May 04 07:10:59.372473 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 07:10:59.372473 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application with Lock( May 04 07:10:59.372473 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 07:10:59.372473 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self._enter() May 04 07:10:59.372473 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 07:10:59.372473 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 07:10:59.374463 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 07:10:59.374463 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self.creator() May 04 07:10:59.374463 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 07:10:59.374463 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application created_value = creator( May 04 07:10:59.374463 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 07:10:59.374463 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 07:10:59.374463 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 07:10:59.374463 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 07:10:59.374463 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 07:10:59.374463 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 07:10:59.374463 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 04 07:10:59.374463 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application May 04 07:10:59.374463 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 299/604] 10.222.0.21 () {56 vars in 1102 bytes} [Wed May 4 07:10:59 2022] GET /identity/v3/roles/service => generated 85 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 07:10:59.374463 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ff99da-68ee-4cca-bd65-746e1adc05b8 None admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:10:59.395089 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2361af8-7e06-4a35-95b4-f0edbb2045ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:10:59.395931 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2361af8-7e06-4a35-95b4-f0edbb2045ea None admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:10:59.396180 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2361af8-7e06-4a35-95b4-f0edbb2045ea None admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:10:59.396449 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2361af8-7e06-4a35-95b4-f0edbb2045ea None admin] PATH_INFO: `/v3/projects/service` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:10:59.403695 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2361af8-7e06-4a35-95b4-f0edbb2045ea None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:10:59.405135 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2361af8-7e06-4a35-95b4-f0edbb2045ea None admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:10:59.419306 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application [None req-e2361af8-7e06-4a35-95b4-f0edbb2045ea None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 04 07:10:59.419306 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 07:10:59.419306 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 07:10:59.419306 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 07:10:59.419306 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 07:10:59.419306 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 07:10:59.419306 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 07:10:59.419306 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 07:10:59.419306 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 07:10:59.419306 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 07:10:59.419306 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 07:10:59.419306 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 07:10:59.419306 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 04 07:10:59.419306 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self._get_project(project_id) May 04 07:10:59.419306 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 04 07:10:59.421343 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 04 07:10:59.421343 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 07:10:59.421343 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 07:10:59.421343 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 07:10:59.421343 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 07:10:59.421343 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 07:10:59.421343 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.get_or_create( May 04 07:10:59.421343 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 07:10:59.421343 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application with Lock( May 04 07:10:59.421343 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 07:10:59.421343 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self._enter() May 04 07:10:59.421343 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 07:10:59.421343 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 07:10:59.421343 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 07:10:59.421343 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.creator() May 04 07:10:59.421343 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 07:10:59.421343 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application created_value = creator( May 04 07:10:59.423437 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 04 07:10:59.423437 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 04 07:10:59.423437 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 04 07:10:59.423437 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 04 07:10:59.423437 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 04 07:10:59.423437 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 04 07:10:59.423437 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 04 07:10:59.423437 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application May 04 07:10:59.423437 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 306/605] 10.222.0.21 () {56 vars in 1111 bytes} [Wed May 4 07:10:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 07:10:59.423437 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2361af8-7e06-4a35-95b4-f0edbb2045ea None admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:10:59.478369 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ff99da-68ee-4cca-bd65-746e1adc05b8 None admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:10:59.513955 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2dbf263-117c-4417-939a-51359ee85cb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:10:59.514997 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2dbf263-117c-4417-939a-51359ee85cb0 None admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:10:59.515445 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2dbf263-117c-4417-939a-51359ee85cb0 None admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:10:59.515893 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2dbf263-117c-4417-939a-51359ee85cb0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:10:59.521052 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2361af8-7e06-4a35-95b4-f0edbb2045ea None admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:10:59.523107 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2dbf263-117c-4417-939a-51359ee85cb0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:10:59.524719 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2dbf263-117c-4417-939a-51359ee85cb0 None admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:10:59.540095 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application [None req-a2dbf263-117c-4417-939a-51359ee85cb0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 04 07:10:59.540095 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 07:10:59.540095 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 07:10:59.540095 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 07:10:59.540095 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 07:10:59.540095 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 07:10:59.540095 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 07:10:59.540095 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 07:10:59.540095 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 07:10:59.540095 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 07:10:59.540095 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 07:10:59.540095 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 07:10:59.540095 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 04 07:10:59.540095 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self._get_project(project_id) May 04 07:10:59.540095 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 04 07:10:59.541230 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 04 07:10:59.541230 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 07:10:59.541230 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 07:10:59.541230 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 07:10:59.541230 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 07:10:59.541230 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 07:10:59.541230 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self.get_or_create( May 04 07:10:59.541230 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 07:10:59.541230 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application with Lock( May 04 07:10:59.541230 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 07:10:59.541230 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self._enter() May 04 07:10:59.541230 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 07:10:59.541230 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 07:10:59.541230 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 07:10:59.541230 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self.creator() May 04 07:10:59.541230 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 07:10:59.541230 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application created_value = creator( May 04 07:10:59.542371 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 04 07:10:59.542371 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 04 07:10:59.542371 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 04 07:10:59.542371 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 04 07:10:59.542371 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 04 07:10:59.542371 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 04 07:10:59.542371 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 04 07:10:59.542371 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application May 04 07:10:59.544453 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 300/606] 10.222.0.21 () {56 vars in 1111 bytes} [Wed May 4 07:10:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 07:10:59.545659 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2dbf263-117c-4417-939a-51359ee85cb0 None admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:10:59.555171 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db74ee8-38e0-414d-a336-bb870c170937 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:10:59.555867 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db74ee8-38e0-414d-a336-bb870c170937 None admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:10:59.556143 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db74ee8-38e0-414d-a336-bb870c170937 None admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:10:59.556412 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db74ee8-38e0-414d-a336-bb870c170937 None admin] PATH_INFO: `/v3/roles` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:10:59.557151 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db74ee8-38e0-414d-a336-bb870c170937 None admin] RBAC: Adding query filter params (name=service) {{(pid=79744) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 07:10:59.557449 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db74ee8-38e0-414d-a336-bb870c170937 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:10:59.559541 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db74ee8-38e0-414d-a336-bb870c170937 None admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:10:59.571333 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 307/607] 10.222.0.21 () {56 vars in 1103 bytes} [Wed May 4 07:10:59 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 07:10:59.571333 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db74ee8-38e0-414d-a336-bb870c170937 None admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:10:59.666088 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2dbf263-117c-4417-939a-51359ee85cb0 None admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:10:59.679507 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db74ee8-38e0-414d-a336-bb870c170937 None admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:10:59.700238 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f5811c-eb0b-4bf9-9f08-f1e25b672a20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:10:59.700895 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f5811c-eb0b-4bf9-9f08-f1e25b672a20 None admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:10:59.701178 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f5811c-eb0b-4bf9-9f08-f1e25b672a20 None admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:10:59.701442 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f5811c-eb0b-4bf9-9f08-f1e25b672a20 None admin] PATH_INFO: `/v3/projects` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:10:59.702252 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f5811c-eb0b-4bf9-9f08-f1e25b672a20 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 07:10:59.702533 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f5811c-eb0b-4bf9-9f08-f1e25b672a20 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:10:59.704002 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f5811c-eb0b-4bf9-9f08-f1e25b672a20 None admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:10:59.712353 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7c1a5c-f632-42e6-a7b1-317aa6b74e9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:10:59.713006 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7c1a5c-f632-42e6-a7b1-317aa6b74e9b None admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:10:59.713281 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7c1a5c-f632-42e6-a7b1-317aa6b74e9b None admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:10:59.713553 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7c1a5c-f632-42e6-a7b1-317aa6b74e9b None admin] PATH_INFO: `/v3/projects` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:10:59.714328 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7c1a5c-f632-42e6-a7b1-317aa6b74e9b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79744) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 07:10:59.715163 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7c1a5c-f632-42e6-a7b1-317aa6b74e9b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:10:59.716112 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 301/608] 10.222.0.21 () {56 vars in 1148 bytes} [Wed May 4 07:10:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 07:10:59.716577 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7c1a5c-f632-42e6-a7b1-317aa6b74e9b None admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:10:59.716926 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f5811c-eb0b-4bf9-9f08-f1e25b672a20 None admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:10:59.733958 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 308/609] 10.222.0.21 () {56 vars in 1148 bytes} [Wed May 4 07:10:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 07:10:59.734858 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7c1a5c-f632-42e6-a7b1-317aa6b74e9b None admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:10:59.815525 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f5811c-eb0b-4bf9-9f08-f1e25b672a20 None admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:10:59.832469 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7c1a5c-f632-42e6-a7b1-317aa6b74e9b None admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:10:59.849508 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12f4ec2-e4ff-4686-b627-35fe5e36e242 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:10:59.850296 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12f4ec2-e4ff-4686-b627-35fe5e36e242 None admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:10:59.850573 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12f4ec2-e4ff-4686-b627-35fe5e36e242 None admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:10:59.850844 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12f4ec2-e4ff-4686-b627-35fe5e36e242 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:10:59.861916 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12f4ec2-e4ff-4686-b627-35fe5e36e242 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:10:59.863401 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12f4ec2-e4ff-4686-b627-35fe5e36e242 None admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:10:59.866599 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bffe2dd-8a75-4972-8a09-bf5ff55882f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:10:59.867515 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bffe2dd-8a75-4972-8a09-bf5ff55882f7 None admin] REQUEST_METHOD: `PUT` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:10:59.867789 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bffe2dd-8a75-4972-8a09-bf5ff55882f7 None admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:10:59.868052 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bffe2dd-8a75-4972-8a09-bf5ff55882f7 None admin] PATH_INFO: `/v3/projects/c9f9c44db4984653b8d4b5f6b3b949f5/users/bb341257aa8246b6847561e2fe1fa385/roles/14041215d0f7476a8e90241a49338706` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:10:59.881158 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application [None req-c12f4ec2-e4ff-4686-b627-35fe5e36e242 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 07:10:59.881158 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 07:10:59.881158 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 07:10:59.881158 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 07:10:59.881158 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 07:10:59.881158 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 07:10:59.881158 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 07:10:59.881158 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 07:10:59.881158 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 07:10:59.881158 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 07:10:59.881158 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 07:10:59.881158 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 07:10:59.881158 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 07:10:59.881158 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 07:10:59.881158 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 07:10:59.883788 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 07:10:59.883788 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 07:10:59.883788 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 07:10:59.883788 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 07:10:59.883788 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 07:10:59.883788 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 07:10:59.883788 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self.get_or_create( May 04 07:10:59.883788 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 07:10:59.883788 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application with Lock( May 04 07:10:59.883788 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 07:10:59.883788 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self._enter() May 04 07:10:59.883788 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 07:10:59.883788 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 07:10:59.883788 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 07:10:59.883788 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self.creator() May 04 07:10:59.883788 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 07:10:59.883788 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application created_value = creator( May 04 07:10:59.885938 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 07:10:59.885938 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 07:10:59.885938 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 07:10:59.885938 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application May 04 07:10:59.885938 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 302/610] 10.222.0.21 () {56 vars in 1108 bytes} [Wed May 4 07:10:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 07:10:59.885938 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12f4ec2-e4ff-4686-b627-35fe5e36e242 None admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:10:59.903598 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bffe2dd-8a75-4972-8a09-bf5ff55882f7 None admin] RBAC: Authorizing `identity:create_grant(project_id=c9f9c44db4984653b8d4b5f6b3b949f5, user_id=bb341257aa8246b6847561e2fe1fa385, role_id=14041215d0f7476a8e90241a49338706)` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:10:59.903598 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bffe2dd-8a75-4972-8a09-bf5ff55882f7 None admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:10:59.931340 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 309/611] 10.222.0.21 () {58 vars in 1439 bytes} [Wed May 4 07:10:59 2022] PUT /identity/v3/projects/c9f9c44db4984653b8d4b5f6b3b949f5/users/bb341257aa8246b6847561e2fe1fa385/roles/14041215d0f7476a8e90241a49338706 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 07:10:59.931340 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bffe2dd-8a75-4972-8a09-bf5ff55882f7 None admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:11:00.096728 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12f4ec2-e4ff-4686-b627-35fe5e36e242 None admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:11:00.118313 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bffe2dd-8a75-4972-8a09-bf5ff55882f7 None admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:11:00.155769 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc21a28f-c57b-48f3-92b9-f258466b8911 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:11:00.156651 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc21a28f-c57b-48f3-92b9-f258466b8911 None admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:11:00.156932 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc21a28f-c57b-48f3-92b9-f258466b8911 None admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:11:00.157201 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc21a28f-c57b-48f3-92b9-f258466b8911 None admin] PATH_INFO: `/v3/domains` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:11:00.157918 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc21a28f-c57b-48f3-92b9-f258466b8911 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79744) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 07:11:00.158219 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc21a28f-c57b-48f3-92b9-f258466b8911 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:11:00.159667 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc21a28f-c57b-48f3-92b9-f258466b8911 None admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:11:00.169979 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f350f05-0a71-404f-abb6-31b0a46bb115 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:11:00.170881 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f350f05-0a71-404f-abb6-31b0a46bb115 None admin] REQUEST_METHOD: `PUT` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:11:00.171184 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f350f05-0a71-404f-abb6-31b0a46bb115 None admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:11:00.171459 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f350f05-0a71-404f-abb6-31b0a46bb115 None admin] PATH_INFO: `/v3/projects/c9f9c44db4984653b8d4b5f6b3b949f5/users/91cb92d00273402b837cb29b37325101/roles/14041215d0f7476a8e90241a49338706` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:11:00.175022 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 310/612] 10.222.0.21 () {56 vars in 1109 bytes} [Wed May 4 07:10:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 07:11:00.182558 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc21a28f-c57b-48f3-92b9-f258466b8911 None admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:11:00.197919 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f350f05-0a71-404f-abb6-31b0a46bb115 None admin] RBAC: Authorizing `identity:create_grant(project_id=c9f9c44db4984653b8d4b5f6b3b949f5, user_id=91cb92d00273402b837cb29b37325101, role_id=14041215d0f7476a8e90241a49338706)` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:11:00.200594 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f350f05-0a71-404f-abb6-31b0a46bb115 None admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:11:00.218846 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 303/613] 10.222.0.21 () {58 vars in 1439 bytes} [Wed May 4 07:10:59 2022] PUT /identity/v3/projects/c9f9c44db4984653b8d4b5f6b3b949f5/users/91cb92d00273402b837cb29b37325101/roles/14041215d0f7476a8e90241a49338706 => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 07:11:00.300775 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc21a28f-c57b-48f3-92b9-f258466b8911 None admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:11:00.338146 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946205f1-d512-4c69-a485-ab2f31589de5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:11:00.339319 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946205f1-d512-4c69-a485-ab2f31589de5 None admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:11:00.340276 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946205f1-d512-4c69-a485-ab2f31589de5 None admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:11:00.340711 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946205f1-d512-4c69-a485-ab2f31589de5 None admin] PATH_INFO: `/v3/users/swift` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:11:00.349806 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946205f1-d512-4c69-a485-ab2f31589de5 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:11:00.351511 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946205f1-d512-4c69-a485-ab2f31589de5 None admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:11:00.367495 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application [None req-946205f1-d512-4c69-a485-ab2f31589de5 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 04 07:11:00.367495 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 07:11:00.367495 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 07:11:00.367495 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 07:11:00.367495 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 07:11:00.367495 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 07:11:00.367495 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 07:11:00.367495 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 07:11:00.367495 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 07:11:00.367495 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 07:11:00.367495 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 07:11:00.367495 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 07:11:00.367495 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 04 07:11:00.367495 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self._get_user(user_id) May 04 07:11:00.367495 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 04 07:11:00.367495 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 04 07:11:00.368830 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 07:11:00.368830 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 07:11:00.368830 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 04 07:11:00.368830 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 07:11:00.368830 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 04 07:11:00.368830 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 07:11:00.368830 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 07:11:00.368830 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 07:11:00.368830 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 07:11:00.368830 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.get_or_create( May 04 07:11:00.368830 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 07:11:00.368830 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application with Lock( May 04 07:11:00.368830 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 07:11:00.368830 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self._enter() May 04 07:11:00.368830 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 07:11:00.368830 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 07:11:00.368830 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 07:11:00.368830 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.creator() May 04 07:11:00.370011 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 07:11:00.370011 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application created_value = creator( May 04 07:11:00.370011 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 04 07:11:00.370011 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 04 07:11:00.370011 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 04 07:11:00.370011 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 04 07:11:00.370011 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 04 07:11:00.370011 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 04 07:11:00.370011 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 04 07:11:00.370011 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application May 04 07:11:00.377083 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 311/614] 10.222.0.21 () {56 vars in 1096 bytes} [Wed May 4 07:11:00 2022] GET /identity/v3/users/swift => generated 83 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 07:11:00.378644 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f350f05-0a71-404f-abb6-31b0a46bb115 None admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:11:00.482260 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f350f05-0a71-404f-abb6-31b0a46bb115 None admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:11:00.517673 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4c1285-853b-4dfc-b8cf-4e727d607666 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:11:00.518347 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4c1285-853b-4dfc-b8cf-4e727d607666 None admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:11:00.518620 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4c1285-853b-4dfc-b8cf-4e727d607666 None admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:11:00.518887 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4c1285-853b-4dfc-b8cf-4e727d607666 None admin] PATH_INFO: `/v3/users` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:11:00.519749 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4c1285-853b-4dfc-b8cf-4e727d607666 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 07:11:00.520048 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4c1285-853b-4dfc-b8cf-4e727d607666 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:11:00.521471 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4c1285-853b-4dfc-b8cf-4e727d607666 None admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:11:00.543281 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 304/615] 10.222.0.21 () {56 vars in 1135 bytes} [Wed May 4 07:11:00 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 07:11:00.546795 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946205f1-d512-4c69-a485-ab2f31589de5 None admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:11:00.647732 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946205f1-d512-4c69-a485-ab2f31589de5 None admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:11:00.681547 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9c1584-8847-4326-929c-0ff0f0db6e2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:11:00.682332 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9c1584-8847-4326-929c-0ff0f0db6e2a None admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:11:00.682607 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9c1584-8847-4326-929c-0ff0f0db6e2a None admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:11:00.682874 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9c1584-8847-4326-929c-0ff0f0db6e2a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:11:00.693663 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9c1584-8847-4326-929c-0ff0f0db6e2a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:11:00.695097 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9c1584-8847-4326-929c-0ff0f0db6e2a None admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:11:00.712328 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application [None req-3e9c1584-8847-4326-929c-0ff0f0db6e2a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 07:11:00.712328 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 07:11:00.712328 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 07:11:00.712328 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 07:11:00.712328 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 07:11:00.712328 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 07:11:00.712328 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 07:11:00.712328 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 07:11:00.712328 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 07:11:00.712328 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 07:11:00.712328 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 07:11:00.712328 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 07:11:00.712328 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 07:11:00.712328 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 07:11:00.712328 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 07:11:00.714414 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 07:11:00.714414 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 07:11:00.714414 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 07:11:00.714414 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 07:11:00.714414 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 07:11:00.714414 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 07:11:00.714414 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.get_or_create( May 04 07:11:00.714414 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 07:11:00.714414 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application with Lock( May 04 07:11:00.714414 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 07:11:00.714414 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self._enter() May 04 07:11:00.714414 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 07:11:00.714414 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 07:11:00.714414 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 07:11:00.714414 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.creator() May 04 07:11:00.714414 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 07:11:00.714414 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application created_value = creator( May 04 07:11:00.716789 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 07:11:00.716789 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 07:11:00.716789 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 07:11:00.716789 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application May 04 07:11:00.719908 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 312/616] 10.222.0.21 () {56 vars in 1108 bytes} [Wed May 4 07:11:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 07:11:00.720110 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4c1285-853b-4dfc-b8cf-4e727d607666 None admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:11:00.827384 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4c1285-853b-4dfc-b8cf-4e727d607666 None admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:11:00.866146 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875db5fb-fdb3-42d0-9378-278f7d6f84ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:11:00.867178 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875db5fb-fdb3-42d0-9378-278f7d6f84ba None admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:11:00.867666 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875db5fb-fdb3-42d0-9378-278f7d6f84ba None admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:11:00.868165 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875db5fb-fdb3-42d0-9378-278f7d6f84ba None admin] PATH_INFO: `/v3/domains` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:11:00.869100 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875db5fb-fdb3-42d0-9378-278f7d6f84ba None admin] RBAC: Adding query filter params (name=Default) {{(pid=79745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 07:11:00.869609 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875db5fb-fdb3-42d0-9378-278f7d6f84ba None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:11:00.872003 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875db5fb-fdb3-42d0-9378-278f7d6f84ba None admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:11:00.888506 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 305/617] 10.222.0.21 () {56 vars in 1109 bytes} [Wed May 4 07:11:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 07:11:00.893743 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9c1584-8847-4326-929c-0ff0f0db6e2a None admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:11:00.994262 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9c1584-8847-4326-929c-0ff0f0db6e2a None admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:11:01.032970 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42a39c1-6e46-4899-a909-346b18dacf59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:11:01.033839 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42a39c1-6e46-4899-a909-346b18dacf59 None admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:11:01.034118 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42a39c1-6e46-4899-a909-346b18dacf59 None admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:11:01.034464 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42a39c1-6e46-4899-a909-346b18dacf59 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:11:01.042364 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42a39c1-6e46-4899-a909-346b18dacf59 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:11:01.043927 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42a39c1-6e46-4899-a909-346b18dacf59 None admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:11:01.059210 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application [None req-a42a39c1-6e46-4899-a909-346b18dacf59 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 04 07:11:01.059210 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 07:11:01.059210 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 07:11:01.059210 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 07:11:01.059210 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 07:11:01.059210 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 07:11:01.059210 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 07:11:01.059210 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 07:11:01.059210 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 07:11:01.059210 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 07:11:01.059210 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 07:11:01.059210 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 07:11:01.059210 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 04 07:11:01.059210 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self._get_project(project_id) May 04 07:11:01.059210 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 04 07:11:01.060200 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 04 07:11:01.060200 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 07:11:01.060200 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 07:11:01.060200 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 07:11:01.060200 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 07:11:01.060200 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 07:11:01.060200 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.get_or_create( May 04 07:11:01.060200 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 07:11:01.060200 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application with Lock( May 04 07:11:01.060200 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 07:11:01.060200 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self._enter() May 04 07:11:01.060200 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 07:11:01.060200 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 07:11:01.060200 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 07:11:01.060200 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.creator() May 04 07:11:01.060200 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 07:11:01.060200 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application created_value = creator( May 04 07:11:01.061093 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 04 07:11:01.061093 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 04 07:11:01.061093 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 04 07:11:01.061093 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 04 07:11:01.061093 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 04 07:11:01.061093 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 04 07:11:01.061093 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 04 07:11:01.061093 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application May 04 07:11:01.063480 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 313/618] 10.222.0.21 () {56 vars in 1111 bytes} [Wed May 4 07:11:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 07:11:01.066467 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875db5fb-fdb3-42d0-9378-278f7d6f84ba None admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:11:01.191641 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875db5fb-fdb3-42d0-9378-278f7d6f84ba None admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:11:01.239716 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ede686b-ed2f-47d6-88a7-404cf3c250c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:11:01.240373 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ede686b-ed2f-47d6-88a7-404cf3c250c8 None admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:11:01.240647 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ede686b-ed2f-47d6-88a7-404cf3c250c8 None admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:11:01.240916 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ede686b-ed2f-47d6-88a7-404cf3c250c8 None admin] PATH_INFO: `/v3/projects` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:11:01.241694 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ede686b-ed2f-47d6-88a7-404cf3c250c8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 07:11:01.241996 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ede686b-ed2f-47d6-88a7-404cf3c250c8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:11:01.243436 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ede686b-ed2f-47d6-88a7-404cf3c250c8 None admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:11:01.253513 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b721fd09-fcc4-4c1d-a0e2-134beae7d576 None None] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:11:01.253688 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b721fd09-fcc4-4c1d-a0e2-134beae7d576 None None] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:11:01.254413 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b721fd09-fcc4-4c1d-a0e2-134beae7d576 None None] PATH_INFO: `/` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:11:01.260158 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 314/619] 10.222.0.21 () {54 vars in 926 bytes} [Wed May 4 07:11:01 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 07:11:01.262819 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 306/620] 10.222.0.21 () {56 vars in 1148 bytes} [Wed May 4 07:11:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 07:11:01.267888 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5925cc50-851a-4b8f-99be-ca8847c13b02 None None] REQUEST_METHOD: `POST` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:11:01.267888 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5925cc50-851a-4b8f-99be-ca8847c13b02 None None] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:11:01.267888 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5925cc50-851a-4b8f-99be-ca8847c13b02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:11:01.268748 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ede686b-ed2f-47d6-88a7-404cf3c250c8 None admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:11:01.301433 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.auth.core [None req-5925cc50-851a-4b8f-99be-ca8847c13b02 None None] MFA Rules not processed for user `83c5e0dcb991496ea6dee38384514508`. Rule list: `[]` (Enabled: `True`). {{(pid=79744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:11:01.302976 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.fernet_utils [None req-5925cc50-851a-4b8f-99be-ca8847c13b02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:11:01.368331 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ede686b-ed2f-47d6-88a7-404cf3c250c8 None admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:11:01.410872 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9d3c4d-7fe5-4168-a9ed-6942026c3cb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:11:01.411792 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9d3c4d-7fe5-4168-a9ed-6942026c3cb3 None admin] REQUEST_METHOD: `PUT` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:11:01.412067 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9d3c4d-7fe5-4168-a9ed-6942026c3cb3 None admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:11:01.412336 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9d3c4d-7fe5-4168-a9ed-6942026c3cb3 None admin] PATH_INFO: `/v3/projects/c9f9c44db4984653b8d4b5f6b3b949f5/users/084c9245d1da4e698c9c3945fa089e85/roles/14041215d0f7476a8e90241a49338706` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:11:01.440073 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9d3c4d-7fe5-4168-a9ed-6942026c3cb3 None admin] RBAC: Authorizing `identity:create_grant(project_id=c9f9c44db4984653b8d4b5f6b3b949f5, user_id=084c9245d1da4e698c9c3945fa089e85, role_id=14041215d0f7476a8e90241a49338706)` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:11:01.441516 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9d3c4d-7fe5-4168-a9ed-6942026c3cb3 None admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:11:01.444823 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 315/621] 10.222.0.21 () {58 vars in 1023 bytes} [Wed May 4 07:11:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 07:11:01.470919 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 307/622] 10.222.0.21 () {58 vars in 1439 bytes} [Wed May 4 07:11:01 2022] PUT /identity/v3/projects/c9f9c44db4984653b8d4b5f6b3b949f5/users/084c9245d1da4e698c9c3945fa089e85/roles/14041215d0f7476a8e90241a49338706 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 07:11:01.479619 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fb8f85-76c9-430d-93ae-07f90f632b87 None None] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:11:01.480556 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fb8f85-76c9-430d-93ae-07f90f632b87 None None] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:11:01.480867 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fb8f85-76c9-430d-93ae-07f90f632b87 None None] PATH_INFO: `/` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:11:01.482541 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 316/623] 10.222.0.21 () {54 vars in 926 bytes} [Wed May 4 07:11:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 07:11:01.487281 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9d3c4d-7fe5-4168-a9ed-6942026c3cb3 None admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:11:01.487862 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf4072a-9d96-454e-a5ae-355a74a204a5 None None] REQUEST_METHOD: `POST` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:11:01.488145 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf4072a-9d96-454e-a5ae-355a74a204a5 None None] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:11:01.488419 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf4072a-9d96-454e-a5ae-355a74a204a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:11:01.529056 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.auth.core [None req-9bf4072a-9d96-454e-a5ae-355a74a204a5 None None] MFA Rules not processed for user `83c5e0dcb991496ea6dee38384514508`. Rule list: `[]` (Enabled: `True`). {{(pid=79744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:11:01.530275 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.fernet_utils [None req-9bf4072a-9d96-454e-a5ae-355a74a204a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:11:01.643955 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 317/624] 10.222.0.21 () {58 vars in 1023 bytes} [Wed May 4 07:11:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 07:11:01.662712 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9d3c4d-7fe5-4168-a9ed-6942026c3cb3 None admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:11:01.679409 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf4072a-9d96-454e-a5ae-355a74a204a5 None None] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:11:01.736409 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132ecf24-36b0-4f97-89bb-bda6da02deff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:11:01.737209 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132ecf24-36b0-4f97-89bb-bda6da02deff None admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:11:01.737483 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132ecf24-36b0-4f97-89bb-bda6da02deff None admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:11:01.737753 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132ecf24-36b0-4f97-89bb-bda6da02deff None admin] PATH_INFO: `/v3/roles/service` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:11:01.750789 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132ecf24-36b0-4f97-89bb-bda6da02deff None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 07:11:01.758685 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application [None req-132ecf24-36b0-4f97-89bb-bda6da02deff None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 04 07:11:01.758685 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 07:11:01.758685 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 07:11:01.758685 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 07:11:01.758685 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 07:11:01.758685 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 07:11:01.758685 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 07:11:01.758685 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 07:11:01.758685 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 07:11:01.758685 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 07:11:01.758685 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 07:11:01.758685 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 07:11:01.758685 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 07:11:01.758685 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 07:11:01.758685 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 07:11:01.758685 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 07:11:01.759684 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 07:11:01.759684 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 07:11:01.759684 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 07:11:01.759684 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 07:11:01.759684 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 07:11:01.759684 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 07:11:01.759684 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 07:11:01.759684 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 07:11:01.759684 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 07:11:01.759684 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self.get_or_create( May 04 07:11:01.759684 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 07:11:01.759684 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application with Lock( May 04 07:11:01.759684 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 07:11:01.759684 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self._enter() May 04 07:11:01.759684 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 07:11:01.759684 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 07:11:01.760661 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 07:11:01.760661 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self.creator() May 04 07:11:01.760661 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 07:11:01.760661 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application created_value = creator( May 04 07:11:01.760661 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 07:11:01.760661 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 07:11:01.760661 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 07:11:01.760661 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 07:11:01.760661 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 07:11:01.760661 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 07:11:01.760661 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 04 07:11:01.760661 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application May 04 07:11:01.760661 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 308/625] 10.222.0.21 () {56 vars in 1102 bytes} [Wed May 4 07:11:01 2022] GET /identity/v3/roles/service => generated 85 bytes in 273 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 07:11:01.768184 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132ecf24-36b0-4f97-89bb-bda6da02deff None admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:11:01.785203 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf4072a-9d96-454e-a5ae-355a74a204a5 None None] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:11:01.821382 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99b8754-2a43-4cd2-b76e-216f442892cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:11:01.822265 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99b8754-2a43-4cd2-b76e-216f442892cf None admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:11:01.822609 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99b8754-2a43-4cd2-b76e-216f442892cf None admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:11:01.822953 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99b8754-2a43-4cd2-b76e-216f442892cf None admin] PATH_INFO: `/v3/roles/service` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:11:01.834198 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99b8754-2a43-4cd2-b76e-216f442892cf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 07:11:01.842854 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application [None req-f99b8754-2a43-4cd2-b76e-216f442892cf None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 04 07:11:01.842854 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 07:11:01.842854 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 07:11:01.842854 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 07:11:01.842854 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 07:11:01.842854 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 07:11:01.842854 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 07:11:01.842854 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 07:11:01.842854 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 07:11:01.842854 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 07:11:01.842854 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 07:11:01.842854 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 07:11:01.842854 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 07:11:01.842854 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 07:11:01.842854 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 07:11:01.842854 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 07:11:01.843987 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 07:11:01.843987 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 07:11:01.843987 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 07:11:01.843987 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 07:11:01.843987 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 07:11:01.843987 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 07:11:01.843987 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 07:11:01.843987 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 07:11:01.843987 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 07:11:01.843987 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.get_or_create( May 04 07:11:01.843987 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 07:11:01.843987 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application with Lock( May 04 07:11:01.843987 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 07:11:01.843987 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self._enter() May 04 07:11:01.843987 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 07:11:01.843987 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 07:11:01.845022 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 07:11:01.845022 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.creator() May 04 07:11:01.845022 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 07:11:01.845022 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application created_value = creator( May 04 07:11:01.845022 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 07:11:01.845022 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 07:11:01.845022 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 07:11:01.845022 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 07:11:01.845022 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 07:11:01.845022 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 07:11:01.845022 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 04 07:11:01.845022 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application May 04 07:11:01.850947 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 318/626] 10.222.0.21 () {56 vars in 1102 bytes} [Wed May 4 07:11:01 2022] GET /identity/v3/roles/service => generated 85 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 07:11:01.852305 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99b8754-2a43-4cd2-b76e-216f442892cf None admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:11:01.930670 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132ecf24-36b0-4f97-89bb-bda6da02deff None admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:11:01.969537 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99b8754-2a43-4cd2-b76e-216f442892cf None admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:11:02.006865 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264cc9eb-dbd1-41a5-9187-ffed15519057 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:11:02.008306 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264cc9eb-dbd1-41a5-9187-ffed15519057 None admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:11:02.008763 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264cc9eb-dbd1-41a5-9187-ffed15519057 None admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:11:02.009221 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264cc9eb-dbd1-41a5-9187-ffed15519057 None admin] PATH_INFO: `/v3/roles` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:11:02.010171 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264cc9eb-dbd1-41a5-9187-ffed15519057 None admin] RBAC: Adding query filter params (name=service) {{(pid=79744) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 07:11:02.010702 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264cc9eb-dbd1-41a5-9187-ffed15519057 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:11:02.012435 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264cc9eb-dbd1-41a5-9187-ffed15519057 None admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:11:02.013730 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fc7cb1-f991-4c94-ae6d-317b63d66fb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:11:02.014474 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fc7cb1-f991-4c94-ae6d-317b63d66fb9 None admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:11:02.014827 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fc7cb1-f991-4c94-ae6d-317b63d66fb9 None admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:11:02.015575 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fc7cb1-f991-4c94-ae6d-317b63d66fb9 None admin] PATH_INFO: `/v3/roles` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:11:02.016317 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77fc7cb1-f991-4c94-ae6d-317b63d66fb9 None admin] RBAC: Adding query filter params (name=service) {{(pid=79745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 07:11:02.016624 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77fc7cb1-f991-4c94-ae6d-317b63d66fb9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:11:02.017997 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77fc7cb1-f991-4c94-ae6d-317b63d66fb9 None admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:11:02.022726 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 319/627] 10.222.0.21 () {56 vars in 1103 bytes} [Wed May 4 07:11:01 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 07:11:02.028197 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264cc9eb-dbd1-41a5-9187-ffed15519057 None admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:11:02.040336 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 309/628] 10.222.0.21 () {56 vars in 1103 bytes} [Wed May 4 07:11:01 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 07:11:02.048613 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fc7cb1-f991-4c94-ae6d-317b63d66fb9 None admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:11:02.157198 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fc7cb1-f991-4c94-ae6d-317b63d66fb9 None admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:11:02.194730 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2a6032-25fa-4a2d-b269-98ef123a8baa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:11:02.195980 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2a6032-25fa-4a2d-b269-98ef123a8baa None admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:11:02.196461 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2a6032-25fa-4a2d-b269-98ef123a8baa None admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:11:02.196945 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2a6032-25fa-4a2d-b269-98ef123a8baa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:11:02.211777 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2a6032-25fa-4a2d-b269-98ef123a8baa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:11:02.213744 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2a6032-25fa-4a2d-b269-98ef123a8baa None admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:11:02.235921 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application [None req-db2a6032-25fa-4a2d-b269-98ef123a8baa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 07:11:02.235921 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 07:11:02.235921 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 07:11:02.235921 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 07:11:02.235921 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 07:11:02.235921 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 07:11:02.235921 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 07:11:02.235921 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 07:11:02.235921 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 07:11:02.235921 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 07:11:02.235921 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 07:11:02.235921 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 07:11:02.235921 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 07:11:02.235921 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 07:11:02.235921 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 07:11:02.236977 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 07:11:02.236977 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 07:11:02.236977 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 07:11:02.236977 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 07:11:02.236977 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 07:11:02.236977 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 07:11:02.236977 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self.get_or_create( May 04 07:11:02.236977 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 07:11:02.236977 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application with Lock( May 04 07:11:02.236977 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 07:11:02.236977 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self._enter() May 04 07:11:02.236977 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 07:11:02.236977 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 07:11:02.236977 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 07:11:02.236977 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self.creator() May 04 07:11:02.236977 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 07:11:02.236977 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application created_value = creator( May 04 07:11:02.237887 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 07:11:02.237887 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 07:11:02.237887 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 07:11:02.237887 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application May 04 07:11:02.240142 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 310/629] 10.222.0.21 () {56 vars in 1108 bytes} [Wed May 4 07:11:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 07:11:02.249627 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2a6032-25fa-4a2d-b269-98ef123a8baa None admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:11:02.284726 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264cc9eb-dbd1-41a5-9187-ffed15519057 None admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:11:02.322523 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21079a5f-e3d4-48d3-b376-acf1cfffb0f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:11:02.324380 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21079a5f-e3d4-48d3-b376-acf1cfffb0f0 None admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:11:02.324947 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21079a5f-e3d4-48d3-b376-acf1cfffb0f0 None admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:11:02.325433 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21079a5f-e3d4-48d3-b376-acf1cfffb0f0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:11:02.338936 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21079a5f-e3d4-48d3-b376-acf1cfffb0f0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:11:02.341855 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21079a5f-e3d4-48d3-b376-acf1cfffb0f0 None admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:11:02.361349 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application [None req-21079a5f-e3d4-48d3-b376-acf1cfffb0f0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 07:11:02.361349 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 07:11:02.361349 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 07:11:02.361349 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 07:11:02.361349 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 07:11:02.361349 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 07:11:02.361349 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 07:11:02.361349 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 07:11:02.361349 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 07:11:02.361349 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 07:11:02.361349 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 07:11:02.361349 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 07:11:02.361349 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 07:11:02.361349 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 07:11:02.361349 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 07:11:02.362346 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 07:11:02.362346 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 07:11:02.362346 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 07:11:02.362346 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 07:11:02.362346 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 07:11:02.362346 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 07:11:02.362346 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.get_or_create( May 04 07:11:02.362346 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 07:11:02.362346 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application with Lock( May 04 07:11:02.362346 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 07:11:02.362346 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self._enter() May 04 07:11:02.362346 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 07:11:02.362346 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 07:11:02.362346 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 07:11:02.362346 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.creator() May 04 07:11:02.362346 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 07:11:02.362346 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application created_value = creator( May 04 07:11:02.363431 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 07:11:02.363431 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 07:11:02.363431 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 07:11:02.363431 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application May 04 07:11:02.365771 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 320/630] 10.222.0.21 () {56 vars in 1108 bytes} [Wed May 4 07:11:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 338 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 07:11:02.371485 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21079a5f-e3d4-48d3-b376-acf1cfffb0f0 None admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:11:02.433931 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2a6032-25fa-4a2d-b269-98ef123a8baa None admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:11:02.468724 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645086e4-429d-4138-be36-df23c5ba30a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:11:02.469768 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645086e4-429d-4138-be36-df23c5ba30a1 None admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:11:02.470243 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645086e4-429d-4138-be36-df23c5ba30a1 None admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:11:02.470763 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645086e4-429d-4138-be36-df23c5ba30a1 None admin] PATH_INFO: `/v3/domains` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:11:02.471726 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645086e4-429d-4138-be36-df23c5ba30a1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 07:11:02.472230 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645086e4-429d-4138-be36-df23c5ba30a1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:11:02.473877 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645086e4-429d-4138-be36-df23c5ba30a1 None admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:11:02.487031 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 311/631] 10.222.0.21 () {56 vars in 1109 bytes} [Wed May 4 07:11:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 07:11:02.492572 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645086e4-429d-4138-be36-df23c5ba30a1 None admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:11:02.497569 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21079a5f-e3d4-48d3-b376-acf1cfffb0f0 None admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:11:02.533347 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae31da56-c889-4831-92c9-725415c1fb25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:11:02.533696 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae31da56-c889-4831-92c9-725415c1fb25 None admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:11:02.533941 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae31da56-c889-4831-92c9-725415c1fb25 None admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:11:02.534213 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae31da56-c889-4831-92c9-725415c1fb25 None admin] PATH_INFO: `/v3/domains` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:11:02.534935 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae31da56-c889-4831-92c9-725415c1fb25 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79744) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 07:11:02.535287 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae31da56-c889-4831-92c9-725415c1fb25 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:11:02.536651 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae31da56-c889-4831-92c9-725415c1fb25 None admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:11:02.549268 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 321/632] 10.222.0.21 () {56 vars in 1109 bytes} [Wed May 4 07:11:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 07:11:02.554418 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae31da56-c889-4831-92c9-725415c1fb25 None admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:11:02.668844 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae31da56-c889-4831-92c9-725415c1fb25 None admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:11:02.708256 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6bb924-8b62-4202-8f3e-b9423bd5c200 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:11:02.709498 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6bb924-8b62-4202-8f3e-b9423bd5c200 None admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:11:02.709885 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6bb924-8b62-4202-8f3e-b9423bd5c200 None admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:11:02.710279 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6bb924-8b62-4202-8f3e-b9423bd5c200 None admin] PATH_INFO: `/v3/users/nova` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:11:02.718649 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6bb924-8b62-4202-8f3e-b9423bd5c200 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:11:02.720850 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6bb924-8b62-4202-8f3e-b9423bd5c200 None admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:11:02.722563 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645086e4-429d-4138-be36-df23c5ba30a1 None admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:11:02.743190 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application [None req-6e6bb924-8b62-4202-8f3e-b9423bd5c200 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 04 07:11:02.743190 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 07:11:02.743190 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 07:11:02.743190 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 07:11:02.743190 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 07:11:02.743190 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 07:11:02.743190 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 07:11:02.743190 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 07:11:02.743190 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 07:11:02.743190 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 07:11:02.743190 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 07:11:02.743190 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 07:11:02.743190 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 04 07:11:02.743190 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self._get_user(user_id) May 04 07:11:02.743190 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 04 07:11:02.743190 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 04 07:11:02.744391 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 07:11:02.744391 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 07:11:02.744391 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 04 07:11:02.744391 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 07:11:02.744391 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 04 07:11:02.744391 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 07:11:02.744391 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 07:11:02.744391 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 07:11:02.744391 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 07:11:02.744391 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.get_or_create( May 04 07:11:02.744391 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 07:11:02.744391 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application with Lock( May 04 07:11:02.744391 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 07:11:02.744391 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self._enter() May 04 07:11:02.744391 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 07:11:02.744391 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 07:11:02.744391 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 07:11:02.744391 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.creator() May 04 07:11:02.745693 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 07:11:02.745693 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application created_value = creator( May 04 07:11:02.745693 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 04 07:11:02.745693 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 04 07:11:02.745693 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 04 07:11:02.745693 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 04 07:11:02.745693 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 04 07:11:02.745693 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 04 07:11:02.745693 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 04 07:11:02.745693 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application May 04 07:11:02.745693 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 322/633] 10.222.0.21 () {56 vars in 1093 bytes} [Wed May 4 07:11:02 2022] GET /identity/v3/users/nova => generated 82 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 07:11:02.747332 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6bb924-8b62-4202-8f3e-b9423bd5c200 None admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:11:02.810333 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc2c952-db6e-4f27-8cbc-ce451c34b207 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:11:02.811561 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc2c952-db6e-4f27-8cbc-ce451c34b207 None admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:11:02.811940 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc2c952-db6e-4f27-8cbc-ce451c34b207 None admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:11:02.812329 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc2c952-db6e-4f27-8cbc-ce451c34b207 None admin] PATH_INFO: `/v3/users/glance` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:11:02.820831 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc2c952-db6e-4f27-8cbc-ce451c34b207 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:11:02.822744 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc2c952-db6e-4f27-8cbc-ce451c34b207 None admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:11:02.842492 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application [None req-3cc2c952-db6e-4f27-8cbc-ce451c34b207 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 04 07:11:02.842492 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 07:11:02.842492 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 07:11:02.842492 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 07:11:02.842492 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 07:11:02.842492 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 07:11:02.842492 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 07:11:02.842492 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 07:11:02.842492 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 07:11:02.842492 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 07:11:02.842492 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 07:11:02.842492 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 07:11:02.842492 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 04 07:11:02.842492 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self._get_user(user_id) May 04 07:11:02.842492 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 04 07:11:02.842492 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 04 07:11:02.843728 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 07:11:02.843728 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 07:11:02.843728 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 04 07:11:02.843728 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 07:11:02.843728 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 04 07:11:02.843728 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 07:11:02.843728 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 07:11:02.843728 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 07:11:02.843728 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 07:11:02.843728 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self.get_or_create( May 04 07:11:02.843728 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 07:11:02.843728 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application with Lock( May 04 07:11:02.843728 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 07:11:02.843728 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self._enter() May 04 07:11:02.843728 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 07:11:02.843728 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 07:11:02.843728 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 07:11:02.843728 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self.creator() May 04 07:11:02.844894 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 07:11:02.844894 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application created_value = creator( May 04 07:11:02.844894 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 04 07:11:02.844894 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 04 07:11:02.844894 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 04 07:11:02.844894 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 04 07:11:02.844894 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 04 07:11:02.844894 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 04 07:11:02.844894 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 04 07:11:02.844894 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application May 04 07:11:02.847201 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 312/634] 10.222.0.21 () {56 vars in 1099 bytes} [Wed May 4 07:11:02 2022] GET /identity/v3/users/glance => generated 84 bytes in 354 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 07:11:02.852251 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc2c952-db6e-4f27-8cbc-ce451c34b207 None admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:11:02.962303 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc2c952-db6e-4f27-8cbc-ce451c34b207 None admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:11:02.967203 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6bb924-8b62-4202-8f3e-b9423bd5c200 None admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:11:03.005903 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f866c6b-2870-4e21-9dc3-6248946bcff6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:11:03.006572 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f866c6b-2870-4e21-9dc3-6248946bcff6 None admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:11:03.006844 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f866c6b-2870-4e21-9dc3-6248946bcff6 None admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:11:03.007404 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f866c6b-2870-4e21-9dc3-6248946bcff6 None admin] PATH_INFO: `/v3/users` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:11:03.008349 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f866c6b-2870-4e21-9dc3-6248946bcff6 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79744) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 07:11:03.008652 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f866c6b-2870-4e21-9dc3-6248946bcff6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:11:03.009704 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76dd52c8-b95b-47da-97e3-90d7f59ca020 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:11:03.010058 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f866c6b-2870-4e21-9dc3-6248946bcff6 None admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:11:03.010862 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76dd52c8-b95b-47da-97e3-90d7f59ca020 None admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:11:03.011976 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76dd52c8-b95b-47da-97e3-90d7f59ca020 None admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:11:03.012600 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76dd52c8-b95b-47da-97e3-90d7f59ca020 None admin] PATH_INFO: `/v3/users` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:11:03.014435 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76dd52c8-b95b-47da-97e3-90d7f59ca020 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=79745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 07:11:03.014950 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76dd52c8-b95b-47da-97e3-90d7f59ca020 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:11:03.016588 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76dd52c8-b95b-47da-97e3-90d7f59ca020 None admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:11:03.030946 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 323/635] 10.222.0.21 () {56 vars in 1133 bytes} [Wed May 4 07:11:02 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 07:11:03.035469 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7f72f7-c0c0-4e34-a6d2-cbaa3a55de0b None None] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:11:03.035469 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7f72f7-c0c0-4e34-a6d2-cbaa3a55de0b None None] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:11:03.035469 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7f72f7-c0c0-4e34-a6d2-cbaa3a55de0b None None] PATH_INFO: `/` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:11:03.035469 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 324/636] 10.222.0.21 () {54 vars in 926 bytes} [Wed May 4 07:11:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 07:11:03.035469 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c67126-20fb-4313-8564-a94851ed7bef None None] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:11:03.035843 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c67126-20fb-4313-8564-a94851ed7bef None None] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:11:03.036342 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c67126-20fb-4313-8564-a94851ed7bef None None] PATH_INFO: `/` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:11:03.037319 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 325/637] 10.222.0.21 () {54 vars in 926 bytes} [Wed May 4 07:11:03 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 07:11:03.038016 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c67126-20fb-4313-8564-a94851ed7bef None None] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:11:03.042492 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 313/638] 10.222.0.21 () {56 vars in 1137 bytes} [Wed May 4 07:11:02 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 07:11:03.044179 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9499b5e-e57a-4b09-8af1-0022507d9fea None None] REQUEST_METHOD: `POST` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:11:03.044458 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9499b5e-e57a-4b09-8af1-0022507d9fea None None] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:11:03.044732 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9499b5e-e57a-4b09-8af1-0022507d9fea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:11:03.060281 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.auth.core [None req-c9499b5e-e57a-4b09-8af1-0022507d9fea None None] MFA Rules not processed for user `83c5e0dcb991496ea6dee38384514508`. Rule list: `[]` (Enabled: `True`). {{(pid=79745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:11:03.061451 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.fernet_utils [None req-c9499b5e-e57a-4b09-8af1-0022507d9fea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:11:03.124725 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 314/639] 10.222.0.21 () {58 vars in 1023 bytes} [Wed May 4 07:11:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 07:11:03.126246 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1045309-4f19-4f2a-a63d-8fe01f4edbb0 None None] REQUEST_METHOD: `POST` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:11:03.126736 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1045309-4f19-4f2a-a63d-8fe01f4edbb0 None None] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:11:03.127364 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1045309-4f19-4f2a-a63d-8fe01f4edbb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:11:03.143359 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.auth.core [None req-a1045309-4f19-4f2a-a63d-8fe01f4edbb0 None None] MFA Rules not processed for user `83c5e0dcb991496ea6dee38384514508`. Rule list: `[]` (Enabled: `True`). {{(pid=79745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:11:03.144833 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.fernet_utils [None req-a1045309-4f19-4f2a-a63d-8fe01f4edbb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:11:03.153874 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c67126-20fb-4313-8564-a94851ed7bef None None] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:11:03.189910 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3838c85b-6dfe-4069-b3db-cada469eabfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:11:03.190922 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3838c85b-6dfe-4069-b3db-cada469eabfe None admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:11:03.191237 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3838c85b-6dfe-4069-b3db-cada469eabfe None admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:11:03.191872 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3838c85b-6dfe-4069-b3db-cada469eabfe None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:11:03.209673 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 315/640] 10.222.0.21 () {58 vars in 1023 bytes} [Wed May 4 07:11:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 07:11:03.210766 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1045309-4f19-4f2a-a63d-8fe01f4edbb0 None None] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:11:03.259545 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3838c85b-6dfe-4069-b3db-cada469eabfe None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:11:03.260991 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3838c85b-6dfe-4069-b3db-cada469eabfe None admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:11:03.316779 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1045309-4f19-4f2a-a63d-8fe01f4edbb0 None None] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:11:03.349726 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f771b5-90f8-4b4b-8cb2-5af98a137f13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:11:03.350376 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f771b5-90f8-4b4b-8cb2-5af98a137f13 None admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:11:03.350654 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f771b5-90f8-4b4b-8cb2-5af98a137f13 None admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:11:03.350930 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f771b5-90f8-4b4b-8cb2-5af98a137f13 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:11:03.357525 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 326/641] 10.222.0.21 () {58 vars in 1282 bytes} [Wed May 4 07:11:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 04 07:11:03.358563 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3838c85b-6dfe-4069-b3db-cada469eabfe None admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:11:03.420096 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f771b5-90f8-4b4b-8cb2-5af98a137f13 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:11:03.421544 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f771b5-90f8-4b4b-8cb2-5af98a137f13 None admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:11:03.453536 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3838c85b-6dfe-4069-b3db-cada469eabfe None admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:11:03.488119 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8acbe8c2-dda8-4f81-92c3-760f3ea55a2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:11:03.488908 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acbe8c2-dda8-4f81-92c3-760f3ea55a2b None admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:11:03.489189 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acbe8c2-dda8-4f81-92c3-760f3ea55a2b None admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:11:03.489948 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acbe8c2-dda8-4f81-92c3-760f3ea55a2b None admin] PATH_INFO: `/v3/roles/service` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:11:03.499205 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8acbe8c2-dda8-4f81-92c3-760f3ea55a2b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 07:11:03.506764 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application [None req-8acbe8c2-dda8-4f81-92c3-760f3ea55a2b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 04 07:11:03.506764 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 07:11:03.506764 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 07:11:03.506764 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 07:11:03.506764 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 07:11:03.506764 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 07:11:03.506764 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 07:11:03.506764 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 07:11:03.506764 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 07:11:03.506764 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 07:11:03.506764 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 07:11:03.506764 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 07:11:03.506764 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 07:11:03.506764 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 07:11:03.506764 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 07:11:03.506764 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 07:11:03.507999 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 07:11:03.507999 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 07:11:03.507999 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 07:11:03.507999 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 07:11:03.507999 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 07:11:03.507999 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 07:11:03.507999 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 07:11:03.507999 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 07:11:03.507999 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 07:11:03.507999 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.get_or_create( May 04 07:11:03.507999 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 07:11:03.507999 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application with Lock( May 04 07:11:03.507999 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 07:11:03.507999 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self._enter() May 04 07:11:03.507999 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 07:11:03.507999 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 07:11:03.508875 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 07:11:03.508875 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.creator() May 04 07:11:03.508875 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 07:11:03.508875 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application created_value = creator( May 04 07:11:03.508875 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 07:11:03.508875 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 07:11:03.508875 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 07:11:03.508875 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 07:11:03.508875 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 07:11:03.508875 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 07:11:03.508875 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 04 07:11:03.508875 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application May 04 07:11:03.513731 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 327/642] 10.222.0.21 () {56 vars in 1102 bytes} [Wed May 4 07:11:03 2022] GET /identity/v3/roles/service => generated 85 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 07:11:03.514410 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8acbe8c2-dda8-4f81-92c3-760f3ea55a2b None admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:11:03.524409 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 316/643] 10.222.0.21 () {58 vars in 1282 bytes} [Wed May 4 07:11:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 04 07:11:03.524409 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f771b5-90f8-4b4b-8cb2-5af98a137f13 None admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:11:03.614089 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8acbe8c2-dda8-4f81-92c3-760f3ea55a2b None admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:11:03.616252 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f771b5-90f8-4b4b-8cb2-5af98a137f13 None admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:11:03.646520 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b376dd-db83-40cb-ad63-196570da2ff3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:11:03.647335 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b376dd-db83-40cb-ad63-196570da2ff3 None admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:11:03.647618 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b376dd-db83-40cb-ad63-196570da2ff3 None admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:11:03.647886 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b376dd-db83-40cb-ad63-196570da2ff3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:11:03.648880 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fa9b79-d315-4b06-a94c-9551246f0724 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:11:03.649665 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fa9b79-d315-4b06-a94c-9551246f0724 None admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:11:03.649939 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fa9b79-d315-4b06-a94c-9551246f0724 None admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:11:03.650208 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fa9b79-d315-4b06-a94c-9551246f0724 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:11:03.657952 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b376dd-db83-40cb-ad63-196570da2ff3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 07:11:03.660193 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6fa9b79-d315-4b06-a94c-9551246f0724 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:11:03.661634 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6fa9b79-d315-4b06-a94c-9551246f0724 None admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:11:03.665557 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application [None req-77b376dd-db83-40cb-ad63-196570da2ff3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 04 07:11:03.665557 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 07:11:03.665557 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 07:11:03.665557 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 07:11:03.665557 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 07:11:03.665557 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 07:11:03.665557 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 07:11:03.665557 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 07:11:03.665557 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 07:11:03.665557 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 07:11:03.665557 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 07:11:03.665557 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 07:11:03.665557 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 07:11:03.665557 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 07:11:03.665557 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 07:11:03.665557 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 07:11:03.666638 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 07:11:03.666638 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 07:11:03.666638 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 07:11:03.666638 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 07:11:03.666638 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 07:11:03.666638 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 07:11:03.666638 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 07:11:03.666638 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 07:11:03.666638 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 07:11:03.666638 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.get_or_create( May 04 07:11:03.666638 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 07:11:03.666638 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application with Lock( May 04 07:11:03.666638 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 07:11:03.666638 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self._enter() May 04 07:11:03.666638 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 07:11:03.666638 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 07:11:03.668166 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 07:11:03.668166 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.creator() May 04 07:11:03.668166 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 07:11:03.668166 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application created_value = creator( May 04 07:11:03.668166 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 07:11:03.668166 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 07:11:03.668166 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 07:11:03.668166 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 07:11:03.668166 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 07:11:03.668166 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 07:11:03.668166 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 04 07:11:03.668166 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application May 04 07:11:03.668166 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 328/644] 10.222.0.21 () {56 vars in 1102 bytes} [Wed May 4 07:11:03 2022] GET /identity/v3/roles/service => generated 85 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 07:11:03.668887 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b376dd-db83-40cb-ad63-196570da2ff3 None admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:11:03.687211 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application [None req-d6fa9b79-d315-4b06-a94c-9551246f0724 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 07:11:03.687211 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 07:11:03.687211 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 07:11:03.687211 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 07:11:03.687211 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 07:11:03.687211 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 07:11:03.687211 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 07:11:03.687211 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 07:11:03.687211 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 07:11:03.687211 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 07:11:03.687211 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 07:11:03.687211 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 07:11:03.687211 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 07:11:03.687211 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 07:11:03.687211 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 07:11:03.688172 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 07:11:03.688172 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 07:11:03.688172 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 07:11:03.688172 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 07:11:03.688172 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 07:11:03.688172 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 07:11:03.688172 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self.get_or_create( May 04 07:11:03.688172 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 07:11:03.688172 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application with Lock( May 04 07:11:03.688172 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 07:11:03.688172 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self._enter() May 04 07:11:03.688172 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 07:11:03.688172 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 07:11:03.688172 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 07:11:03.688172 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self.creator() May 04 07:11:03.688172 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 07:11:03.688172 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application created_value = creator( May 04 07:11:03.689182 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 07:11:03.689182 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 07:11:03.689182 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 07:11:03.689182 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application May 04 07:11:03.689417 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 317/645] 10.222.0.21 () {56 vars in 1108 bytes} [Wed May 4 07:11:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 07:11:03.690204 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fa9b79-d315-4b06-a94c-9551246f0724 None admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:11:03.774745 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b376dd-db83-40cb-ad63-196570da2ff3 None admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:11:03.788518 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fa9b79-d315-4b06-a94c-9551246f0724 None admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:11:03.812779 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ecfce1-cab4-4fb1-af5e-4048caaa8f87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:11:03.813446 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ecfce1-cab4-4fb1-af5e-4048caaa8f87 None admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:11:03.813728 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ecfce1-cab4-4fb1-af5e-4048caaa8f87 None admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:11:03.813999 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ecfce1-cab4-4fb1-af5e-4048caaa8f87 None admin] PATH_INFO: `/v3/roles` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:11:03.814738 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ecfce1-cab4-4fb1-af5e-4048caaa8f87 None admin] RBAC: Adding query filter params (name=service) {{(pid=79744) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 07:11:03.815052 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ecfce1-cab4-4fb1-af5e-4048caaa8f87 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:11:03.816455 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ecfce1-cab4-4fb1-af5e-4048caaa8f87 None admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:11:03.821615 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5c6147-aa18-4e15-9076-7d4db76a6526 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:11:03.822404 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5c6147-aa18-4e15-9076-7d4db76a6526 None admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:11:03.822683 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5c6147-aa18-4e15-9076-7d4db76a6526 None admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:11:03.822956 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5c6147-aa18-4e15-9076-7d4db76a6526 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:11:03.830159 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 329/646] 10.222.0.21 () {56 vars in 1103 bytes} [Wed May 4 07:11:03 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 07:11:03.830159 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ecfce1-cab4-4fb1-af5e-4048caaa8f87 None admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:11:03.838599 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5c6147-aa18-4e15-9076-7d4db76a6526 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:11:03.840737 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5c6147-aa18-4e15-9076-7d4db76a6526 None admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:11:03.857533 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application [None req-1e5c6147-aa18-4e15-9076-7d4db76a6526 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 07:11:03.857533 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 07:11:03.857533 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 07:11:03.857533 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 07:11:03.857533 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 07:11:03.857533 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 07:11:03.857533 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 07:11:03.857533 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 07:11:03.857533 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 07:11:03.857533 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 07:11:03.857533 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 07:11:03.857533 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 07:11:03.857533 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 07:11:03.857533 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 07:11:03.857533 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 07:11:03.858466 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 07:11:03.858466 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 07:11:03.858466 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 07:11:03.858466 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 07:11:03.858466 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 07:11:03.858466 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 07:11:03.858466 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self.get_or_create( May 04 07:11:03.858466 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 07:11:03.858466 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application with Lock( May 04 07:11:03.858466 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 07:11:03.858466 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self._enter() May 04 07:11:03.858466 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 07:11:03.858466 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 07:11:03.858466 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 07:11:03.858466 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self.creator() May 04 07:11:03.858466 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 07:11:03.858466 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application created_value = creator( May 04 07:11:03.859432 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 07:11:03.859432 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 07:11:03.859432 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 07:11:03.859432 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application May 04 07:11:03.859432 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 318/647] 10.222.0.21 () {56 vars in 1108 bytes} [Wed May 4 07:11:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 07:11:03.859712 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5c6147-aa18-4e15-9076-7d4db76a6526 None admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:11:03.940888 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ecfce1-cab4-4fb1-af5e-4048caaa8f87 None admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:11:03.963385 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5c6147-aa18-4e15-9076-7d4db76a6526 None admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:11:03.975136 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2727f1ad-c120-4608-bd3e-3ee2e3496e87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:11:03.975835 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2727f1ad-c120-4608-bd3e-3ee2e3496e87 None admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:11:03.976122 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2727f1ad-c120-4608-bd3e-3ee2e3496e87 None admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:11:03.976379 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2727f1ad-c120-4608-bd3e-3ee2e3496e87 None admin] PATH_INFO: `/v3/roles` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:11:03.977120 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2727f1ad-c120-4608-bd3e-3ee2e3496e87 None admin] RBAC: Adding query filter params (name=service) {{(pid=79744) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 07:11:03.977422 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2727f1ad-c120-4608-bd3e-3ee2e3496e87 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:11:03.978765 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2727f1ad-c120-4608-bd3e-3ee2e3496e87 None admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:11:03.987428 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 330/648] 10.222.0.21 () {56 vars in 1103 bytes} [Wed May 4 07:11:03 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 07:11:03.988214 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2727f1ad-c120-4608-bd3e-3ee2e3496e87 None admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:11:04.006110 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c18b04-764d-421c-b705-ca54bcad35b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:11:04.006771 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c18b04-764d-421c-b705-ca54bcad35b2 None admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:11:04.007322 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c18b04-764d-421c-b705-ca54bcad35b2 None admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:11:04.007593 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c18b04-764d-421c-b705-ca54bcad35b2 None admin] PATH_INFO: `/v3/domains` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:11:04.008307 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c18b04-764d-421c-b705-ca54bcad35b2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 07:11:04.008605 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c18b04-764d-421c-b705-ca54bcad35b2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:11:04.009961 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c18b04-764d-421c-b705-ca54bcad35b2 None admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:11:04.031031 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 319/649] 10.222.0.21 () {56 vars in 1109 bytes} [Wed May 4 07:11:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 07:11:04.031031 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c18b04-764d-421c-b705-ca54bcad35b2 None admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:11:04.086357 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2727f1ad-c120-4608-bd3e-3ee2e3496e87 None admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:11:04.120601 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aaf7adf-c566-488f-a786-158daeb97138 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:11:04.121439 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aaf7adf-c566-488f-a786-158daeb97138 None admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:11:04.121733 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aaf7adf-c566-488f-a786-158daeb97138 None admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:11:04.122006 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aaf7adf-c566-488f-a786-158daeb97138 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:11:04.124036 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c18b04-764d-421c-b705-ca54bcad35b2 None admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:11:04.132346 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aaf7adf-c566-488f-a786-158daeb97138 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:11:04.133768 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aaf7adf-c566-488f-a786-158daeb97138 None admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:11:04.150123 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application [None req-2aaf7adf-c566-488f-a786-158daeb97138 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 07:11:04.150123 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 07:11:04.150123 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 07:11:04.150123 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 07:11:04.150123 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 07:11:04.150123 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 07:11:04.150123 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 07:11:04.150123 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 07:11:04.150123 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 07:11:04.150123 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 07:11:04.150123 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 07:11:04.150123 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 07:11:04.150123 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 07:11:04.150123 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 07:11:04.150123 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 07:11:04.151245 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 07:11:04.151245 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 07:11:04.151245 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 07:11:04.151245 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 07:11:04.151245 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 07:11:04.151245 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 07:11:04.151245 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.get_or_create( May 04 07:11:04.151245 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 07:11:04.151245 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application with Lock( May 04 07:11:04.151245 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 07:11:04.151245 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self._enter() May 04 07:11:04.151245 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 07:11:04.151245 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 07:11:04.151245 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 07:11:04.151245 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.creator() May 04 07:11:04.151245 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 07:11:04.151245 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application created_value = creator( May 04 07:11:04.152697 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 07:11:04.152697 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 07:11:04.152697 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 07:11:04.152697 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application May 04 07:11:04.152697 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 331/650] 10.222.0.21 () {56 vars in 1108 bytes} [Wed May 4 07:11:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 07:11:04.153101 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aaf7adf-c566-488f-a786-158daeb97138 None admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:11:04.160803 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81dc2a6-9489-43e6-a93d-8bf1878f5c2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:11:04.161454 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81dc2a6-9489-43e6-a93d-8bf1878f5c2a None admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:11:04.161726 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81dc2a6-9489-43e6-a93d-8bf1878f5c2a None admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:11:04.161990 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81dc2a6-9489-43e6-a93d-8bf1878f5c2a None admin] PATH_INFO: `/v3/domains` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:11:04.162694 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81dc2a6-9489-43e6-a93d-8bf1878f5c2a None admin] RBAC: Adding query filter params (name=Default) {{(pid=79745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 07:11:04.162993 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81dc2a6-9489-43e6-a93d-8bf1878f5c2a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:11:04.164368 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81dc2a6-9489-43e6-a93d-8bf1878f5c2a None admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:11:04.175560 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 320/651] 10.222.0.21 () {56 vars in 1109 bytes} [Wed May 4 07:11:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 07:11:04.176327 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81dc2a6-9489-43e6-a93d-8bf1878f5c2a None admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:11:04.245038 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aaf7adf-c566-488f-a786-158daeb97138 None admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:11:04.268497 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81dc2a6-9489-43e6-a93d-8bf1878f5c2a None admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:11:04.276647 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42476aa-31ec-4d01-8097-b717e31e4952 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:11:04.277508 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42476aa-31ec-4d01-8097-b717e31e4952 None admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:11:04.277785 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42476aa-31ec-4d01-8097-b717e31e4952 None admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:11:04.278061 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42476aa-31ec-4d01-8097-b717e31e4952 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:11:04.288745 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42476aa-31ec-4d01-8097-b717e31e4952 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:11:04.290117 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42476aa-31ec-4d01-8097-b717e31e4952 None admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:11:04.299894 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a64773-c429-4495-aef4-8817d0817714 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:11:04.300665 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a64773-c429-4495-aef4-8817d0817714 None admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:11:04.300940 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a64773-c429-4495-aef4-8817d0817714 None admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:11:04.301208 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a64773-c429-4495-aef4-8817d0817714 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:11:04.307019 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application [None req-e42476aa-31ec-4d01-8097-b717e31e4952 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 07:11:04.307019 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 07:11:04.307019 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 07:11:04.307019 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 07:11:04.307019 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 07:11:04.307019 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 07:11:04.307019 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 07:11:04.307019 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 07:11:04.307019 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 07:11:04.307019 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 07:11:04.307019 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 07:11:04.307019 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 07:11:04.307019 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 07:11:04.307019 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 07:11:04.307019 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 07:11:04.308080 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 07:11:04.308080 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 07:11:04.308080 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 07:11:04.308080 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 07:11:04.308080 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 07:11:04.308080 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 07:11:04.308080 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.get_or_create( May 04 07:11:04.308080 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 07:11:04.308080 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application with Lock( May 04 07:11:04.308080 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 07:11:04.308080 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self._enter() May 04 07:11:04.308080 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 07:11:04.308080 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 07:11:04.308080 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 07:11:04.308080 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.creator() May 04 07:11:04.308080 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 07:11:04.308080 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application created_value = creator( May 04 07:11:04.314173 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 07:11:04.314173 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 07:11:04.314173 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 07:11:04.314173 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application May 04 07:11:04.314447 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a64773-c429-4495-aef4-8817d0817714 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:11:04.314535 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 332/652] 10.222.0.21 () {56 vars in 1108 bytes} [Wed May 4 07:11:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 07:11:04.314625 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a64773-c429-4495-aef4-8817d0817714 None admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:11:04.314717 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ead3c7-111e-42da-a989-acf9cf90f797 None None] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:11:04.314717 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ead3c7-111e-42da-a989-acf9cf90f797 None None] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:11:04.314717 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ead3c7-111e-42da-a989-acf9cf90f797 None None] PATH_INFO: `/` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:11:04.314717 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 333/653] 10.222.0.21 () {54 vars in 926 bytes} [Wed May 4 07:11:04 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 07:11:04.314717 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ead3c7-111e-42da-a989-acf9cf90f797 None None] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:11:04.329809 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application [None req-d3a64773-c429-4495-aef4-8817d0817714 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 04 07:11:04.329809 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 07:11:04.329809 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 07:11:04.329809 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 07:11:04.329809 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 07:11:04.329809 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 07:11:04.329809 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 07:11:04.329809 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 07:11:04.329809 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 07:11:04.329809 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 07:11:04.329809 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 07:11:04.329809 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 07:11:04.329809 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 04 07:11:04.329809 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self._get_project(project_id) May 04 07:11:04.329809 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 04 07:11:04.330889 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 04 07:11:04.330889 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 07:11:04.330889 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 07:11:04.330889 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 07:11:04.330889 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 07:11:04.330889 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 07:11:04.330889 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self.get_or_create( May 04 07:11:04.330889 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 07:11:04.330889 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application with Lock( May 04 07:11:04.330889 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 07:11:04.330889 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self._enter() May 04 07:11:04.330889 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 07:11:04.330889 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 07:11:04.330889 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 07:11:04.330889 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self.creator() May 04 07:11:04.330889 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 07:11:04.330889 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application created_value = creator( May 04 07:11:04.332072 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 04 07:11:04.332072 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 04 07:11:04.332072 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 04 07:11:04.332072 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 04 07:11:04.332072 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 04 07:11:04.332072 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 04 07:11:04.332072 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 04 07:11:04.332072 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application May 04 07:11:04.332072 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 321/654] 10.222.0.21 () {56 vars in 1111 bytes} [Wed May 4 07:11:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 07:11:04.332072 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a64773-c429-4495-aef4-8817d0817714 None admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:11:04.414901 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ead3c7-111e-42da-a989-acf9cf90f797 None None] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:11:04.423723 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a64773-c429-4495-aef4-8817d0817714 None admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:11:04.451241 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0dfc56-6908-4423-95b0-a5e3aba01c9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:11:04.451908 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0dfc56-6908-4423-95b0-a5e3aba01c9f None admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:11:04.452193 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0dfc56-6908-4423-95b0-a5e3aba01c9f None admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:11:04.452464 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0dfc56-6908-4423-95b0-a5e3aba01c9f None admin] PATH_INFO: `/v3/domains` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:11:04.453183 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0dfc56-6908-4423-95b0-a5e3aba01c9f None admin] RBAC: Adding query filter params (name=Default) {{(pid=79744) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 07:11:04.453484 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0dfc56-6908-4423-95b0-a5e3aba01c9f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:11:04.454873 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0dfc56-6908-4423-95b0-a5e3aba01c9f None admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:11:04.455865 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e8b0ed-5d6e-4478-9144-27dcd017f06b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:11:04.456654 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e8b0ed-5d6e-4478-9144-27dcd017f06b None admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:11:04.456935 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e8b0ed-5d6e-4478-9144-27dcd017f06b None admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:11:04.457207 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e8b0ed-5d6e-4478-9144-27dcd017f06b None admin] PATH_INFO: `/v3/projects/service` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:11:04.463740 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e8b0ed-5d6e-4478-9144-27dcd017f06b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:11:04.465260 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e8b0ed-5d6e-4478-9144-27dcd017f06b None admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:11:04.466380 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 334/655] 10.222.0.21 () {56 vars in 1109 bytes} [Wed May 4 07:11:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 07:11:04.467174 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0dfc56-6908-4423-95b0-a5e3aba01c9f None admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:11:04.478779 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application [None req-d5e8b0ed-5d6e-4478-9144-27dcd017f06b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 04 07:11:04.478779 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 07:11:04.478779 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 07:11:04.478779 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 07:11:04.478779 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 07:11:04.478779 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 07:11:04.478779 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 07:11:04.478779 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 07:11:04.478779 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 07:11:04.478779 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 07:11:04.478779 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 07:11:04.478779 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 07:11:04.478779 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 04 07:11:04.478779 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self._get_project(project_id) May 04 07:11:04.478779 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 04 07:11:04.479881 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 04 07:11:04.479881 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 07:11:04.479881 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 07:11:04.479881 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 07:11:04.479881 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 07:11:04.479881 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 07:11:04.479881 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self.get_or_create( May 04 07:11:04.479881 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 07:11:04.479881 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application with Lock( May 04 07:11:04.479881 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 07:11:04.479881 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self._enter() May 04 07:11:04.479881 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 07:11:04.479881 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 07:11:04.479881 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 07:11:04.479881 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self.creator() May 04 07:11:04.479881 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 07:11:04.479881 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application created_value = creator( May 04 07:11:04.481451 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 04 07:11:04.481451 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 04 07:11:04.481451 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 04 07:11:04.481451 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 04 07:11:04.481451 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 04 07:11:04.481451 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 04 07:11:04.481451 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 04 07:11:04.481451 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application May 04 07:11:04.481451 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 322/656] 10.222.0.21 () {56 vars in 1111 bytes} [Wed May 4 07:11:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 07:11:04.481964 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4caa20-167a-4fa7-9cda-9756bb2dc61e None None] REQUEST_METHOD: `POST` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:11:04.481964 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4caa20-167a-4fa7-9cda-9756bb2dc61e None None] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:11:04.482333 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4caa20-167a-4fa7-9cda-9756bb2dc61e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:11:04.497935 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.auth.core [None req-ec4caa20-167a-4fa7-9cda-9756bb2dc61e None None] MFA Rules not processed for user `83c5e0dcb991496ea6dee38384514508`. Rule list: `[]` (Enabled: `True`). {{(pid=79745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:11:04.499119 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.fernet_utils [None req-ec4caa20-167a-4fa7-9cda-9756bb2dc61e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:11:04.561789 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 323/657] 10.222.0.21 () {58 vars in 1023 bytes} [Wed May 4 07:11:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 07:11:04.562537 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4caa20-167a-4fa7-9cda-9756bb2dc61e None None] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:11:04.565833 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0dfc56-6908-4423-95b0-a5e3aba01c9f None admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:11:04.598732 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19077bb-f7ad-4909-aeb6-e6cfe48689e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:11:04.599412 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19077bb-f7ad-4909-aeb6-e6cfe48689e4 None admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:11:04.599689 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19077bb-f7ad-4909-aeb6-e6cfe48689e4 None admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:11:04.599957 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19077bb-f7ad-4909-aeb6-e6cfe48689e4 None admin] PATH_INFO: `/v3/domains` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:11:04.600660 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19077bb-f7ad-4909-aeb6-e6cfe48689e4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79744) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 07:11:04.600962 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19077bb-f7ad-4909-aeb6-e6cfe48689e4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:11:04.602297 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19077bb-f7ad-4909-aeb6-e6cfe48689e4 None admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:11:04.613075 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 335/658] 10.222.0.21 () {56 vars in 1109 bytes} [Wed May 4 07:11:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 07:11:04.613842 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19077bb-f7ad-4909-aeb6-e6cfe48689e4 None admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:11:04.656239 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4caa20-167a-4fa7-9cda-9756bb2dc61e None None] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:11:04.688077 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f78e6e-4387-45ad-9165-939325b491af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:11:04.688722 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f78e6e-4387-45ad-9165-939325b491af None admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:11:04.688992 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f78e6e-4387-45ad-9165-939325b491af None admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:11:04.689258 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f78e6e-4387-45ad-9165-939325b491af None admin] PATH_INFO: `/v3/projects` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:11:04.690029 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f78e6e-4387-45ad-9165-939325b491af None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 07:11:04.690329 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f78e6e-4387-45ad-9165-939325b491af None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:11:04.691769 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f78e6e-4387-45ad-9165-939325b491af None admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:11:04.703116 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 324/659] 10.222.0.21 () {56 vars in 1148 bytes} [Wed May 4 07:11:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 07:11:04.703906 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f78e6e-4387-45ad-9165-939325b491af None admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:11:04.712687 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19077bb-f7ad-4909-aeb6-e6cfe48689e4 None admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:11:04.744194 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba62722-e088-4beb-acdc-bb48d6bdf374 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:11:04.744979 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba62722-e088-4beb-acdc-bb48d6bdf374 None admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:11:04.745258 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba62722-e088-4beb-acdc-bb48d6bdf374 None admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:11:04.745525 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba62722-e088-4beb-acdc-bb48d6bdf374 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:11:04.753561 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba62722-e088-4beb-acdc-bb48d6bdf374 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:11:04.754980 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba62722-e088-4beb-acdc-bb48d6bdf374 None admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:11:04.769441 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application [None req-8ba62722-e088-4beb-acdc-bb48d6bdf374 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 04 07:11:04.769441 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 07:11:04.769441 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 07:11:04.769441 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 07:11:04.769441 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 07:11:04.769441 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 07:11:04.769441 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 07:11:04.769441 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 07:11:04.769441 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 07:11:04.769441 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 07:11:04.769441 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 07:11:04.769441 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 07:11:04.769441 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 04 07:11:04.769441 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self._get_user(user_id) May 04 07:11:04.769441 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 04 07:11:04.769441 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 04 07:11:04.770608 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 07:11:04.770608 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 07:11:04.770608 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 04 07:11:04.770608 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 07:11:04.770608 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 04 07:11:04.770608 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 07:11:04.770608 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 07:11:04.770608 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 07:11:04.770608 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 07:11:04.770608 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.get_or_create( May 04 07:11:04.770608 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 07:11:04.770608 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application with Lock( May 04 07:11:04.770608 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 07:11:04.770608 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self._enter() May 04 07:11:04.770608 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 07:11:04.770608 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 07:11:04.770608 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 07:11:04.770608 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.creator() May 04 07:11:04.771597 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 07:11:04.771597 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application created_value = creator( May 04 07:11:04.771597 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 04 07:11:04.771597 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 04 07:11:04.771597 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 04 07:11:04.771597 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 04 07:11:04.771597 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 04 07:11:04.771597 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 04 07:11:04.771597 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 04 07:11:04.771597 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application May 04 07:11:04.771597 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 336/660] 10.222.0.21 () {56 vars in 1099 bytes} [Wed May 4 07:11:04 2022] GET /identity/v3/users/cinder => generated 84 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 07:11:04.771597 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba62722-e088-4beb-acdc-bb48d6bdf374 None admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:11:04.796708 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f78e6e-4387-45ad-9165-939325b491af None admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:11:04.827898 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc60038c-f09f-4afd-9135-5b1fec77989c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:11:04.828471 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc60038c-f09f-4afd-9135-5b1fec77989c None admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:11:04.828745 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc60038c-f09f-4afd-9135-5b1fec77989c None admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:11:04.829012 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc60038c-f09f-4afd-9135-5b1fec77989c None admin] PATH_INFO: `/v3/projects` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:11:04.829775 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc60038c-f09f-4afd-9135-5b1fec77989c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 07:11:04.830077 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc60038c-f09f-4afd-9135-5b1fec77989c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:11:04.831516 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc60038c-f09f-4afd-9135-5b1fec77989c None admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:11:04.843847 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 325/661] 10.222.0.21 () {56 vars in 1148 bytes} [Wed May 4 07:11:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 07:11:04.844686 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc60038c-f09f-4afd-9135-5b1fec77989c None admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:11:04.868382 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba62722-e088-4beb-acdc-bb48d6bdf374 None admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:11:04.902851 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348ad9c7-5df8-491c-afa0-d068b2d086cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:11:04.903685 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348ad9c7-5df8-491c-afa0-d068b2d086cc None admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:11:04.903964 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348ad9c7-5df8-491c-afa0-d068b2d086cc None admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:11:04.904235 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348ad9c7-5df8-491c-afa0-d068b2d086cc None admin] PATH_INFO: `/v3/roles/service` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:11:04.915737 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348ad9c7-5df8-491c-afa0-d068b2d086cc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 07:11:04.924571 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application [None req-348ad9c7-5df8-491c-afa0-d068b2d086cc None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 04 07:11:04.924571 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 07:11:04.924571 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 07:11:04.924571 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 07:11:04.924571 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 07:11:04.924571 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 07:11:04.924571 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 07:11:04.924571 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 07:11:04.924571 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 07:11:04.924571 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 07:11:04.924571 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 07:11:04.924571 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 07:11:04.924571 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 07:11:04.924571 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 07:11:04.924571 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 07:11:04.924571 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 07:11:04.925610 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 07:11:04.925610 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 07:11:04.925610 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 07:11:04.925610 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 07:11:04.925610 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 07:11:04.925610 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 07:11:04.925610 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 07:11:04.925610 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 07:11:04.925610 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 07:11:04.925610 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.get_or_create( May 04 07:11:04.925610 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 07:11:04.925610 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application with Lock( May 04 07:11:04.925610 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 07:11:04.925610 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self._enter() May 04 07:11:04.925610 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 07:11:04.925610 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 07:11:04.926465 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 07:11:04.926465 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.creator() May 04 07:11:04.926465 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 07:11:04.926465 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application created_value = creator( May 04 07:11:04.926465 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 07:11:04.926465 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 07:11:04.926465 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 07:11:04.926465 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 07:11:04.926465 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 07:11:04.926465 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 07:11:04.926465 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 04 07:11:04.926465 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application May 04 07:11:04.926465 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 337/662] 10.222.0.21 () {56 vars in 1102 bytes} [Wed May 4 07:11:04 2022] GET /identity/v3/roles/service => generated 85 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 07:11:04.927209 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348ad9c7-5df8-491c-afa0-d068b2d086cc None admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:11:05.031522 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348ad9c7-5df8-491c-afa0-d068b2d086cc None admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:11:05.060211 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc60038c-f09f-4afd-9135-5b1fec77989c None admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:11:05.062126 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00cb4928-58f3-4bbd-bf2d-17148d46c689 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:11:05.062760 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cb4928-58f3-4bbd-bf2d-17148d46c689 None admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:11:05.063041 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cb4928-58f3-4bbd-bf2d-17148d46c689 None admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:11:05.063332 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cb4928-58f3-4bbd-bf2d-17148d46c689 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:11:05.064142 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00cb4928-58f3-4bbd-bf2d-17148d46c689 None admin] RBAC: Adding query filter params (role.id=14041215d0f7476a8e90241a49338706, scope.project.id=c9f9c44db4984653b8d4b5f6b3b949f5, user.id=1077289fedae43b6be47be7f716d573a) {{(pid=79744) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 07:11:05.064445 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00cb4928-58f3-4bbd-bf2d-17148d46c689 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:11:05.065848 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00cb4928-58f3-4bbd-bf2d-17148d46c689 None admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:11:05.071349 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 338/663] 10.222.0.21 () {56 vars in 1374 bytes} [Wed May 4 07:11:04 2022] GET /identity/v3/role_assignments?user.id=1077289fedae43b6be47be7f716d573a&scope.project.id=c9f9c44db4984653b8d4b5f6b3b949f5&role.id=14041215d0f7476a8e90241a49338706 => generated 608 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 07:11:05.072247 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00cb4928-58f3-4bbd-bf2d-17148d46c689 None admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:11:05.097391 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb544aca-a837-4e1b-ac9b-8baae98a7196 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:11:05.098117 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb544aca-a837-4e1b-ac9b-8baae98a7196 None admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:11:05.098393 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb544aca-a837-4e1b-ac9b-8baae98a7196 None admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:11:05.098668 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb544aca-a837-4e1b-ac9b-8baae98a7196 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:11:05.107736 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb544aca-a837-4e1b-ac9b-8baae98a7196 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:11:05.109210 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb544aca-a837-4e1b-ac9b-8baae98a7196 None admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:11:05.124848 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application [None req-bb544aca-a837-4e1b-ac9b-8baae98a7196 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 04 07:11:05.124848 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 07:11:05.124848 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 07:11:05.124848 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 07:11:05.124848 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 07:11:05.124848 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 07:11:05.124848 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 07:11:05.124848 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 07:11:05.124848 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 07:11:05.124848 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 07:11:05.124848 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 07:11:05.124848 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 07:11:05.124848 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 04 07:11:05.124848 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self._get_user(user_id) May 04 07:11:05.124848 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 04 07:11:05.124848 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 04 07:11:05.126086 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 07:11:05.126086 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 07:11:05.126086 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 04 07:11:05.126086 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 07:11:05.126086 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 04 07:11:05.126086 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 07:11:05.126086 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 07:11:05.126086 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 07:11:05.126086 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 07:11:05.126086 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self.get_or_create( May 04 07:11:05.126086 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 07:11:05.126086 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application with Lock( May 04 07:11:05.126086 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 07:11:05.126086 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self._enter() May 04 07:11:05.126086 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 07:11:05.126086 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 07:11:05.126086 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 07:11:05.126086 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self.creator() May 04 07:11:05.127091 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 07:11:05.127091 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application created_value = creator( May 04 07:11:05.127091 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 04 07:11:05.127091 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 04 07:11:05.127091 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 04 07:11:05.127091 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 04 07:11:05.127091 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 04 07:11:05.127091 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 04 07:11:05.127091 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 04 07:11:05.127091 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application May 04 07:11:05.127091 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 326/664] 10.222.0.21 () {56 vars in 1102 bytes} [Wed May 4 07:11:04 2022] GET /identity/v3/users/neutron => generated 85 bytes in 282 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 07:11:05.127765 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb544aca-a837-4e1b-ac9b-8baae98a7196 None admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:11:05.192436 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00cb4928-58f3-4bbd-bf2d-17148d46c689 None admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:11:05.238246 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb544aca-a837-4e1b-ac9b-8baae98a7196 None admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:11:05.239723 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb90ce7-fa70-46dc-a5ee-63f40be0e339 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:11:05.240399 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb90ce7-fa70-46dc-a5ee-63f40be0e339 None admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:11:05.240675 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb90ce7-fa70-46dc-a5ee-63f40be0e339 None admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:11:05.240967 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb90ce7-fa70-46dc-a5ee-63f40be0e339 None admin] PATH_INFO: `/v3/users` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:11:05.241810 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb90ce7-fa70-46dc-a5ee-63f40be0e339 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=79744) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 07:11:05.242112 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb90ce7-fa70-46dc-a5ee-63f40be0e339 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:11:05.243595 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb90ce7-fa70-46dc-a5ee-63f40be0e339 None admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:11:05.262348 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 339/665] 10.222.0.21 () {56 vars in 1137 bytes} [Wed May 4 07:11:05 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 07:11:05.263309 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb90ce7-fa70-46dc-a5ee-63f40be0e339 None admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:11:05.279994 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc27ec8f-c1e2-47d6-b095-581e5d5412d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:11:05.280656 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc27ec8f-c1e2-47d6-b095-581e5d5412d6 None admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:11:05.280939 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc27ec8f-c1e2-47d6-b095-581e5d5412d6 None admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:11:05.281259 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc27ec8f-c1e2-47d6-b095-581e5d5412d6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:11:05.282116 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc27ec8f-c1e2-47d6-b095-581e5d5412d6 None admin] RBAC: Adding query filter params (role.id=14041215d0f7476a8e90241a49338706, scope.project.id=c9f9c44db4984653b8d4b5f6b3b949f5, user.id=7538f5cab3364625a3e909f5f117ef2d) {{(pid=79745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 07:11:05.282428 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc27ec8f-c1e2-47d6-b095-581e5d5412d6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:11:05.283885 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc27ec8f-c1e2-47d6-b095-581e5d5412d6 None admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:11:05.290041 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 327/666] 10.222.0.21 () {56 vars in 1374 bytes} [Wed May 4 07:11:05 2022] GET /identity/v3/role_assignments?user.id=7538f5cab3364625a3e909f5f117ef2d&scope.project.id=c9f9c44db4984653b8d4b5f6b3b949f5&role.id=14041215d0f7476a8e90241a49338706 => generated 608 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 07:11:05.291372 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc27ec8f-c1e2-47d6-b095-581e5d5412d6 None admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:11:05.380791 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb90ce7-fa70-46dc-a5ee-63f40be0e339 None admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:11:05.420061 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38b9c9e-0e75-45e6-8c5e-275525a5d2ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:11:05.421063 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38b9c9e-0e75-45e6-8c5e-275525a5d2ab None admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:11:05.421525 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38b9c9e-0e75-45e6-8c5e-275525a5d2ab None admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:11:05.421730 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc27ec8f-c1e2-47d6-b095-581e5d5412d6 None admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:11:05.422181 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38b9c9e-0e75-45e6-8c5e-275525a5d2ab None admin] PATH_INFO: `/v3/roles` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:11:05.423131 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38b9c9e-0e75-45e6-8c5e-275525a5d2ab None admin] RBAC: Adding query filter params (name=service) {{(pid=79744) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 07:11:05.423651 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38b9c9e-0e75-45e6-8c5e-275525a5d2ab None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:11:05.425235 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38b9c9e-0e75-45e6-8c5e-275525a5d2ab None admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:11:05.434977 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 340/667] 10.222.0.21 () {56 vars in 1103 bytes} [Wed May 4 07:11:05 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 07:11:05.436275 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38b9c9e-0e75-45e6-8c5e-275525a5d2ab None admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:11:05.468865 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170258f5-255d-4992-89ac-d36848db146c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:11:05.469980 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170258f5-255d-4992-89ac-d36848db146c None admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:11:05.470370 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170258f5-255d-4992-89ac-d36848db146c None admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:11:05.470715 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170258f5-255d-4992-89ac-d36848db146c None admin] PATH_INFO: `/v3/users` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:11:05.471839 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170258f5-255d-4992-89ac-d36848db146c None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=79745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 07:11:05.472605 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170258f5-255d-4992-89ac-d36848db146c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:11:05.474153 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170258f5-255d-4992-89ac-d36848db146c None admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:11:05.493957 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 328/668] 10.222.0.21 () {56 vars in 1139 bytes} [Wed May 4 07:11:05 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 07:11:05.494622 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170258f5-255d-4992-89ac-d36848db146c None admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:11:05.549777 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38b9c9e-0e75-45e6-8c5e-275525a5d2ab None admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:11:05.584483 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b2f849-199b-458e-9b0f-cb0fe4acc5c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:11:05.585136 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b2f849-199b-458e-9b0f-cb0fe4acc5c9 None admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:11:05.585418 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b2f849-199b-458e-9b0f-cb0fe4acc5c9 None admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:11:05.585689 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b2f849-199b-458e-9b0f-cb0fe4acc5c9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:11:05.603258 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170258f5-255d-4992-89ac-d36848db146c None admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:11:05.639056 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb64fcb1-2d4f-4a66-9f89-e01bdcebcdce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:11:05.639800 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb64fcb1-2d4f-4a66-9f89-e01bdcebcdce None admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:11:05.640078 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb64fcb1-2d4f-4a66-9f89-e01bdcebcdce None admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:11:05.640403 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb64fcb1-2d4f-4a66-9f89-e01bdcebcdce None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:11:05.650442 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb64fcb1-2d4f-4a66-9f89-e01bdcebcdce None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:11:05.652503 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb64fcb1-2d4f-4a66-9f89-e01bdcebcdce None admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:11:05.655726 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b2f849-199b-458e-9b0f-cb0fe4acc5c9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:11:05.657313 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b2f849-199b-458e-9b0f-cb0fe4acc5c9 None admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:11:05.670598 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application [None req-bb64fcb1-2d4f-4a66-9f89-e01bdcebcdce None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 07:11:05.670598 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 07:11:05.670598 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 07:11:05.670598 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 07:11:05.670598 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 07:11:05.670598 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 07:11:05.670598 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 07:11:05.670598 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 07:11:05.670598 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 07:11:05.670598 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 07:11:05.670598 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 07:11:05.670598 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 07:11:05.670598 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 07:11:05.670598 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 07:11:05.670598 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 07:11:05.671726 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 07:11:05.671726 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 07:11:05.671726 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 07:11:05.671726 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 07:11:05.671726 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 07:11:05.671726 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 07:11:05.671726 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self.get_or_create( May 04 07:11:05.671726 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 07:11:05.671726 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application with Lock( May 04 07:11:05.671726 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 07:11:05.671726 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self._enter() May 04 07:11:05.671726 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 07:11:05.671726 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 07:11:05.671726 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 07:11:05.671726 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self.creator() May 04 07:11:05.671726 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 07:11:05.671726 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application created_value = creator( May 04 07:11:05.672863 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 07:11:05.672863 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 07:11:05.672863 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 07:11:05.672863 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application May 04 07:11:05.672863 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 329/669] 10.222.0.21 () {56 vars in 1108 bytes} [Wed May 4 07:11:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 07:11:05.673144 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb64fcb1-2d4f-4a66-9f89-e01bdcebcdce None admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:11:05.758744 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 341/670] 10.222.0.21 () {58 vars in 1282 bytes} [Wed May 4 07:11:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 04 07:11:05.759701 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b2f849-199b-458e-9b0f-cb0fe4acc5c9 None admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:11:05.785524 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb64fcb1-2d4f-4a66-9f89-e01bdcebcdce None admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:11:05.818761 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf8daf5-5bda-442a-b6a7-5152e26664cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:11:05.819590 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf8daf5-5bda-442a-b6a7-5152e26664cc None admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:11:05.819965 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf8daf5-5bda-442a-b6a7-5152e26664cc None admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:11:05.820331 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf8daf5-5bda-442a-b6a7-5152e26664cc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:11:05.858347 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b2f849-199b-458e-9b0f-cb0fe4acc5c9 None admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:11:05.891266 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf8daf5-5bda-442a-b6a7-5152e26664cc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:11:05.892832 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf8daf5-5bda-442a-b6a7-5152e26664cc None admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:11:05.893651 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa74af8c-6f63-45d2-9776-a7f9f0af8d23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:11:05.894315 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa74af8c-6f63-45d2-9776-a7f9f0af8d23 None admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:11:05.894593 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa74af8c-6f63-45d2-9776-a7f9f0af8d23 None admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:11:05.894863 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa74af8c-6f63-45d2-9776-a7f9f0af8d23 None admin] PATH_INFO: `/v3/domains` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:11:05.895635 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa74af8c-6f63-45d2-9776-a7f9f0af8d23 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79744) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 07:11:05.895941 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa74af8c-6f63-45d2-9776-a7f9f0af8d23 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:11:05.897297 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa74af8c-6f63-45d2-9776-a7f9f0af8d23 None admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:11:05.913154 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 342/671] 10.222.0.21 () {56 vars in 1109 bytes} [Wed May 4 07:11:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 07:11:05.914068 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa74af8c-6f63-45d2-9776-a7f9f0af8d23 None admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:11:05.993802 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 330/672] 10.222.0.21 () {58 vars in 1282 bytes} [Wed May 4 07:11:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 04 07:11:05.994652 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf8daf5-5bda-442a-b6a7-5152e26664cc None admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:11:06.019178 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa74af8c-6f63-45d2-9776-a7f9f0af8d23 None admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:11:06.054180 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84871fd-7a85-48a2-a635-a6c20b6ef062 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:11:06.054968 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84871fd-7a85-48a2-a635-a6c20b6ef062 None admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:11:06.055280 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84871fd-7a85-48a2-a635-a6c20b6ef062 None admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:11:06.055551 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84871fd-7a85-48a2-a635-a6c20b6ef062 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:11:06.066534 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84871fd-7a85-48a2-a635-a6c20b6ef062 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:11:06.068006 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84871fd-7a85-48a2-a635-a6c20b6ef062 None admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:11:06.086156 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application [None req-f84871fd-7a85-48a2-a635-a6c20b6ef062 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 07:11:06.086156 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 07:11:06.086156 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 07:11:06.086156 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 07:11:06.086156 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 07:11:06.086156 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 07:11:06.086156 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 07:11:06.086156 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 07:11:06.086156 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 07:11:06.086156 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 07:11:06.086156 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 07:11:06.086156 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 07:11:06.086156 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 07:11:06.086156 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 07:11:06.086156 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 07:11:06.088191 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 07:11:06.088191 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 07:11:06.088191 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 07:11:06.088191 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 07:11:06.088191 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 07:11:06.088191 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 07:11:06.088191 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.get_or_create( May 04 07:11:06.088191 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 07:11:06.088191 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application with Lock( May 04 07:11:06.088191 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 07:11:06.088191 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self._enter() May 04 07:11:06.088191 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 07:11:06.088191 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 07:11:06.088191 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 07:11:06.088191 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.creator() May 04 07:11:06.088191 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 07:11:06.088191 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application created_value = creator( May 04 07:11:06.090221 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 07:11:06.090221 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 07:11:06.090221 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 07:11:06.090221 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application May 04 07:11:06.090221 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 343/673] 10.222.0.21 () {56 vars in 1108 bytes} [Wed May 4 07:11:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 07:11:06.090221 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84871fd-7a85-48a2-a635-a6c20b6ef062 None admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:11:06.095199 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf8daf5-5bda-442a-b6a7-5152e26664cc None admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:11:06.126820 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d611cc36-e806-4b21-b9f0-2fbce3fc0982 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:11:06.127777 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d611cc36-e806-4b21-b9f0-2fbce3fc0982 None admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:11:06.128053 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d611cc36-e806-4b21-b9f0-2fbce3fc0982 None admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:11:06.128317 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d611cc36-e806-4b21-b9f0-2fbce3fc0982 None admin] PATH_INFO: `/v3/users/swift` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:11:06.135814 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d611cc36-e806-4b21-b9f0-2fbce3fc0982 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:11:06.137970 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d611cc36-e806-4b21-b9f0-2fbce3fc0982 None admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:11:06.152415 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application [None req-d611cc36-e806-4b21-b9f0-2fbce3fc0982 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 04 07:11:06.152415 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 07:11:06.152415 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 07:11:06.152415 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 07:11:06.152415 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 07:11:06.152415 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 07:11:06.152415 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 07:11:06.152415 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 07:11:06.152415 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 07:11:06.152415 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 07:11:06.152415 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 07:11:06.152415 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 07:11:06.152415 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 04 07:11:06.152415 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self._get_user(user_id) May 04 07:11:06.152415 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 04 07:11:06.152415 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 04 07:11:06.154811 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 07:11:06.154811 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 07:11:06.154811 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 04 07:11:06.154811 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 07:11:06.154811 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 04 07:11:06.154811 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 07:11:06.154811 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 07:11:06.154811 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 07:11:06.154811 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 07:11:06.154811 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self.get_or_create( May 04 07:11:06.154811 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 07:11:06.154811 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application with Lock( May 04 07:11:06.154811 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 07:11:06.154811 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self._enter() May 04 07:11:06.154811 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 07:11:06.154811 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 07:11:06.154811 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 07:11:06.154811 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self.creator() May 04 07:11:06.157147 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 07:11:06.157147 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application created_value = creator( May 04 07:11:06.157147 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 04 07:11:06.157147 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 04 07:11:06.157147 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 04 07:11:06.157147 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 04 07:11:06.157147 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 04 07:11:06.157147 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 04 07:11:06.157147 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 04 07:11:06.157147 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application May 04 07:11:06.157147 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 331/674] 10.222.0.21 () {56 vars in 1096 bytes} [Wed May 4 07:11:05 2022] GET /identity/v3/users/swift => generated 83 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 07:11:06.157147 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d611cc36-e806-4b21-b9f0-2fbce3fc0982 None admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:11:06.195978 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84871fd-7a85-48a2-a635-a6c20b6ef062 None admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:11:06.230725 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbae3027-fa3d-42fb-8f17-bb6387aa6549 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:11:06.231546 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbae3027-fa3d-42fb-8f17-bb6387aa6549 None admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:11:06.231831 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbae3027-fa3d-42fb-8f17-bb6387aa6549 None admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:11:06.232107 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbae3027-fa3d-42fb-8f17-bb6387aa6549 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:11:06.242891 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbae3027-fa3d-42fb-8f17-bb6387aa6549 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:11:06.244367 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbae3027-fa3d-42fb-8f17-bb6387aa6549 None admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:11:06.255757 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d611cc36-e806-4b21-b9f0-2fbce3fc0982 None admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:11:06.262684 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application [None req-cbae3027-fa3d-42fb-8f17-bb6387aa6549 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 07:11:06.262684 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 07:11:06.262684 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 07:11:06.262684 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 07:11:06.262684 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 07:11:06.262684 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 07:11:06.262684 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 07:11:06.262684 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 07:11:06.262684 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 07:11:06.262684 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 07:11:06.262684 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 07:11:06.262684 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 07:11:06.262684 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 07:11:06.262684 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 07:11:06.262684 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 07:11:06.264712 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 07:11:06.264712 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 07:11:06.264712 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 07:11:06.264712 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 07:11:06.264712 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 07:11:06.264712 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 07:11:06.264712 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.get_or_create( May 04 07:11:06.264712 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 07:11:06.264712 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application with Lock( May 04 07:11:06.264712 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 07:11:06.264712 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self._enter() May 04 07:11:06.264712 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 07:11:06.264712 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 07:11:06.264712 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 07:11:06.264712 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.creator() May 04 07:11:06.264712 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 07:11:06.264712 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application created_value = creator( May 04 07:11:06.266759 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 07:11:06.266759 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 07:11:06.266759 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 07:11:06.266759 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application May 04 07:11:06.273874 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 344/675] 10.222.0.21 () {56 vars in 1108 bytes} [Wed May 4 07:11:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 07:11:06.273874 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbae3027-fa3d-42fb-8f17-bb6387aa6549 None admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:11:06.289922 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b053e23-c896-4587-aa56-b476d8fbe07c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:11:06.290734 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b053e23-c896-4587-aa56-b476d8fbe07c None admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:11:06.291020 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b053e23-c896-4587-aa56-b476d8fbe07c None admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:11:06.291336 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b053e23-c896-4587-aa56-b476d8fbe07c None admin] PATH_INFO: `/v3/domains` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:11:06.292058 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b053e23-c896-4587-aa56-b476d8fbe07c None admin] RBAC: Adding query filter params (name=Default) {{(pid=79745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 07:11:06.292589 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b053e23-c896-4587-aa56-b476d8fbe07c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:11:06.294060 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b053e23-c896-4587-aa56-b476d8fbe07c None admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:11:06.306063 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 332/676] 10.222.0.21 () {56 vars in 1109 bytes} [Wed May 4 07:11:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 07:11:06.307045 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b053e23-c896-4587-aa56-b476d8fbe07c None admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:11:06.375958 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbae3027-fa3d-42fb-8f17-bb6387aa6549 None admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:11:06.413426 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d3e60c-dabe-4503-b94e-5a21d3d8952d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:11:06.414079 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d3e60c-dabe-4503-b94e-5a21d3d8952d None admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:11:06.414359 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d3e60c-dabe-4503-b94e-5a21d3d8952d None admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:11:06.414898 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d3e60c-dabe-4503-b94e-5a21d3d8952d None admin] PATH_INFO: `/v3/users` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:11:06.415547 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d3e60c-dabe-4503-b94e-5a21d3d8952d None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79744) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 07:11:06.415861 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d3e60c-dabe-4503-b94e-5a21d3d8952d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:11:06.417273 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d3e60c-dabe-4503-b94e-5a21d3d8952d None admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:11:06.430047 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b053e23-c896-4587-aa56-b476d8fbe07c None admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:11:06.440037 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 345/677] 10.222.0.21 () {56 vars in 1135 bytes} [Wed May 4 07:11:06 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 07:11:06.440913 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d3e60c-dabe-4503-b94e-5a21d3d8952d None admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:11:06.475508 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3310f20-91c1-462b-bda8-86e6f7dc08ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:11:06.476577 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3310f20-91c1-462b-bda8-86e6f7dc08ed None admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:11:06.477078 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3310f20-91c1-462b-bda8-86e6f7dc08ed None admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:11:06.477543 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3310f20-91c1-462b-bda8-86e6f7dc08ed None admin] PATH_INFO: `/v3/domains` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:11:06.478465 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3310f20-91c1-462b-bda8-86e6f7dc08ed None admin] RBAC: Adding query filter params (name=Default) {{(pid=79745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 07:11:06.478961 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3310f20-91c1-462b-bda8-86e6f7dc08ed None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:11:06.480615 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3310f20-91c1-462b-bda8-86e6f7dc08ed None admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:11:06.492310 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 333/678] 10.222.0.21 () {56 vars in 1109 bytes} [Wed May 4 07:11:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 07:11:06.493376 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3310f20-91c1-462b-bda8-86e6f7dc08ed None admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:11:06.547057 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d3e60c-dabe-4503-b94e-5a21d3d8952d None admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:11:06.581734 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fabad18-e576-4576-b852-a1dc3dbccdf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:11:06.582580 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fabad18-e576-4576-b852-a1dc3dbccdf0 None admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:11:06.582793 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fabad18-e576-4576-b852-a1dc3dbccdf0 None admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:11:06.583067 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fabad18-e576-4576-b852-a1dc3dbccdf0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:11:06.590425 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fabad18-e576-4576-b852-a1dc3dbccdf0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:11:06.591966 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fabad18-e576-4576-b852-a1dc3dbccdf0 None admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:11:06.593123 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3310f20-91c1-462b-bda8-86e6f7dc08ed None admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:11:06.607010 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application [None req-2fabad18-e576-4576-b852-a1dc3dbccdf0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 04 07:11:06.607010 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 07:11:06.607010 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 07:11:06.607010 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 07:11:06.607010 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 07:11:06.607010 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 07:11:06.607010 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 07:11:06.607010 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 07:11:06.607010 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 07:11:06.607010 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 07:11:06.607010 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 07:11:06.607010 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 07:11:06.607010 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 04 07:11:06.607010 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self._get_project(project_id) May 04 07:11:06.607010 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 04 07:11:06.607993 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 04 07:11:06.607993 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 07:11:06.607993 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 07:11:06.607993 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 07:11:06.607993 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 07:11:06.607993 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 07:11:06.607993 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.get_or_create( May 04 07:11:06.607993 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 07:11:06.607993 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application with Lock( May 04 07:11:06.607993 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 07:11:06.607993 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self._enter() May 04 07:11:06.607993 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 07:11:06.607993 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 07:11:06.607993 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 07:11:06.607993 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.creator() May 04 07:11:06.607993 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 07:11:06.607993 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application created_value = creator( May 04 07:11:06.608917 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 04 07:11:06.608917 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 04 07:11:06.608917 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 04 07:11:06.608917 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 04 07:11:06.608917 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 04 07:11:06.608917 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 04 07:11:06.608917 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 04 07:11:06.608917 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application May 04 07:11:06.613229 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 346/679] 10.222.0.21 () {56 vars in 1111 bytes} [Wed May 4 07:11:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 07:11:06.614073 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fabad18-e576-4576-b852-a1dc3dbccdf0 None admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:11:06.631393 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a4d42e-3429-4aa5-947e-f223e9a03d28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:11:06.632689 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a4d42e-3429-4aa5-947e-f223e9a03d28 None admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:11:06.633192 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a4d42e-3429-4aa5-947e-f223e9a03d28 None admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:11:06.633677 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a4d42e-3429-4aa5-947e-f223e9a03d28 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:11:06.701424 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a4d42e-3429-4aa5-947e-f223e9a03d28 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:11:06.703183 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a4d42e-3429-4aa5-947e-f223e9a03d28 None admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:11:06.719838 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fabad18-e576-4576-b852-a1dc3dbccdf0 None admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:11:06.754477 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e96def-1bc5-4da2-8c8d-0a7a202cd9d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:11:06.755581 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e96def-1bc5-4da2-8c8d-0a7a202cd9d1 None admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:11:06.755869 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e96def-1bc5-4da2-8c8d-0a7a202cd9d1 None admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:11:06.756144 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e96def-1bc5-4da2-8c8d-0a7a202cd9d1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:11:06.766355 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e96def-1bc5-4da2-8c8d-0a7a202cd9d1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:11:06.768002 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e96def-1bc5-4da2-8c8d-0a7a202cd9d1 None admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:11:06.786462 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application [None req-b8e96def-1bc5-4da2-8c8d-0a7a202cd9d1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 04 07:11:06.786462 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 07:11:06.786462 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 07:11:06.786462 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 07:11:06.786462 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 07:11:06.786462 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 07:11:06.786462 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 07:11:06.786462 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 07:11:06.786462 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 07:11:06.786462 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 07:11:06.786462 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 07:11:06.786462 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 07:11:06.786462 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 04 07:11:06.786462 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self._get_project(project_id) May 04 07:11:06.786462 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 04 07:11:06.787443 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 04 07:11:06.787443 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 07:11:06.787443 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 07:11:06.787443 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 07:11:06.787443 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 07:11:06.787443 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 07:11:06.787443 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.get_or_create( May 04 07:11:06.787443 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 07:11:06.787443 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application with Lock( May 04 07:11:06.787443 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 07:11:06.787443 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self._enter() May 04 07:11:06.787443 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 07:11:06.787443 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 07:11:06.787443 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 07:11:06.787443 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.creator() May 04 07:11:06.787443 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 07:11:06.787443 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application created_value = creator( May 04 07:11:06.788356 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 04 07:11:06.788356 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 04 07:11:06.788356 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 04 07:11:06.788356 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 04 07:11:06.788356 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 04 07:11:06.788356 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 04 07:11:06.788356 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 04 07:11:06.788356 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application May 04 07:11:06.791221 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 347/680] 10.222.0.21 () {56 vars in 1111 bytes} [Wed May 4 07:11:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 07:11:06.792222 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e96def-1bc5-4da2-8c8d-0a7a202cd9d1 None admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:11:06.808348 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 334/681] 10.222.0.21 () {58 vars in 1282 bytes} [Wed May 4 07:11:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 04 07:11:06.809452 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a4d42e-3429-4aa5-947e-f223e9a03d28 None admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:11:06.899616 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e96def-1bc5-4da2-8c8d-0a7a202cd9d1 None admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:11:06.907634 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a4d42e-3429-4aa5-947e-f223e9a03d28 None admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:11:06.938303 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684877e0-7a4b-4a6c-8a13-f85ae693d27f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:11:06.939360 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684877e0-7a4b-4a6c-8a13-f85ae693d27f None admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:11:06.939652 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684877e0-7a4b-4a6c-8a13-f85ae693d27f None admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:11:06.939919 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684877e0-7a4b-4a6c-8a13-f85ae693d27f None admin] PATH_INFO: `/v3/projects` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:11:06.940703 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684877e0-7a4b-4a6c-8a13-f85ae693d27f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79744) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 07:11:06.941012 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684877e0-7a4b-4a6c-8a13-f85ae693d27f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:11:06.942453 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684877e0-7a4b-4a6c-8a13-f85ae693d27f None admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:11:06.944172 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2349dd73-b2e3-48a0-a596-e97ded34d54c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:11:06.945060 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2349dd73-b2e3-48a0-a596-e97ded34d54c None admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:11:06.945532 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2349dd73-b2e3-48a0-a596-e97ded34d54c None admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:11:06.946043 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2349dd73-b2e3-48a0-a596-e97ded34d54c None admin] PATH_INFO: `/v3/projects` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:11:06.947007 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2349dd73-b2e3-48a0-a596-e97ded34d54c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 07:11:06.947552 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2349dd73-b2e3-48a0-a596-e97ded34d54c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:11:06.949276 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2349dd73-b2e3-48a0-a596-e97ded34d54c None admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:11:06.959482 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 348/682] 10.222.0.21 () {56 vars in 1148 bytes} [Wed May 4 07:11:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 07:11:06.960305 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684877e0-7a4b-4a6c-8a13-f85ae693d27f None admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:11:06.962018 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 335/683] 10.222.0.21 () {56 vars in 1148 bytes} [Wed May 4 07:11:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 07:11:06.963022 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2349dd73-b2e3-48a0-a596-e97ded34d54c None admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:11:07.066142 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2349dd73-b2e3-48a0-a596-e97ded34d54c None admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:11:07.070834 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684877e0-7a4b-4a6c-8a13-f85ae693d27f None admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:11:07.100505 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f71692-41ad-436b-9d38-714aa458a46e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:11:07.101658 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f71692-41ad-436b-9d38-714aa458a46e None admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:11:07.102230 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f71692-41ad-436b-9d38-714aa458a46e None admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:11:07.102798 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f71692-41ad-436b-9d38-714aa458a46e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:11:07.103841 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f71692-41ad-436b-9d38-714aa458a46e None admin] RBAC: Adding query filter params (role.id=14041215d0f7476a8e90241a49338706, scope.project.id=c9f9c44db4984653b8d4b5f6b3b949f5, user.id=bb341257aa8246b6847561e2fe1fa385) {{(pid=79745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 07:11:07.104374 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f71692-41ad-436b-9d38-714aa458a46e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:11:07.104786 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b4b741-2a09-47bb-b6e2-6932682a31b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:11:07.105737 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b4b741-2a09-47bb-b6e2-6932682a31b2 None admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:11:07.106115 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b4b741-2a09-47bb-b6e2-6932682a31b2 None admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:11:07.106485 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b4b741-2a09-47bb-b6e2-6932682a31b2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:11:07.106641 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f71692-41ad-436b-9d38-714aa458a46e None admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:11:07.113348 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 336/684] 10.222.0.21 () {56 vars in 1374 bytes} [Wed May 4 07:11:06 2022] GET /identity/v3/role_assignments?user.id=bb341257aa8246b6847561e2fe1fa385&scope.project.id=c9f9c44db4984653b8d4b5f6b3b949f5&role.id=14041215d0f7476a8e90241a49338706 => generated 608 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 07:11:07.114371 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f71692-41ad-436b-9d38-714aa458a46e None admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:11:07.124933 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b4b741-2a09-47bb-b6e2-6932682a31b2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:11:07.126517 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b4b741-2a09-47bb-b6e2-6932682a31b2 None admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:11:07.156816 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application [None req-e3b4b741-2a09-47bb-b6e2-6932682a31b2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 07:11:07.156816 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 07:11:07.156816 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 07:11:07.156816 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 07:11:07.156816 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 07:11:07.156816 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 07:11:07.156816 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 07:11:07.156816 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 07:11:07.156816 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 07:11:07.156816 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 07:11:07.156816 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 07:11:07.156816 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 07:11:07.156816 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 07:11:07.156816 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 07:11:07.156816 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 07:11:07.157911 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 07:11:07.157911 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 07:11:07.157911 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 07:11:07.157911 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 07:11:07.157911 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 07:11:07.157911 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 07:11:07.157911 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.get_or_create( May 04 07:11:07.157911 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 07:11:07.157911 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application with Lock( May 04 07:11:07.157911 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 07:11:07.157911 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self._enter() May 04 07:11:07.157911 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 07:11:07.157911 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 07:11:07.157911 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 07:11:07.157911 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.creator() May 04 07:11:07.157911 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 07:11:07.157911 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application created_value = creator( May 04 07:11:07.158857 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 07:11:07.158857 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 07:11:07.158857 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 07:11:07.158857 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application May 04 07:11:07.165097 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 349/685] 10.222.0.21 () {56 vars in 1108 bytes} [Wed May 4 07:11:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 07:11:07.170653 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b4b741-2a09-47bb-b6e2-6932682a31b2 None admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:11:07.222925 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f71692-41ad-436b-9d38-714aa458a46e None admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:11:07.257737 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88bb41ec-b2fe-47ff-b20f-7055aae8b15e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:11:07.258695 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bb41ec-b2fe-47ff-b20f-7055aae8b15e None admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:11:07.259112 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bb41ec-b2fe-47ff-b20f-7055aae8b15e None admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:11:07.259566 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bb41ec-b2fe-47ff-b20f-7055aae8b15e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:11:07.260676 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88bb41ec-b2fe-47ff-b20f-7055aae8b15e None admin] RBAC: Adding query filter params (role.id=14041215d0f7476a8e90241a49338706, scope.project.id=c9f9c44db4984653b8d4b5f6b3b949f5, user.id=91cb92d00273402b837cb29b37325101) {{(pid=79745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 07:11:07.261127 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88bb41ec-b2fe-47ff-b20f-7055aae8b15e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:11:07.263406 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88bb41ec-b2fe-47ff-b20f-7055aae8b15e None admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:11:07.270721 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 337/686] 10.222.0.21 () {56 vars in 1374 bytes} [Wed May 4 07:11:07 2022] GET /identity/v3/role_assignments?user.id=91cb92d00273402b837cb29b37325101&scope.project.id=c9f9c44db4984653b8d4b5f6b3b949f5&role.id=14041215d0f7476a8e90241a49338706 => generated 608 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 07:11:07.369723 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b4b741-2a09-47bb-b6e2-6932682a31b2 None admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:11:07.430201 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7f2af3-c951-48cc-95c4-20c6e261bc82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:11:07.430895 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7f2af3-c951-48cc-95c4-20c6e261bc82 None admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:11:07.431204 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7f2af3-c951-48cc-95c4-20c6e261bc82 None admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:11:07.431484 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7f2af3-c951-48cc-95c4-20c6e261bc82 None admin] PATH_INFO: `/v3/domains` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:11:07.432225 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7f2af3-c951-48cc-95c4-20c6e261bc82 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79744) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 07:11:07.432530 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7f2af3-c951-48cc-95c4-20c6e261bc82 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:11:07.434189 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7f2af3-c951-48cc-95c4-20c6e261bc82 None admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:11:07.453850 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 350/687] 10.222.0.21 () {56 vars in 1109 bytes} [Wed May 4 07:11:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 07:11:07.460486 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88bb41ec-b2fe-47ff-b20f-7055aae8b15e None admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:11:07.578850 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88bb41ec-b2fe-47ff-b20f-7055aae8b15e None admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:11:07.620359 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d29acd-5bb2-487f-aadc-4bd103aa2afe None None] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:11:07.621227 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d29acd-5bb2-487f-aadc-4bd103aa2afe None None] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:11:07.621548 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d29acd-5bb2-487f-aadc-4bd103aa2afe None None] PATH_INFO: `/` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:11:07.623034 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 351/688] 10.222.0.21 () {54 vars in 926 bytes} [Wed May 4 07:11:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 04 07:11:07.624706 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c25ce7-94af-43d5-b1c2-2600589c36d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:11:07.625505 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c25ce7-94af-43d5-b1c2-2600589c36d5 None admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:11:07.625780 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c25ce7-94af-43d5-b1c2-2600589c36d5 None admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:11:07.626046 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c25ce7-94af-43d5-b1c2-2600589c36d5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:11:07.628342 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765cbbca-b70d-4cc7-9265-502eaccadf58 None None] REQUEST_METHOD: `POST` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:11:07.628625 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765cbbca-b70d-4cc7-9265-502eaccadf58 None None] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:11:07.628897 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765cbbca-b70d-4cc7-9265-502eaccadf58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:11:07.641217 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c25ce7-94af-43d5-b1c2-2600589c36d5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:11:07.643898 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c25ce7-94af-43d5-b1c2-2600589c36d5 None admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:11:07.651410 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.auth.core [None req-765cbbca-b70d-4cc7-9265-502eaccadf58 None None] MFA Rules not processed for user `83c5e0dcb991496ea6dee38384514508`. Rule list: `[]` (Enabled: `True`). {{(pid=79744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:11:07.653328 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.fernet_utils [None req-765cbbca-b70d-4cc7-9265-502eaccadf58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:11:07.662946 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application [None req-78c25ce7-94af-43d5-b1c2-2600589c36d5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 04 07:11:07.662946 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 07:11:07.662946 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 07:11:07.662946 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 07:11:07.662946 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 07:11:07.662946 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 07:11:07.662946 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 07:11:07.662946 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 07:11:07.662946 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 07:11:07.662946 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 07:11:07.662946 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 07:11:07.662946 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 07:11:07.662946 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 04 07:11:07.662946 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self._get_project(project_id) May 04 07:11:07.662946 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 04 07:11:07.663988 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 04 07:11:07.663988 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 07:11:07.663988 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 07:11:07.663988 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 07:11:07.663988 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 07:11:07.663988 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 07:11:07.663988 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self.get_or_create( May 04 07:11:07.663988 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 07:11:07.663988 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application with Lock( May 04 07:11:07.663988 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 07:11:07.663988 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self._enter() May 04 07:11:07.663988 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 07:11:07.663988 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 07:11:07.663988 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 07:11:07.663988 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self.creator() May 04 07:11:07.663988 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 07:11:07.663988 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application created_value = creator( May 04 07:11:07.664911 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 04 07:11:07.664911 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 04 07:11:07.664911 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 04 07:11:07.664911 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 04 07:11:07.664911 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 04 07:11:07.664911 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 04 07:11:07.664911 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 04 07:11:07.664911 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application May 04 07:11:07.665369 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 338/689] 10.222.0.21 () {56 vars in 1111 bytes} [Wed May 4 07:11:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 07:11:07.672432 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c25ce7-94af-43d5-b1c2-2600589c36d5 None admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:11:07.748857 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 352/690] 10.222.0.21 () {58 vars in 1023 bytes} [Wed May 4 07:11:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 04 07:11:07.784303 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765cbbca-b70d-4cc7-9265-502eaccadf58 None None] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:11:07.784977 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c25ce7-94af-43d5-b1c2-2600589c36d5 None admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:11:07.821546 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08262593-340a-422a-bf0f-bffb9c11bd4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:11:07.822205 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08262593-340a-422a-bf0f-bffb9c11bd4f None admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:11:07.822561 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08262593-340a-422a-bf0f-bffb9c11bd4f None admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:11:07.822753 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08262593-340a-422a-bf0f-bffb9c11bd4f None admin] PATH_INFO: `/v3/projects` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:11:07.823576 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08262593-340a-422a-bf0f-bffb9c11bd4f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 07:11:07.824756 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08262593-340a-422a-bf0f-bffb9c11bd4f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:11:07.826600 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08262593-340a-422a-bf0f-bffb9c11bd4f None admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:11:07.838799 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 339/691] 10.222.0.21 () {56 vars in 1148 bytes} [Wed May 4 07:11:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 07:11:07.851201 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08262593-340a-422a-bf0f-bffb9c11bd4f None admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:11:07.929055 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765cbbca-b70d-4cc7-9265-502eaccadf58 None None] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:11:07.949912 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08262593-340a-422a-bf0f-bffb9c11bd4f None admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:11:07.964229 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68919da8-1325-4fbe-a0ef-3c0d476cca4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:11:07.965990 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68919da8-1325-4fbe-a0ef-3c0d476cca4f None admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:11:07.966410 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68919da8-1325-4fbe-a0ef-3c0d476cca4f None admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:11:07.966880 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68919da8-1325-4fbe-a0ef-3c0d476cca4f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:11:07.977093 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68919da8-1325-4fbe-a0ef-3c0d476cca4f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 07:11:07.984854 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b4f030-2202-47c1-a554-77a66ea3ec46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:11:07.985506 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b4f030-2202-47c1-a554-77a66ea3ec46 None admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:11:07.985784 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b4f030-2202-47c1-a554-77a66ea3ec46 None admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:11:07.986060 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b4f030-2202-47c1-a554-77a66ea3ec46 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:11:07.986203 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application [None req-68919da8-1325-4fbe-a0ef-3c0d476cca4f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 04 07:11:07.986203 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 07:11:07.986203 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 07:11:07.986203 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 07:11:07.986203 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 07:11:07.986203 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 07:11:07.986203 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 07:11:07.986203 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 07:11:07.986203 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 07:11:07.986203 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 07:11:07.986203 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 07:11:07.986203 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 07:11:07.986203 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 07:11:07.986203 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 07:11:07.986203 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 07:11:07.986203 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 07:11:07.987321 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 07:11:07.987321 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 07:11:07.987321 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 07:11:07.987321 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 07:11:07.987321 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 07:11:07.987321 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 07:11:07.987321 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 07:11:07.987321 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 07:11:07.987321 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 07:11:07.987321 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.get_or_create( May 04 07:11:07.987321 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 07:11:07.987321 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application with Lock( May 04 07:11:07.987321 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 07:11:07.987321 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self._enter() May 04 07:11:07.987321 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 07:11:07.987321 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 07:11:07.988366 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 07:11:07.988366 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.creator() May 04 07:11:07.988366 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 07:11:07.988366 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application created_value = creator( May 04 07:11:07.988366 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 07:11:07.988366 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 07:11:07.988366 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 07:11:07.988366 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 07:11:07.988366 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 07:11:07.988366 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 07:11:07.988366 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 04 07:11:07.988366 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application May 04 07:11:07.989055 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b4f030-2202-47c1-a554-77a66ea3ec46 None admin] RBAC: Adding query filter params (role.id=14041215d0f7476a8e90241a49338706, scope.project.id=c9f9c44db4984653b8d4b5f6b3b949f5, user.id=084c9245d1da4e698c9c3945fa089e85) {{(pid=79745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 07:11:07.989055 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b4f030-2202-47c1-a554-77a66ea3ec46 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:11:07.989055 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b4f030-2202-47c1-a554-77a66ea3ec46 None admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:11:07.995557 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 353/693] 10.222.0.21 () {56 vars in 1096 bytes} [Wed May 4 07:11:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 07:11:07.997193 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbc25a3-0810-4f95-ab77-69be2d9785d2 None None] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:11:07.997636 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbc25a3-0810-4f95-ab77-69be2d9785d2 None None] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:11:07.998053 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbc25a3-0810-4f95-ab77-69be2d9785d2 None None] PATH_INFO: `/` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:11:08.000016 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 354/694] 10.222.0.21 () {54 vars in 926 bytes} [Wed May 4 07:11:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 07:11:08.000907 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbc25a3-0810-4f95-ab77-69be2d9785d2 None None] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:11:08.005259 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 340/694] 10.222.0.21 () {56 vars in 1374 bytes} [Wed May 4 07:11:07 2022] GET /identity/v3/role_assignments?user.id=084c9245d1da4e698c9c3945fa089e85&scope.project.id=c9f9c44db4984653b8d4b5f6b3b949f5&role.id=14041215d0f7476a8e90241a49338706 => generated 608 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 07:11:08.007443 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fbfc3a-f647-42c3-ba9c-c5d765488be6 None None] REQUEST_METHOD: `POST` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:11:08.007736 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fbfc3a-f647-42c3-ba9c-c5d765488be6 None None] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:11:08.008015 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fbfc3a-f647-42c3-ba9c-c5d765488be6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:11:08.044653 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.auth.core [None req-52fbfc3a-f647-42c3-ba9c-c5d765488be6 None None] MFA Rules not processed for user `83c5e0dcb991496ea6dee38384514508`. Rule list: `[]` (Enabled: `True`). {{(pid=79745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:11:08.046340 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.fernet_utils [None req-52fbfc3a-f647-42c3-ba9c-c5d765488be6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:11:08.114097 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbc25a3-0810-4f95-ab77-69be2d9785d2 None None] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:11:08.150024 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63d8760-706e-4587-a675-b3234dcdc162 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:11:08.151119 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63d8760-706e-4587-a675-b3234dcdc162 None admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:11:08.151650 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63d8760-706e-4587-a675-b3234dcdc162 None admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:11:08.152266 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63d8760-706e-4587-a675-b3234dcdc162 None admin] PATH_INFO: `/v3/roles` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:11:08.153289 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63d8760-706e-4587-a675-b3234dcdc162 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79744) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 07:11:08.153797 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63d8760-706e-4587-a675-b3234dcdc162 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:11:08.155485 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63d8760-706e-4587-a675-b3234dcdc162 None admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:11:08.165949 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 355/695] 10.222.0.21 () {56 vars in 1099 bytes} [Wed May 4 07:11:08 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 07:11:08.172353 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63d8760-706e-4587-a675-b3234dcdc162 None admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:11:08.203281 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 341/696] 10.222.0.21 () {58 vars in 1023 bytes} [Wed May 4 07:11:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 07:11:08.256267 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52fbfc3a-f647-42c3-ba9c-c5d765488be6 None None] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:11:08.282814 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63d8760-706e-4587-a675-b3234dcdc162 None admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:11:08.328495 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36ed6cb-4737-4e04-8be0-d2a24cd6a367 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:11:08.329592 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36ed6cb-4737-4e04-8be0-d2a24cd6a367 None admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:11:08.329876 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36ed6cb-4737-4e04-8be0-d2a24cd6a367 None admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:11:08.330150 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36ed6cb-4737-4e04-8be0-d2a24cd6a367 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:11:08.344419 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36ed6cb-4737-4e04-8be0-d2a24cd6a367 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:11:08.346040 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36ed6cb-4737-4e04-8be0-d2a24cd6a367 None admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:11:08.370997 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application [None req-b36ed6cb-4737-4e04-8be0-d2a24cd6a367 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 07:11:08.370997 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 07:11:08.370997 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 07:11:08.370997 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 07:11:08.370997 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 07:11:08.370997 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 07:11:08.370997 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 07:11:08.370997 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 07:11:08.370997 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 07:11:08.370997 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 07:11:08.370997 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 07:11:08.370997 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 07:11:08.370997 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 07:11:08.370997 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 07:11:08.370997 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 07:11:08.372545 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 07:11:08.372545 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 07:11:08.372545 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 07:11:08.372545 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 07:11:08.372545 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 07:11:08.372545 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 07:11:08.372545 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.get_or_create( May 04 07:11:08.372545 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 07:11:08.372545 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application with Lock( May 04 07:11:08.372545 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 07:11:08.372545 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self._enter() May 04 07:11:08.372545 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 07:11:08.372545 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 07:11:08.372545 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 07:11:08.372545 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.creator() May 04 07:11:08.372545 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 07:11:08.372545 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application created_value = creator( May 04 07:11:08.373941 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 07:11:08.373941 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 07:11:08.373941 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 07:11:08.373941 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application May 04 07:11:08.373941 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 356/697] 10.222.0.21 () {56 vars in 1108 bytes} [Wed May 4 07:11:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 07:11:08.380575 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36ed6cb-4737-4e04-8be0-d2a24cd6a367 None admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:11:08.382212 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52fbfc3a-f647-42c3-ba9c-c5d765488be6 None None] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:11:08.426189 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730cbf02-5391-47a3-9c6f-737d1a25277c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:11:08.426979 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730cbf02-5391-47a3-9c6f-737d1a25277c None admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:11:08.427341 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730cbf02-5391-47a3-9c6f-737d1a25277c None admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:11:08.427613 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730cbf02-5391-47a3-9c6f-737d1a25277c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:11:08.441327 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730cbf02-5391-47a3-9c6f-737d1a25277c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:11:08.442791 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730cbf02-5391-47a3-9c6f-737d1a25277c None admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:11:08.465046 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application [None req-730cbf02-5391-47a3-9c6f-737d1a25277c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 07:11:08.465046 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 07:11:08.465046 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 07:11:08.465046 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 07:11:08.465046 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 07:11:08.465046 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 07:11:08.465046 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 07:11:08.465046 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 07:11:08.465046 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 07:11:08.465046 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 07:11:08.465046 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 07:11:08.465046 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 07:11:08.465046 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 07:11:08.465046 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 07:11:08.465046 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 07:11:08.465995 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 07:11:08.465995 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 07:11:08.465995 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 07:11:08.465995 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 07:11:08.465995 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 07:11:08.465995 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 07:11:08.465995 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self.get_or_create( May 04 07:11:08.465995 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 07:11:08.465995 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application with Lock( May 04 07:11:08.465995 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 07:11:08.465995 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self._enter() May 04 07:11:08.465995 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 07:11:08.465995 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 07:11:08.465995 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 07:11:08.465995 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self.creator() May 04 07:11:08.465995 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 07:11:08.465995 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application created_value = creator( May 04 07:11:08.466896 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 07:11:08.466896 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 07:11:08.466896 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 07:11:08.466896 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application May 04 07:11:08.471208 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 342/698] 10.222.0.21 () {56 vars in 1108 bytes} [Wed May 4 07:11:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 07:11:08.473001 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730cbf02-5391-47a3-9c6f-737d1a25277c None admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:11:08.507381 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36ed6cb-4737-4e04-8be0-d2a24cd6a367 None admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:11:08.548990 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8cb7f6-1465-4b1a-a2c1-68d28b9feb28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:11:08.549655 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8cb7f6-1465-4b1a-a2c1-68d28b9feb28 None admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:11:08.549933 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8cb7f6-1465-4b1a-a2c1-68d28b9feb28 None admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:11:08.550206 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8cb7f6-1465-4b1a-a2c1-68d28b9feb28 None admin] PATH_INFO: `/v3/domains` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:11:08.550929 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8cb7f6-1465-4b1a-a2c1-68d28b9feb28 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79744) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 07:11:08.551779 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8cb7f6-1465-4b1a-a2c1-68d28b9feb28 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:11:08.553665 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8cb7f6-1465-4b1a-a2c1-68d28b9feb28 None admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:11:08.571209 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 357/699] 10.222.0.21 () {56 vars in 1109 bytes} [Wed May 4 07:11:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 07:11:08.575031 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8cb7f6-1465-4b1a-a2c1-68d28b9feb28 None admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:11:08.602961 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730cbf02-5391-47a3-9c6f-737d1a25277c None admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:11:08.651930 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c72ef6-d59a-4205-9d8e-bcebdf9ece08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:11:08.652705 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c72ef6-d59a-4205-9d8e-bcebdf9ece08 None admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:11:08.653102 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c72ef6-d59a-4205-9d8e-bcebdf9ece08 None admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:11:08.653281 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c72ef6-d59a-4205-9d8e-bcebdf9ece08 None admin] PATH_INFO: `/v3/domains` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:11:08.653954 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c72ef6-d59a-4205-9d8e-bcebdf9ece08 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 07:11:08.654254 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c72ef6-d59a-4205-9d8e-bcebdf9ece08 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:11:08.655651 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c72ef6-d59a-4205-9d8e-bcebdf9ece08 None admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:11:08.672840 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 343/700] 10.222.0.21 () {56 vars in 1109 bytes} [Wed May 4 07:11:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 07:11:08.674078 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c72ef6-d59a-4205-9d8e-bcebdf9ece08 None admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:11:08.698249 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8cb7f6-1465-4b1a-a2c1-68d28b9feb28 None admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:11:08.741969 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2092b98-3f52-4673-a7f8-de57ffb7e6a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:11:08.743768 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2092b98-3f52-4673-a7f8-de57ffb7e6a3 None admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:11:08.744194 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2092b98-3f52-4673-a7f8-de57ffb7e6a3 None admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:11:08.744628 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2092b98-3f52-4673-a7f8-de57ffb7e6a3 None admin] PATH_INFO: `/v3/users/nova` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:11:08.754010 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2092b98-3f52-4673-a7f8-de57ffb7e6a3 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:11:08.756249 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2092b98-3f52-4673-a7f8-de57ffb7e6a3 None admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:11:08.772388 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c72ef6-d59a-4205-9d8e-bcebdf9ece08 None admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:11:08.775642 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application [None req-e2092b98-3f52-4673-a7f8-de57ffb7e6a3 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 04 07:11:08.775642 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 07:11:08.775642 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 07:11:08.775642 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 07:11:08.775642 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 07:11:08.775642 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 07:11:08.775642 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 07:11:08.775642 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 07:11:08.775642 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 07:11:08.775642 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 07:11:08.775642 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 07:11:08.775642 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 07:11:08.775642 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 04 07:11:08.775642 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self._get_user(user_id) May 04 07:11:08.775642 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 04 07:11:08.775642 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 04 07:11:08.776742 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 07:11:08.776742 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 07:11:08.776742 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 04 07:11:08.776742 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 07:11:08.776742 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 04 07:11:08.776742 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 07:11:08.776742 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 07:11:08.776742 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 07:11:08.776742 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 07:11:08.776742 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.get_or_create( May 04 07:11:08.776742 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 07:11:08.776742 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application with Lock( May 04 07:11:08.776742 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 07:11:08.776742 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self._enter() May 04 07:11:08.776742 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 07:11:08.776742 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 07:11:08.776742 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 07:11:08.776742 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.creator() May 04 07:11:08.777938 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 07:11:08.777938 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application created_value = creator( May 04 07:11:08.777938 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 04 07:11:08.777938 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 04 07:11:08.777938 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 04 07:11:08.777938 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 04 07:11:08.777938 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 04 07:11:08.777938 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 04 07:11:08.777938 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 04 07:11:08.777938 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application May 04 07:11:08.780238 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 358/701] 10.222.0.21 () {56 vars in 1093 bytes} [Wed May 4 07:11:08 2022] GET /identity/v3/users/nova => generated 82 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 07:11:08.785792 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2092b98-3f52-4673-a7f8-de57ffb7e6a3 None admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:11:08.810664 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ff07be-fc92-40a4-828f-44801b0ff496 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:11:08.811569 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ff07be-fc92-40a4-828f-44801b0ff496 None admin] REQUEST_METHOD: `POST` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:11:08.811971 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ff07be-fc92-40a4-828f-44801b0ff496 None admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:11:08.812408 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ff07be-fc92-40a4-828f-44801b0ff496 None admin] PATH_INFO: `/v3/users` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:11:08.813214 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ff07be-fc92-40a4-828f-44801b0ff496 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:11:08.814695 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ff07be-fc92-40a4-828f-44801b0ff496 None admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:11:08.843403 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 344/702] 10.222.0.21 () {60 vars in 1132 bytes} [Wed May 4 07:11:08 2022] POST /identity/v3/users => generated 254 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 07:11:08.924301 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2092b98-3f52-4673-a7f8-de57ffb7e6a3 None admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:11:08.968428 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de6e43a-0565-4b47-9edc-50c7693f7916 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:11:08.969394 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de6e43a-0565-4b47-9edc-50c7693f7916 None admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:11:08.969861 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de6e43a-0565-4b47-9edc-50c7693f7916 None admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:11:08.970273 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de6e43a-0565-4b47-9edc-50c7693f7916 None admin] PATH_INFO: `/v3/users` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:11:08.971280 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de6e43a-0565-4b47-9edc-50c7693f7916 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79744) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 07:11:08.971751 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de6e43a-0565-4b47-9edc-50c7693f7916 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:11:08.973359 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de6e43a-0565-4b47-9edc-50c7693f7916 None admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:11:09.000644 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 359/703] 10.222.0.21 () {56 vars in 1133 bytes} [Wed May 4 07:11:08 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 07:11:09.006463 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ff07be-fc92-40a4-828f-44801b0ff496 None admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:11:09.121763 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ff07be-fc92-40a4-828f-44801b0ff496 None admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:11:09.155519 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744f9f8f-68a4-4c82-9e40-2dfef91ac797 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:11:09.156160 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744f9f8f-68a4-4c82-9e40-2dfef91ac797 None admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:11:09.156433 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744f9f8f-68a4-4c82-9e40-2dfef91ac797 None admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:11:09.156700 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744f9f8f-68a4-4c82-9e40-2dfef91ac797 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:11:09.224936 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744f9f8f-68a4-4c82-9e40-2dfef91ac797 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:11:09.226302 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744f9f8f-68a4-4c82-9e40-2dfef91ac797 None admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:11:09.324216 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 345/704] 10.222.0.21 () {58 vars in 1282 bytes} [Wed May 4 07:11:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 04 07:11:09.330197 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de6e43a-0565-4b47-9edc-50c7693f7916 None admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:11:09.434511 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de6e43a-0565-4b47-9edc-50c7693f7916 None admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:11:09.479297 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb6efc3-33e2-4179-acd0-ac82807eabe1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:11:09.480601 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb6efc3-33e2-4179-acd0-ac82807eabe1 None admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:11:09.480874 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb6efc3-33e2-4179-acd0-ac82807eabe1 None admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:11:09.481141 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb6efc3-33e2-4179-acd0-ac82807eabe1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:11:09.493784 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb6efc3-33e2-4179-acd0-ac82807eabe1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:11:09.495258 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb6efc3-33e2-4179-acd0-ac82807eabe1 None admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:11:09.524298 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application [None req-5cb6efc3-33e2-4179-acd0-ac82807eabe1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 07:11:09.524298 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 07:11:09.524298 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 07:11:09.524298 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 07:11:09.524298 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 07:11:09.524298 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 07:11:09.524298 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 07:11:09.524298 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 07:11:09.524298 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 07:11:09.524298 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 07:11:09.524298 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 07:11:09.524298 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 07:11:09.524298 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 07:11:09.524298 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 07:11:09.524298 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 07:11:09.525288 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 07:11:09.525288 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 07:11:09.525288 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 07:11:09.525288 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 07:11:09.525288 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 07:11:09.525288 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 07:11:09.525288 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.get_or_create( May 04 07:11:09.525288 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 07:11:09.525288 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application with Lock( May 04 07:11:09.525288 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 07:11:09.525288 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self._enter() May 04 07:11:09.525288 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 07:11:09.525288 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 07:11:09.525288 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 07:11:09.525288 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.creator() May 04 07:11:09.525288 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 07:11:09.525288 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application created_value = creator( May 04 07:11:09.527298 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 07:11:09.527298 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 07:11:09.527298 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 07:11:09.527298 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application May 04 07:11:09.527298 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 360/705] 10.222.0.21 () {56 vars in 1108 bytes} [Wed May 4 07:11:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 07:11:09.531928 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744f9f8f-68a4-4c82-9e40-2dfef91ac797 None admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:11:09.656348 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744f9f8f-68a4-4c82-9e40-2dfef91ac797 None admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:11:09.690916 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df8f96c-2803-4e25-8fa7-69ffbec05056 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:11:09.691986 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df8f96c-2803-4e25-8fa7-69ffbec05056 None admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:11:09.692493 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df8f96c-2803-4e25-8fa7-69ffbec05056 None admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:11:09.692966 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df8f96c-2803-4e25-8fa7-69ffbec05056 None admin] PATH_INFO: `/v3/domains` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:11:09.693881 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df8f96c-2803-4e25-8fa7-69ffbec05056 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 07:11:09.694403 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df8f96c-2803-4e25-8fa7-69ffbec05056 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:11:09.695972 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df8f96c-2803-4e25-8fa7-69ffbec05056 None admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:11:09.708155 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 346/706] 10.222.0.21 () {56 vars in 1109 bytes} [Wed May 4 07:11:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 07:11:09.715182 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb6efc3-33e2-4179-acd0-ac82807eabe1 None admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:11:09.859974 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb6efc3-33e2-4179-acd0-ac82807eabe1 None admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:11:09.904023 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056d47e9-4d6f-4403-beae-089ae41e4d11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:11:09.905236 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056d47e9-4d6f-4403-beae-089ae41e4d11 None admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:11:09.905743 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056d47e9-4d6f-4403-beae-089ae41e4d11 None admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:11:09.906215 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056d47e9-4d6f-4403-beae-089ae41e4d11 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:11:09.918424 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056d47e9-4d6f-4403-beae-089ae41e4d11 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:11:09.919914 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056d47e9-4d6f-4403-beae-089ae41e4d11 None admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:11:09.938671 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application [None req-056d47e9-4d6f-4403-beae-089ae41e4d11 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 04 07:11:09.938671 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 07:11:09.938671 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 07:11:09.938671 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 07:11:09.938671 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 07:11:09.938671 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 07:11:09.938671 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 07:11:09.938671 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 07:11:09.938671 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 07:11:09.938671 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 07:11:09.938671 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 07:11:09.938671 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 07:11:09.938671 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 04 07:11:09.938671 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self._get_project(project_id) May 04 07:11:09.938671 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 04 07:11:09.939679 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 04 07:11:09.939679 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 07:11:09.939679 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 07:11:09.939679 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 07:11:09.939679 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 07:11:09.939679 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 07:11:09.939679 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.get_or_create( May 04 07:11:09.939679 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 07:11:09.939679 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application with Lock( May 04 07:11:09.939679 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 07:11:09.939679 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self._enter() May 04 07:11:09.939679 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 07:11:09.939679 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 07:11:09.939679 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 07:11:09.939679 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.creator() May 04 07:11:09.939679 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 07:11:09.939679 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application created_value = creator( May 04 07:11:09.941682 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 04 07:11:09.941682 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 04 07:11:09.941682 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 04 07:11:09.941682 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 04 07:11:09.941682 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 04 07:11:09.941682 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 04 07:11:09.941682 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 04 07:11:09.941682 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application May 04 07:11:09.941682 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 361/707] 10.222.0.21 () {56 vars in 1111 bytes} [Wed May 4 07:11:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 07:11:09.946091 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df8f96c-2803-4e25-8fa7-69ffbec05056 None admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:11:10.015021 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4166cefc-8d72-49e0-a200-ec32456e91a3 None None] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:11:10.015376 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4166cefc-8d72-49e0-a200-ec32456e91a3 None None] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:11:10.015593 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4166cefc-8d72-49e0-a200-ec32456e91a3 None None] PATH_INFO: `/` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:11:10.017025 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 362/708] 10.222.0.21 () {54 vars in 926 bytes} [Wed May 4 07:11:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 04 07:11:10.022009 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d8a635-afb4-4513-a3d2-933a2b6dd5b4 None None] REQUEST_METHOD: `POST` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:11:10.022294 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d8a635-afb4-4513-a3d2-933a2b6dd5b4 None None] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:11:10.022570 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d8a635-afb4-4513-a3d2-933a2b6dd5b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:11:10.045923 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.auth.core [None req-29d8a635-afb4-4513-a3d2-933a2b6dd5b4 None None] MFA Rules not processed for user `83c5e0dcb991496ea6dee38384514508`. Rule list: `[]` (Enabled: `True`). {{(pid=79744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:11:10.047089 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.fernet_utils [None req-29d8a635-afb4-4513-a3d2-933a2b6dd5b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:11:10.091809 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df8f96c-2803-4e25-8fa7-69ffbec05056 None admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:11:10.154997 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296649f4-bc6e-4f2d-8aed-68a97e2a46d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:11:10.155650 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296649f4-bc6e-4f2d-8aed-68a97e2a46d9 None admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:11:10.155929 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296649f4-bc6e-4f2d-8aed-68a97e2a46d9 None admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:11:10.156196 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296649f4-bc6e-4f2d-8aed-68a97e2a46d9 None admin] PATH_INFO: `/v3/projects` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:11:10.156984 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296649f4-bc6e-4f2d-8aed-68a97e2a46d9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 07:11:10.157288 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296649f4-bc6e-4f2d-8aed-68a97e2a46d9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:11:10.158705 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296649f4-bc6e-4f2d-8aed-68a97e2a46d9 None admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:11:10.179884 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 363/709] 10.222.0.21 () {58 vars in 1023 bytes} [Wed May 4 07:11:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 04 07:11:10.183609 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 347/710] 10.222.0.21 () {56 vars in 1148 bytes} [Wed May 4 07:11:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 07:11:10.185112 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab0c336-9c1d-4d85-9eb3-6a76300d0556 None None] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:11:10.185458 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab0c336-9c1d-4d85-9eb3-6a76300d0556 None None] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:11:10.185738 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab0c336-9c1d-4d85-9eb3-6a76300d0556 None None] PATH_INFO: `/` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:11:10.191643 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 364/711] 10.222.0.21 () {54 vars in 926 bytes} [Wed May 4 07:11:10 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 07:11:10.193290 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296649f4-bc6e-4f2d-8aed-68a97e2a46d9 None admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:11:10.199284 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b5d436-11ec-4fa6-baee-d2966f0563e2 None None] REQUEST_METHOD: `POST` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:11:10.199871 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b5d436-11ec-4fa6-baee-d2966f0563e2 None None] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:11:10.200353 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b5d436-11ec-4fa6-baee-d2966f0563e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:11:10.218427 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.auth.core [None req-91b5d436-11ec-4fa6-baee-d2966f0563e2 None None] MFA Rules not processed for user `83c5e0dcb991496ea6dee38384514508`. Rule list: `[]` (Enabled: `True`). {{(pid=79744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:11:10.219950 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.fernet_utils [None req-91b5d436-11ec-4fa6-baee-d2966f0563e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:11:10.302336 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 365/712] 10.222.0.21 () {58 vars in 1023 bytes} [Wed May 4 07:11:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 07:11:10.303209 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b5d436-11ec-4fa6-baee-d2966f0563e2 None None] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:11:10.303439 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296649f4-bc6e-4f2d-8aed-68a97e2a46d9 None admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:11:10.345831 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d989755-d959-4b1d-a167-584851e4ea85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:11:10.347327 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d989755-d959-4b1d-a167-584851e4ea85 None admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:11:10.347849 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d989755-d959-4b1d-a167-584851e4ea85 None admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:11:10.348712 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d989755-d959-4b1d-a167-584851e4ea85 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:11:10.350070 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d989755-d959-4b1d-a167-584851e4ea85 None admin] RBAC: Adding query filter params (role.id=eb54c9cea2774a25b1fe8c79724408ee, scope.project.id=c9f9c44db4984653b8d4b5f6b3b949f5, user.id=1077289fedae43b6be47be7f716d573a) {{(pid=79745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 07:11:10.350891 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d989755-d959-4b1d-a167-584851e4ea85 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:11:10.352967 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d989755-d959-4b1d-a167-584851e4ea85 None admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:11:10.361127 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 348/713] 10.222.0.21 () {56 vars in 1374 bytes} [Wed May 4 07:11:10 2022] GET /identity/v3/role_assignments?user.id=1077289fedae43b6be47be7f716d573a&scope.project.id=c9f9c44db4984653b8d4b5f6b3b949f5&role.id=eb54c9cea2774a25b1fe8c79724408ee => generated 259 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 07:11:10.367381 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d989755-d959-4b1d-a167-584851e4ea85 None admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:11:10.460227 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b5d436-11ec-4fa6-baee-d2966f0563e2 None None] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:11:10.515972 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e1b5e7-574a-464d-a435-428ad7496932 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:11:10.522151 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e1b5e7-574a-464d-a435-428ad7496932 None admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:11:10.522808 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e1b5e7-574a-464d-a435-428ad7496932 None admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:11:10.523322 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e1b5e7-574a-464d-a435-428ad7496932 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:11:10.524219 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e1b5e7-574a-464d-a435-428ad7496932 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:11:10.525858 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e1b5e7-574a-464d-a435-428ad7496932 None admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:11:10.546698 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application [None req-33e1b5e7-574a-464d-a435-428ad7496932 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. May 04 07:11:10.546698 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 07:11:10.546698 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 04 07:11:10.546698 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 04 07:11:10.546698 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 04 07:11:10.546698 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 04 07:11:10.546698 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 04 07:11:10.546698 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 07:11:10.546698 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 04 07:11:10.546698 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application May 04 07:11:10.546698 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 04 07:11:10.546698 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application May 04 07:11:10.546698 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 07:11:10.546698 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 07:11:10.546698 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 07:11:10.546698 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 07:11:10.547794 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 07:11:10.547794 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 07:11:10.547794 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 07:11:10.547794 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 07:11:10.547794 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 07:11:10.547794 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 07:11:10.547794 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 07:11:10.547794 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 04 07:11:10.547794 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self._get_service(service_id) May 04 07:11:10.547794 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 04 07:11:10.547794 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 04 07:11:10.547794 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 07:11:10.547794 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 07:11:10.547794 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 07:11:10.547794 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 07:11:10.547794 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 07:11:10.548653 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.get_or_create( May 04 07:11:10.548653 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 07:11:10.548653 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application with Lock( May 04 07:11:10.548653 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 07:11:10.548653 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self._enter() May 04 07:11:10.548653 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 07:11:10.548653 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 07:11:10.548653 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 07:11:10.548653 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.creator() May 04 07:11:10.548653 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 07:11:10.548653 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application created_value = creator( May 04 07:11:10.548653 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 04 07:11:10.548653 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 07:11:10.548653 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 04 07:11:10.548653 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application May 04 07:11:10.563737 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 366/714] 10.222.0.21 () {56 vars in 1129 bytes} [Wed May 4 07:11:10 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 07:11:10.568402 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e1b5e7-574a-464d-a435-428ad7496932 None admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:11:10.587160 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d989755-d959-4b1d-a167-584851e4ea85 None admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:11:10.630137 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb6eab9-5d6d-4511-acfb-abae303b845b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:11:10.631481 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb6eab9-5d6d-4511-acfb-abae303b845b None admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:11:10.632225 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb6eab9-5d6d-4511-acfb-abae303b845b None admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:11:10.632703 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb6eab9-5d6d-4511-acfb-abae303b845b None admin] PATH_INFO: `/v3/services/network` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:11:10.633960 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb6eab9-5d6d-4511-acfb-abae303b845b None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:11:10.635558 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb6eab9-5d6d-4511-acfb-abae303b845b None admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:11:10.650991 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application [None req-3eb6eab9-5d6d-4511-acfb-abae303b845b None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. May 04 07:11:10.650991 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 07:11:10.650991 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 04 07:11:10.650991 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 04 07:11:10.650991 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 04 07:11:10.650991 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 04 07:11:10.650991 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 04 07:11:10.650991 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 07:11:10.650991 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 04 07:11:10.650991 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application May 04 07:11:10.650991 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 04 07:11:10.650991 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application May 04 07:11:10.650991 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 07:11:10.650991 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 07:11:10.650991 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 07:11:10.650991 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 07:11:10.650991 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 07:11:10.653022 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 07:11:10.653022 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 07:11:10.653022 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 07:11:10.653022 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 07:11:10.653022 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 07:11:10.653022 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 07:11:10.653022 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 04 07:11:10.653022 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self._get_service(service_id) May 04 07:11:10.653022 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 04 07:11:10.653022 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 04 07:11:10.653022 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 07:11:10.653022 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 07:11:10.653022 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 07:11:10.653022 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 07:11:10.653022 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 07:11:10.653022 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self.get_or_create( May 04 07:11:10.653875 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 07:11:10.653875 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application with Lock( May 04 07:11:10.653875 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 07:11:10.653875 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self._enter() May 04 07:11:10.653875 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 07:11:10.653875 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 07:11:10.653875 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 07:11:10.653875 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self.creator() May 04 07:11:10.653875 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 07:11:10.653875 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application created_value = creator( May 04 07:11:10.653875 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 04 07:11:10.653875 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 07:11:10.653875 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 04 07:11:10.653875 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application May 04 07:11:10.657961 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 349/715] 10.222.0.21 () {56 vars in 1111 bytes} [Wed May 4 07:11:10 2022] GET /identity/v3/services/network => generated 88 bytes in 296 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 07:11:10.663610 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb6eab9-5d6d-4511-acfb-abae303b845b None admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:11:10.779235 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb6eab9-5d6d-4511-acfb-abae303b845b None admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:11:10.785127 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e1b5e7-574a-464d-a435-428ad7496932 None admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:11:10.817214 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51a7cf3-d9da-40dc-bba5-6473d14e5f2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:11:10.818250 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51a7cf3-d9da-40dc-bba5-6473d14e5f2b None admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:11:10.818753 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51a7cf3-d9da-40dc-bba5-6473d14e5f2b None admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:11:10.819261 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51a7cf3-d9da-40dc-bba5-6473d14e5f2b None admin] PATH_INFO: `/v3/services` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:11:10.820480 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51a7cf3-d9da-40dc-bba5-6473d14e5f2b None admin] RBAC: Adding query filter params (name=network) {{(pid=79745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 07:11:10.820995 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51a7cf3-d9da-40dc-bba5-6473d14e5f2b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:11:10.822592 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51a7cf3-d9da-40dc-bba5-6473d14e5f2b None admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:11:10.828850 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 350/716] 10.222.0.21 () {56 vars in 1112 bytes} [Wed May 4 07:11:10 2022] GET /identity/v3/services?name=network => generated 124 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 07:11:10.834026 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51a7cf3-d9da-40dc-bba5-6473d14e5f2b None admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:11:10.868769 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a862b14c-5f13-428c-89a4-95a24803fcb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:11:10.869446 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a862b14c-5f13-428c-89a4-95a24803fcb6 None admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:11:10.869732 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a862b14c-5f13-428c-89a4-95a24803fcb6 None admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:11:10.870006 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a862b14c-5f13-428c-89a4-95a24803fcb6 None admin] PATH_INFO: `/v3/services` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:11:10.871352 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a862b14c-5f13-428c-89a4-95a24803fcb6 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=79744) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 07:11:10.871847 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a862b14c-5f13-428c-89a4-95a24803fcb6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:11:10.873220 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a862b14c-5f13-428c-89a4-95a24803fcb6 None admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:11:10.889405 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 367/717] 10.222.0.21 () {56 vars in 1124 bytes} [Wed May 4 07:11:10 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 321 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 07:11:10.894305 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a862b14c-5f13-428c-89a4-95a24803fcb6 None admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:11:10.944712 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51a7cf3-d9da-40dc-bba5-6473d14e5f2b None admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:11:10.995641 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b00acdf-1b8a-4743-b695-91a562b7dc49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:11:10.996319 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b00acdf-1b8a-4743-b695-91a562b7dc49 None admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:11:10.996789 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b00acdf-1b8a-4743-b695-91a562b7dc49 None admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:11:10.997063 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b00acdf-1b8a-4743-b695-91a562b7dc49 None admin] PATH_INFO: `/v3/services` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:11:10.997782 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b00acdf-1b8a-4743-b695-91a562b7dc49 None admin] RBAC: Adding query filter params (type=network) {{(pid=79745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 07:11:10.998089 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b00acdf-1b8a-4743-b695-91a562b7dc49 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:11:10.999535 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b00acdf-1b8a-4743-b695-91a562b7dc49 None admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:11:11.006463 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 351/718] 10.222.0.21 () {56 vars in 1112 bytes} [Wed May 4 07:11:10 2022] GET /identity/v3/services?type=network => generated 124 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 07:11:11.054563 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a862b14c-5f13-428c-89a4-95a24803fcb6 None admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:11:11.091960 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a45e01-b296-4f5d-b634-d5eb508683ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:11:11.092881 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a45e01-b296-4f5d-b634-d5eb508683ca None admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:11:11.093312 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a45e01-b296-4f5d-b634-d5eb508683ca None admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:11:11.093790 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a45e01-b296-4f5d-b634-d5eb508683ca None admin] PATH_INFO: `/v3/services` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:11:11.094647 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a45e01-b296-4f5d-b634-d5eb508683ca None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=79744) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 07:11:11.095098 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a45e01-b296-4f5d-b634-d5eb508683ca None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:11:11.096630 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a45e01-b296-4f5d-b634-d5eb508683ca None admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:11:11.103262 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 368/719] 10.222.0.21 () {56 vars in 1124 bytes} [Wed May 4 07:11:10 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 07:11:11.235847 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fae8d0-b872-4d51-8d5e-2ce4db62696a None None] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:11:11.236712 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fae8d0-b872-4d51-8d5e-2ce4db62696a None None] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:11:11.237147 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fae8d0-b872-4d51-8d5e-2ce4db62696a None None] PATH_INFO: `/` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:11:11.238658 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 352/720] 10.222.0.21 () {54 vars in 926 bytes} [Wed May 4 07:11:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 07:11:11.246265 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9619da87-52db-4c47-9a09-ae6ad247a7a5 None None] REQUEST_METHOD: `POST` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:11:11.246810 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9619da87-52db-4c47-9a09-ae6ad247a7a5 None None] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:11:11.247286 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9619da87-52db-4c47-9a09-ae6ad247a7a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:11:11.270384 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.auth.core [None req-9619da87-52db-4c47-9a09-ae6ad247a7a5 None None] MFA Rules not processed for user `83c5e0dcb991496ea6dee38384514508`. Rule list: `[]` (Enabled: `True`). {{(pid=79744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:11:11.271860 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.fernet_utils [None req-9619da87-52db-4c47-9a09-ae6ad247a7a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:11:11.347757 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 369/721] 10.222.0.21 () {58 vars in 1023 bytes} [Wed May 4 07:11:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 07:11:11.383187 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66fae8d0-b872-4d51-8d5e-2ce4db62696a None None] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:11:11.523082 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66fae8d0-b872-4d51-8d5e-2ce4db62696a None None] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:11:11.572380 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559865a5-7662-45dd-b1bf-4d6c0a4b0302 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:11:11.573571 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559865a5-7662-45dd-b1bf-4d6c0a4b0302 None admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:11:11.574160 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559865a5-7662-45dd-b1bf-4d6c0a4b0302 None admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:11:11.574636 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559865a5-7662-45dd-b1bf-4d6c0a4b0302 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:11:11.587859 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559865a5-7662-45dd-b1bf-4d6c0a4b0302 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 07:11:11.596149 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application [None req-559865a5-7662-45dd-b1bf-4d6c0a4b0302 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 04 07:11:11.596149 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 07:11:11.596149 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 07:11:11.596149 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 07:11:11.596149 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 07:11:11.596149 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 07:11:11.596149 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 07:11:11.596149 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 07:11:11.596149 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 07:11:11.596149 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 07:11:11.596149 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 07:11:11.596149 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 07:11:11.596149 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 07:11:11.596149 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 07:11:11.596149 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 07:11:11.596149 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 07:11:11.597088 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 07:11:11.597088 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 07:11:11.597088 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 07:11:11.597088 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 07:11:11.597088 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 07:11:11.597088 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 07:11:11.597088 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 07:11:11.597088 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 07:11:11.597088 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 07:11:11.597088 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self.get_or_create( May 04 07:11:11.597088 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 07:11:11.597088 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application with Lock( May 04 07:11:11.597088 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 07:11:11.597088 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self._enter() May 04 07:11:11.597088 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 07:11:11.597088 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 07:11:11.598047 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 07:11:11.598047 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self.creator() May 04 07:11:11.598047 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 07:11:11.598047 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application created_value = creator( May 04 07:11:11.598047 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 07:11:11.598047 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 07:11:11.598047 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 07:11:11.598047 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 07:11:11.598047 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 07:11:11.598047 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 07:11:11.598047 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 04 07:11:11.598047 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application May 04 07:11:11.601477 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 353/722] 10.222.0.21 () {56 vars in 1096 bytes} [Wed May 4 07:11:11 2022] GET /identity/v3/roles/admin => generated 83 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 07:11:11.608283 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9619da87-52db-4c47-9a09-ae6ad247a7a5 None None] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:11:11.772532 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9619da87-52db-4c47-9a09-ae6ad247a7a5 None None] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:11:11.814092 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690a1a21-aa9c-4c3d-ba0e-bd6133976ed0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:11:11.814785 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690a1a21-aa9c-4c3d-ba0e-bd6133976ed0 None admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:11:11.815062 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690a1a21-aa9c-4c3d-ba0e-bd6133976ed0 None admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:11:11.815359 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690a1a21-aa9c-4c3d-ba0e-bd6133976ed0 None admin] PATH_INFO: `/v3/roles` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:11:11.816120 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690a1a21-aa9c-4c3d-ba0e-bd6133976ed0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79744) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 07:11:11.816424 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690a1a21-aa9c-4c3d-ba0e-bd6133976ed0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:11:11.817888 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690a1a21-aa9c-4c3d-ba0e-bd6133976ed0 None admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:11:11.828597 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 370/723] 10.222.0.21 () {56 vars in 1099 bytes} [Wed May 4 07:11:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 07:11:11.834040 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559865a5-7662-45dd-b1bf-4d6c0a4b0302 None admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:11:11.976052 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559865a5-7662-45dd-b1bf-4d6c0a4b0302 None admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:11:12.016558 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01787fe-1cc7-4c6a-b56b-df430f001b70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:11:12.017734 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01787fe-1cc7-4c6a-b56b-df430f001b70 None admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:11:12.018240 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01787fe-1cc7-4c6a-b56b-df430f001b70 None admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:11:12.018720 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01787fe-1cc7-4c6a-b56b-df430f001b70 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:11:12.033338 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01787fe-1cc7-4c6a-b56b-df430f001b70 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:11:12.035110 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01787fe-1cc7-4c6a-b56b-df430f001b70 None admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:11:12.052991 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application [None req-b01787fe-1cc7-4c6a-b56b-df430f001b70 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 07:11:12.052991 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 07:11:12.052991 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 07:11:12.052991 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 07:11:12.052991 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 07:11:12.052991 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 07:11:12.052991 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 07:11:12.052991 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 07:11:12.052991 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 07:11:12.052991 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 07:11:12.052991 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 07:11:12.052991 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 07:11:12.052991 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 07:11:12.052991 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 07:11:12.052991 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 07:11:12.053925 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 07:11:12.053925 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 07:11:12.053925 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 07:11:12.053925 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 07:11:12.053925 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 07:11:12.053925 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 07:11:12.053925 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self.get_or_create( May 04 07:11:12.053925 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 07:11:12.053925 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application with Lock( May 04 07:11:12.053925 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 07:11:12.053925 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self._enter() May 04 07:11:12.053925 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 07:11:12.053925 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 07:11:12.053925 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 07:11:12.053925 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self.creator() May 04 07:11:12.053925 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 07:11:12.053925 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application created_value = creator( May 04 07:11:12.054833 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 07:11:12.054833 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 07:11:12.054833 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 07:11:12.054833 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application May 04 07:11:12.057874 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 354/724] 10.222.0.21 () {56 vars in 1108 bytes} [Wed May 4 07:11:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 07:11:12.063676 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690a1a21-aa9c-4c3d-ba0e-bd6133976ed0 None admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:11:12.181474 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690a1a21-aa9c-4c3d-ba0e-bd6133976ed0 None admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:11:12.226786 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ebb1d8-9f07-4b5b-b99e-20630e7e84bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:11:12.227818 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ebb1d8-9f07-4b5b-b99e-20630e7e84bb None admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:11:12.228304 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ebb1d8-9f07-4b5b-b99e-20630e7e84bb None admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:11:12.228788 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ebb1d8-9f07-4b5b-b99e-20630e7e84bb None admin] PATH_INFO: `/v3/domains` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:11:12.229754 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ebb1d8-9f07-4b5b-b99e-20630e7e84bb None admin] RBAC: Adding query filter params (name=Default) {{(pid=79744) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 07:11:12.230368 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ebb1d8-9f07-4b5b-b99e-20630e7e84bb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:11:12.231953 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ebb1d8-9f07-4b5b-b99e-20630e7e84bb None admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:11:12.254153 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 371/725] 10.222.0.21 () {56 vars in 1109 bytes} [Wed May 4 07:11:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 07:11:12.260145 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ebb1d8-9f07-4b5b-b99e-20630e7e84bb None admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:11:12.260936 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098493e7-8246-4040-a8b5-1bdca2c77cef None None] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:11:12.261902 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098493e7-8246-4040-a8b5-1bdca2c77cef None None] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:11:12.262383 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098493e7-8246-4040-a8b5-1bdca2c77cef None None] PATH_INFO: `/` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:11:12.264366 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 355/726] 10.222.0.21 () {54 vars in 926 bytes} [Wed May 4 07:11:12 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 07:11:12.270718 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf815d98-10e5-420c-8c63-dcf9d96cb92d None None] REQUEST_METHOD: `POST` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:11:12.271345 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf815d98-10e5-420c-8c63-dcf9d96cb92d None None] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:11:12.271868 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf815d98-10e5-420c-8c63-dcf9d96cb92d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:11:12.289389 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.auth.core [None req-cf815d98-10e5-420c-8c63-dcf9d96cb92d None None] MFA Rules not processed for user `83c5e0dcb991496ea6dee38384514508`. Rule list: `[]` (Enabled: `True`). {{(pid=79745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:11:12.290871 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.fernet_utils [None req-cf815d98-10e5-420c-8c63-dcf9d96cb92d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:11:12.397173 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 356/727] 10.222.0.21 () {58 vars in 1023 bytes} [Wed May 4 07:11:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 04 07:11:12.424089 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf815d98-10e5-420c-8c63-dcf9d96cb92d None None] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:11:12.424302 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ebb1d8-9f07-4b5b-b99e-20630e7e84bb None admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:11:12.504895 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2781f9f7-a44a-4085-bdcc-3b55514e0230 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:11:12.505612 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2781f9f7-a44a-4085-bdcc-3b55514e0230 None admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:11:12.505888 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2781f9f7-a44a-4085-bdcc-3b55514e0230 None admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:11:12.506155 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2781f9f7-a44a-4085-bdcc-3b55514e0230 None admin] PATH_INFO: `/v3/users/swift` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:11:12.518458 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2781f9f7-a44a-4085-bdcc-3b55514e0230 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:11:12.519941 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2781f9f7-a44a-4085-bdcc-3b55514e0230 None admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:11:12.536440 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application [None req-2781f9f7-a44a-4085-bdcc-3b55514e0230 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 04 07:11:12.536440 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 07:11:12.536440 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 07:11:12.536440 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 07:11:12.536440 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 07:11:12.536440 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 07:11:12.536440 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 07:11:12.536440 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 07:11:12.536440 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 07:11:12.536440 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 07:11:12.536440 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 07:11:12.536440 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 07:11:12.536440 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 04 07:11:12.536440 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self._get_user(user_id) May 04 07:11:12.536440 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 04 07:11:12.536440 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 04 07:11:12.537442 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 07:11:12.537442 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 07:11:12.537442 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 04 07:11:12.537442 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 07:11:12.537442 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 04 07:11:12.537442 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 07:11:12.537442 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 07:11:12.537442 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 07:11:12.537442 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 07:11:12.537442 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.get_or_create( May 04 07:11:12.537442 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 07:11:12.537442 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application with Lock( May 04 07:11:12.537442 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 07:11:12.537442 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self._enter() May 04 07:11:12.537442 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 07:11:12.537442 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 07:11:12.537442 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 07:11:12.537442 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.creator() May 04 07:11:12.538392 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 07:11:12.538392 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application created_value = creator( May 04 07:11:12.538392 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 04 07:11:12.538392 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 04 07:11:12.538392 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 04 07:11:12.538392 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 04 07:11:12.538392 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 04 07:11:12.538392 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 04 07:11:12.538392 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 04 07:11:12.538392 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application May 04 07:11:12.538392 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 372/728] 10.222.0.21 () {56 vars in 1096 bytes} [Wed May 4 07:11:12 2022] GET /identity/v3/users/swift => generated 83 bytes in 278 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 07:11:12.544736 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2781f9f7-a44a-4085-bdcc-3b55514e0230 None admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:11:12.628192 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf815d98-10e5-420c-8c63-dcf9d96cb92d None None] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:11:12.695006 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f11116-87b9-4081-bccf-d3b4845daa70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:11:12.696741 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f11116-87b9-4081-bccf-d3b4845daa70 None admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:11:12.696741 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f11116-87b9-4081-bccf-d3b4845daa70 None admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:11:12.696741 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f11116-87b9-4081-bccf-d3b4845daa70 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:11:12.714053 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f11116-87b9-4081-bccf-d3b4845daa70 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 07:11:12.714611 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2781f9f7-a44a-4085-bdcc-3b55514e0230 None admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:11:12.716515 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application [None req-81f11116-87b9-4081-bccf-d3b4845daa70 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 04 07:11:12.716515 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 07:11:12.716515 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 07:11:12.716515 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 07:11:12.716515 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 07:11:12.716515 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 07:11:12.716515 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 07:11:12.716515 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 07:11:12.716515 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 07:11:12.716515 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 07:11:12.716515 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 07:11:12.716515 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 07:11:12.716515 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 07:11:12.716515 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 07:11:12.716515 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 07:11:12.716515 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 07:11:12.717662 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 07:11:12.717662 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 07:11:12.717662 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 07:11:12.717662 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 07:11:12.717662 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 07:11:12.717662 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 07:11:12.717662 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 07:11:12.717662 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 07:11:12.717662 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 07:11:12.717662 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self.get_or_create( May 04 07:11:12.717662 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 07:11:12.717662 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application with Lock( May 04 07:11:12.717662 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 07:11:12.717662 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self._enter() May 04 07:11:12.717662 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 07:11:12.717662 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 07:11:12.718765 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 07:11:12.718765 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self.creator() May 04 07:11:12.718765 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 07:11:12.718765 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application created_value = creator( May 04 07:11:12.718765 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 07:11:12.718765 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 07:11:12.718765 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 07:11:12.718765 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 07:11:12.718765 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 07:11:12.718765 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 07:11:12.718765 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 04 07:11:12.718765 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application May 04 07:11:12.721442 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 357/729] 10.222.0.21 () {56 vars in 1102 bytes} [Wed May 4 07:11:12 2022] GET /identity/v3/roles/service => generated 85 bytes in 297 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 07:11:12.732459 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f11116-87b9-4081-bccf-d3b4845daa70 None admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:11:12.758724 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75dd76c1-e0a6-4da5-ba11-cb150b5aa405 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:11:12.759656 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75dd76c1-e0a6-4da5-ba11-cb150b5aa405 None admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:11:12.760098 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75dd76c1-e0a6-4da5-ba11-cb150b5aa405 None admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:11:12.760509 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75dd76c1-e0a6-4da5-ba11-cb150b5aa405 None admin] PATH_INFO: `/v3/users` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:11:12.762330 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75dd76c1-e0a6-4da5-ba11-cb150b5aa405 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79744) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 07:11:12.762782 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75dd76c1-e0a6-4da5-ba11-cb150b5aa405 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:11:12.764427 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75dd76c1-e0a6-4da5-ba11-cb150b5aa405 None admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:11:12.782119 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 373/730] 10.222.0.21 () {56 vars in 1135 bytes} [Wed May 4 07:11:12 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 07:11:12.791278 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75dd76c1-e0a6-4da5-ba11-cb150b5aa405 None admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:11:12.912631 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f11116-87b9-4081-bccf-d3b4845daa70 None admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:11:12.954069 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fce37e6-3544-42b4-9ddc-89b0e09ebdf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:11:12.954738 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fce37e6-3544-42b4-9ddc-89b0e09ebdf1 None admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:11:12.955013 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fce37e6-3544-42b4-9ddc-89b0e09ebdf1 None admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:11:12.955313 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fce37e6-3544-42b4-9ddc-89b0e09ebdf1 None admin] PATH_INFO: `/v3/roles` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:11:12.956069 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fce37e6-3544-42b4-9ddc-89b0e09ebdf1 None admin] RBAC: Adding query filter params (name=service) {{(pid=79745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 07:11:12.956370 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fce37e6-3544-42b4-9ddc-89b0e09ebdf1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:11:12.957737 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fce37e6-3544-42b4-9ddc-89b0e09ebdf1 None admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:11:12.975604 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 358/731] 10.222.0.21 () {56 vars in 1103 bytes} [Wed May 4 07:11:12 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 07:11:12.984113 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fce37e6-3544-42b4-9ddc-89b0e09ebdf1 None admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:11:12.993930 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75dd76c1-e0a6-4da5-ba11-cb150b5aa405 None admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:11:13.071874 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52db912d-18fd-4c10-820c-894e1b047664 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:11:13.072542 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52db912d-18fd-4c10-820c-894e1b047664 None admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:11:13.072824 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52db912d-18fd-4c10-820c-894e1b047664 None admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:11:13.073101 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52db912d-18fd-4c10-820c-894e1b047664 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:11:13.087957 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fce37e6-3544-42b4-9ddc-89b0e09ebdf1 None admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:11:13.123776 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91576ef3-c823-41d6-ac67-4811338f216b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:11:13.124938 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91576ef3-c823-41d6-ac67-4811338f216b None admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:11:13.125527 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91576ef3-c823-41d6-ac67-4811338f216b None admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:11:13.126000 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91576ef3-c823-41d6-ac67-4811338f216b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:11:13.137415 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91576ef3-c823-41d6-ac67-4811338f216b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:11:13.139173 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91576ef3-c823-41d6-ac67-4811338f216b None admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:11:13.156810 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application [None req-91576ef3-c823-41d6-ac67-4811338f216b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 07:11:13.156810 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 07:11:13.156810 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 07:11:13.156810 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 07:11:13.156810 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 07:11:13.156810 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 07:11:13.156810 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 07:11:13.156810 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 07:11:13.156810 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 07:11:13.156810 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 07:11:13.156810 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 07:11:13.156810 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 07:11:13.156810 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 07:11:13.156810 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 07:11:13.156810 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 07:11:13.157757 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 07:11:13.157757 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 07:11:13.157757 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 07:11:13.157757 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 07:11:13.157757 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 07:11:13.157757 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 07:11:13.157757 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self.get_or_create( May 04 07:11:13.157757 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 07:11:13.157757 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application with Lock( May 04 07:11:13.157757 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 07:11:13.157757 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self._enter() May 04 07:11:13.157757 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 07:11:13.157757 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 07:11:13.157757 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 07:11:13.157757 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self.creator() May 04 07:11:13.157757 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 07:11:13.157757 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application created_value = creator( May 04 07:11:13.158662 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 07:11:13.158662 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 07:11:13.158662 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 07:11:13.158662 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application May 04 07:11:13.166010 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52db912d-18fd-4c10-820c-894e1b047664 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:11:13.166010 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52db912d-18fd-4c10-820c-894e1b047664 None admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:11:13.166381 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 359/732] 10.222.0.21 () {56 vars in 1108 bytes} [Wed May 4 07:11:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 07:11:13.168053 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d047a48a-daef-423b-9faa-2907588beb28 None None] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:11:13.168569 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d047a48a-daef-423b-9faa-2907588beb28 None None] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:11:13.169046 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d047a48a-daef-423b-9faa-2907588beb28 None None] PATH_INFO: `/` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:11:13.170848 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 360/733] 10.222.0.21 () {54 vars in 926 bytes} [Wed May 4 07:11:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 07:11:13.171769 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d047a48a-daef-423b-9faa-2907588beb28 None None] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:11:13.282328 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d047a48a-daef-423b-9faa-2907588beb28 None None] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:11:13.321779 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415c91f1-14cf-4d39-8bfb-04388aeefcb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:11:13.322907 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415c91f1-14cf-4d39-8bfb-04388aeefcb4 None admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:11:13.323448 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415c91f1-14cf-4d39-8bfb-04388aeefcb4 None admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:11:13.324620 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415c91f1-14cf-4d39-8bfb-04388aeefcb4 None admin] PATH_INFO: `/v3/domains` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:11:13.325590 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415c91f1-14cf-4d39-8bfb-04388aeefcb4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 07:11:13.326110 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415c91f1-14cf-4d39-8bfb-04388aeefcb4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:11:13.327743 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415c91f1-14cf-4d39-8bfb-04388aeefcb4 None admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:11:13.346634 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 361/734] 10.222.0.21 () {56 vars in 1109 bytes} [Wed May 4 07:11:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 07:11:13.348658 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32e40ad-953e-4493-af1d-24c1f41bb220 None None] REQUEST_METHOD: `POST` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:11:13.349229 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32e40ad-953e-4493-af1d-24c1f41bb220 None None] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:11:13.349776 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32e40ad-953e-4493-af1d-24c1f41bb220 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:11:13.369095 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.auth.core [None req-c32e40ad-953e-4493-af1d-24c1f41bb220 None None] MFA Rules not processed for user `83c5e0dcb991496ea6dee38384514508`. Rule list: `[]` (Enabled: `True`). {{(pid=79745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:11:13.371391 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.fernet_utils [None req-c32e40ad-953e-4493-af1d-24c1f41bb220 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:11:13.397162 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 374/735] 10.222.0.21 () {58 vars in 1282 bytes} [Wed May 4 07:11:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 610 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 04 07:11:13.397951 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52db912d-18fd-4c10-820c-894e1b047664 None admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:11:13.458377 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 362/736] 10.222.0.21 () {58 vars in 1023 bytes} [Wed May 4 07:11:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 07:11:13.464737 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32e40ad-953e-4493-af1d-24c1f41bb220 None None] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:11:13.498375 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52db912d-18fd-4c10-820c-894e1b047664 None admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:11:13.532605 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8712de5f-692a-46b5-bb44-4d87b29e894a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:11:13.533420 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8712de5f-692a-46b5-bb44-4d87b29e894a None admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:11:13.533698 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8712de5f-692a-46b5-bb44-4d87b29e894a None admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:11:13.533975 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8712de5f-692a-46b5-bb44-4d87b29e894a None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:11:13.541626 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8712de5f-692a-46b5-bb44-4d87b29e894a None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:11:13.544333 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8712de5f-692a-46b5-bb44-4d87b29e894a None admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:11:13.558806 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application [None req-8712de5f-692a-46b5-bb44-4d87b29e894a None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 04 07:11:13.558806 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 07:11:13.558806 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 07:11:13.558806 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 07:11:13.558806 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 07:11:13.558806 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 07:11:13.558806 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 07:11:13.558806 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 07:11:13.558806 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 07:11:13.558806 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 07:11:13.558806 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 07:11:13.558806 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 07:11:13.558806 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 04 07:11:13.558806 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self._get_user(user_id) May 04 07:11:13.558806 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 04 07:11:13.558806 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 04 07:11:13.559829 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 07:11:13.559829 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 07:11:13.559829 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 04 07:11:13.559829 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 07:11:13.559829 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 04 07:11:13.559829 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 07:11:13.559829 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 07:11:13.559829 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 07:11:13.559829 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 07:11:13.559829 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.get_or_create( May 04 07:11:13.559829 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 07:11:13.559829 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application with Lock( May 04 07:11:13.559829 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 07:11:13.559829 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self._enter() May 04 07:11:13.559829 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 07:11:13.559829 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 07:11:13.559829 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 07:11:13.559829 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.creator() May 04 07:11:13.567083 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 07:11:13.567083 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application created_value = creator( May 04 07:11:13.567083 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 04 07:11:13.567083 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 04 07:11:13.567083 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 04 07:11:13.567083 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 04 07:11:13.567083 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 04 07:11:13.567083 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 04 07:11:13.567083 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 04 07:11:13.567083 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application May 04 07:11:13.567083 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 375/737] 10.222.0.21 () {56 vars in 1117 bytes} [Wed May 4 07:11:13 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 07:11:13.567083 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8712de5f-692a-46b5-bb44-4d87b29e894a None admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:11:13.579957 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32e40ad-953e-4493-af1d-24c1f41bb220 None None] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:11:13.615471 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc2130d-c033-4f8b-961c-e32a378acc7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:11:13.616254 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc2130d-c033-4f8b-961c-e32a378acc7c None admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:11:13.616558 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc2130d-c033-4f8b-961c-e32a378acc7c None admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:11:13.616828 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc2130d-c033-4f8b-961c-e32a378acc7c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:11:13.626837 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc2130d-c033-4f8b-961c-e32a378acc7c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:11:13.628391 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc2130d-c033-4f8b-961c-e32a378acc7c None admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:11:13.646115 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application [None req-3cc2130d-c033-4f8b-961c-e32a378acc7c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 07:11:13.646115 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 07:11:13.646115 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 07:11:13.646115 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 07:11:13.646115 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 07:11:13.646115 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 07:11:13.646115 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 07:11:13.646115 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 07:11:13.646115 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 07:11:13.646115 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 07:11:13.646115 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 07:11:13.646115 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 07:11:13.646115 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 07:11:13.646115 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 07:11:13.646115 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 07:11:13.647294 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 07:11:13.647294 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 07:11:13.647294 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 07:11:13.647294 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 07:11:13.647294 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 07:11:13.647294 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 07:11:13.647294 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self.get_or_create( May 04 07:11:13.647294 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 07:11:13.647294 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application with Lock( May 04 07:11:13.647294 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 07:11:13.647294 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self._enter() May 04 07:11:13.647294 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 07:11:13.647294 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 07:11:13.647294 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 07:11:13.647294 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self.creator() May 04 07:11:13.647294 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 07:11:13.647294 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application created_value = creator( May 04 07:11:13.648259 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 07:11:13.648259 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 07:11:13.648259 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 07:11:13.648259 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application May 04 07:11:13.648259 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 363/738] 10.222.0.21 () {56 vars in 1108 bytes} [Wed May 4 07:11:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 07:11:13.648552 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2926bce-1acf-420a-977b-5cc4f81f6f0c None None] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:11:13.649557 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2926bce-1acf-420a-977b-5cc4f81f6f0c None None] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:11:13.649557 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2926bce-1acf-420a-977b-5cc4f81f6f0c None None] PATH_INFO: `/` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:11:13.654458 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 364/739] 10.222.0.21 () {54 vars in 926 bytes} [Wed May 4 07:11:13 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 07:11:13.655118 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2926bce-1acf-420a-977b-5cc4f81f6f0c None None] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:11:13.670927 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8712de5f-692a-46b5-bb44-4d87b29e894a None admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:11:13.706609 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd899137-34e5-4e27-8535-736d16683c18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:11:13.707448 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd899137-34e5-4e27-8535-736d16683c18 None admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:11:13.707721 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd899137-34e5-4e27-8535-736d16683c18 None admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:11:13.707987 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd899137-34e5-4e27-8535-736d16683c18 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:11:13.720557 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd899137-34e5-4e27-8535-736d16683c18 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 07:11:13.728083 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application [None req-bd899137-34e5-4e27-8535-736d16683c18 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 04 07:11:13.728083 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 07:11:13.728083 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 07:11:13.728083 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 07:11:13.728083 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 07:11:13.728083 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 07:11:13.728083 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 07:11:13.728083 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 07:11:13.728083 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 07:11:13.728083 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 07:11:13.728083 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 07:11:13.728083 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 07:11:13.728083 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 07:11:13.728083 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 07:11:13.728083 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 07:11:13.728083 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 07:11:13.729193 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 07:11:13.729193 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 07:11:13.729193 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 07:11:13.729193 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 07:11:13.729193 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 07:11:13.729193 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 07:11:13.729193 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 07:11:13.729193 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 07:11:13.729193 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 07:11:13.729193 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.get_or_create( May 04 07:11:13.729193 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 07:11:13.729193 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application with Lock( May 04 07:11:13.729193 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 07:11:13.729193 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self._enter() May 04 07:11:13.729193 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 07:11:13.729193 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 07:11:13.730830 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 07:11:13.730830 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.creator() May 04 07:11:13.730830 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 07:11:13.730830 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application created_value = creator( May 04 07:11:13.730830 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 07:11:13.730830 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 07:11:13.730830 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 07:11:13.730830 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 07:11:13.730830 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 07:11:13.730830 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 07:11:13.730830 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 04 07:11:13.730830 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application May 04 07:11:13.730830 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 376/740] 10.222.0.21 () {56 vars in 1096 bytes} [Wed May 4 07:11:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 07:11:13.730830 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd899137-34e5-4e27-8535-736d16683c18 None admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:11:13.775618 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2926bce-1acf-420a-977b-5cc4f81f6f0c None None] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:11:13.810555 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82842dc2-ef26-44c5-af27-74642af18ffb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:11:13.811449 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82842dc2-ef26-44c5-af27-74642af18ffb None admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:11:13.811722 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82842dc2-ef26-44c5-af27-74642af18ffb None admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:11:13.811994 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82842dc2-ef26-44c5-af27-74642af18ffb None admin] PATH_INFO: `/v3/users` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:11:13.812824 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82842dc2-ef26-44c5-af27-74642af18ffb None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 07:11:13.813131 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82842dc2-ef26-44c5-af27-74642af18ffb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:11:13.814548 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82842dc2-ef26-44c5-af27-74642af18ffb None admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:11:13.836139 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 365/741] 10.222.0.21 () {56 vars in 1149 bytes} [Wed May 4 07:11:13 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 07:11:13.836139 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd11985a-affc-4f47-bd90-e59f751e4e87 None None] REQUEST_METHOD: `POST` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:11:13.836139 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd11985a-affc-4f47-bd90-e59f751e4e87 None None] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:11:13.836489 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd899137-34e5-4e27-8535-736d16683c18 None admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:11:13.836591 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd11985a-affc-4f47-bd90-e59f751e4e87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:11:13.850362 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.auth.core [None req-fd11985a-affc-4f47-bd90-e59f751e4e87 None None] MFA Rules not processed for user `83c5e0dcb991496ea6dee38384514508`. Rule list: `[]` (Enabled: `True`). {{(pid=79745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:11:13.851981 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.fernet_utils [None req-fd11985a-affc-4f47-bd90-e59f751e4e87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:11:13.870510 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618b17bb-77e9-4ad5-892e-65ec6acbe2a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:11:13.871183 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618b17bb-77e9-4ad5-892e-65ec6acbe2a7 None admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:11:13.871464 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618b17bb-77e9-4ad5-892e-65ec6acbe2a7 None admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:11:13.871732 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618b17bb-77e9-4ad5-892e-65ec6acbe2a7 None admin] PATH_INFO: `/v3/domains` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:11:13.872451 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618b17bb-77e9-4ad5-892e-65ec6acbe2a7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79744) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 07:11:13.872751 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618b17bb-77e9-4ad5-892e-65ec6acbe2a7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:11:13.874095 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618b17bb-77e9-4ad5-892e-65ec6acbe2a7 None admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:11:13.890246 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 377/742] 10.222.0.21 () {56 vars in 1109 bytes} [Wed May 4 07:11:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 07:11:13.890246 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618b17bb-77e9-4ad5-892e-65ec6acbe2a7 None admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:11:13.926162 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 366/743] 10.222.0.21 () {58 vars in 1023 bytes} [Wed May 4 07:11:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 07:11:13.927003 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd11985a-affc-4f47-bd90-e59f751e4e87 None None] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:11:13.992909 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618b17bb-77e9-4ad5-892e-65ec6acbe2a7 None admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:11:14.019354 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd11985a-affc-4f47-bd90-e59f751e4e87 None None] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:11:14.025186 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3490f072-2ab9-46c4-81b2-ec7a4bb37ade None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:11:14.025849 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3490f072-2ab9-46c4-81b2-ec7a4bb37ade None admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:11:14.026129 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3490f072-2ab9-46c4-81b2-ec7a4bb37ade None admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:11:14.026403 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3490f072-2ab9-46c4-81b2-ec7a4bb37ade None admin] PATH_INFO: `/v3/roles` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:11:14.027752 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3490f072-2ab9-46c4-81b2-ec7a4bb37ade None admin] RBAC: Adding query filter params (name=admin) {{(pid=79744) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 07:11:14.028062 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3490f072-2ab9-46c4-81b2-ec7a4bb37ade None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:11:14.029409 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3490f072-2ab9-46c4-81b2-ec7a4bb37ade None admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:11:14.037265 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 378/744] 10.222.0.21 () {56 vars in 1099 bytes} [Wed May 4 07:11:13 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 07:11:14.038547 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e228d640-c131-4821-ac72-6bdba0327326 None None] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:11:14.038837 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e228d640-c131-4821-ac72-6bdba0327326 None None] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:11:14.039107 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e228d640-c131-4821-ac72-6bdba0327326 None None] PATH_INFO: `/` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:11:14.043395 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 379/745] 10.222.0.21 () {54 vars in 926 bytes} [Wed May 4 07:11:14 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 07:11:14.044062 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e228d640-c131-4821-ac72-6bdba0327326 None None] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:11:14.053901 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ee8f71-fdad-4eb4-b1ab-59d48d909e79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:11:14.054550 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ee8f71-fdad-4eb4-b1ab-59d48d909e79 None admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:11:14.054951 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ee8f71-fdad-4eb4-b1ab-59d48d909e79 None admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:11:14.055094 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ee8f71-fdad-4eb4-b1ab-59d48d909e79 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:11:14.118099 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ee8f71-fdad-4eb4-b1ab-59d48d909e79 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:11:14.119495 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ee8f71-fdad-4eb4-b1ab-59d48d909e79 None admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:11:14.137105 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e228d640-c131-4821-ac72-6bdba0327326 None None] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:11:14.167882 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef74964-4d23-4184-8854-b5958e0488f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:11:14.168648 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef74964-4d23-4184-8854-b5958e0488f6 None admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:11:14.168924 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef74964-4d23-4184-8854-b5958e0488f6 None admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:11:14.169180 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef74964-4d23-4184-8854-b5958e0488f6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:11:14.175424 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef74964-4d23-4184-8854-b5958e0488f6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:11:14.176818 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef74964-4d23-4184-8854-b5958e0488f6 None admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:11:14.190760 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application [None req-2ef74964-4d23-4184-8854-b5958e0488f6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 04 07:11:14.190760 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 07:11:14.190760 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 07:11:14.190760 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 07:11:14.190760 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 07:11:14.190760 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 07:11:14.190760 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 07:11:14.190760 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 07:11:14.190760 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 07:11:14.190760 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 07:11:14.190760 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 07:11:14.190760 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 07:11:14.190760 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 04 07:11:14.190760 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self._get_project(project_id) May 04 07:11:14.190760 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 04 07:11:14.191695 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 04 07:11:14.191695 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 07:11:14.191695 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 07:11:14.191695 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 07:11:14.191695 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 07:11:14.191695 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 07:11:14.191695 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.get_or_create( May 04 07:11:14.191695 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 07:11:14.191695 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application with Lock( May 04 07:11:14.191695 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 07:11:14.191695 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self._enter() May 04 07:11:14.191695 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 07:11:14.191695 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 07:11:14.191695 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 07:11:14.191695 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.creator() May 04 07:11:14.191695 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 07:11:14.191695 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application created_value = creator( May 04 07:11:14.192602 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 04 07:11:14.192602 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 04 07:11:14.192602 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 04 07:11:14.192602 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 04 07:11:14.192602 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 04 07:11:14.192602 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 04 07:11:14.192602 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 04 07:11:14.192602 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application May 04 07:11:14.192602 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 380/746] 10.222.0.21 () {56 vars in 1111 bytes} [Wed May 4 07:11:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 07:11:14.193087 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef74964-4d23-4184-8854-b5958e0488f6 None admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:11:14.217271 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 367/747] 10.222.0.21 () {58 vars in 1282 bytes} [Wed May 4 07:11:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 04 07:11:14.218169 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ee8f71-fdad-4eb4-b1ab-59d48d909e79 None admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:11:14.288861 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef74964-4d23-4184-8854-b5958e0488f6 None admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:11:14.318542 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ee8f71-fdad-4eb4-b1ab-59d48d909e79 None admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:11:14.320496 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8062d54f-3452-44ce-96ce-8ad440b74028 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:11:14.321147 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8062d54f-3452-44ce-96ce-8ad440b74028 None admin] REQUEST_METHOD: `POST` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:11:14.321418 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8062d54f-3452-44ce-96ce-8ad440b74028 None admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:11:14.321680 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8062d54f-3452-44ce-96ce-8ad440b74028 None admin] PATH_INFO: `/v3/services` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:11:14.322376 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8062d54f-3452-44ce-96ce-8ad440b74028 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:11:14.323951 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8062d54f-3452-44ce-96ce-8ad440b74028 None admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:11:14.338754 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 381/748] 10.222.0.21 () {60 vars in 1141 bytes} [Wed May 4 07:11:14 2022] POST /identity/v3/services => generated 240 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 07:11:14.340913 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d272560a-06ec-44ee-b0d2-1d08f31493ef None None] REQUEST_METHOD: `POST` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:11:14.341300 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d272560a-06ec-44ee-b0d2-1d08f31493ef None None] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:11:14.341573 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d272560a-06ec-44ee-b0d2-1d08f31493ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:11:14.358543 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.auth.core [None req-d272560a-06ec-44ee-b0d2-1d08f31493ef None None] MFA Rules not processed for user `83c5e0dcb991496ea6dee38384514508`. Rule list: `[]` (Enabled: `True`). {{(pid=79744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:11:14.359778 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.fernet_utils [None req-d272560a-06ec-44ee-b0d2-1d08f31493ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:11:14.372493 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2ebeff-4a3e-4849-890d-d28992c8e434 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:11:14.373205 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2ebeff-4a3e-4849-890d-d28992c8e434 None admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:11:14.373478 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2ebeff-4a3e-4849-890d-d28992c8e434 None admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:11:14.373744 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2ebeff-4a3e-4849-890d-d28992c8e434 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:11:14.384761 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2ebeff-4a3e-4849-890d-d28992c8e434 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:11:14.386925 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2ebeff-4a3e-4849-890d-d28992c8e434 None admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:11:14.405374 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application [None req-cd2ebeff-4a3e-4849-890d-d28992c8e434 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 07:11:14.405374 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 07:11:14.405374 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 07:11:14.405374 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 07:11:14.405374 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 07:11:14.405374 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 07:11:14.405374 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 07:11:14.405374 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 07:11:14.405374 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 07:11:14.405374 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 07:11:14.405374 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 07:11:14.405374 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 07:11:14.405374 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 07:11:14.405374 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 07:11:14.405374 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 07:11:14.406477 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 07:11:14.406477 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 07:11:14.406477 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 07:11:14.406477 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 07:11:14.406477 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 07:11:14.406477 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 07:11:14.406477 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self.get_or_create( May 04 07:11:14.406477 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 07:11:14.406477 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application with Lock( May 04 07:11:14.406477 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 07:11:14.406477 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self._enter() May 04 07:11:14.406477 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 07:11:14.406477 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 07:11:14.406477 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 07:11:14.406477 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self.creator() May 04 07:11:14.406477 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 07:11:14.406477 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application created_value = creator( May 04 07:11:14.407988 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 07:11:14.407988 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 07:11:14.407988 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 07:11:14.407988 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application May 04 07:11:14.407988 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 368/749] 10.222.0.21 () {56 vars in 1108 bytes} [Wed May 4 07:11:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 07:11:14.407988 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2ebeff-4a3e-4849-890d-d28992c8e434 None admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:11:14.441824 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 382/750] 10.222.0.21 () {58 vars in 1023 bytes} [Wed May 4 07:11:14 2022] POST /identity/v3/auth/tokens => generated 898 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 07:11:14.443130 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d272560a-06ec-44ee-b0d2-1d08f31493ef None None] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:11:14.525233 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2ebeff-4a3e-4849-890d-d28992c8e434 None admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:11:14.549388 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d272560a-06ec-44ee-b0d2-1d08f31493ef None None] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:11:14.561104 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df94fce-3aae-43bb-b119-51c87af80ef8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:11:14.562016 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df94fce-3aae-43bb-b119-51c87af80ef8 None admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:11:14.562016 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df94fce-3aae-43bb-b119-51c87af80ef8 None admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:11:14.562287 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df94fce-3aae-43bb-b119-51c87af80ef8 None admin] PATH_INFO: `/v3/projects` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:11:14.564664 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df94fce-3aae-43bb-b119-51c87af80ef8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 07:11:14.564664 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df94fce-3aae-43bb-b119-51c87af80ef8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:11:14.564869 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df94fce-3aae-43bb-b119-51c87af80ef8 None admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:11:14.577178 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 369/751] 10.222.0.21 () {56 vars in 1148 bytes} [Wed May 4 07:11:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 07:11:14.577834 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df94fce-3aae-43bb-b119-51c87af80ef8 None admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:11:14.584592 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e65855d-740b-4edb-ab2a-cc6914b39c85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:11:14.585384 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e65855d-740b-4edb-ab2a-cc6914b39c85 None admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:11:14.585660 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e65855d-740b-4edb-ab2a-cc6914b39c85 None admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:11:14.585929 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e65855d-740b-4edb-ab2a-cc6914b39c85 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:11:14.597409 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e65855d-740b-4edb-ab2a-cc6914b39c85 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:11:14.598845 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e65855d-740b-4edb-ab2a-cc6914b39c85 None admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:11:14.615997 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application [None req-0e65855d-740b-4edb-ab2a-cc6914b39c85 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 07:11:14.615997 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 07:11:14.615997 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 07:11:14.615997 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 07:11:14.615997 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 07:11:14.615997 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 07:11:14.615997 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 07:11:14.615997 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 07:11:14.615997 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 07:11:14.615997 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 07:11:14.615997 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 07:11:14.615997 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 07:11:14.615997 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 07:11:14.615997 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 07:11:14.615997 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 07:11:14.616940 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 07:11:14.616940 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 07:11:14.616940 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 07:11:14.616940 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 07:11:14.616940 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 07:11:14.616940 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 07:11:14.616940 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.get_or_create( May 04 07:11:14.616940 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 07:11:14.616940 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application with Lock( May 04 07:11:14.616940 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 07:11:14.616940 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self._enter() May 04 07:11:14.616940 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 07:11:14.616940 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 07:11:14.616940 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 07:11:14.616940 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.creator() May 04 07:11:14.616940 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 07:11:14.616940 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application created_value = creator( May 04 07:11:14.617904 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 07:11:14.617904 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 07:11:14.617904 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 07:11:14.617904 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application May 04 07:11:14.617904 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 383/752] 10.222.0.21 () {56 vars in 1108 bytes} [Wed May 4 07:11:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 07:11:14.618656 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e65855d-740b-4edb-ab2a-cc6914b39c85 None admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:11:14.676425 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df94fce-3aae-43bb-b119-51c87af80ef8 None admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:11:14.709538 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cecbad21-1fe2-45df-a4b8-4eeb7888671b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:11:14.710191 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecbad21-1fe2-45df-a4b8-4eeb7888671b None admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:11:14.710660 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecbad21-1fe2-45df-a4b8-4eeb7888671b None admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:11:14.710788 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecbad21-1fe2-45df-a4b8-4eeb7888671b None admin] PATH_INFO: `/v3/domains` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:11:14.711513 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cecbad21-1fe2-45df-a4b8-4eeb7888671b None admin] RBAC: Adding query filter params (name=Default) {{(pid=79745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 07:11:14.711756 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cecbad21-1fe2-45df-a4b8-4eeb7888671b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:11:14.713325 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cecbad21-1fe2-45df-a4b8-4eeb7888671b None admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:11:14.716116 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e65855d-740b-4edb-ab2a-cc6914b39c85 None admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:11:14.728534 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 370/753] 10.222.0.21 () {56 vars in 1109 bytes} [Wed May 4 07:11:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 07:11:14.728534 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cecbad21-1fe2-45df-a4b8-4eeb7888671b None admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:11:14.750394 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731827e0-60d1-46b9-9894-93f1a21e44fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:11:14.751062 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731827e0-60d1-46b9-9894-93f1a21e44fb None admin] REQUEST_METHOD: `POST` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:11:14.751373 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731827e0-60d1-46b9-9894-93f1a21e44fb None admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:11:14.751649 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731827e0-60d1-46b9-9894-93f1a21e44fb None admin] PATH_INFO: `/v3/services` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:11:14.752368 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731827e0-60d1-46b9-9894-93f1a21e44fb None admin] RBAC: Authorizing `identity:create_service()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:11:14.753726 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731827e0-60d1-46b9-9894-93f1a21e44fb None admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:11:14.779254 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 384/754] 10.222.0.21 () {60 vars in 1141 bytes} [Wed May 4 07:11:14 2022] POST /identity/v3/services => generated 251 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 07:11:14.779254 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731827e0-60d1-46b9-9894-93f1a21e44fb None admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:11:14.828434 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cecbad21-1fe2-45df-a4b8-4eeb7888671b None admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:11:14.869821 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746a4e1d-8c08-4d60-bb16-e84e5d2cc7ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:11:14.870607 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746a4e1d-8c08-4d60-bb16-e84e5d2cc7ac None admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:11:14.870951 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746a4e1d-8c08-4d60-bb16-e84e5d2cc7ac None admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:11:14.871337 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746a4e1d-8c08-4d60-bb16-e84e5d2cc7ac None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:11:14.872241 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746a4e1d-8c08-4d60-bb16-e84e5d2cc7ac None admin] RBAC: Adding query filter params (role.id=eb54c9cea2774a25b1fe8c79724408ee, scope.project.id=c9f9c44db4984653b8d4b5f6b3b949f5, user.id=084c9245d1da4e698c9c3945fa089e85) {{(pid=79745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 07:11:14.872615 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746a4e1d-8c08-4d60-bb16-e84e5d2cc7ac None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:11:14.874160 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746a4e1d-8c08-4d60-bb16-e84e5d2cc7ac None admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:11:14.879856 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731827e0-60d1-46b9-9894-93f1a21e44fb None admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:11:14.880853 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 371/755] 10.222.0.21 () {56 vars in 1374 bytes} [Wed May 4 07:11:14 2022] GET /identity/v3/role_assignments?user.id=084c9245d1da4e698c9c3945fa089e85&scope.project.id=c9f9c44db4984653b8d4b5f6b3b949f5&role.id=eb54c9cea2774a25b1fe8c79724408ee => generated 259 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 07:11:14.881764 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746a4e1d-8c08-4d60-bb16-e84e5d2cc7ac None admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:11:14.952121 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29f07a0-6d5f-474d-8c86-36b55e8454e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:11:14.952727 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29f07a0-6d5f-474d-8c86-36b55e8454e5 None admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:11:14.953008 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29f07a0-6d5f-474d-8c86-36b55e8454e5 None admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:11:14.953299 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29f07a0-6d5f-474d-8c86-36b55e8454e5 None admin] PATH_INFO: `/v3/domains` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:11:14.954075 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29f07a0-6d5f-474d-8c86-36b55e8454e5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79744) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 07:11:14.954382 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29f07a0-6d5f-474d-8c86-36b55e8454e5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:11:14.955836 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29f07a0-6d5f-474d-8c86-36b55e8454e5 None admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:11:14.973463 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 385/756] 10.222.0.21 () {56 vars in 1109 bytes} [Wed May 4 07:11:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 07:11:14.979290 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29f07a0-6d5f-474d-8c86-36b55e8454e5 None admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:11:14.993545 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746a4e1d-8c08-4d60-bb16-e84e5d2cc7ac None admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:11:15.037470 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ab6b3b-438d-4451-85dc-1e7cf60e9f9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:11:15.037470 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ab6b3b-438d-4451-85dc-1e7cf60e9f9d None admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:11:15.037470 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ab6b3b-438d-4451-85dc-1e7cf60e9f9d None admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:11:15.037470 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ab6b3b-438d-4451-85dc-1e7cf60e9f9d None admin] PATH_INFO: `/v3/users/nova` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:11:15.050861 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ab6b3b-438d-4451-85dc-1e7cf60e9f9d None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:11:15.052358 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ab6b3b-438d-4451-85dc-1e7cf60e9f9d None admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:11:15.067903 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application [None req-74ab6b3b-438d-4451-85dc-1e7cf60e9f9d None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 04 07:11:15.067903 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 07:11:15.067903 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 07:11:15.067903 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 07:11:15.067903 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 07:11:15.067903 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 07:11:15.067903 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 07:11:15.067903 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 07:11:15.067903 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 07:11:15.067903 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 07:11:15.067903 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 07:11:15.067903 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 07:11:15.067903 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 04 07:11:15.067903 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self._get_user(user_id) May 04 07:11:15.067903 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 04 07:11:15.067903 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 04 07:11:15.068932 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 07:11:15.068932 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 07:11:15.068932 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 04 07:11:15.068932 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 07:11:15.068932 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 04 07:11:15.068932 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 07:11:15.068932 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 07:11:15.068932 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 07:11:15.068932 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 07:11:15.068932 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self.get_or_create( May 04 07:11:15.068932 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 07:11:15.068932 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application with Lock( May 04 07:11:15.068932 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 07:11:15.068932 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self._enter() May 04 07:11:15.068932 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 07:11:15.068932 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 07:11:15.068932 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 07:11:15.068932 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self.creator() May 04 07:11:15.069894 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 07:11:15.069894 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application created_value = creator( May 04 07:11:15.069894 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 04 07:11:15.069894 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 04 07:11:15.069894 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 04 07:11:15.069894 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 04 07:11:15.069894 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 04 07:11:15.069894 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 04 07:11:15.069894 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 04 07:11:15.069894 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application May 04 07:11:15.069894 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 372/757] 10.222.0.21 () {56 vars in 1093 bytes} [Wed May 4 07:11:14 2022] GET /identity/v3/users/nova => generated 82 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 07:11:15.074994 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ab6b3b-438d-4451-85dc-1e7cf60e9f9d None admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:11:15.121477 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29f07a0-6d5f-474d-8c86-36b55e8454e5 None admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:11:15.161755 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aefbb31-6530-4d3f-8403-1217dad93e2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:11:15.162913 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aefbb31-6530-4d3f-8403-1217dad93e2d None admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:11:15.163426 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aefbb31-6530-4d3f-8403-1217dad93e2d None admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:11:15.163879 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aefbb31-6530-4d3f-8403-1217dad93e2d None admin] PATH_INFO: `/v3/projects/service` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:11:15.171978 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aefbb31-6530-4d3f-8403-1217dad93e2d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:11:15.173692 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aefbb31-6530-4d3f-8403-1217dad93e2d None admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:11:15.187170 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ab6b3b-438d-4451-85dc-1e7cf60e9f9d None admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:11:15.198391 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application [None req-5aefbb31-6530-4d3f-8403-1217dad93e2d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 04 07:11:15.198391 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 07:11:15.198391 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 07:11:15.198391 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 07:11:15.198391 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 07:11:15.198391 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 07:11:15.198391 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 07:11:15.198391 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 07:11:15.198391 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 07:11:15.198391 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 07:11:15.198391 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 07:11:15.198391 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 07:11:15.198391 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 04 07:11:15.198391 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self._get_project(project_id) May 04 07:11:15.198391 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 04 07:11:15.200588 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 04 07:11:15.200588 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 07:11:15.200588 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 07:11:15.200588 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 07:11:15.200588 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 07:11:15.200588 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 07:11:15.200588 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.get_or_create( May 04 07:11:15.200588 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 07:11:15.200588 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application with Lock( May 04 07:11:15.200588 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 07:11:15.200588 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self._enter() May 04 07:11:15.200588 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 07:11:15.200588 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 07:11:15.200588 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 07:11:15.200588 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.creator() May 04 07:11:15.200588 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 07:11:15.200588 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application created_value = creator( May 04 07:11:15.201503 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 04 07:11:15.201503 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 04 07:11:15.201503 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 04 07:11:15.201503 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 04 07:11:15.201503 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 04 07:11:15.201503 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 04 07:11:15.201503 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 04 07:11:15.201503 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application May 04 07:11:15.208789 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 386/758] 10.222.0.21 () {56 vars in 1111 bytes} [Wed May 4 07:11:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 07:11:15.216046 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aefbb31-6530-4d3f-8403-1217dad93e2d None admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:11:15.221081 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e8a75e-10ca-413c-9ab2-99bc822718e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:11:15.222031 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e8a75e-10ca-413c-9ab2-99bc822718e3 None admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:11:15.222503 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e8a75e-10ca-413c-9ab2-99bc822718e3 None admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:11:15.222970 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e8a75e-10ca-413c-9ab2-99bc822718e3 None admin] PATH_INFO: `/v3/users` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:11:15.224016 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e8a75e-10ca-413c-9ab2-99bc822718e3 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 07:11:15.225344 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e8a75e-10ca-413c-9ab2-99bc822718e3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:11:15.227071 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e8a75e-10ca-413c-9ab2-99bc822718e3 None admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:11:15.246428 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 373/759] 10.222.0.21 () {56 vars in 1133 bytes} [Wed May 4 07:11:15 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 07:11:15.252095 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e8a75e-10ca-413c-9ab2-99bc822718e3 None admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:11:15.359710 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aefbb31-6530-4d3f-8403-1217dad93e2d None admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:11:15.394276 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7134f9fa-7219-4019-8e27-f747f76f3a8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:11:15.395361 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7134f9fa-7219-4019-8e27-f747f76f3a8b None admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:11:15.395844 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7134f9fa-7219-4019-8e27-f747f76f3a8b None admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:11:15.396326 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7134f9fa-7219-4019-8e27-f747f76f3a8b None admin] PATH_INFO: `/v3/projects` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:11:15.397299 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7134f9fa-7219-4019-8e27-f747f76f3a8b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79744) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 07:11:15.397810 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7134f9fa-7219-4019-8e27-f747f76f3a8b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:11:15.399426 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7134f9fa-7219-4019-8e27-f747f76f3a8b None admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:11:15.412119 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 387/760] 10.222.0.21 () {56 vars in 1148 bytes} [Wed May 4 07:11:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 07:11:15.418531 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7134f9fa-7219-4019-8e27-f747f76f3a8b None admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:11:15.441810 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e8a75e-10ca-413c-9ab2-99bc822718e3 None admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:11:15.508094 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e517d166-04ea-4d4f-9438-2d378680d953 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:11:15.508834 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e517d166-04ea-4d4f-9438-2d378680d953 None admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:11:15.509110 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e517d166-04ea-4d4f-9438-2d378680d953 None admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:11:15.509377 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e517d166-04ea-4d4f-9438-2d378680d953 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:11:15.521942 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e517d166-04ea-4d4f-9438-2d378680d953 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:11:15.523729 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e517d166-04ea-4d4f-9438-2d378680d953 None admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:11:15.548849 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application [None req-e517d166-04ea-4d4f-9438-2d378680d953 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 07:11:15.548849 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 07:11:15.548849 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 07:11:15.548849 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 07:11:15.548849 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 07:11:15.548849 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 07:11:15.548849 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 07:11:15.548849 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 07:11:15.548849 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 07:11:15.548849 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 07:11:15.548849 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 07:11:15.548849 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 07:11:15.548849 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 07:11:15.548849 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 07:11:15.548849 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 07:11:15.549840 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 07:11:15.549840 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 07:11:15.549840 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 07:11:15.549840 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 07:11:15.549840 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 07:11:15.549840 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 07:11:15.549840 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self.get_or_create( May 04 07:11:15.549840 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 07:11:15.549840 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application with Lock( May 04 07:11:15.549840 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 07:11:15.549840 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self._enter() May 04 07:11:15.549840 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 07:11:15.549840 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 07:11:15.549840 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 07:11:15.549840 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self.creator() May 04 07:11:15.549840 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 07:11:15.549840 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application created_value = creator( May 04 07:11:15.550766 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 07:11:15.550766 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 07:11:15.550766 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 07:11:15.550766 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application May 04 07:11:15.555821 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 374/761] 10.222.0.21 () {56 vars in 1108 bytes} [Wed May 4 07:11:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 302 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 07:11:15.564104 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e517d166-04ea-4d4f-9438-2d378680d953 None admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:11:15.578017 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7134f9fa-7219-4019-8e27-f747f76f3a8b None admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:11:15.616829 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93c282c-5d00-4750-a9d3-6c529e7b9626 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:11:15.617508 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93c282c-5d00-4750-a9d3-6c529e7b9626 None admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:11:15.617783 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93c282c-5d00-4750-a9d3-6c529e7b9626 None admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:11:15.618054 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93c282c-5d00-4750-a9d3-6c529e7b9626 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:11:15.618876 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93c282c-5d00-4750-a9d3-6c529e7b9626 None admin] RBAC: Adding query filter params (role.id=14041215d0f7476a8e90241a49338706, scope.project.id=c9f9c44db4984653b8d4b5f6b3b949f5, user.id=704cdbc22849413baa4e0189947ebebc) {{(pid=79744) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 07:11:15.619189 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93c282c-5d00-4750-a9d3-6c529e7b9626 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:11:15.621198 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93c282c-5d00-4750-a9d3-6c529e7b9626 None admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:11:15.631199 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 388/762] 10.222.0.21 () {56 vars in 1374 bytes} [Wed May 4 07:11:15 2022] GET /identity/v3/role_assignments?user.id=704cdbc22849413baa4e0189947ebebc&scope.project.id=c9f9c44db4984653b8d4b5f6b3b949f5&role.id=14041215d0f7476a8e90241a49338706 => generated 259 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 07:11:15.696378 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e517d166-04ea-4d4f-9438-2d378680d953 None admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:11:15.759977 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9541ac2-6262-4e24-9034-9705de186918 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:11:15.760585 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9541ac2-6262-4e24-9034-9705de186918 None admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:11:15.760869 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9541ac2-6262-4e24-9034-9705de186918 None admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:11:15.761186 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9541ac2-6262-4e24-9034-9705de186918 None admin] PATH_INFO: `/v3/domains` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:11:15.762621 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9541ac2-6262-4e24-9034-9705de186918 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 07:11:15.762935 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9541ac2-6262-4e24-9034-9705de186918 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:11:15.764385 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9541ac2-6262-4e24-9034-9705de186918 None admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:11:15.781616 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 375/763] 10.222.0.21 () {56 vars in 1109 bytes} [Wed May 4 07:11:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 07:11:15.787333 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93c282c-5d00-4750-a9d3-6c529e7b9626 None admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:11:15.946975 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93c282c-5d00-4750-a9d3-6c529e7b9626 None admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:11:15.981667 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9bf3967-cf15-4b6b-ac8d-c20213cf6af3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:11:15.982471 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bf3967-cf15-4b6b-ac8d-c20213cf6af3 None admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:11:15.982746 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bf3967-cf15-4b6b-ac8d-c20213cf6af3 None admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:11:15.983018 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bf3967-cf15-4b6b-ac8d-c20213cf6af3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:11:15.989988 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9bf3967-cf15-4b6b-ac8d-c20213cf6af3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:11:15.991447 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9bf3967-cf15-4b6b-ac8d-c20213cf6af3 None admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:11:16.006391 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application [None req-c9bf3967-cf15-4b6b-ac8d-c20213cf6af3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 04 07:11:16.006391 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 07:11:16.006391 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 07:11:16.006391 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 07:11:16.006391 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 07:11:16.006391 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 07:11:16.006391 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 07:11:16.006391 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 07:11:16.006391 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 07:11:16.006391 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 07:11:16.006391 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 07:11:16.006391 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 07:11:16.006391 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 04 07:11:16.006391 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self._get_project(project_id) May 04 07:11:16.006391 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 04 07:11:16.007704 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 04 07:11:16.007704 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 07:11:16.007704 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 07:11:16.007704 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 07:11:16.007704 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 07:11:16.007704 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 07:11:16.007704 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.get_or_create( May 04 07:11:16.007704 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 07:11:16.007704 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application with Lock( May 04 07:11:16.007704 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 07:11:16.007704 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self._enter() May 04 07:11:16.007704 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 07:11:16.007704 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 07:11:16.007704 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 07:11:16.007704 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.creator() May 04 07:11:16.007704 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 07:11:16.007704 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application created_value = creator( May 04 07:11:16.009220 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 04 07:11:16.009220 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 04 07:11:16.009220 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 04 07:11:16.009220 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 04 07:11:16.009220 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 04 07:11:16.009220 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 04 07:11:16.009220 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 04 07:11:16.009220 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application May 04 07:11:16.009220 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 389/764] 10.222.0.21 () {56 vars in 1111 bytes} [Wed May 4 07:11:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 07:11:16.014398 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9541ac2-6262-4e24-9034-9705de186918 None admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:11:16.142124 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9541ac2-6262-4e24-9034-9705de186918 None admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:11:16.188206 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de399c56-47ee-4cfe-8b9b-083164b45b34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:11:16.188871 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de399c56-47ee-4cfe-8b9b-083164b45b34 None admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:11:16.189140 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de399c56-47ee-4cfe-8b9b-083164b45b34 None admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:11:16.189416 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de399c56-47ee-4cfe-8b9b-083164b45b34 None admin] PATH_INFO: `/v3/projects` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:11:16.190197 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de399c56-47ee-4cfe-8b9b-083164b45b34 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 07:11:16.190503 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de399c56-47ee-4cfe-8b9b-083164b45b34 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:11:16.191945 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de399c56-47ee-4cfe-8b9b-083164b45b34 None admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:11:16.213678 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 376/765] 10.222.0.21 () {56 vars in 1148 bytes} [Wed May 4 07:11:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 07:11:16.219948 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9bf3967-cf15-4b6b-ac8d-c20213cf6af3 None admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:11:16.346742 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9bf3967-cf15-4b6b-ac8d-c20213cf6af3 None admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:11:16.380880 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4fb552-e254-43fc-98ba-ce3cb252eba6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:11:16.381773 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4fb552-e254-43fc-98ba-ce3cb252eba6 None admin] REQUEST_METHOD: `PUT` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:11:16.382300 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4fb552-e254-43fc-98ba-ce3cb252eba6 None admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:11:16.382569 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4fb552-e254-43fc-98ba-ce3cb252eba6 None admin] PATH_INFO: `/v3/projects/c9f9c44db4984653b8d4b5f6b3b949f5/users/1077289fedae43b6be47be7f716d573a/roles/eb54c9cea2774a25b1fe8c79724408ee` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:11:16.384534 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4fb552-e254-43fc-98ba-ce3cb252eba6 None admin] RBAC: Authorizing `identity:create_grant(project_id=c9f9c44db4984653b8d4b5f6b3b949f5, user_id=1077289fedae43b6be47be7f716d573a, role_id=eb54c9cea2774a25b1fe8c79724408ee)` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:11:16.386492 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4fb552-e254-43fc-98ba-ce3cb252eba6 None admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:11:16.409054 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 390/766] 10.222.0.21 () {58 vars in 1439 bytes} [Wed May 4 07:11:16 2022] PUT /identity/v3/projects/c9f9c44db4984653b8d4b5f6b3b949f5/users/1077289fedae43b6be47be7f716d573a/roles/eb54c9cea2774a25b1fe8c79724408ee => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 07:11:16.995068 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f9aad5-2c11-40d3-bfab-effa1022c8bf None None] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:11:16.996884 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f9aad5-2c11-40d3-bfab-effa1022c8bf None None] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:11:16.997379 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f9aad5-2c11-40d3-bfab-effa1022c8bf None None] PATH_INFO: `/` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:11:16.999254 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 377/767] 10.222.0.21 () {54 vars in 926 bytes} [Wed May 4 07:11:16 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 07:11:17.004243 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa6c68b-1d9b-4936-8b08-477baec8cbe9 None None] REQUEST_METHOD: `POST` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:11:17.005064 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa6c68b-1d9b-4936-8b08-477baec8cbe9 None None] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:11:17.005564 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa6c68b-1d9b-4936-8b08-477baec8cbe9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:11:17.028259 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.auth.core [None req-3aa6c68b-1d9b-4936-8b08-477baec8cbe9 None None] MFA Rules not processed for user `83c5e0dcb991496ea6dee38384514508`. Rule list: `[]` (Enabled: `True`). {{(pid=79744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:11:17.029783 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.fernet_utils [None req-3aa6c68b-1d9b-4936-8b08-477baec8cbe9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:11:17.115173 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 391/768] 10.222.0.21 () {58 vars in 1023 bytes} [Wed May 4 07:11:17 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 07:11:17.158242 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f9aad5-2c11-40d3-bfab-effa1022c8bf None None] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:11:17.267916 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f9aad5-2c11-40d3-bfab-effa1022c8bf None None] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:11:17.306190 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab86dc3-cfaf-4ec8-aa3c-5eb21fa0d72e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:11:17.307366 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab86dc3-cfaf-4ec8-aa3c-5eb21fa0d72e None admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:11:17.308455 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab86dc3-cfaf-4ec8-aa3c-5eb21fa0d72e None admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:11:17.309077 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab86dc3-cfaf-4ec8-aa3c-5eb21fa0d72e None admin] PATH_INFO: `/v3/services/network` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:11:17.309961 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab86dc3-cfaf-4ec8-aa3c-5eb21fa0d72e None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:11:17.311564 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab86dc3-cfaf-4ec8-aa3c-5eb21fa0d72e None admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:11:17.324058 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application [None req-fab86dc3-cfaf-4ec8-aa3c-5eb21fa0d72e None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. May 04 07:11:17.324058 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 07:11:17.324058 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 04 07:11:17.324058 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 04 07:11:17.324058 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 04 07:11:17.324058 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 04 07:11:17.324058 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 04 07:11:17.324058 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 07:11:17.324058 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 04 07:11:17.324058 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application May 04 07:11:17.324058 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 04 07:11:17.324058 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application May 04 07:11:17.324058 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 07:11:17.324058 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 07:11:17.324058 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 07:11:17.324058 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 07:11:17.324058 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 07:11:17.325086 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 07:11:17.325086 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 07:11:17.325086 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 07:11:17.325086 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 07:11:17.325086 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 07:11:17.325086 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 07:11:17.325086 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 04 07:11:17.325086 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self._get_service(service_id) May 04 07:11:17.325086 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 04 07:11:17.325086 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 04 07:11:17.325086 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 07:11:17.325086 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 07:11:17.325086 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 07:11:17.325086 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 07:11:17.325086 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 07:11:17.325086 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self.get_or_create( May 04 07:11:17.325933 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 07:11:17.325933 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application with Lock( May 04 07:11:17.325933 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 07:11:17.325933 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self._enter() May 04 07:11:17.325933 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 07:11:17.325933 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 07:11:17.325933 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 07:11:17.325933 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self.creator() May 04 07:11:17.325933 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 07:11:17.325933 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application created_value = creator( May 04 07:11:17.325933 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 04 07:11:17.325933 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 07:11:17.325933 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 04 07:11:17.325933 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application May 04 07:11:17.328869 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 378/769] 10.222.0.21 () {56 vars in 1111 bytes} [Wed May 4 07:11:17 2022] GET /identity/v3/services/network => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 07:11:17.334483 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa6c68b-1d9b-4936-8b08-477baec8cbe9 None None] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:11:17.508582 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa6c68b-1d9b-4936-8b08-477baec8cbe9 None None] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:11:17.561025 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887286ad-470b-401f-836f-afa50c692ad1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:11:17.561711 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887286ad-470b-401f-836f-afa50c692ad1 None admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:11:17.561988 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887286ad-470b-401f-836f-afa50c692ad1 None admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:11:17.562258 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887286ad-470b-401f-836f-afa50c692ad1 None admin] PATH_INFO: `/v3/services` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:11:17.562975 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887286ad-470b-401f-836f-afa50c692ad1 None admin] RBAC: Adding query filter params (name=network) {{(pid=79744) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 07:11:17.563315 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887286ad-470b-401f-836f-afa50c692ad1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:11:17.564687 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887286ad-470b-401f-836f-afa50c692ad1 None admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:11:17.576360 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 392/770] 10.222.0.21 () {56 vars in 1112 bytes} [Wed May 4 07:11:17 2022] GET /identity/v3/services?name=network => generated 124 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 07:11:17.581582 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab86dc3-cfaf-4ec8-aa3c-5eb21fa0d72e None admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:11:17.734869 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab86dc3-cfaf-4ec8-aa3c-5eb21fa0d72e None admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:11:17.773831 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251f198f-8441-48d3-bc63-6f49fafe0320 None None] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:11:17.774491 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251f198f-8441-48d3-bc63-6f49fafe0320 None None] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:11:17.774970 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251f198f-8441-48d3-bc63-6f49fafe0320 None None] PATH_INFO: `/` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:11:17.781992 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 393/771] 10.222.0.21 () {54 vars in 926 bytes} [Wed May 4 07:11:17 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 04 07:11:17.784323 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d12fb1-538c-473a-a77d-5fa24723663b None None] REQUEST_METHOD: `POST` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:11:17.785237 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d12fb1-538c-473a-a77d-5fa24723663b None None] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:11:17.785990 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d12fb1-538c-473a-a77d-5fa24723663b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:11:17.793450 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684da77d-7753-4973-bbed-5c533fba2255 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:11:17.794123 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684da77d-7753-4973-bbed-5c533fba2255 None admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:11:17.794405 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684da77d-7753-4973-bbed-5c533fba2255 None admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:11:17.794681 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684da77d-7753-4973-bbed-5c533fba2255 None admin] PATH_INFO: `/v3/services` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:11:17.795419 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684da77d-7753-4973-bbed-5c533fba2255 None admin] RBAC: Adding query filter params (type=network) {{(pid=79745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 07:11:17.795726 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684da77d-7753-4973-bbed-5c533fba2255 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:11:17.797096 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684da77d-7753-4973-bbed-5c533fba2255 None admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:11:17.805180 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.auth.core [None req-c4d12fb1-538c-473a-a77d-5fa24723663b None None] MFA Rules not processed for user `83c5e0dcb991496ea6dee38384514508`. Rule list: `[]` (Enabled: `True`). {{(pid=79744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:11:17.806704 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.fernet_utils [None req-c4d12fb1-538c-473a-a77d-5fa24723663b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:11:17.807648 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 379/772] 10.222.0.21 () {56 vars in 1112 bytes} [Wed May 4 07:11:17 2022] GET /identity/v3/services?type=network => generated 350 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 07:11:17.814326 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684da77d-7753-4973-bbed-5c533fba2255 None admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:11:17.924971 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684da77d-7753-4973-bbed-5c533fba2255 None admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:11:17.957629 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 394/773] 10.222.0.21 () {58 vars in 1023 bytes} [Wed May 4 07:11:17 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 04 07:11:17.962760 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb4727b-083e-4822-8044-1ce28a13b693 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:11:17.963719 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb4727b-083e-4822-8044-1ce28a13b693 None admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:11:17.964258 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb4727b-083e-4822-8044-1ce28a13b693 None admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:11:17.964764 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb4727b-083e-4822-8044-1ce28a13b693 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:11:17.965824 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb4727b-083e-4822-8044-1ce28a13b693 None admin] RBAC: Adding query filter params (interface=public, service_id=6abb6f0d859e4ae5983270936bf839f0, region_id=RegionOne) {{(pid=79745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 07:11:17.966342 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb4727b-083e-4822-8044-1ce28a13b693 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:11:17.967972 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb4727b-083e-4822-8044-1ce28a13b693 None admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:11:17.976323 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 380/774] 10.222.0.21 () {56 vars in 1251 bytes} [Wed May 4 07:11:17 2022] GET /identity/v3/endpoints?service_id=6abb6f0d859e4ae5983270936bf839f0&interface=public®ion_id=RegionOne => generated 194 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 07:11:17.983223 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d12fb1-538c-473a-a77d-5fa24723663b None None] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:11:17.997898 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb4727b-083e-4822-8044-1ce28a13b693 None admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:11:18.096834 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d12fb1-538c-473a-a77d-5fa24723663b None None] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:11:18.097926 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb4727b-083e-4822-8044-1ce28a13b693 None admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:11:18.130612 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf92d13-24a8-420a-b880-d867ea43ec57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:11:18.131297 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf92d13-24a8-420a-b880-d867ea43ec57 None admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:11:18.131574 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf92d13-24a8-420a-b880-d867ea43ec57 None admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:11:18.131838 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf92d13-24a8-420a-b880-d867ea43ec57 None admin] PATH_INFO: `/v3/services` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:11:18.132766 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf92d13-24a8-420a-b880-d867ea43ec57 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:11:18.133846 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b88f870-28b1-40bb-a2f7-68873a1fabfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:11:18.134112 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf92d13-24a8-420a-b880-d867ea43ec57 None admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:11:18.135076 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b88f870-28b1-40bb-a2f7-68873a1fabfc None admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:11:18.135544 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b88f870-28b1-40bb-a2f7-68873a1fabfc None admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:11:18.136110 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b88f870-28b1-40bb-a2f7-68873a1fabfc None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:11:18.137018 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b88f870-28b1-40bb-a2f7-68873a1fabfc None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:11:18.138519 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b88f870-28b1-40bb-a2f7-68873a1fabfc None admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:11:18.147175 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 395/775] 10.222.0.21 () {56 vars in 1087 bytes} [Wed May 4 07:11:17 2022] GET /identity/v3/services => generated 772 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 07:11:18.147175 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef07c51-5f2b-46fa-893a-cf054ff8d758 None None] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:11:18.147175 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef07c51-5f2b-46fa-893a-cf054ff8d758 None None] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:11:18.147175 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef07c51-5f2b-46fa-893a-cf054ff8d758 None None] PATH_INFO: `/` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:11:18.147175 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 396/776] 10.222.0.21 () {54 vars in 926 bytes} [Wed May 4 07:11:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 07:11:18.149349 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78882fe-d997-49b5-a85a-1aa857c1db92 None None] REQUEST_METHOD: `POST` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:11:18.149728 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78882fe-d997-49b5-a85a-1aa857c1db92 None None] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:11:18.150096 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78882fe-d997-49b5-a85a-1aa857c1db92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:11:18.167069 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application [None req-8b88f870-28b1-40bb-a2f7-68873a1fabfc None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. May 04 07:11:18.167069 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 07:11:18.167069 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 04 07:11:18.167069 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 04 07:11:18.167069 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 04 07:11:18.167069 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 04 07:11:18.167069 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 04 07:11:18.167069 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 07:11:18.167069 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 04 07:11:18.167069 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application May 04 07:11:18.167069 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 04 07:11:18.167069 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application May 04 07:11:18.167069 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 07:11:18.167069 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 07:11:18.167069 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 07:11:18.167069 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 07:11:18.168165 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 07:11:18.168165 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 07:11:18.168165 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 07:11:18.168165 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 07:11:18.168165 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 07:11:18.168165 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 07:11:18.168165 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 07:11:18.168165 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 04 07:11:18.168165 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self._get_service(service_id) May 04 07:11:18.168165 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 04 07:11:18.168165 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 04 07:11:18.168165 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 07:11:18.168165 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 07:11:18.168165 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 07:11:18.168165 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 07:11:18.168165 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 07:11:18.169172 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self.get_or_create( May 04 07:11:18.169172 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 07:11:18.169172 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application with Lock( May 04 07:11:18.169172 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 07:11:18.169172 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self._enter() May 04 07:11:18.169172 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 07:11:18.169172 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 07:11:18.169172 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 07:11:18.169172 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self.creator() May 04 07:11:18.169172 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 07:11:18.169172 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application created_value = creator( May 04 07:11:18.169172 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 04 07:11:18.169172 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 07:11:18.169172 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 04 07:11:18.169172 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application May 04 07:11:18.171910 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 381/777] 10.222.0.21 () {56 vars in 1129 bytes} [Wed May 4 07:11:17 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 07:11:18.177868 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b88f870-28b1-40bb-a2f7-68873a1fabfc None admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:11:18.180907 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.auth.core [None req-b78882fe-d997-49b5-a85a-1aa857c1db92 None None] MFA Rules not processed for user `83c5e0dcb991496ea6dee38384514508`. Rule list: `[]` (Enabled: `True`). {{(pid=79744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:11:18.182624 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.fernet_utils [None req-b78882fe-d997-49b5-a85a-1aa857c1db92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:11:18.259619 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 397/778] 10.222.0.21 () {58 vars in 1023 bytes} [Wed May 4 07:11:18 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 04 07:11:18.282749 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78882fe-d997-49b5-a85a-1aa857c1db92 None None] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:11:18.390067 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78882fe-d997-49b5-a85a-1aa857c1db92 None None] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:11:18.420761 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b88f870-28b1-40bb-a2f7-68873a1fabfc None admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:11:18.425147 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc67ab07-3463-4ac7-94be-b10c7e32a799 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:11:18.426002 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc67ab07-3463-4ac7-94be-b10c7e32a799 None admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:11:18.426281 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc67ab07-3463-4ac7-94be-b10c7e32a799 None admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:11:18.426549 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc67ab07-3463-4ac7-94be-b10c7e32a799 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:11:18.439760 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc67ab07-3463-4ac7-94be-b10c7e32a799 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 07:11:18.453720 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application [None req-bc67ab07-3463-4ac7-94be-b10c7e32a799 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 04 07:11:18.453720 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 07:11:18.453720 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 07:11:18.453720 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 07:11:18.453720 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 07:11:18.453720 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 07:11:18.453720 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 07:11:18.453720 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 07:11:18.453720 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 07:11:18.453720 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 07:11:18.453720 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 07:11:18.453720 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 07:11:18.453720 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 07:11:18.453720 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 07:11:18.453720 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 07:11:18.453720 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 07:11:18.454736 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 07:11:18.454736 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 07:11:18.454736 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 07:11:18.454736 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 07:11:18.454736 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 07:11:18.454736 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 07:11:18.454736 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 07:11:18.454736 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 07:11:18.454736 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 07:11:18.454736 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.get_or_create( May 04 07:11:18.454736 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 07:11:18.454736 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application with Lock( May 04 07:11:18.454736 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 07:11:18.454736 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self._enter() May 04 07:11:18.454736 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 07:11:18.454736 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 07:11:18.455630 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 07:11:18.455630 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.creator() May 04 07:11:18.455630 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 07:11:18.455630 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application created_value = creator( May 04 07:11:18.455630 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 07:11:18.455630 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 07:11:18.455630 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 07:11:18.455630 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 07:11:18.455630 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 07:11:18.455630 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 07:11:18.455630 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 04 07:11:18.455630 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application May 04 07:11:18.455630 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 398/779] 10.222.0.21 () {56 vars in 1096 bytes} [Wed May 4 07:11:18 2022] GET /identity/v3/roles/admin => generated 83 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 07:11:18.460706 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc67ab07-3463-4ac7-94be-b10c7e32a799 None admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:11:18.482530 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e510adc-1f15-4311-b2a1-95ee731f5280 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:11:18.483234 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e510adc-1f15-4311-b2a1-95ee731f5280 None admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:11:18.483513 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e510adc-1f15-4311-b2a1-95ee731f5280 None admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:11:18.483781 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e510adc-1f15-4311-b2a1-95ee731f5280 None admin] PATH_INFO: `/v3/services` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:11:18.484489 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e510adc-1f15-4311-b2a1-95ee731f5280 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=79745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 07:11:18.484789 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e510adc-1f15-4311-b2a1-95ee731f5280 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:11:18.486161 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e510adc-1f15-4311-b2a1-95ee731f5280 None admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:11:18.491266 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 382/780] 10.222.0.21 () {56 vars in 1124 bytes} [Wed May 4 07:11:18 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 07:11:18.497635 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e510adc-1f15-4311-b2a1-95ee731f5280 None admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:11:18.577541 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc67ab07-3463-4ac7-94be-b10c7e32a799 None admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:11:18.613755 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a480f79a-c317-459f-a837-ff7cab4e167c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:11:18.615080 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a480f79a-c317-459f-a837-ff7cab4e167c None admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:11:18.615780 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a480f79a-c317-459f-a837-ff7cab4e167c None admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:11:18.616578 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a480f79a-c317-459f-a837-ff7cab4e167c None admin] PATH_INFO: `/v3/roles` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:11:18.617833 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a480f79a-c317-459f-a837-ff7cab4e167c None admin] RBAC: Adding query filter params (name=admin) {{(pid=79744) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 07:11:18.618498 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a480f79a-c317-459f-a837-ff7cab4e167c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:11:18.621366 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a480f79a-c317-459f-a837-ff7cab4e167c None admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:11:18.622111 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e510adc-1f15-4311-b2a1-95ee731f5280 None admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:11:18.632848 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 399/781] 10.222.0.21 () {56 vars in 1099 bytes} [Wed May 4 07:11:18 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 07:11:18.634546 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f805f4-a44d-4873-959e-fe147bea77dd None None] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:11:18.635042 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f805f4-a44d-4873-959e-fe147bea77dd None None] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:11:18.635540 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f805f4-a44d-4873-959e-fe147bea77dd None None] PATH_INFO: `/` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:11:18.637639 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 400/782] 10.222.0.21 () {54 vars in 926 bytes} [Wed May 4 07:11:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 07:11:18.639298 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f805f4-a44d-4873-959e-fe147bea77dd None None] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:11:18.662319 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9057e68-c066-40b5-82de-e877ad1f5978 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:11:18.662901 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9057e68-c066-40b5-82de-e877ad1f5978 None admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:11:18.663205 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9057e68-c066-40b5-82de-e877ad1f5978 None admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:11:18.663479 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9057e68-c066-40b5-82de-e877ad1f5978 None admin] PATH_INFO: `/v3/services` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:11:18.664180 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9057e68-c066-40b5-82de-e877ad1f5978 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=79745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 07:11:18.664479 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9057e68-c066-40b5-82de-e877ad1f5978 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:11:18.665838 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9057e68-c066-40b5-82de-e877ad1f5978 None admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:11:18.671811 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 383/783] 10.222.0.21 () {56 vars in 1124 bytes} [Wed May 4 07:11:18 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 07:11:18.673025 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176a327a-4b94-4ca7-b61f-231b8fe15ea4 None None] REQUEST_METHOD: `POST` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:11:18.673303 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176a327a-4b94-4ca7-b61f-231b8fe15ea4 None None] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:11:18.673569 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176a327a-4b94-4ca7-b61f-231b8fe15ea4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:11:18.690937 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.auth.core [None req-176a327a-4b94-4ca7-b61f-231b8fe15ea4 None None] MFA Rules not processed for user `83c5e0dcb991496ea6dee38384514508`. Rule list: `[]` (Enabled: `True`). {{(pid=79745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:11:18.695096 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.fernet_utils [None req-176a327a-4b94-4ca7-b61f-231b8fe15ea4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:11:18.766358 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 384/784] 10.222.0.21 () {58 vars in 1023 bytes} [Wed May 4 07:11:18 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 07:11:18.767712 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176a327a-4b94-4ca7-b61f-231b8fe15ea4 None None] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:11:18.775011 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f805f4-a44d-4873-959e-fe147bea77dd None None] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:11:18.821331 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55a2646-e244-4c4d-98bc-7b40f209e4bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:11:18.822978 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55a2646-e244-4c4d-98bc-7b40f209e4bb None admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:11:18.824184 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55a2646-e244-4c4d-98bc-7b40f209e4bb None admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:11:18.824731 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55a2646-e244-4c4d-98bc-7b40f209e4bb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:11:18.837939 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55a2646-e244-4c4d-98bc-7b40f209e4bb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:11:18.840894 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55a2646-e244-4c4d-98bc-7b40f209e4bb None admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:11:18.862907 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application [None req-a55a2646-e244-4c4d-98bc-7b40f209e4bb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 07:11:18.862907 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 07:11:18.862907 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 07:11:18.862907 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 07:11:18.862907 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 07:11:18.862907 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 07:11:18.862907 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 07:11:18.862907 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 07:11:18.862907 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 07:11:18.862907 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 07:11:18.862907 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 07:11:18.862907 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 07:11:18.862907 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 07:11:18.862907 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 07:11:18.862907 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 07:11:18.863926 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 07:11:18.863926 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 07:11:18.863926 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 07:11:18.863926 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 07:11:18.863926 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 07:11:18.863926 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 07:11:18.863926 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.get_or_create( May 04 07:11:18.863926 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 07:11:18.863926 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application with Lock( May 04 07:11:18.863926 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 07:11:18.863926 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self._enter() May 04 07:11:18.863926 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 07:11:18.863926 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 07:11:18.863926 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 07:11:18.863926 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.creator() May 04 07:11:18.863926 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 07:11:18.863926 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application created_value = creator( May 04 07:11:18.864821 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 07:11:18.864821 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 07:11:18.864821 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 07:11:18.864821 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application May 04 07:11:18.867810 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 401/785] 10.222.0.21 () {56 vars in 1108 bytes} [Wed May 4 07:11:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 07:11:18.869020 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55a2646-e244-4c4d-98bc-7b40f209e4bb None admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:11:18.884086 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176a327a-4b94-4ca7-b61f-231b8fe15ea4 None None] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:11:18.928045 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2cdd0ed-47ea-40f1-811a-ebbcbe56f250 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:11:18.929059 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cdd0ed-47ea-40f1-811a-ebbcbe56f250 None admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:11:18.929447 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cdd0ed-47ea-40f1-811a-ebbcbe56f250 None admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:11:18.929821 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cdd0ed-47ea-40f1-811a-ebbcbe56f250 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:11:18.930984 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2cdd0ed-47ea-40f1-811a-ebbcbe56f250 None admin] RBAC: Adding query filter params (interface=public, service_id=c46e70a468804faaaeb0f76a090b0c91, region_id=RegionOne) {{(pid=79745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 07:11:18.931440 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2cdd0ed-47ea-40f1-811a-ebbcbe56f250 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:11:18.933915 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2cdd0ed-47ea-40f1-811a-ebbcbe56f250 None admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:11:18.943230 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 385/786] 10.222.0.21 () {56 vars in 1251 bytes} [Wed May 4 07:11:18 2022] GET /identity/v3/endpoints?service_id=c46e70a468804faaaeb0f76a090b0c91&interface=public®ion_id=RegionOne => generated 194 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 07:11:18.944426 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2cdd0ed-47ea-40f1-811a-ebbcbe56f250 None admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:11:18.992442 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55a2646-e244-4c4d-98bc-7b40f209e4bb None admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:11:19.032875 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2eea2d-94fd-4231-b1f8-a65f55941665 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:11:19.033833 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2eea2d-94fd-4231-b1f8-a65f55941665 None admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:11:19.034321 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2eea2d-94fd-4231-b1f8-a65f55941665 None admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:11:19.034563 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2eea2d-94fd-4231-b1f8-a65f55941665 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:11:19.048120 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2eea2d-94fd-4231-b1f8-a65f55941665 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 07:11:19.050580 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2cdd0ed-47ea-40f1-811a-ebbcbe56f250 None admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:11:19.060338 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application [None req-5a2eea2d-94fd-4231-b1f8-a65f55941665 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 04 07:11:19.060338 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 07:11:19.060338 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 07:11:19.060338 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 07:11:19.060338 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 07:11:19.060338 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 07:11:19.060338 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 07:11:19.060338 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 07:11:19.060338 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 07:11:19.060338 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 07:11:19.060338 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 07:11:19.060338 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 07:11:19.060338 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 07:11:19.060338 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 07:11:19.060338 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 07:11:19.060338 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 07:11:19.061335 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 07:11:19.061335 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 07:11:19.061335 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 07:11:19.061335 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 07:11:19.061335 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 07:11:19.061335 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 07:11:19.061335 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 07:11:19.061335 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 07:11:19.061335 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 07:11:19.061335 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.get_or_create( May 04 07:11:19.061335 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 07:11:19.061335 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application with Lock( May 04 07:11:19.061335 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 07:11:19.061335 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self._enter() May 04 07:11:19.061335 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 07:11:19.061335 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 07:11:19.062198 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 07:11:19.062198 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.creator() May 04 07:11:19.062198 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 07:11:19.062198 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application created_value = creator( May 04 07:11:19.062198 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 07:11:19.062198 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 07:11:19.062198 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 07:11:19.062198 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 07:11:19.062198 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 07:11:19.062198 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 07:11:19.062198 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 04 07:11:19.062198 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application May 04 07:11:19.066758 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 402/787] 10.222.0.21 () {56 vars in 1102 bytes} [Wed May 4 07:11:18 2022] GET /identity/v3/roles/service => generated 85 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 07:11:19.067704 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2eea2d-94fd-4231-b1f8-a65f55941665 None admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:11:19.090465 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b468558-f037-488d-be6d-b7870972cda9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:11:19.091589 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b468558-f037-488d-be6d-b7870972cda9 None admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:11:19.092052 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b468558-f037-488d-be6d-b7870972cda9 None admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:11:19.092498 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b468558-f037-488d-be6d-b7870972cda9 None admin] PATH_INFO: `/v3/domains` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:11:19.093395 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b468558-f037-488d-be6d-b7870972cda9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 07:11:19.093895 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b468558-f037-488d-be6d-b7870972cda9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:11:19.095472 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b468558-f037-488d-be6d-b7870972cda9 None admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:11:19.107688 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 386/788] 10.222.0.21 () {56 vars in 1109 bytes} [Wed May 4 07:11:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 07:11:19.108856 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b468558-f037-488d-be6d-b7870972cda9 None admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:11:19.171775 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2eea2d-94fd-4231-b1f8-a65f55941665 None admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:11:19.204999 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68927529-623d-479f-929f-9c06616ce0eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:11:19.205519 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68927529-623d-479f-929f-9c06616ce0eb None admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:11:19.205770 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68927529-623d-479f-929f-9c06616ce0eb None admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:11:19.206042 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68927529-623d-479f-929f-9c06616ce0eb None admin] PATH_INFO: `/v3/services` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:11:19.206719 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68927529-623d-479f-929f-9c06616ce0eb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:11:19.208317 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68927529-623d-479f-929f-9c06616ce0eb None admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:11:19.211183 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b468558-f037-488d-be6d-b7870972cda9 None admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:11:19.213017 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 403/789] 10.222.0.21 () {56 vars in 1087 bytes} [Wed May 4 07:11:19 2022] GET /identity/v3/services => generated 772 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 07:11:19.214951 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68927529-623d-479f-929f-9c06616ce0eb None admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:11:19.257620 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2c5345-32f6-4280-9a6c-8079ade0ea19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:11:19.258947 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2c5345-32f6-4280-9a6c-8079ade0ea19 None admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:11:19.259360 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2c5345-32f6-4280-9a6c-8079ade0ea19 None admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:11:19.260040 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2c5345-32f6-4280-9a6c-8079ade0ea19 None admin] PATH_INFO: `/v3/roles` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:11:19.261546 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2c5345-32f6-4280-9a6c-8079ade0ea19 None admin] RBAC: Adding query filter params (name=service) {{(pid=79745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 07:11:19.262224 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2c5345-32f6-4280-9a6c-8079ade0ea19 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:11:19.264168 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2c5345-32f6-4280-9a6c-8079ade0ea19 None admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:11:19.279372 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 387/790] 10.222.0.21 () {56 vars in 1103 bytes} [Wed May 4 07:11:19 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 07:11:19.281207 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fbe483-c15b-47fa-9843-2e1bc407686f None None] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:11:19.281498 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fbe483-c15b-47fa-9843-2e1bc407686f None None] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:11:19.281779 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fbe483-c15b-47fa-9843-2e1bc407686f None None] PATH_INFO: `/` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:11:19.283214 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 388/791] 10.222.0.21 () {54 vars in 926 bytes} [Wed May 4 07:11:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 07:11:19.288324 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fbe483-c15b-47fa-9843-2e1bc407686f None None] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:11:19.355236 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68927529-623d-479f-929f-9c06616ce0eb None admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:11:19.394219 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3ef6df-8873-4d7b-abcf-e9d74c328057 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:11:19.395357 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3ef6df-8873-4d7b-abcf-e9d74c328057 None admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:11:19.395357 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3ef6df-8873-4d7b-abcf-e9d74c328057 None admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:11:19.395644 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3ef6df-8873-4d7b-abcf-e9d74c328057 None admin] PATH_INFO: `/v3/users/swift` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:11:19.407523 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3ef6df-8873-4d7b-abcf-e9d74c328057 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:11:19.409079 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3ef6df-8873-4d7b-abcf-e9d74c328057 None admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:11:19.425445 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fbe483-c15b-47fa-9843-2e1bc407686f None None] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:11:19.425856 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application [None req-da3ef6df-8873-4d7b-abcf-e9d74c328057 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 04 07:11:19.425856 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 07:11:19.425856 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 07:11:19.425856 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 07:11:19.425856 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 07:11:19.425856 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 07:11:19.425856 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 07:11:19.425856 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 07:11:19.425856 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 07:11:19.425856 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 07:11:19.425856 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 07:11:19.425856 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 07:11:19.425856 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 04 07:11:19.425856 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self._get_user(user_id) May 04 07:11:19.425856 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 04 07:11:19.425856 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 04 07:11:19.426772 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 07:11:19.426772 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 07:11:19.426772 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 04 07:11:19.426772 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 07:11:19.426772 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 04 07:11:19.426772 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 07:11:19.426772 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 07:11:19.426772 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 07:11:19.426772 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 07:11:19.426772 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.get_or_create( May 04 07:11:19.426772 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 07:11:19.426772 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application with Lock( May 04 07:11:19.426772 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 07:11:19.426772 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self._enter() May 04 07:11:19.426772 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 07:11:19.426772 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 07:11:19.426772 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 07:11:19.426772 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.creator() May 04 07:11:19.427803 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 07:11:19.427803 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application created_value = creator( May 04 07:11:19.427803 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 04 07:11:19.427803 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 04 07:11:19.427803 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 04 07:11:19.427803 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 04 07:11:19.427803 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 04 07:11:19.427803 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 04 07:11:19.427803 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 04 07:11:19.427803 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application May 04 07:11:19.427803 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 404/792] 10.222.0.21 () {56 vars in 1096 bytes} [Wed May 4 07:11:19 2022] GET /identity/v3/users/swift => generated 83 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 07:11:19.428915 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f7bd80-4cc8-45ea-b286-1ffa9f3fdc55 None None] REQUEST_METHOD: `POST` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:11:19.428915 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f7bd80-4cc8-45ea-b286-1ffa9f3fdc55 None None] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:11:19.429190 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f7bd80-4cc8-45ea-b286-1ffa9f3fdc55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:11:19.454172 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.auth.core [None req-23f7bd80-4cc8-45ea-b286-1ffa9f3fdc55 None None] MFA Rules not processed for user `83c5e0dcb991496ea6dee38384514508`. Rule list: `[]` (Enabled: `True`). {{(pid=79744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:11:19.455475 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.fernet_utils [None req-23f7bd80-4cc8-45ea-b286-1ffa9f3fdc55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:11:19.481266 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867116a1-60c2-4711-ae46-f2237bf833f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:11:19.483037 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867116a1-60c2-4711-ae46-f2237bf833f3 None admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:11:19.483649 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867116a1-60c2-4711-ae46-f2237bf833f3 None admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:11:19.484302 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867116a1-60c2-4711-ae46-f2237bf833f3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:11:19.497679 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867116a1-60c2-4711-ae46-f2237bf833f3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:11:19.500005 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867116a1-60c2-4711-ae46-f2237bf833f3 None admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:11:19.522785 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application [None req-867116a1-60c2-4711-ae46-f2237bf833f3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 07:11:19.522785 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 07:11:19.522785 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 07:11:19.522785 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 07:11:19.522785 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 07:11:19.522785 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 07:11:19.522785 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 07:11:19.522785 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 07:11:19.522785 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 07:11:19.522785 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 07:11:19.522785 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 07:11:19.522785 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 07:11:19.522785 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 07:11:19.522785 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 07:11:19.522785 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 07:11:19.523817 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 07:11:19.523817 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 07:11:19.523817 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 07:11:19.523817 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 07:11:19.523817 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 07:11:19.523817 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 07:11:19.523817 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self.get_or_create( May 04 07:11:19.523817 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 07:11:19.523817 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application with Lock( May 04 07:11:19.523817 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 07:11:19.523817 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self._enter() May 04 07:11:19.523817 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 07:11:19.523817 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 07:11:19.523817 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 07:11:19.523817 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self.creator() May 04 07:11:19.523817 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 07:11:19.523817 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application created_value = creator( May 04 07:11:19.524736 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 07:11:19.524736 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 07:11:19.524736 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 07:11:19.524736 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application May 04 07:11:19.524736 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 389/793] 10.222.0.21 () {56 vars in 1108 bytes} [Wed May 4 07:11:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 07:11:19.525555 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867116a1-60c2-4711-ae46-f2237bf833f3 None admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:11:19.537778 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 405/794] 10.222.0.21 () {58 vars in 1023 bytes} [Wed May 4 07:11:19 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 07:11:19.539371 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f7bd80-4cc8-45ea-b286-1ffa9f3fdc55 None None] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:11:19.653098 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867116a1-60c2-4711-ae46-f2237bf833f3 None admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:11:19.657853 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f7bd80-4cc8-45ea-b286-1ffa9f3fdc55 None None] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:11:19.693530 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1965998d-c3c1-4979-8d8f-167db2e433aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:11:19.694673 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1965998d-c3c1-4979-8d8f-167db2e433aa None admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:11:19.695261 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1965998d-c3c1-4979-8d8f-167db2e433aa None admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:11:19.695805 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1965998d-c3c1-4979-8d8f-167db2e433aa None admin] PATH_INFO: `/v3/users` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:11:19.696977 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1965998d-c3c1-4979-8d8f-167db2e433aa None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 07:11:19.697138 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759504e9-7e8b-4b76-8137-1dd615521409 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:11:19.697653 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1965998d-c3c1-4979-8d8f-167db2e433aa None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:11:19.697969 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759504e9-7e8b-4b76-8137-1dd615521409 None admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:11:19.698326 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759504e9-7e8b-4b76-8137-1dd615521409 None admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:11:19.698649 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759504e9-7e8b-4b76-8137-1dd615521409 None admin] PATH_INFO: `/v3/domains` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:11:19.699458 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759504e9-7e8b-4b76-8137-1dd615521409 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79744) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 07:11:19.699823 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759504e9-7e8b-4b76-8137-1dd615521409 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:11:19.700560 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1965998d-c3c1-4979-8d8f-167db2e433aa None admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:11:19.701316 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759504e9-7e8b-4b76-8137-1dd615521409 None admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:11:19.719367 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 406/795] 10.222.0.21 () {56 vars in 1109 bytes} [Wed May 4 07:11:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 07:11:19.720252 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759504e9-7e8b-4b76-8137-1dd615521409 None admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:11:19.723014 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 390/796] 10.222.0.21 () {56 vars in 1135 bytes} [Wed May 4 07:11:19 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 07:11:19.724821 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1965998d-c3c1-4979-8d8f-167db2e433aa None admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:11:19.821327 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759504e9-7e8b-4b76-8137-1dd615521409 None admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:11:19.855616 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966647af-7fae-4893-aea3-7a271407da88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:11:19.856517 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966647af-7fae-4893-aea3-7a271407da88 None admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:11:19.856881 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966647af-7fae-4893-aea3-7a271407da88 None admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:11:19.857223 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966647af-7fae-4893-aea3-7a271407da88 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:11:19.857332 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1965998d-c3c1-4979-8d8f-167db2e433aa None admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:11:19.869463 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966647af-7fae-4893-aea3-7a271407da88 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 07:11:19.880103 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application [None req-966647af-7fae-4893-aea3-7a271407da88 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 04 07:11:19.880103 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 07:11:19.880103 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 07:11:19.880103 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 07:11:19.880103 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 07:11:19.880103 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 07:11:19.880103 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 07:11:19.880103 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 07:11:19.880103 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 07:11:19.880103 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 07:11:19.880103 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 07:11:19.880103 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 07:11:19.880103 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 07:11:19.880103 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 07:11:19.880103 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 07:11:19.880103 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 07:11:19.881056 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 07:11:19.881056 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 07:11:19.881056 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 07:11:19.881056 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 07:11:19.881056 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 07:11:19.881056 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 07:11:19.881056 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 07:11:19.881056 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 07:11:19.881056 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 07:11:19.881056 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.get_or_create( May 04 07:11:19.881056 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 07:11:19.881056 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application with Lock( May 04 07:11:19.881056 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 07:11:19.881056 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self._enter() May 04 07:11:19.881056 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 07:11:19.881056 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 07:11:19.881914 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 07:11:19.881914 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.creator() May 04 07:11:19.881914 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 07:11:19.881914 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application created_value = creator( May 04 07:11:19.881914 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 07:11:19.881914 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 07:11:19.881914 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 07:11:19.881914 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 07:11:19.881914 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 07:11:19.881914 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 07:11:19.881914 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 04 07:11:19.881914 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application May 04 07:11:19.882812 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 407/797] 10.222.0.21 () {56 vars in 1096 bytes} [Wed May 4 07:11:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 07:11:19.883307 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966647af-7fae-4893-aea3-7a271407da88 None admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:11:19.898734 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def4425d-40d2-4f37-89cb-a0482bf70043 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:11:19.899931 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def4425d-40d2-4f37-89cb-a0482bf70043 None admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:11:19.900211 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def4425d-40d2-4f37-89cb-a0482bf70043 None admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:11:19.900479 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def4425d-40d2-4f37-89cb-a0482bf70043 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:11:19.910639 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def4425d-40d2-4f37-89cb-a0482bf70043 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:11:19.912541 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def4425d-40d2-4f37-89cb-a0482bf70043 None admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:11:19.931785 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application [None req-def4425d-40d2-4f37-89cb-a0482bf70043 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 04 07:11:19.931785 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 07:11:19.931785 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 07:11:19.931785 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 07:11:19.931785 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 07:11:19.931785 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 07:11:19.931785 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 07:11:19.931785 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 07:11:19.931785 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 07:11:19.931785 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 07:11:19.931785 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 07:11:19.931785 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 07:11:19.931785 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 04 07:11:19.931785 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self._get_user(user_id) May 04 07:11:19.931785 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 04 07:11:19.931785 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 04 07:11:19.933767 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 07:11:19.933767 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 07:11:19.933767 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 04 07:11:19.933767 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 07:11:19.933767 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 04 07:11:19.933767 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 07:11:19.933767 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 07:11:19.933767 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 07:11:19.933767 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 07:11:19.933767 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self.get_or_create( May 04 07:11:19.933767 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 07:11:19.933767 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application with Lock( May 04 07:11:19.933767 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 07:11:19.933767 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self._enter() May 04 07:11:19.933767 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 07:11:19.933767 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 07:11:19.933767 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 07:11:19.933767 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self.creator() May 04 07:11:19.935691 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 07:11:19.935691 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application created_value = creator( May 04 07:11:19.935691 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 04 07:11:19.935691 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 04 07:11:19.935691 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 04 07:11:19.935691 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 04 07:11:19.935691 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 04 07:11:19.935691 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 04 07:11:19.935691 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 04 07:11:19.935691 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application May 04 07:11:19.940587 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 391/798] 10.222.0.21 () {56 vars in 1117 bytes} [Wed May 4 07:11:19 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 07:11:19.940587 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def4425d-40d2-4f37-89cb-a0482bf70043 None admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:11:20.002340 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966647af-7fae-4893-aea3-7a271407da88 None admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:11:20.050909 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7384aaef-245f-4500-9c87-847178a1f3e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:11:20.052220 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7384aaef-245f-4500-9c87-847178a1f3e0 None admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:11:20.052573 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7384aaef-245f-4500-9c87-847178a1f3e0 None admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:11:20.052849 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7384aaef-245f-4500-9c87-847178a1f3e0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:11:20.064776 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def4425d-40d2-4f37-89cb-a0482bf70043 None admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:11:20.067274 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7384aaef-245f-4500-9c87-847178a1f3e0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:11:20.069638 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7384aaef-245f-4500-9c87-847178a1f3e0 None admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:11:20.093250 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application [None req-7384aaef-245f-4500-9c87-847178a1f3e0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 07:11:20.093250 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 07:11:20.093250 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 07:11:20.093250 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 07:11:20.093250 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 07:11:20.093250 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 07:11:20.093250 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 07:11:20.093250 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 07:11:20.093250 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 07:11:20.093250 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 07:11:20.093250 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 07:11:20.093250 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 07:11:20.093250 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 07:11:20.093250 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 07:11:20.093250 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 07:11:20.094659 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 07:11:20.094659 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 07:11:20.094659 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 07:11:20.094659 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 07:11:20.094659 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 07:11:20.094659 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 07:11:20.094659 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.get_or_create( May 04 07:11:20.094659 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 07:11:20.094659 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application with Lock( May 04 07:11:20.094659 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 07:11:20.094659 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self._enter() May 04 07:11:20.094659 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 07:11:20.094659 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 07:11:20.094659 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 07:11:20.094659 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.creator() May 04 07:11:20.094659 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 07:11:20.094659 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application created_value = creator( May 04 07:11:20.096155 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 07:11:20.096155 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 07:11:20.096155 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 07:11:20.096155 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application May 04 07:11:20.099523 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 408/799] 10.222.0.21 () {56 vars in 1108 bytes} [Wed May 4 07:11:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 07:11:20.100698 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7384aaef-245f-4500-9c87-847178a1f3e0 None admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:11:20.109109 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2feb3b23-27e9-4d37-9191-decc1f7f955a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:11:20.110026 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2feb3b23-27e9-4d37-9191-decc1f7f955a None admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:11:20.110394 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2feb3b23-27e9-4d37-9191-decc1f7f955a None admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:11:20.110761 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2feb3b23-27e9-4d37-9191-decc1f7f955a None admin] PATH_INFO: `/v3/roles` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:11:20.112054 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2feb3b23-27e9-4d37-9191-decc1f7f955a None admin] RBAC: Adding query filter params (name=admin) {{(pid=79745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 07:11:20.112473 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2feb3b23-27e9-4d37-9191-decc1f7f955a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:11:20.114304 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2feb3b23-27e9-4d37-9191-decc1f7f955a None admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:11:20.125359 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 392/800] 10.222.0.21 () {56 vars in 1099 bytes} [Wed May 4 07:11:19 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 07:11:20.125905 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2feb3b23-27e9-4d37-9191-decc1f7f955a None admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:11:20.241906 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7384aaef-245f-4500-9c87-847178a1f3e0 None admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:11:20.255892 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2feb3b23-27e9-4d37-9191-decc1f7f955a None admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:11:20.296318 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338c5551-90cd-41f2-8227-23d16461fd1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:11:20.297144 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338c5551-90cd-41f2-8227-23d16461fd1b None admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:11:20.297561 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338c5551-90cd-41f2-8227-23d16461fd1b None admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:11:20.297916 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338c5551-90cd-41f2-8227-23d16461fd1b None admin] PATH_INFO: `/v3/domains` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:11:20.298745 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338c5551-90cd-41f2-8227-23d16461fd1b None admin] RBAC: Adding query filter params (name=Default) {{(pid=79745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 07:11:20.299179 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338c5551-90cd-41f2-8227-23d16461fd1b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:11:20.300744 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338c5551-90cd-41f2-8227-23d16461fd1b None admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:11:20.307050 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfab9a7c-9871-456e-924b-650d91aa3a00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:11:20.307839 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfab9a7c-9871-456e-924b-650d91aa3a00 None admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:11:20.308062 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfab9a7c-9871-456e-924b-650d91aa3a00 None admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:11:20.308337 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfab9a7c-9871-456e-924b-650d91aa3a00 None admin] PATH_INFO: `/v3/users` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:11:20.309179 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfab9a7c-9871-456e-924b-650d91aa3a00 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79744) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 07:11:20.309558 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfab9a7c-9871-456e-924b-650d91aa3a00 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:11:20.311075 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfab9a7c-9871-456e-924b-650d91aa3a00 None admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:11:20.315129 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 393/801] 10.222.0.21 () {56 vars in 1109 bytes} [Wed May 4 07:11:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 07:11:20.316003 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338c5551-90cd-41f2-8227-23d16461fd1b None admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:11:20.336615 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 409/802] 10.222.0.21 () {56 vars in 1149 bytes} [Wed May 4 07:11:20 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 07:11:20.337430 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfab9a7c-9871-456e-924b-650d91aa3a00 None admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:11:20.428459 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338c5551-90cd-41f2-8227-23d16461fd1b None admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:11:20.449194 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfab9a7c-9871-456e-924b-650d91aa3a00 None admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:11:20.471181 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e60547-47b9-45ea-a9fc-4e5cc17a600e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:11:20.472002 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e60547-47b9-45ea-a9fc-4e5cc17a600e None admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:11:20.472281 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e60547-47b9-45ea-a9fc-4e5cc17a600e None admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:11:20.472552 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e60547-47b9-45ea-a9fc-4e5cc17a600e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:11:20.485016 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e60547-47b9-45ea-a9fc-4e5cc17a600e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:11:20.485807 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f1ff6f-620a-43a4-99e7-864f567515ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:11:20.486465 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e60547-47b9-45ea-a9fc-4e5cc17a600e None admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:11:20.486719 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f1ff6f-620a-43a4-99e7-864f567515ac None admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:11:20.487078 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f1ff6f-620a-43a4-99e7-864f567515ac None admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:11:20.487465 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f1ff6f-620a-43a4-99e7-864f567515ac None admin] PATH_INFO: `/v3/projects/service` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:11:20.500071 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f1ff6f-620a-43a4-99e7-864f567515ac None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:11:20.501513 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f1ff6f-620a-43a4-99e7-864f567515ac None admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:11:20.506067 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application [None req-b6e60547-47b9-45ea-a9fc-4e5cc17a600e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 07:11:20.506067 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 07:11:20.506067 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 07:11:20.506067 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 07:11:20.506067 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 07:11:20.506067 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 07:11:20.506067 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 07:11:20.506067 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 07:11:20.506067 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 07:11:20.506067 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 07:11:20.506067 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 07:11:20.506067 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 07:11:20.506067 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 07:11:20.506067 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 07:11:20.506067 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 07:11:20.508302 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 07:11:20.508302 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 07:11:20.508302 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 07:11:20.508302 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 07:11:20.508302 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 07:11:20.508302 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 07:11:20.508302 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self.get_or_create( May 04 07:11:20.508302 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 07:11:20.508302 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application with Lock( May 04 07:11:20.508302 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 07:11:20.508302 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self._enter() May 04 07:11:20.508302 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 07:11:20.508302 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 07:11:20.508302 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 07:11:20.508302 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self.creator() May 04 07:11:20.508302 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 07:11:20.508302 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application created_value = creator( May 04 07:11:20.510453 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 07:11:20.510453 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 07:11:20.510453 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 07:11:20.510453 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application May 04 07:11:20.510453 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 394/803] 10.222.0.21 () {56 vars in 1108 bytes} [Wed May 4 07:11:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 07:11:20.510453 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e60547-47b9-45ea-a9fc-4e5cc17a600e None admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:11:20.518965 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application [None req-87f1ff6f-620a-43a4-99e7-864f567515ac None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 04 07:11:20.518965 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 07:11:20.518965 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 07:11:20.518965 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 07:11:20.518965 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 07:11:20.518965 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 07:11:20.518965 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 07:11:20.518965 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 07:11:20.518965 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 07:11:20.518965 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 07:11:20.518965 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 07:11:20.518965 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 07:11:20.518965 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 04 07:11:20.518965 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self._get_project(project_id) May 04 07:11:20.518965 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 04 07:11:20.521990 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 04 07:11:20.521990 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 07:11:20.521990 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 07:11:20.521990 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 07:11:20.521990 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 07:11:20.521990 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 07:11:20.521990 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.get_or_create( May 04 07:11:20.521990 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 07:11:20.521990 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application with Lock( May 04 07:11:20.521990 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 07:11:20.521990 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self._enter() May 04 07:11:20.521990 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 07:11:20.521990 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 07:11:20.521990 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 07:11:20.521990 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.creator() May 04 07:11:20.521990 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 07:11:20.521990 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application created_value = creator( May 04 07:11:20.523918 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 04 07:11:20.523918 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 04 07:11:20.523918 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 04 07:11:20.523918 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 04 07:11:20.523918 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 04 07:11:20.523918 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 04 07:11:20.523918 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 04 07:11:20.523918 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application May 04 07:11:20.528234 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 410/804] 10.222.0.21 () {56 vars in 1111 bytes} [Wed May 4 07:11:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 07:11:20.528234 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f1ff6f-620a-43a4-99e7-864f567515ac None admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:11:20.633685 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e60547-47b9-45ea-a9fc-4e5cc17a600e None admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:11:20.641091 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f1ff6f-620a-43a4-99e7-864f567515ac None admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:11:20.674145 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbf4b8c-1e80-45d1-9a15-9bac1a8f855b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:11:20.675172 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbf4b8c-1e80-45d1-9a15-9bac1a8f855b None admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:11:20.675571 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbf4b8c-1e80-45d1-9a15-9bac1a8f855b None admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:11:20.675961 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbf4b8c-1e80-45d1-9a15-9bac1a8f855b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:11:20.677413 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2beb1f-1702-4d33-ad9f-8c749fcf3430 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:11:20.678071 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2beb1f-1702-4d33-ad9f-8c749fcf3430 None admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:11:20.678350 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2beb1f-1702-4d33-ad9f-8c749fcf3430 None admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:11:20.678618 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2beb1f-1702-4d33-ad9f-8c749fcf3430 None admin] PATH_INFO: `/v3/domains` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:11:20.679359 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2beb1f-1702-4d33-ad9f-8c749fcf3430 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79744) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 07:11:20.679661 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2beb1f-1702-4d33-ad9f-8c749fcf3430 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:11:20.681079 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2beb1f-1702-4d33-ad9f-8c749fcf3430 None admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:11:20.689815 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dbf4b8c-1e80-45d1-9a15-9bac1a8f855b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:11:20.691311 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dbf4b8c-1e80-45d1-9a15-9bac1a8f855b None admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:11:20.699233 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 411/805] 10.222.0.21 () {56 vars in 1109 bytes} [Wed May 4 07:11:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 07:11:20.700193 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2beb1f-1702-4d33-ad9f-8c749fcf3430 None admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:11:20.711789 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application [None req-7dbf4b8c-1e80-45d1-9a15-9bac1a8f855b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 07:11:20.711789 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 07:11:20.711789 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 07:11:20.711789 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 07:11:20.711789 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 07:11:20.711789 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 07:11:20.711789 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 07:11:20.711789 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 07:11:20.711789 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 07:11:20.711789 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 07:11:20.711789 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 07:11:20.711789 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 07:11:20.711789 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 07:11:20.711789 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 07:11:20.711789 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 07:11:20.713950 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 07:11:20.713950 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 07:11:20.713950 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 07:11:20.713950 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 07:11:20.713950 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 07:11:20.713950 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 07:11:20.713950 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self.get_or_create( May 04 07:11:20.713950 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 07:11:20.713950 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application with Lock( May 04 07:11:20.713950 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 07:11:20.713950 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self._enter() May 04 07:11:20.713950 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 07:11:20.713950 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 07:11:20.713950 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 07:11:20.713950 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self.creator() May 04 07:11:20.713950 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 07:11:20.713950 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application created_value = creator( May 04 07:11:20.716915 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 07:11:20.716915 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 07:11:20.716915 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 07:11:20.716915 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application May 04 07:11:20.723261 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 395/806] 10.222.0.21 () {56 vars in 1108 bytes} [Wed May 4 07:11:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 07:11:20.723261 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbf4b8c-1e80-45d1-9a15-9bac1a8f855b None admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:11:20.809146 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2beb1f-1702-4d33-ad9f-8c749fcf3430 None admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:11:20.847003 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37af86d7-e07e-4858-b111-2706ed1df233 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:11:20.847882 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37af86d7-e07e-4858-b111-2706ed1df233 None admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:11:20.848003 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37af86d7-e07e-4858-b111-2706ed1df233 None admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:11:20.848306 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37af86d7-e07e-4858-b111-2706ed1df233 None admin] PATH_INFO: `/v3/projects` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:11:20.849103 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37af86d7-e07e-4858-b111-2706ed1df233 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79744) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 07:11:20.849470 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37af86d7-e07e-4858-b111-2706ed1df233 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:11:20.850851 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37af86d7-e07e-4858-b111-2706ed1df233 None admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:11:20.860964 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbf4b8c-1e80-45d1-9a15-9bac1a8f855b None admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:11:20.864047 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 412/807] 10.222.0.21 () {56 vars in 1148 bytes} [Wed May 4 07:11:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 07:11:20.864764 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37af86d7-e07e-4858-b111-2706ed1df233 None admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:11:20.904661 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d180b8-b2d6-4a08-8a10-cab96c5f1111 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:11:20.905456 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d180b8-b2d6-4a08-8a10-cab96c5f1111 None admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:11:20.905737 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d180b8-b2d6-4a08-8a10-cab96c5f1111 None admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:11:20.906010 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d180b8-b2d6-4a08-8a10-cab96c5f1111 None admin] PATH_INFO: `/v3/users/nova` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:11:20.913725 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d180b8-b2d6-4a08-8a10-cab96c5f1111 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:11:20.915198 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d180b8-b2d6-4a08-8a10-cab96c5f1111 None admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:11:20.929667 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application [None req-a6d180b8-b2d6-4a08-8a10-cab96c5f1111 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 04 07:11:20.929667 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 07:11:20.929667 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 07:11:20.929667 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 07:11:20.929667 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 07:11:20.929667 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 07:11:20.929667 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 07:11:20.929667 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 07:11:20.929667 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 07:11:20.929667 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 07:11:20.929667 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 07:11:20.929667 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 07:11:20.929667 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 04 07:11:20.929667 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self._get_user(user_id) May 04 07:11:20.929667 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 04 07:11:20.929667 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 04 07:11:20.931712 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 07:11:20.931712 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 07:11:20.931712 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 04 07:11:20.931712 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 07:11:20.931712 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 04 07:11:20.931712 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 07:11:20.931712 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 07:11:20.931712 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 07:11:20.931712 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 07:11:20.931712 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self.get_or_create( May 04 07:11:20.931712 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 07:11:20.931712 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application with Lock( May 04 07:11:20.931712 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 07:11:20.931712 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self._enter() May 04 07:11:20.931712 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 07:11:20.931712 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 07:11:20.931712 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 07:11:20.931712 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self.creator() May 04 07:11:20.933471 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 07:11:20.933471 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application created_value = creator( May 04 07:11:20.933471 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 04 07:11:20.933471 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 04 07:11:20.933471 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 04 07:11:20.933471 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 04 07:11:20.933471 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 04 07:11:20.933471 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 04 07:11:20.933471 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 04 07:11:20.933471 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application May 04 07:11:20.933471 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 396/808] 10.222.0.21 () {56 vars in 1093 bytes} [Wed May 4 07:11:20 2022] GET /identity/v3/users/nova => generated 82 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 07:11:20.933471 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d180b8-b2d6-4a08-8a10-cab96c5f1111 None admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:11:20.985209 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37af86d7-e07e-4858-b111-2706ed1df233 None admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:11:21.022529 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d90939e-8ba0-4a6f-93f2-65c2028fbd7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:11:21.023261 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d90939e-8ba0-4a6f-93f2-65c2028fbd7d None admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:11:21.023957 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d90939e-8ba0-4a6f-93f2-65c2028fbd7d None admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:11:21.024334 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d90939e-8ba0-4a6f-93f2-65c2028fbd7d None admin] PATH_INFO: `/v3/domains` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:11:21.025233 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d90939e-8ba0-4a6f-93f2-65c2028fbd7d None admin] RBAC: Adding query filter params (name=Default) {{(pid=79744) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 07:11:21.025545 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d90939e-8ba0-4a6f-93f2-65c2028fbd7d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:11:21.028294 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d90939e-8ba0-4a6f-93f2-65c2028fbd7d None admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:11:21.036047 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d180b8-b2d6-4a08-8a10-cab96c5f1111 None admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:11:21.050044 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 413/809] 10.222.0.21 () {56 vars in 1109 bytes} [Wed May 4 07:11:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 07:11:21.050044 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48b37a7-88af-4e17-9224-3543761a02a4 None None] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:11:21.050044 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48b37a7-88af-4e17-9224-3543761a02a4 None None] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:11:21.050044 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48b37a7-88af-4e17-9224-3543761a02a4 None None] PATH_INFO: `/` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:11:21.050044 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 414/810] 10.222.0.21 () {54 vars in 926 bytes} [Wed May 4 07:11:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 07:11:21.050044 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48b37a7-88af-4e17-9224-3543761a02a4 None None] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:11:21.071440 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b2b5f3-084c-40e1-b279-2e6c96f7a27c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:11:21.072241 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b2b5f3-084c-40e1-b279-2e6c96f7a27c None admin] REQUEST_METHOD: `PUT` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:11:21.072516 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b2b5f3-084c-40e1-b279-2e6c96f7a27c None admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:11:21.072785 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b2b5f3-084c-40e1-b279-2e6c96f7a27c None admin] PATH_INFO: `/v3/projects/c9f9c44db4984653b8d4b5f6b3b949f5/users/084c9245d1da4e698c9c3945fa089e85/roles/eb54c9cea2774a25b1fe8c79724408ee` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:11:21.075918 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b2b5f3-084c-40e1-b279-2e6c96f7a27c None admin] RBAC: Authorizing `identity:create_grant(project_id=c9f9c44db4984653b8d4b5f6b3b949f5, user_id=084c9245d1da4e698c9c3945fa089e85, role_id=eb54c9cea2774a25b1fe8c79724408ee)` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:11:21.077340 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b2b5f3-084c-40e1-b279-2e6c96f7a27c None admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:11:21.097643 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 397/811] 10.222.0.21 () {58 vars in 1439 bytes} [Wed May 4 07:11:20 2022] PUT /identity/v3/projects/c9f9c44db4984653b8d4b5f6b3b949f5/users/084c9245d1da4e698c9c3945fa089e85/roles/eb54c9cea2774a25b1fe8c79724408ee => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 07:11:21.097643 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55a740f-ac2c-4418-8d0d-349a87353dc9 None None] REQUEST_METHOD: `POST` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:11:21.097643 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55a740f-ac2c-4418-8d0d-349a87353dc9 None None] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:11:21.097643 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55a740f-ac2c-4418-8d0d-349a87353dc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:11:21.116320 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.auth.core [None req-d55a740f-ac2c-4418-8d0d-349a87353dc9 None None] MFA Rules not processed for user `83c5e0dcb991496ea6dee38384514508`. Rule list: `[]` (Enabled: `True`). {{(pid=79745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:11:21.117610 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.fernet_utils [None req-d55a740f-ac2c-4418-8d0d-349a87353dc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:11:21.172035 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48b37a7-88af-4e17-9224-3543761a02a4 None None] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:11:21.201850 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 398/812] 10.222.0.21 () {58 vars in 1023 bytes} [Wed May 4 07:11:21 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 07:11:21.202836 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55a740f-ac2c-4418-8d0d-349a87353dc9 None None] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:11:21.209728 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c69de75-f160-45de-9b61-2cf60907aa87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:11:21.210393 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c69de75-f160-45de-9b61-2cf60907aa87 None admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:11:21.210668 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c69de75-f160-45de-9b61-2cf60907aa87 None admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:11:21.210936 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c69de75-f160-45de-9b61-2cf60907aa87 None admin] PATH_INFO: `/v3/users` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:11:21.211794 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c69de75-f160-45de-9b61-2cf60907aa87 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79744) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 07:11:21.212095 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c69de75-f160-45de-9b61-2cf60907aa87 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:11:21.213502 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c69de75-f160-45de-9b61-2cf60907aa87 None admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:11:21.238303 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 415/813] 10.222.0.21 () {56 vars in 1133 bytes} [Wed May 4 07:11:21 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 07:11:21.239299 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c69de75-f160-45de-9b61-2cf60907aa87 None admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:11:21.311928 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55a740f-ac2c-4418-8d0d-349a87353dc9 None None] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:11:21.349141 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87976dae-03ba-4e39-ba07-afc7832b817e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:11:21.349526 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c69de75-f160-45de-9b61-2cf60907aa87 None admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:11:21.349955 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87976dae-03ba-4e39-ba07-afc7832b817e None admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:11:21.350130 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87976dae-03ba-4e39-ba07-afc7832b817e None admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:11:21.350407 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87976dae-03ba-4e39-ba07-afc7832b817e None admin] PATH_INFO: `/v3/projects/service` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:11:21.358342 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87976dae-03ba-4e39-ba07-afc7832b817e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:11:21.360446 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87976dae-03ba-4e39-ba07-afc7832b817e None admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:11:21.375026 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application [None req-87976dae-03ba-4e39-ba07-afc7832b817e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 04 07:11:21.375026 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 07:11:21.375026 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 07:11:21.375026 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 07:11:21.375026 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 07:11:21.375026 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 07:11:21.375026 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 07:11:21.375026 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 07:11:21.375026 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 07:11:21.375026 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 07:11:21.375026 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 07:11:21.375026 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 07:11:21.375026 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 04 07:11:21.375026 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self._get_project(project_id) May 04 07:11:21.375026 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 04 07:11:21.376020 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 04 07:11:21.376020 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 07:11:21.376020 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 07:11:21.376020 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 07:11:21.376020 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 07:11:21.376020 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 07:11:21.376020 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self.get_or_create( May 04 07:11:21.376020 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 07:11:21.376020 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application with Lock( May 04 07:11:21.376020 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 07:11:21.376020 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self._enter() May 04 07:11:21.376020 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 07:11:21.376020 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 07:11:21.376020 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 07:11:21.376020 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self.creator() May 04 07:11:21.376020 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 07:11:21.376020 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application created_value = creator( May 04 07:11:21.377600 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 04 07:11:21.377600 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 04 07:11:21.377600 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 04 07:11:21.377600 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 04 07:11:21.377600 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 04 07:11:21.377600 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 04 07:11:21.377600 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 04 07:11:21.377600 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application May 04 07:11:21.377600 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 399/814] 10.222.0.21 () {56 vars in 1111 bytes} [Wed May 4 07:11:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 07:11:21.377600 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87976dae-03ba-4e39-ba07-afc7832b817e None admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:11:21.396813 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5206a354-3909-436f-b2a8-25105d59c956 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:11:21.398004 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5206a354-3909-436f-b2a8-25105d59c956 None admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:11:21.398285 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5206a354-3909-436f-b2a8-25105d59c956 None admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:11:21.398560 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5206a354-3909-436f-b2a8-25105d59c956 None admin] PATH_INFO: `/v3/services/network` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:11:21.399280 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5206a354-3909-436f-b2a8-25105d59c956 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:11:21.401325 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5206a354-3909-436f-b2a8-25105d59c956 None admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:11:21.418844 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application [None req-5206a354-3909-436f-b2a8-25105d59c956 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. May 04 07:11:21.418844 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 07:11:21.418844 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 04 07:11:21.418844 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 04 07:11:21.418844 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 04 07:11:21.418844 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 04 07:11:21.418844 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 04 07:11:21.418844 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 07:11:21.418844 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 04 07:11:21.418844 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application May 04 07:11:21.418844 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 04 07:11:21.418844 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application May 04 07:11:21.418844 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 07:11:21.418844 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 07:11:21.418844 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 07:11:21.418844 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 07:11:21.418844 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 07:11:21.421429 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 07:11:21.421429 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 07:11:21.421429 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 07:11:21.421429 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 07:11:21.421429 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 07:11:21.421429 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 07:11:21.421429 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 04 07:11:21.421429 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self._get_service(service_id) May 04 07:11:21.421429 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 04 07:11:21.421429 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 04 07:11:21.421429 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 07:11:21.421429 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 07:11:21.421429 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 07:11:21.421429 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 07:11:21.421429 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 07:11:21.421429 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.get_or_create( May 04 07:11:21.423587 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 07:11:21.423587 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application with Lock( May 04 07:11:21.423587 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 07:11:21.423587 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self._enter() May 04 07:11:21.423587 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 07:11:21.423587 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 07:11:21.423587 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 07:11:21.423587 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.creator() May 04 07:11:21.423587 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 07:11:21.423587 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application created_value = creator( May 04 07:11:21.423587 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 04 07:11:21.423587 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 07:11:21.423587 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 04 07:11:21.423587 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application May 04 07:11:21.423587 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 416/815] 10.222.0.21 () {56 vars in 1111 bytes} [Wed May 4 07:11:21 2022] GET /identity/v3/services/network => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 07:11:21.425585 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5206a354-3909-436f-b2a8-25105d59c956 None admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:11:21.504761 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87976dae-03ba-4e39-ba07-afc7832b817e None admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:11:21.532002 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5206a354-3909-436f-b2a8-25105d59c956 None admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:11:21.548688 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed83d77-f841-4c82-9196-4a3bb560ae58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:11:21.549627 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed83d77-f841-4c82-9196-4a3bb560ae58 None admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:11:21.549908 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed83d77-f841-4c82-9196-4a3bb560ae58 None admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:11:21.550182 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed83d77-f841-4c82-9196-4a3bb560ae58 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:11:21.566373 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8eddb38-6acc-4bdc-984e-2784d32b1316 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:11:21.567098 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8eddb38-6acc-4bdc-984e-2784d32b1316 None admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:11:21.567428 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8eddb38-6acc-4bdc-984e-2784d32b1316 None admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:11:21.567706 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8eddb38-6acc-4bdc-984e-2784d32b1316 None admin] PATH_INFO: `/v3/projects` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:11:21.568819 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8eddb38-6acc-4bdc-984e-2784d32b1316 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79744) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 07:11:21.575297 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8eddb38-6acc-4bdc-984e-2784d32b1316 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:11:21.575297 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8eddb38-6acc-4bdc-984e-2784d32b1316 None admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:11:21.588077 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 417/816] 10.222.0.21 () {56 vars in 1148 bytes} [Wed May 4 07:11:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 07:11:21.588940 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8eddb38-6acc-4bdc-984e-2784d32b1316 None admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:11:21.647252 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed83d77-f841-4c82-9196-4a3bb560ae58 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:11:21.647252 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed83d77-f841-4c82-9196-4a3bb560ae58 None admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:11:21.691864 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8eddb38-6acc-4bdc-984e-2784d32b1316 None admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:11:21.727944 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3b00f9-6149-44ab-a896-00f2ad849a62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:11:21.729047 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3b00f9-6149-44ab-a896-00f2ad849a62 None admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:11:21.729553 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3b00f9-6149-44ab-a896-00f2ad849a62 None admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:11:21.730043 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3b00f9-6149-44ab-a896-00f2ad849a62 None admin] PATH_INFO: `/v3/services` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:11:21.730941 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3b00f9-6149-44ab-a896-00f2ad849a62 None admin] RBAC: Adding query filter params (name=network) {{(pid=79744) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 07:11:21.731467 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3b00f9-6149-44ab-a896-00f2ad849a62 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:11:21.733026 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3b00f9-6149-44ab-a896-00f2ad849a62 None admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:11:21.738123 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 418/817] 10.222.0.21 () {56 vars in 1112 bytes} [Wed May 4 07:11:21 2022] GET /identity/v3/services?name=network => generated 124 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 07:11:21.739682 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2495d1d9-d5c6-4d67-9bb4-df9ed18d189e None None] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:11:21.740174 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2495d1d9-d5c6-4d67-9bb4-df9ed18d189e None None] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:11:21.740673 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2495d1d9-d5c6-4d67-9bb4-df9ed18d189e None None] PATH_INFO: `/` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:11:21.742442 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 419/818] 10.222.0.21 () {54 vars in 926 bytes} [Wed May 4 07:11:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 07:11:21.743401 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2495d1d9-d5c6-4d67-9bb4-df9ed18d189e None None] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:11:21.751131 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 400/819] 10.222.0.21 () {58 vars in 1282 bytes} [Wed May 4 07:11:21 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 04 07:11:21.751131 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed83d77-f841-4c82-9196-4a3bb560ae58 None admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:11:21.847927 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2495d1d9-d5c6-4d67-9bb4-df9ed18d189e None None] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:11:21.850198 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed83d77-f841-4c82-9196-4a3bb560ae58 None admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:11:21.889336 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51bc58d-365d-41d5-b2cb-7a1ef0ba3307 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:11:21.890282 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51bc58d-365d-41d5-b2cb-7a1ef0ba3307 None admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:11:21.890712 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51bc58d-365d-41d5-b2cb-7a1ef0ba3307 None admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:11:21.891669 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51bc58d-365d-41d5-b2cb-7a1ef0ba3307 None admin] PATH_INFO: `/v3/services` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:11:21.892956 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51bc58d-365d-41d5-b2cb-7a1ef0ba3307 None admin] RBAC: Adding query filter params (type=network) {{(pid=79745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 07:11:21.893734 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51bc58d-365d-41d5-b2cb-7a1ef0ba3307 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:11:21.895795 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51bc58d-365d-41d5-b2cb-7a1ef0ba3307 None admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:11:21.896583 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69944935-36fa-4727-8c60-bfde9fa908f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:11:21.897682 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69944935-36fa-4727-8c60-bfde9fa908f8 None admin] REQUEST_METHOD: `PUT` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:11:21.899343 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69944935-36fa-4727-8c60-bfde9fa908f8 None admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:11:21.899766 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69944935-36fa-4727-8c60-bfde9fa908f8 None admin] PATH_INFO: `/v3/projects/c9f9c44db4984653b8d4b5f6b3b949f5/users/704cdbc22849413baa4e0189947ebebc/roles/14041215d0f7476a8e90241a49338706` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:11:21.908879 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 401/820] 10.222.0.21 () {56 vars in 1112 bytes} [Wed May 4 07:11:21 2022] GET /identity/v3/services?type=network => generated 350 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 07:11:21.908879 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a072b66d-1ce5-4132-961c-dbdecdcb1b9f None None] REQUEST_METHOD: `POST` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:11:21.908879 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a072b66d-1ce5-4132-961c-dbdecdcb1b9f None None] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:11:21.908879 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a072b66d-1ce5-4132-961c-dbdecdcb1b9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:11:21.921868 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69944935-36fa-4727-8c60-bfde9fa908f8 None admin] RBAC: Authorizing `identity:create_grant(project_id=c9f9c44db4984653b8d4b5f6b3b949f5, user_id=704cdbc22849413baa4e0189947ebebc, role_id=14041215d0f7476a8e90241a49338706)` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:11:21.923725 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69944935-36fa-4727-8c60-bfde9fa908f8 None admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:11:21.928719 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.auth.core [None req-a072b66d-1ce5-4132-961c-dbdecdcb1b9f None None] MFA Rules not processed for user `83c5e0dcb991496ea6dee38384514508`. Rule list: `[]` (Enabled: `True`). {{(pid=79745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:11:21.930864 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.fernet_utils [None req-a072b66d-1ce5-4132-961c-dbdecdcb1b9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:11:21.939941 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 420/821] 10.222.0.21 () {58 vars in 1439 bytes} [Wed May 4 07:11:21 2022] PUT /identity/v3/projects/c9f9c44db4984653b8d4b5f6b3b949f5/users/704cdbc22849413baa4e0189947ebebc/roles/14041215d0f7476a8e90241a49338706 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 07:11:21.940986 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69944935-36fa-4727-8c60-bfde9fa908f8 None admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:11:22.072853 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69944935-36fa-4727-8c60-bfde9fa908f8 None admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:11:22.086358 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 402/822] 10.222.0.21 () {58 vars in 1023 bytes} [Wed May 4 07:11:21 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 07:11:22.086912 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a072b66d-1ce5-4132-961c-dbdecdcb1b9f None None] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:11:22.128742 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a340c07-119f-4529-8c01-4dee78e0eaa2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:11:22.129546 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a340c07-119f-4529-8c01-4dee78e0eaa2 None admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:11:22.129830 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a340c07-119f-4529-8c01-4dee78e0eaa2 None admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:11:22.130128 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a340c07-119f-4529-8c01-4dee78e0eaa2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:11:22.141691 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a340c07-119f-4529-8c01-4dee78e0eaa2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:11:22.143284 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a340c07-119f-4529-8c01-4dee78e0eaa2 None admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:11:22.162405 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application [None req-0a340c07-119f-4529-8c01-4dee78e0eaa2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 07:11:22.162405 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 07:11:22.162405 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 07:11:22.162405 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 07:11:22.162405 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 07:11:22.162405 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 07:11:22.162405 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 07:11:22.162405 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 07:11:22.162405 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 07:11:22.162405 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 07:11:22.162405 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 07:11:22.162405 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 07:11:22.162405 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 07:11:22.162405 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 07:11:22.162405 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 07:11:22.163373 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 07:11:22.163373 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 07:11:22.163373 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 07:11:22.163373 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 07:11:22.163373 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 07:11:22.163373 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 07:11:22.163373 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.get_or_create( May 04 07:11:22.163373 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 07:11:22.163373 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application with Lock( May 04 07:11:22.163373 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 07:11:22.163373 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self._enter() May 04 07:11:22.163373 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 07:11:22.163373 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 07:11:22.163373 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 07:11:22.163373 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.creator() May 04 07:11:22.163373 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 07:11:22.163373 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application created_value = creator( May 04 07:11:22.164279 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 07:11:22.164279 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 07:11:22.164279 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 07:11:22.164279 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application May 04 07:11:22.164279 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 421/823] 10.222.0.21 () {56 vars in 1108 bytes} [Wed May 4 07:11:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 07:11:22.165228 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a340c07-119f-4529-8c01-4dee78e0eaa2 None admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:11:22.217711 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a072b66d-1ce5-4132-961c-dbdecdcb1b9f None None] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:11:22.268686 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ec89f6-ef1c-4743-baf5-afbf88cf1e8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:11:22.269347 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ec89f6-ef1c-4743-baf5-afbf88cf1e8e None admin] REQUEST_METHOD: `POST` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:11:22.269626 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ec89f6-ef1c-4743-baf5-afbf88cf1e8e None admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:11:22.269900 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ec89f6-ef1c-4743-baf5-afbf88cf1e8e None admin] PATH_INFO: `/v3/endpoints` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:11:22.270740 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ec89f6-ef1c-4743-baf5-afbf88cf1e8e None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:11:22.272091 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ec89f6-ef1c-4743-baf5-afbf88cf1e8e None admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:11:22.290638 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a340c07-119f-4529-8c01-4dee78e0eaa2 None admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:11:22.297049 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 403/824] 10.222.0.21 () {60 vars in 1144 bytes} [Wed May 4 07:11:22 2022] POST /identity/v3/endpoints => generated 327 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 07:11:22.297906 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ec89f6-ef1c-4743-baf5-afbf88cf1e8e None admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:11:22.345833 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841c4e35-771f-4781-b411-892a7067f8bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:11:22.346688 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841c4e35-771f-4781-b411-892a7067f8bb None admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:11:22.347926 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841c4e35-771f-4781-b411-892a7067f8bb None admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:11:22.347926 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841c4e35-771f-4781-b411-892a7067f8bb None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:11:22.347926 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841c4e35-771f-4781-b411-892a7067f8bb None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:11:22.349407 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841c4e35-771f-4781-b411-892a7067f8bb None admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:11:22.363637 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application [None req-841c4e35-771f-4781-b411-892a7067f8bb None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. May 04 07:11:22.363637 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 07:11:22.363637 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 04 07:11:22.363637 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 04 07:11:22.363637 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 04 07:11:22.363637 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 04 07:11:22.363637 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 04 07:11:22.363637 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 07:11:22.363637 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 04 07:11:22.363637 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application May 04 07:11:22.363637 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 04 07:11:22.363637 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application May 04 07:11:22.363637 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 07:11:22.363637 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 07:11:22.363637 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 07:11:22.363637 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 07:11:22.365210 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 07:11:22.365210 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 07:11:22.365210 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 07:11:22.365210 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 07:11:22.365210 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 07:11:22.365210 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 07:11:22.365210 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 07:11:22.365210 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 04 07:11:22.365210 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self._get_service(service_id) May 04 07:11:22.365210 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 04 07:11:22.365210 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 04 07:11:22.365210 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 07:11:22.365210 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 07:11:22.365210 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 07:11:22.365210 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 07:11:22.365210 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 07:11:22.366182 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.get_or_create( May 04 07:11:22.366182 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 07:11:22.366182 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application with Lock( May 04 07:11:22.366182 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 07:11:22.366182 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self._enter() May 04 07:11:22.366182 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 07:11:22.366182 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 07:11:22.366182 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 07:11:22.366182 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.creator() May 04 07:11:22.366182 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 07:11:22.366182 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application created_value = creator( May 04 07:11:22.366182 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 04 07:11:22.366182 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 07:11:22.366182 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 04 07:11:22.366182 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application May 04 07:11:22.366182 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 422/825] 10.222.0.21 () {56 vars in 1129 bytes} [Wed May 4 07:11:22 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 07:11:22.371653 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841c4e35-771f-4781-b411-892a7067f8bb None admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:11:22.421992 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ec89f6-ef1c-4743-baf5-afbf88cf1e8e None admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:11:22.484005 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10320b6-f500-4d0d-b158-0644046c8e19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:11:22.484692 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10320b6-f500-4d0d-b158-0644046c8e19 None admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:11:22.484973 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10320b6-f500-4d0d-b158-0644046c8e19 None admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:11:22.485245 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10320b6-f500-4d0d-b158-0644046c8e19 None admin] PATH_INFO: `/v3/domains` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:11:22.485974 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10320b6-f500-4d0d-b158-0644046c8e19 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 07:11:22.486279 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10320b6-f500-4d0d-b158-0644046c8e19 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:11:22.487696 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10320b6-f500-4d0d-b158-0644046c8e19 None admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:11:22.506803 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841c4e35-771f-4781-b411-892a7067f8bb None admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:11:22.522194 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 404/826] 10.222.0.21 () {56 vars in 1109 bytes} [Wed May 4 07:11:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 07:11:22.529048 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10320b6-f500-4d0d-b158-0644046c8e19 None admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:11:22.577351 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6fe7ee8-d150-4a8c-b3c0-c6b7066625ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:11:22.578019 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fe7ee8-d150-4a8c-b3c0-c6b7066625ae None admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:11:22.578300 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fe7ee8-d150-4a8c-b3c0-c6b7066625ae None admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:11:22.578573 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fe7ee8-d150-4a8c-b3c0-c6b7066625ae None admin] PATH_INFO: `/v3/services` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:11:22.579304 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6fe7ee8-d150-4a8c-b3c0-c6b7066625ae None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=79744) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 07:11:22.579610 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6fe7ee8-d150-4a8c-b3c0-c6b7066625ae None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:11:22.580971 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6fe7ee8-d150-4a8c-b3c0-c6b7066625ae None admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:11:22.594823 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 423/827] 10.222.0.21 () {56 vars in 1124 bytes} [Wed May 4 07:11:22 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 07:11:22.600567 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6fe7ee8-d150-4a8c-b3c0-c6b7066625ae None admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:11:22.681558 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10320b6-f500-4d0d-b158-0644046c8e19 None admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:11:22.719943 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df512744-b7da-4a9f-8396-45531eb77a99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:11:22.723202 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df512744-b7da-4a9f-8396-45531eb77a99 None admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:11:22.723537 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df512744-b7da-4a9f-8396-45531eb77a99 None admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:11:22.723824 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df512744-b7da-4a9f-8396-45531eb77a99 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:11:22.726864 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6fe7ee8-d150-4a8c-b3c0-c6b7066625ae None admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:11:22.732187 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df512744-b7da-4a9f-8396-45531eb77a99 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:11:22.733630 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df512744-b7da-4a9f-8396-45531eb77a99 None admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:11:22.748770 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application [None req-df512744-b7da-4a9f-8396-45531eb77a99 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 04 07:11:22.748770 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 07:11:22.748770 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 07:11:22.748770 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 07:11:22.748770 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 07:11:22.748770 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 07:11:22.748770 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 07:11:22.748770 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 07:11:22.748770 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 07:11:22.748770 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 07:11:22.748770 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 07:11:22.748770 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 07:11:22.748770 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 04 07:11:22.748770 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self._get_project(project_id) May 04 07:11:22.748770 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 04 07:11:22.749728 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 04 07:11:22.749728 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 07:11:22.749728 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 07:11:22.749728 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 07:11:22.749728 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 07:11:22.749728 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 07:11:22.749728 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self.get_or_create( May 04 07:11:22.749728 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 07:11:22.749728 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application with Lock( May 04 07:11:22.749728 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 07:11:22.749728 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self._enter() May 04 07:11:22.749728 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 07:11:22.749728 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 07:11:22.749728 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 07:11:22.749728 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self.creator() May 04 07:11:22.749728 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 07:11:22.749728 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application created_value = creator( May 04 07:11:22.750652 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 04 07:11:22.750652 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 04 07:11:22.750652 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 04 07:11:22.750652 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 04 07:11:22.750652 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 04 07:11:22.750652 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 04 07:11:22.750652 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 04 07:11:22.750652 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application May 04 07:11:22.754688 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 405/828] 10.222.0.21 () {56 vars in 1111 bytes} [Wed May 4 07:11:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 07:11:22.757775 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df512744-b7da-4a9f-8396-45531eb77a99 None admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:11:22.775953 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83dde25f-cc9c-4910-a5ae-5c7725f3b581 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:11:22.776953 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83dde25f-cc9c-4910-a5ae-5c7725f3b581 None admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:11:22.777239 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83dde25f-cc9c-4910-a5ae-5c7725f3b581 None admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:11:22.777513 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83dde25f-cc9c-4910-a5ae-5c7725f3b581 None admin] PATH_INFO: `/v3/services` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:11:22.778622 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83dde25f-cc9c-4910-a5ae-5c7725f3b581 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=79744) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 07:11:22.778934 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83dde25f-cc9c-4910-a5ae-5c7725f3b581 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:11:22.781006 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83dde25f-cc9c-4910-a5ae-5c7725f3b581 None admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:11:22.786584 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 424/829] 10.222.0.21 () {56 vars in 1124 bytes} [Wed May 4 07:11:22 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 07:11:22.792013 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83dde25f-cc9c-4910-a5ae-5c7725f3b581 None admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:11:22.879802 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df512744-b7da-4a9f-8396-45531eb77a99 None admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:11:22.901130 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83dde25f-cc9c-4910-a5ae-5c7725f3b581 None admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:11:22.915051 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e851e2b9-0fb8-4396-b880-38a65e9eaf47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:11:22.915816 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e851e2b9-0fb8-4396-b880-38a65e9eaf47 None admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:11:22.916203 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e851e2b9-0fb8-4396-b880-38a65e9eaf47 None admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:11:22.916697 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e851e2b9-0fb8-4396-b880-38a65e9eaf47 None admin] PATH_INFO: `/v3/projects` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:11:22.918092 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e851e2b9-0fb8-4396-b880-38a65e9eaf47 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 07:11:22.918505 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e851e2b9-0fb8-4396-b880-38a65e9eaf47 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:11:22.920055 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e851e2b9-0fb8-4396-b880-38a65e9eaf47 None admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:11:22.935126 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 406/830] 10.222.0.21 () {56 vars in 1148 bytes} [Wed May 4 07:11:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 07:11:22.938608 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e851e2b9-0fb8-4396-b880-38a65e9eaf47 None admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:11:22.941789 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5a6772-fa86-4ff7-9005-161aa0ea7b2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:11:22.942453 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5a6772-fa86-4ff7-9005-161aa0ea7b2a None admin] REQUEST_METHOD: `POST` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:11:22.942730 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5a6772-fa86-4ff7-9005-161aa0ea7b2a None admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:11:22.942997 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5a6772-fa86-4ff7-9005-161aa0ea7b2a None admin] PATH_INFO: `/v3/endpoints` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:11:22.944131 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5a6772-fa86-4ff7-9005-161aa0ea7b2a None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:11:22.945113 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5a6772-fa86-4ff7-9005-161aa0ea7b2a None admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:11:22.969771 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 425/831] 10.222.0.21 () {60 vars in 1144 bytes} [Wed May 4 07:11:22 2022] POST /identity/v3/endpoints => generated 346 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 07:11:23.056766 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e851e2b9-0fb8-4396-b880-38a65e9eaf47 None admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:11:23.103000 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3def5e87-a120-4710-a770-2f365eb41c72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:11:23.104391 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3def5e87-a120-4710-a770-2f365eb41c72 None admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:11:23.104843 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3def5e87-a120-4710-a770-2f365eb41c72 None admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:11:23.105257 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3def5e87-a120-4710-a770-2f365eb41c72 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:11:23.106320 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3def5e87-a120-4710-a770-2f365eb41c72 None admin] RBAC: Adding query filter params (role.id=eb54c9cea2774a25b1fe8c79724408ee, scope.project.id=c9f9c44db4984653b8d4b5f6b3b949f5, user.id=1077289fedae43b6be47be7f716d573a) {{(pid=79745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 07:11:23.106781 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3def5e87-a120-4710-a770-2f365eb41c72 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:11:23.108442 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3def5e87-a120-4710-a770-2f365eb41c72 None admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:11:23.119293 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 407/832] 10.222.0.21 () {56 vars in 1374 bytes} [Wed May 4 07:11:22 2022] GET /identity/v3/role_assignments?user.id=1077289fedae43b6be47be7f716d573a&scope.project.id=c9f9c44db4984653b8d4b5f6b3b949f5&role.id=eb54c9cea2774a25b1fe8c79724408ee => generated 608 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 07:11:23.545954 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59183f19-6c11-49e2-9dbc-e6975af20942 None None] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:11:23.546504 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59183f19-6c11-49e2-9dbc-e6975af20942 None None] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:11:23.546749 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59183f19-6c11-49e2-9dbc-e6975af20942 None None] PATH_INFO: `/` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:11:23.548534 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 426/833] 10.222.0.21 () {54 vars in 926 bytes} [Wed May 4 07:11:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 07:11:23.553822 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ad7b5b-3c1a-4437-9a53-4fcafa91ca06 None None] REQUEST_METHOD: `POST` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:11:23.554241 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ad7b5b-3c1a-4437-9a53-4fcafa91ca06 None None] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:11:23.554624 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ad7b5b-3c1a-4437-9a53-4fcafa91ca06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:11:23.571581 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.auth.core [None req-64ad7b5b-3c1a-4437-9a53-4fcafa91ca06 None None] MFA Rules not processed for user `83c5e0dcb991496ea6dee38384514508`. Rule list: `[]` (Enabled: `True`). {{(pid=79745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:11:23.572754 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.fernet_utils [None req-64ad7b5b-3c1a-4437-9a53-4fcafa91ca06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:11:23.638900 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 408/834] 10.222.0.21 () {58 vars in 1023 bytes} [Wed May 4 07:11:23 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 07:11:23.662465 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59183f19-6c11-49e2-9dbc-e6975af20942 None None] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:11:23.765246 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59183f19-6c11-49e2-9dbc-e6975af20942 None None] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:11:23.799091 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef9a2d8-6eb7-49a1-b7f3-08476c8fda92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:11:23.799911 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef9a2d8-6eb7-49a1-b7f3-08476c8fda92 None admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:11:23.800192 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef9a2d8-6eb7-49a1-b7f3-08476c8fda92 None admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:11:23.800462 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef9a2d8-6eb7-49a1-b7f3-08476c8fda92 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:11:23.811258 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef9a2d8-6eb7-49a1-b7f3-08476c8fda92 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 07:11:23.818826 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application [None req-1ef9a2d8-6eb7-49a1-b7f3-08476c8fda92 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 04 07:11:23.818826 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 07:11:23.818826 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 07:11:23.818826 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 07:11:23.818826 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 07:11:23.818826 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 07:11:23.818826 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 07:11:23.818826 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 07:11:23.818826 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 07:11:23.818826 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 07:11:23.818826 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 07:11:23.818826 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 07:11:23.818826 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 07:11:23.818826 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 07:11:23.818826 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 07:11:23.818826 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 07:11:23.820080 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 07:11:23.820080 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 07:11:23.820080 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 07:11:23.820080 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 07:11:23.820080 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 07:11:23.820080 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 07:11:23.820080 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 07:11:23.820080 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 07:11:23.820080 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 07:11:23.820080 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.get_or_create( May 04 07:11:23.820080 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 07:11:23.820080 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application with Lock( May 04 07:11:23.820080 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 07:11:23.820080 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self._enter() May 04 07:11:23.820080 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 07:11:23.820080 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 07:11:23.822741 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 07:11:23.822741 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.creator() May 04 07:11:23.822741 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 07:11:23.822741 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application created_value = creator( May 04 07:11:23.822741 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 07:11:23.822741 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 07:11:23.822741 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 07:11:23.822741 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 07:11:23.822741 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 07:11:23.822741 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 07:11:23.822741 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 04 07:11:23.822741 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application May 04 07:11:23.822741 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 427/835] 10.222.0.21 () {56 vars in 1096 bytes} [Wed May 4 07:11:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 07:11:23.827219 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ad7b5b-3c1a-4437-9a53-4fcafa91ca06 None None] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:11:23.926958 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ad7b5b-3c1a-4437-9a53-4fcafa91ca06 None None] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:11:23.967418 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf24827-86d4-462c-b3e9-fa7850860246 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:11:23.968094 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf24827-86d4-462c-b3e9-fa7850860246 None admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:11:23.968373 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf24827-86d4-462c-b3e9-fa7850860246 None admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:11:23.968647 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf24827-86d4-462c-b3e9-fa7850860246 None admin] PATH_INFO: `/v3/roles` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:11:23.969392 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf24827-86d4-462c-b3e9-fa7850860246 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 07:11:23.969699 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf24827-86d4-462c-b3e9-fa7850860246 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:11:23.971060 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf24827-86d4-462c-b3e9-fa7850860246 None admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:11:23.979886 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 409/836] 10.222.0.21 () {56 vars in 1099 bytes} [Wed May 4 07:11:23 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 07:11:23.985527 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef9a2d8-6eb7-49a1-b7f3-08476c8fda92 None admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:11:24.086753 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef9a2d8-6eb7-49a1-b7f3-08476c8fda92 None admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:11:24.120838 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b702e23-ae94-40ad-867c-5ea23675aca0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:11:24.121630 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b702e23-ae94-40ad-867c-5ea23675aca0 None admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:11:24.121905 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b702e23-ae94-40ad-867c-5ea23675aca0 None admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:11:24.122177 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b702e23-ae94-40ad-867c-5ea23675aca0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:11:24.132419 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b702e23-ae94-40ad-867c-5ea23675aca0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:11:24.133855 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b702e23-ae94-40ad-867c-5ea23675aca0 None admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:11:24.151887 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application [None req-0b702e23-ae94-40ad-867c-5ea23675aca0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 07:11:24.151887 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 07:11:24.151887 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 07:11:24.151887 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 07:11:24.151887 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 07:11:24.151887 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 07:11:24.151887 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 07:11:24.151887 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 07:11:24.151887 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 07:11:24.151887 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 07:11:24.151887 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 07:11:24.151887 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 07:11:24.151887 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 07:11:24.151887 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 07:11:24.151887 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 07:11:24.154339 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 07:11:24.154339 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 07:11:24.154339 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 07:11:24.154339 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 07:11:24.154339 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 07:11:24.154339 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 07:11:24.154339 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.get_or_create( May 04 07:11:24.154339 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 07:11:24.154339 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application with Lock( May 04 07:11:24.154339 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 07:11:24.154339 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self._enter() May 04 07:11:24.154339 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 07:11:24.154339 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 07:11:24.154339 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 07:11:24.154339 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.creator() May 04 07:11:24.154339 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 07:11:24.154339 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application created_value = creator( May 04 07:11:24.156696 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 07:11:24.156696 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 07:11:24.156696 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 07:11:24.156696 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application May 04 07:11:24.156696 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 428/837] 10.222.0.21 () {56 vars in 1108 bytes} [Wed May 4 07:11:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 07:11:24.160281 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf24827-86d4-462c-b3e9-fa7850860246 None admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:11:24.280546 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf24827-86d4-462c-b3e9-fa7850860246 None admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:11:24.315801 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6506e7b-f36e-48e0-9d1e-b8b10461c779 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:11:24.316777 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6506e7b-f36e-48e0-9d1e-b8b10461c779 None admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:11:24.317223 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6506e7b-f36e-48e0-9d1e-b8b10461c779 None admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:11:24.317644 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6506e7b-f36e-48e0-9d1e-b8b10461c779 None admin] PATH_INFO: `/v3/domains` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:11:24.318517 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6506e7b-f36e-48e0-9d1e-b8b10461c779 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 07:11:24.318972 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6506e7b-f36e-48e0-9d1e-b8b10461c779 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:11:24.320530 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6506e7b-f36e-48e0-9d1e-b8b10461c779 None admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:11:24.333840 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 410/838] 10.222.0.21 () {56 vars in 1109 bytes} [Wed May 4 07:11:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 07:11:24.339858 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b702e23-ae94-40ad-867c-5ea23675aca0 None admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:11:24.393185 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2672603-9520-4306-90f7-cb0ba85b0b65 None None] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:11:24.393185 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2672603-9520-4306-90f7-cb0ba85b0b65 None None] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:11:24.393477 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2672603-9520-4306-90f7-cb0ba85b0b65 None None] PATH_INFO: `/` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:11:24.394949 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 411/839] 10.222.0.21 () {54 vars in 926 bytes} [Wed May 4 07:11:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 04 07:11:24.399732 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203369bb-1cd1-4ea3-841a-64a5f380ccb9 None None] REQUEST_METHOD: `POST` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:11:24.400010 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203369bb-1cd1-4ea3-841a-64a5f380ccb9 None None] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:11:24.400283 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203369bb-1cd1-4ea3-841a-64a5f380ccb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:11:24.417044 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.auth.core [None req-203369bb-1cd1-4ea3-841a-64a5f380ccb9 None None] MFA Rules not processed for user `83c5e0dcb991496ea6dee38384514508`. Rule list: `[]` (Enabled: `True`). {{(pid=79745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:11:24.418219 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.fernet_utils [None req-203369bb-1cd1-4ea3-841a-64a5f380ccb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:11:24.443520 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b702e23-ae94-40ad-867c-5ea23675aca0 None admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:11:24.483557 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9c5a8a-e95c-4dbf-a4e1-cea743cc35e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:11:24.484723 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9c5a8a-e95c-4dbf-a4e1-cea743cc35e7 None admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:11:24.485211 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9c5a8a-e95c-4dbf-a4e1-cea743cc35e7 None admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:11:24.485695 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9c5a8a-e95c-4dbf-a4e1-cea743cc35e7 None admin] PATH_INFO: `/v3/users/swift` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:11:24.493234 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9c5a8a-e95c-4dbf-a4e1-cea743cc35e7 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:11:24.494863 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9c5a8a-e95c-4dbf-a4e1-cea743cc35e7 None admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:11:24.500361 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 412/840] 10.222.0.21 () {58 vars in 1023 bytes} [Wed May 4 07:11:24 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 04 07:11:24.516348 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application [None req-dd9c5a8a-e95c-4dbf-a4e1-cea743cc35e7 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 04 07:11:24.516348 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 07:11:24.516348 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 07:11:24.516348 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 07:11:24.516348 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 07:11:24.516348 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 07:11:24.516348 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 07:11:24.516348 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 07:11:24.516348 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 07:11:24.516348 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 07:11:24.516348 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 07:11:24.516348 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 07:11:24.516348 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 04 07:11:24.516348 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self._get_user(user_id) May 04 07:11:24.516348 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 04 07:11:24.516348 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 04 07:11:24.517318 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 07:11:24.517318 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 07:11:24.517318 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 04 07:11:24.517318 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 07:11:24.517318 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 04 07:11:24.517318 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 07:11:24.517318 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 07:11:24.517318 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 07:11:24.517318 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 07:11:24.517318 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.get_or_create( May 04 07:11:24.517318 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 07:11:24.517318 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application with Lock( May 04 07:11:24.517318 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 07:11:24.517318 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self._enter() May 04 07:11:24.517318 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 07:11:24.517318 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 07:11:24.517318 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 07:11:24.517318 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.creator() May 04 07:11:24.518357 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 07:11:24.518357 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application created_value = creator( May 04 07:11:24.518357 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 04 07:11:24.518357 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 04 07:11:24.518357 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 04 07:11:24.518357 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 04 07:11:24.518357 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 04 07:11:24.518357 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 04 07:11:24.518357 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 04 07:11:24.518357 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application May 04 07:11:24.518357 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 429/841] 10.222.0.21 () {56 vars in 1096 bytes} [Wed May 4 07:11:24 2022] GET /identity/v3/users/swift => generated 83 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 07:11:24.526132 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203369bb-1cd1-4ea3-841a-64a5f380ccb9 None None] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:11:24.532121 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9c5a8a-e95c-4dbf-a4e1-cea743cc35e7 None admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:11:24.644948 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203369bb-1cd1-4ea3-841a-64a5f380ccb9 None None] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:11:24.656398 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9c5a8a-e95c-4dbf-a4e1-cea743cc35e7 None admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:11:24.690543 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6113de-6a43-40c3-a1e6-6b2f0e3e0e49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:11:24.691625 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6113de-6a43-40c3-a1e6-6b2f0e3e0e49 None admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:11:24.692186 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6113de-6a43-40c3-a1e6-6b2f0e3e0e49 None admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:11:24.692665 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6113de-6a43-40c3-a1e6-6b2f0e3e0e49 None admin] PATH_INFO: `/v3/users` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:11:24.693704 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6113de-6a43-40c3-a1e6-6b2f0e3e0e49 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 07:11:24.694217 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6113de-6a43-40c3-a1e6-6b2f0e3e0e49 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:11:24.695879 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6113de-6a43-40c3-a1e6-6b2f0e3e0e49 None admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:11:24.698152 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6bbc3e2-8132-4045-b943-2099c9e9a5e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:11:24.700507 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bbc3e2-8132-4045-b943-2099c9e9a5e5 None admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:11:24.700786 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bbc3e2-8132-4045-b943-2099c9e9a5e5 None admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:11:24.701059 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bbc3e2-8132-4045-b943-2099c9e9a5e5 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:11:24.713158 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6bbc3e2-8132-4045-b943-2099c9e9a5e5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 07:11:24.721266 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 413/842] 10.222.0.21 () {56 vars in 1135 bytes} [Wed May 4 07:11:24 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 07:11:24.721432 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application [None req-e6bbc3e2-8132-4045-b943-2099c9e9a5e5 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 04 07:11:24.721432 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 07:11:24.721432 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 07:11:24.721432 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 07:11:24.721432 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 07:11:24.721432 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 07:11:24.721432 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 07:11:24.721432 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 07:11:24.721432 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 07:11:24.721432 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 07:11:24.721432 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 07:11:24.721432 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 07:11:24.721432 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 07:11:24.721432 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 07:11:24.721432 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 07:11:24.721432 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 07:11:24.722324 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 07:11:24.722324 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 07:11:24.722324 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 07:11:24.722324 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 07:11:24.722324 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 07:11:24.722324 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 07:11:24.722324 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 07:11:24.722324 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 07:11:24.722324 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 07:11:24.722324 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.get_or_create( May 04 07:11:24.722324 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 07:11:24.722324 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application with Lock( May 04 07:11:24.722324 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 07:11:24.722324 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self._enter() May 04 07:11:24.722324 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 07:11:24.722324 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 07:11:24.723214 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 07:11:24.723214 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.creator() May 04 07:11:24.723214 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 07:11:24.723214 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application created_value = creator( May 04 07:11:24.723214 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 07:11:24.723214 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 07:11:24.723214 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 07:11:24.723214 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 07:11:24.723214 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 07:11:24.723214 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 07:11:24.723214 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 04 07:11:24.723214 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application May 04 07:11:24.723214 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 430/843] 10.222.0.21 () {56 vars in 1102 bytes} [Wed May 4 07:11:24 2022] GET /identity/v3/roles/service => generated 85 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 07:11:24.724647 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6bbc3e2-8132-4045-b943-2099c9e9a5e5 None admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:11:24.728200 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6113de-6a43-40c3-a1e6-6b2f0e3e0e49 None admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:11:24.835179 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6113de-6a43-40c3-a1e6-6b2f0e3e0e49 None admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:11:24.848086 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6bbc3e2-8132-4045-b943-2099c9e9a5e5 None admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:11:24.866095 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8686ebc1-0258-40c3-af27-e9eab3b9e27e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:11:24.866756 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8686ebc1-0258-40c3-af27-e9eab3b9e27e None admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:11:24.867030 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8686ebc1-0258-40c3-af27-e9eab3b9e27e None admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:11:24.867339 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8686ebc1-0258-40c3-af27-e9eab3b9e27e None admin] PATH_INFO: `/v3/roles` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:11:24.868086 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8686ebc1-0258-40c3-af27-e9eab3b9e27e None admin] RBAC: Adding query filter params (name=service) {{(pid=79745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 07:11:24.868389 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8686ebc1-0258-40c3-af27-e9eab3b9e27e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:11:24.869751 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8686ebc1-0258-40c3-af27-e9eab3b9e27e None admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:11:24.879268 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 414/844] 10.222.0.21 () {56 vars in 1103 bytes} [Wed May 4 07:11:24 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 07:11:24.884914 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8686ebc1-0258-40c3-af27-e9eab3b9e27e None admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:11:24.888585 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9341ffed-0989-4645-aa09-82fd4753b13a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:11:24.890106 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9341ffed-0989-4645-aa09-82fd4753b13a None admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:11:24.890397 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9341ffed-0989-4645-aa09-82fd4753b13a None admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:11:24.890733 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9341ffed-0989-4645-aa09-82fd4753b13a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:11:24.973607 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9341ffed-0989-4645-aa09-82fd4753b13a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:11:24.975426 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9341ffed-0989-4645-aa09-82fd4753b13a None admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:11:25.010005 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8686ebc1-0258-40c3-af27-e9eab3b9e27e None admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:11:25.053764 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b01e83-5ceb-4dd1-9255-9b6210167a71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:11:25.055137 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b01e83-5ceb-4dd1-9255-9b6210167a71 None admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:11:25.055447 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b01e83-5ceb-4dd1-9255-9b6210167a71 None admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:11:25.055723 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b01e83-5ceb-4dd1-9255-9b6210167a71 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:11:25.069489 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b01e83-5ceb-4dd1-9255-9b6210167a71 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:11:25.071680 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b01e83-5ceb-4dd1-9255-9b6210167a71 None admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:11:25.077543 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 431/845] 10.222.0.21 () {58 vars in 1282 bytes} [Wed May 4 07:11:24 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 04 07:11:25.088785 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9341ffed-0989-4645-aa09-82fd4753b13a None admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:11:25.100986 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application [None req-92b01e83-5ceb-4dd1-9255-9b6210167a71 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 07:11:25.100986 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 07:11:25.100986 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 07:11:25.100986 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 07:11:25.100986 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 07:11:25.100986 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 07:11:25.100986 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 07:11:25.100986 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 07:11:25.100986 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 07:11:25.100986 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 07:11:25.100986 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 07:11:25.100986 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 07:11:25.100986 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 07:11:25.100986 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 07:11:25.100986 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 07:11:25.102907 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 07:11:25.102907 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 07:11:25.102907 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 07:11:25.102907 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 07:11:25.102907 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 07:11:25.102907 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 07:11:25.102907 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self.get_or_create( May 04 07:11:25.102907 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 07:11:25.102907 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application with Lock( May 04 07:11:25.102907 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 07:11:25.102907 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self._enter() May 04 07:11:25.102907 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 07:11:25.102907 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 07:11:25.102907 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 07:11:25.102907 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self.creator() May 04 07:11:25.102907 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 07:11:25.102907 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application created_value = creator( May 04 07:11:25.103846 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 07:11:25.103846 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 07:11:25.103846 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 07:11:25.103846 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application May 04 07:11:25.103846 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 415/846] 10.222.0.21 () {56 vars in 1108 bytes} [Wed May 4 07:11:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 07:11:25.110462 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b01e83-5ceb-4dd1-9255-9b6210167a71 None admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:11:25.220542 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9341ffed-0989-4645-aa09-82fd4753b13a None admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:11:25.225838 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b01e83-5ceb-4dd1-9255-9b6210167a71 None admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:11:25.268493 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1833f152-9c44-4bc9-843d-89a97d21f6e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:11:25.269367 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1833f152-9c44-4bc9-843d-89a97d21f6e6 None admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:11:25.269709 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1833f152-9c44-4bc9-843d-89a97d21f6e6 None admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:11:25.270060 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1833f152-9c44-4bc9-843d-89a97d21f6e6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:11:25.271053 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6cfb5b-6226-40bc-b051-8601e4a162a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:11:25.271948 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6cfb5b-6226-40bc-b051-8601e4a162a8 None admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:11:25.272408 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6cfb5b-6226-40bc-b051-8601e4a162a8 None admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:11:25.272857 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6cfb5b-6226-40bc-b051-8601e4a162a8 None admin] PATH_INFO: `/v3/domains` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:11:25.273785 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6cfb5b-6226-40bc-b051-8601e4a162a8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 07:11:25.274296 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6cfb5b-6226-40bc-b051-8601e4a162a8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:11:25.275893 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6cfb5b-6226-40bc-b051-8601e4a162a8 None admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:11:25.281713 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1833f152-9c44-4bc9-843d-89a97d21f6e6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:11:25.283159 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1833f152-9c44-4bc9-843d-89a97d21f6e6 None admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:11:25.289152 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 416/847] 10.222.0.21 () {56 vars in 1109 bytes} [Wed May 4 07:11:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 07:11:25.297441 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6cfb5b-6226-40bc-b051-8601e4a162a8 None admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:11:25.308880 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application [None req-1833f152-9c44-4bc9-843d-89a97d21f6e6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 07:11:25.308880 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 07:11:25.308880 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 07:11:25.308880 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 07:11:25.308880 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 07:11:25.308880 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 07:11:25.308880 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 07:11:25.308880 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 07:11:25.308880 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 07:11:25.308880 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 07:11:25.308880 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 07:11:25.308880 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 07:11:25.308880 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 07:11:25.308880 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 07:11:25.308880 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 07:11:25.311014 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 07:11:25.311014 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 07:11:25.311014 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 07:11:25.311014 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 07:11:25.311014 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 07:11:25.311014 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 07:11:25.311014 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.get_or_create( May 04 07:11:25.311014 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 07:11:25.311014 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application with Lock( May 04 07:11:25.311014 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 07:11:25.311014 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self._enter() May 04 07:11:25.311014 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 07:11:25.311014 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 07:11:25.311014 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 07:11:25.311014 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.creator() May 04 07:11:25.311014 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 07:11:25.311014 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application created_value = creator( May 04 07:11:25.313200 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 07:11:25.313200 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 07:11:25.313200 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 07:11:25.313200 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application May 04 07:11:25.313200 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 432/848] 10.222.0.21 () {56 vars in 1108 bytes} [Wed May 4 07:11:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 07:11:25.313200 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b266e91-a8a3-4631-b861-0b7942413bbe None None] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:11:25.313200 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b266e91-a8a3-4631-b861-0b7942413bbe None None] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:11:25.313200 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b266e91-a8a3-4631-b861-0b7942413bbe None None] PATH_INFO: `/` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:11:25.315515 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 433/849] 10.222.0.21 () {54 vars in 926 bytes} [Wed May 4 07:11:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 07:11:25.315661 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b266e91-a8a3-4631-b861-0b7942413bbe None None] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:11:25.403463 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6cfb5b-6226-40bc-b051-8601e4a162a8 None admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:11:25.424658 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b266e91-a8a3-4631-b861-0b7942413bbe None None] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:11:25.437051 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82f5857-a689-451f-97c4-e833def48547 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:11:25.437850 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82f5857-a689-451f-97c4-e833def48547 None admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:11:25.438126 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82f5857-a689-451f-97c4-e833def48547 None admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:11:25.438399 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82f5857-a689-451f-97c4-e833def48547 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:11:25.445441 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82f5857-a689-451f-97c4-e833def48547 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:11:25.449804 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82f5857-a689-451f-97c4-e833def48547 None admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:11:25.464080 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4176df-a1ba-41e0-8252-208d3a3717cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:11:25.464743 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4176df-a1ba-41e0-8252-208d3a3717cc None admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:11:25.464868 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application [None req-e82f5857-a689-451f-97c4-e833def48547 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 04 07:11:25.464868 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 07:11:25.464868 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 07:11:25.464868 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 07:11:25.464868 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 07:11:25.464868 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 07:11:25.464868 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 07:11:25.464868 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 07:11:25.464868 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 07:11:25.464868 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 07:11:25.464868 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 07:11:25.464868 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 07:11:25.464868 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 04 07:11:25.464868 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self._get_user(user_id) May 04 07:11:25.464868 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 04 07:11:25.464868 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 04 07:11:25.465752 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 07:11:25.465752 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 07:11:25.465752 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 04 07:11:25.465752 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 07:11:25.465752 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 04 07:11:25.465752 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 07:11:25.465752 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 07:11:25.465752 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 07:11:25.465752 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 07:11:25.465752 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self.get_or_create( May 04 07:11:25.465752 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 07:11:25.465752 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application with Lock( May 04 07:11:25.465752 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 07:11:25.465752 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self._enter() May 04 07:11:25.465752 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 07:11:25.465752 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 07:11:25.465752 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 07:11:25.465752 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self.creator() May 04 07:11:25.466791 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 07:11:25.466791 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application created_value = creator( May 04 07:11:25.466791 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 04 07:11:25.466791 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 04 07:11:25.466791 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 04 07:11:25.466791 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 04 07:11:25.466791 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 04 07:11:25.466791 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 04 07:11:25.466791 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 04 07:11:25.466791 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application May 04 07:11:25.467868 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4176df-a1ba-41e0-8252-208d3a3717cc None admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:11:25.467868 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4176df-a1ba-41e0-8252-208d3a3717cc None admin] PATH_INFO: `/v3/domains` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:11:25.467868 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4176df-a1ba-41e0-8252-208d3a3717cc None admin] RBAC: Adding query filter params (name=Default) {{(pid=79744) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 07:11:25.467868 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4176df-a1ba-41e0-8252-208d3a3717cc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:11:25.467868 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4176df-a1ba-41e0-8252-208d3a3717cc None admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:11:25.470657 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 417/850] 10.222.0.21 () {56 vars in 1117 bytes} [Wed May 4 07:11:25 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 07:11:25.471995 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b9289e-b73e-4b06-afb0-4b17e3ff9957 None None] REQUEST_METHOD: `POST` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:11:25.472277 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b9289e-b73e-4b06-afb0-4b17e3ff9957 None None] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:11:25.472550 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b9289e-b73e-4b06-afb0-4b17e3ff9957 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:11:25.483571 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 434/851] 10.222.0.21 () {56 vars in 1109 bytes} [Wed May 4 07:11:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 07:11:25.484891 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4176df-a1ba-41e0-8252-208d3a3717cc None admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:11:25.492262 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.auth.core [None req-03b9289e-b73e-4b06-afb0-4b17e3ff9957 None None] MFA Rules not processed for user `83c5e0dcb991496ea6dee38384514508`. Rule list: `[]` (Enabled: `True`). {{(pid=79745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:11:25.493530 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.fernet_utils [None req-03b9289e-b73e-4b06-afb0-4b17e3ff9957 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:11:25.556014 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 418/852] 10.222.0.21 () {58 vars in 1023 bytes} [Wed May 4 07:11:25 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 07:11:25.556835 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b9289e-b73e-4b06-afb0-4b17e3ff9957 None None] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:11:25.579563 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4176df-a1ba-41e0-8252-208d3a3717cc None admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:11:25.610837 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba1dad5-4c2d-4913-bbcb-5dc596059657 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:11:25.611531 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba1dad5-4c2d-4913-bbcb-5dc596059657 None admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:11:25.611809 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba1dad5-4c2d-4913-bbcb-5dc596059657 None admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:11:25.612086 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba1dad5-4c2d-4913-bbcb-5dc596059657 None admin] PATH_INFO: `/v3/users` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:11:25.612915 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba1dad5-4c2d-4913-bbcb-5dc596059657 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79744) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 07:11:25.613223 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba1dad5-4c2d-4913-bbcb-5dc596059657 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:11:25.614635 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba1dad5-4c2d-4913-bbcb-5dc596059657 None admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:11:25.636570 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 435/853] 10.222.0.21 () {56 vars in 1149 bytes} [Wed May 4 07:11:25 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 07:11:25.636570 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d80acb5-9041-4ad1-9bdd-6c109b1380d9 None None] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:11:25.636570 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d80acb5-9041-4ad1-9bdd-6c109b1380d9 None None] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:11:25.636570 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d80acb5-9041-4ad1-9bdd-6c109b1380d9 None None] PATH_INFO: `/` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:11:25.636570 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 436/854] 10.222.0.21 () {54 vars in 926 bytes} [Wed May 4 07:11:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 07:11:25.636993 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d80acb5-9041-4ad1-9bdd-6c109b1380d9 None None] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:11:25.648556 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b9289e-b73e-4b06-afb0-4b17e3ff9957 None None] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:11:25.679788 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b864d6-395d-4da4-9fc0-9e1ff3775a92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:11:25.680567 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b864d6-395d-4da4-9fc0-9e1ff3775a92 None admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:11:25.680837 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b864d6-395d-4da4-9fc0-9e1ff3775a92 None admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:11:25.681107 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b864d6-395d-4da4-9fc0-9e1ff3775a92 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:11:25.687955 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b864d6-395d-4da4-9fc0-9e1ff3775a92 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:11:25.689374 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b864d6-395d-4da4-9fc0-9e1ff3775a92 None admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:11:25.702788 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application [None req-47b864d6-395d-4da4-9fc0-9e1ff3775a92 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 04 07:11:25.702788 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 07:11:25.702788 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 07:11:25.702788 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 07:11:25.702788 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 07:11:25.702788 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 07:11:25.702788 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 07:11:25.702788 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 07:11:25.702788 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 07:11:25.702788 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 07:11:25.702788 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 07:11:25.702788 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 07:11:25.702788 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 04 07:11:25.702788 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self._get_project(project_id) May 04 07:11:25.702788 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 04 07:11:25.703833 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 04 07:11:25.703833 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 07:11:25.703833 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 07:11:25.703833 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 07:11:25.703833 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 07:11:25.703833 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 07:11:25.703833 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self.get_or_create( May 04 07:11:25.703833 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 07:11:25.703833 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application with Lock( May 04 07:11:25.703833 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 07:11:25.703833 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self._enter() May 04 07:11:25.703833 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 07:11:25.703833 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 07:11:25.703833 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 07:11:25.703833 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self.creator() May 04 07:11:25.703833 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 07:11:25.703833 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application created_value = creator( May 04 07:11:25.704747 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 04 07:11:25.704747 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 04 07:11:25.704747 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 04 07:11:25.704747 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 04 07:11:25.704747 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 04 07:11:25.704747 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 04 07:11:25.704747 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 04 07:11:25.704747 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application May 04 07:11:25.704747 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 419/855] 10.222.0.21 () {56 vars in 1111 bytes} [Wed May 4 07:11:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 07:11:25.704747 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b864d6-395d-4da4-9fc0-9e1ff3775a92 None admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:11:25.733253 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d80acb5-9041-4ad1-9bdd-6c109b1380d9 None None] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:11:25.765112 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20f1117-f263-48a6-89e3-ded19d2123e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:11:25.765819 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20f1117-f263-48a6-89e3-ded19d2123e5 None admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:11:25.766098 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20f1117-f263-48a6-89e3-ded19d2123e5 None admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:11:25.766361 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20f1117-f263-48a6-89e3-ded19d2123e5 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:11:25.767002 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20f1117-f263-48a6-89e3-ded19d2123e5 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:11:25.768371 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20f1117-f263-48a6-89e3-ded19d2123e5 None admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:11:25.780450 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application [None req-e20f1117-f263-48a6-89e3-ded19d2123e5 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. May 04 07:11:25.780450 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 07:11:25.780450 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 04 07:11:25.780450 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 04 07:11:25.780450 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 04 07:11:25.780450 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 04 07:11:25.780450 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 04 07:11:25.780450 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 07:11:25.780450 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 04 07:11:25.780450 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application May 04 07:11:25.780450 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 04 07:11:25.780450 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application May 04 07:11:25.780450 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 07:11:25.780450 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 07:11:25.780450 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 07:11:25.780450 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 07:11:25.780450 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 07:11:25.781458 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 07:11:25.781458 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 07:11:25.781458 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 07:11:25.781458 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 07:11:25.781458 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 07:11:25.781458 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 07:11:25.781458 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 04 07:11:25.781458 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self._get_service(service_id) May 04 07:11:25.781458 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 04 07:11:25.781458 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 04 07:11:25.781458 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 07:11:25.781458 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 07:11:25.781458 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 07:11:25.781458 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 07:11:25.781458 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 07:11:25.781458 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.get_or_create( May 04 07:11:25.782336 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 07:11:25.782336 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application with Lock( May 04 07:11:25.782336 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 07:11:25.782336 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self._enter() May 04 07:11:25.782336 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 07:11:25.782336 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 07:11:25.782336 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 07:11:25.782336 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.creator() May 04 07:11:25.782336 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 07:11:25.782336 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application created_value = creator( May 04 07:11:25.782336 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 04 07:11:25.782336 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 07:11:25.782336 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 04 07:11:25.782336 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application May 04 07:11:25.782336 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 437/856] 10.222.0.21 () {56 vars in 1114 bytes} [Wed May 4 07:11:25 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 146 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 07:11:25.783214 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e51c2b-390b-4647-947d-e7e225b3811d None None] REQUEST_METHOD: `POST` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:11:25.783214 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e51c2b-390b-4647-947d-e7e225b3811d None None] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:11:25.783346 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e51c2b-390b-4647-947d-e7e225b3811d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:11:25.798713 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.auth.core [None req-27e51c2b-390b-4647-947d-e7e225b3811d None None] MFA Rules not processed for user `83c5e0dcb991496ea6dee38384514508`. Rule list: `[]` (Enabled: `True`). {{(pid=79744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:11:25.799896 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.fernet_utils [None req-27e51c2b-390b-4647-947d-e7e225b3811d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:11:25.802776 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b864d6-395d-4da4-9fc0-9e1ff3775a92 None admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:11:25.834557 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d720e287-98b1-4000-8358-2cd10f590846 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:11:25.835209 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d720e287-98b1-4000-8358-2cd10f590846 None admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:11:25.835484 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d720e287-98b1-4000-8358-2cd10f590846 None admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:11:25.835748 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d720e287-98b1-4000-8358-2cd10f590846 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:11:25.865558 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 438/857] 10.222.0.21 () {58 vars in 1023 bytes} [Wed May 4 07:11:25 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 07:11:25.866383 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e51c2b-390b-4647-947d-e7e225b3811d None None] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:11:25.899210 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d720e287-98b1-4000-8358-2cd10f590846 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:11:25.900746 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d720e287-98b1-4000-8358-2cd10f590846 None admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:11:25.968165 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e51c2b-390b-4647-947d-e7e225b3811d None None] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:11:25.991116 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 420/858] 10.222.0.21 () {58 vars in 1282 bytes} [Wed May 4 07:11:25 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 287 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 04 07:11:25.991953 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d720e287-98b1-4000-8358-2cd10f590846 None admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:11:26.001381 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3592eab6-56b9-41e5-8c66-4bd4e42632a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:11:26.002032 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3592eab6-56b9-41e5-8c66-4bd4e42632a0 None admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:11:26.002307 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3592eab6-56b9-41e5-8c66-4bd4e42632a0 None admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:11:26.002575 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3592eab6-56b9-41e5-8c66-4bd4e42632a0 None admin] PATH_INFO: `/v3/projects` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:11:26.003381 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3592eab6-56b9-41e5-8c66-4bd4e42632a0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79744) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 07:11:26.003681 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3592eab6-56b9-41e5-8c66-4bd4e42632a0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:11:26.005077 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3592eab6-56b9-41e5-8c66-4bd4e42632a0 None admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:11:26.017014 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 439/859] 10.222.0.21 () {56 vars in 1148 bytes} [Wed May 4 07:11:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 07:11:26.017724 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3592eab6-56b9-41e5-8c66-4bd4e42632a0 None admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:11:26.092848 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d720e287-98b1-4000-8358-2cd10f590846 None admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:11:26.110864 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3592eab6-56b9-41e5-8c66-4bd4e42632a0 None admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:11:26.124925 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f26a28-bbba-4ddf-8c67-75c1e9ba88ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:11:26.125575 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f26a28-bbba-4ddf-8c67-75c1e9ba88ef None admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:11:26.125852 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f26a28-bbba-4ddf-8c67-75c1e9ba88ef None admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:11:26.126119 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f26a28-bbba-4ddf-8c67-75c1e9ba88ef None admin] PATH_INFO: `/v3/services` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:11:26.126806 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f26a28-bbba-4ddf-8c67-75c1e9ba88ef None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=79745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 07:11:26.127123 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f26a28-bbba-4ddf-8c67-75c1e9ba88ef None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:11:26.128483 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f26a28-bbba-4ddf-8c67-75c1e9ba88ef None admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:11:26.132957 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 421/860] 10.222.0.21 () {56 vars in 1114 bytes} [Wed May 4 07:11:25 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 07:11:26.133724 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f26a28-bbba-4ddf-8c67-75c1e9ba88ef None admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:11:26.142571 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3807044b-d52d-406f-8cf4-d42131dcff0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:11:26.143397 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3807044b-d52d-406f-8cf4-d42131dcff0f None admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:11:26.143679 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3807044b-d52d-406f-8cf4-d42131dcff0f None admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:11:26.143949 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3807044b-d52d-406f-8cf4-d42131dcff0f None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:11:26.144591 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3807044b-d52d-406f-8cf4-d42131dcff0f None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:11:26.145929 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3807044b-d52d-406f-8cf4-d42131dcff0f None admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:11:26.157816 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application [None req-3807044b-d52d-406f-8cf4-d42131dcff0f None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 04 07:11:26.157816 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 07:11:26.157816 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 04 07:11:26.157816 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 04 07:11:26.157816 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 04 07:11:26.157816 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 04 07:11:26.157816 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 04 07:11:26.157816 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 07:11:26.157816 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 04 07:11:26.157816 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application May 04 07:11:26.157816 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 04 07:11:26.157816 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application May 04 07:11:26.157816 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 07:11:26.157816 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 07:11:26.157816 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 07:11:26.157816 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 07:11:26.158947 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 07:11:26.158947 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 07:11:26.158947 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 07:11:26.158947 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 07:11:26.158947 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 07:11:26.158947 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 07:11:26.158947 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 07:11:26.158947 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 04 07:11:26.158947 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self._get_service(service_id) May 04 07:11:26.158947 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 04 07:11:26.158947 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 04 07:11:26.158947 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 07:11:26.158947 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 07:11:26.158947 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 07:11:26.158947 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 07:11:26.158947 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 07:11:26.159933 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.get_or_create( May 04 07:11:26.159933 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 07:11:26.159933 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application with Lock( May 04 07:11:26.159933 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 07:11:26.159933 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self._enter() May 04 07:11:26.159933 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 07:11:26.159933 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 07:11:26.159933 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 07:11:26.159933 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.creator() May 04 07:11:26.159933 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 07:11:26.159933 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application created_value = creator( May 04 07:11:26.159933 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 04 07:11:26.159933 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 07:11:26.159933 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 04 07:11:26.159933 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application May 04 07:11:26.164422 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 440/861] 10.222.0.21 () {56 vars in 1132 bytes} [Wed May 4 07:11:26 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 146 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 07:11:26.164422 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3807044b-d52d-406f-8cf4-d42131dcff0f None admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:11:26.225625 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f26a28-bbba-4ddf-8c67-75c1e9ba88ef None admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:11:26.257536 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3807044b-d52d-406f-8cf4-d42131dcff0f None admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:11:26.258591 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd9b73a-81d0-49b5-9b10-251bbf8ac271 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:11:26.259390 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd9b73a-81d0-49b5-9b10-251bbf8ac271 None admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:11:26.259668 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd9b73a-81d0-49b5-9b10-251bbf8ac271 None admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:11:26.259941 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd9b73a-81d0-49b5-9b10-251bbf8ac271 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:11:26.270149 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd9b73a-81d0-49b5-9b10-251bbf8ac271 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:11:26.271555 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd9b73a-81d0-49b5-9b10-251bbf8ac271 None admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:11:26.289059 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application [None req-6dd9b73a-81d0-49b5-9b10-251bbf8ac271 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 07:11:26.289059 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 07:11:26.289059 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 07:11:26.289059 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 07:11:26.289059 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 07:11:26.289059 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 07:11:26.289059 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 07:11:26.289059 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 07:11:26.289059 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 07:11:26.289059 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 07:11:26.289059 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 07:11:26.289059 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 07:11:26.289059 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 07:11:26.289059 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 07:11:26.289059 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 07:11:26.290003 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 07:11:26.290003 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 07:11:26.290003 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 07:11:26.290003 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 07:11:26.290003 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 07:11:26.290003 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 07:11:26.290003 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self.get_or_create( May 04 07:11:26.290003 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 07:11:26.290003 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application with Lock( May 04 07:11:26.290003 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 07:11:26.290003 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self._enter() May 04 07:11:26.290003 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 07:11:26.290003 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 07:11:26.290003 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 07:11:26.290003 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self.creator() May 04 07:11:26.290003 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 07:11:26.290003 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application created_value = creator( May 04 07:11:26.290903 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 07:11:26.290903 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 07:11:26.290903 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 07:11:26.290903 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application May 04 07:11:26.291139 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e069ac71-d323-4392-ba3e-e9d7a1437598 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:11:26.291403 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 422/862] 10.222.0.21 () {56 vars in 1108 bytes} [Wed May 4 07:11:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 07:11:26.291498 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e069ac71-d323-4392-ba3e-e9d7a1437598 None admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:11:26.291498 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e069ac71-d323-4392-ba3e-e9d7a1437598 None admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:11:26.291635 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd9b73a-81d0-49b5-9b10-251bbf8ac271 None admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:11:26.291706 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e069ac71-d323-4392-ba3e-e9d7a1437598 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:11:26.291847 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e069ac71-d323-4392-ba3e-e9d7a1437598 None admin] RBAC: Adding query filter params (role.id=eb54c9cea2774a25b1fe8c79724408ee, scope.project.id=c9f9c44db4984653b8d4b5f6b3b949f5, user.id=084c9245d1da4e698c9c3945fa089e85) {{(pid=79744) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 07:11:26.292752 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e069ac71-d323-4392-ba3e-e9d7a1437598 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:11:26.294154 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e069ac71-d323-4392-ba3e-e9d7a1437598 None admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:11:26.311937 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 441/863] 10.222.0.21 () {56 vars in 1374 bytes} [Wed May 4 07:11:26 2022] GET /identity/v3/role_assignments?user.id=084c9245d1da4e698c9c3945fa089e85&scope.project.id=c9f9c44db4984653b8d4b5f6b3b949f5&role.id=eb54c9cea2774a25b1fe8c79724408ee => generated 608 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 07:11:26.311937 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e069ac71-d323-4392-ba3e-e9d7a1437598 None admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:11:26.399977 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd9b73a-81d0-49b5-9b10-251bbf8ac271 None admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:11:26.410419 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e069ac71-d323-4392-ba3e-e9d7a1437598 None admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:11:26.435917 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32fbbab-ecc0-4c49-b0e1-0ae5b81fc429 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:11:26.436983 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32fbbab-ecc0-4c49-b0e1-0ae5b81fc429 None admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:11:26.437480 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32fbbab-ecc0-4c49-b0e1-0ae5b81fc429 None admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:11:26.437947 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32fbbab-ecc0-4c49-b0e1-0ae5b81fc429 None admin] PATH_INFO: `/v3/services` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:11:26.438936 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32fbbab-ecc0-4c49-b0e1-0ae5b81fc429 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=79745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 07:11:26.439343 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32fbbab-ecc0-4c49-b0e1-0ae5b81fc429 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:11:26.440917 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32fbbab-ecc0-4c49-b0e1-0ae5b81fc429 None admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:11:26.447355 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 423/864] 10.222.0.21 () {56 vars in 1114 bytes} [Wed May 4 07:11:26 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 07:11:26.447540 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32fbbab-ecc0-4c49-b0e1-0ae5b81fc429 None admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:11:26.451340 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25feda64-9670-4f71-8dc2-f4d89a5afa33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:11:26.452038 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25feda64-9670-4f71-8dc2-f4d89a5afa33 None admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:11:26.452314 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25feda64-9670-4f71-8dc2-f4d89a5afa33 None admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:11:26.452582 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25feda64-9670-4f71-8dc2-f4d89a5afa33 None admin] PATH_INFO: `/v3/services` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:11:26.453317 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25feda64-9670-4f71-8dc2-f4d89a5afa33 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=79744) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 07:11:26.453626 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25feda64-9670-4f71-8dc2-f4d89a5afa33 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:11:26.455075 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25feda64-9670-4f71-8dc2-f4d89a5afa33 None admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:11:26.467621 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 442/865] 10.222.0.21 () {56 vars in 1126 bytes} [Wed May 4 07:11:26 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 07:11:26.469843 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25feda64-9670-4f71-8dc2-f4d89a5afa33 None admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:11:26.569104 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32fbbab-ecc0-4c49-b0e1-0ae5b81fc429 None admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:11:26.595115 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25feda64-9670-4f71-8dc2-f4d89a5afa33 None admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:11:26.613548 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f70f8d9-13ce-40a2-a303-72b5ba0b5959 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:11:26.614527 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f70f8d9-13ce-40a2-a303-72b5ba0b5959 None admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:11:26.614981 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f70f8d9-13ce-40a2-a303-72b5ba0b5959 None admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:11:26.615451 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f70f8d9-13ce-40a2-a303-72b5ba0b5959 None admin] PATH_INFO: `/v3/domains` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:11:26.616361 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f70f8d9-13ce-40a2-a303-72b5ba0b5959 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 07:11:26.616874 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f70f8d9-13ce-40a2-a303-72b5ba0b5959 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:11:26.618447 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f70f8d9-13ce-40a2-a303-72b5ba0b5959 None admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:11:26.631445 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 424/866] 10.222.0.21 () {56 vars in 1109 bytes} [Wed May 4 07:11:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 07:11:26.631896 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ff686a-3990-4b65-9eef-008aad1d3d99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:11:26.632874 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ff686a-3990-4b65-9eef-008aad1d3d99 None admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:11:26.633155 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ff686a-3990-4b65-9eef-008aad1d3d99 None admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:11:26.633428 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ff686a-3990-4b65-9eef-008aad1d3d99 None admin] PATH_INFO: `/v3/services` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:11:26.634131 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ff686a-3990-4b65-9eef-008aad1d3d99 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=79744) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 07:11:26.634431 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ff686a-3990-4b65-9eef-008aad1d3d99 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:11:26.640964 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ff686a-3990-4b65-9eef-008aad1d3d99 None admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:11:26.641175 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f70f8d9-13ce-40a2-a303-72b5ba0b5959 None admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:11:26.641706 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 443/867] 10.222.0.21 () {56 vars in 1126 bytes} [Wed May 4 07:11:26 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 07:11:26.750404 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f70f8d9-13ce-40a2-a303-72b5ba0b5959 None admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:11:26.787643 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51bfda48-5ae0-4b93-95c4-7ed13a3561ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:11:26.788813 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bfda48-5ae0-4b93-95c4-7ed13a3561ec None admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:11:26.789245 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bfda48-5ae0-4b93-95c4-7ed13a3561ec None admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:11:26.789666 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bfda48-5ae0-4b93-95c4-7ed13a3561ec None admin] PATH_INFO: `/v3/projects/service` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:11:26.798177 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51bfda48-5ae0-4b93-95c4-7ed13a3561ec None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:11:26.799932 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51bfda48-5ae0-4b93-95c4-7ed13a3561ec None admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:11:26.815489 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application [None req-51bfda48-5ae0-4b93-95c4-7ed13a3561ec None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 04 07:11:26.815489 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 07:11:26.815489 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 07:11:26.815489 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 07:11:26.815489 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 07:11:26.815489 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 07:11:26.815489 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 07:11:26.815489 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 07:11:26.815489 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 07:11:26.815489 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 07:11:26.815489 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 07:11:26.815489 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 07:11:26.815489 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 04 07:11:26.815489 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self._get_project(project_id) May 04 07:11:26.815489 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 04 07:11:26.816649 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 04 07:11:26.816649 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 07:11:26.816649 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 07:11:26.816649 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 07:11:26.816649 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 07:11:26.816649 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 07:11:26.816649 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self.get_or_create( May 04 07:11:26.816649 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 07:11:26.816649 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application with Lock( May 04 07:11:26.816649 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 07:11:26.816649 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self._enter() May 04 07:11:26.816649 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 07:11:26.816649 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 07:11:26.816649 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 07:11:26.816649 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self.creator() May 04 07:11:26.816649 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 07:11:26.816649 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application created_value = creator( May 04 07:11:26.817791 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 04 07:11:26.817791 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 04 07:11:26.817791 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 04 07:11:26.817791 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 04 07:11:26.817791 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 04 07:11:26.817791 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 04 07:11:26.817791 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 04 07:11:26.817791 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application May 04 07:11:26.820062 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 425/868] 10.222.0.21 () {56 vars in 1111 bytes} [Wed May 4 07:11:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 07:11:26.826729 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ff686a-3990-4b65-9eef-008aad1d3d99 None admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:11:26.930789 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ff686a-3990-4b65-9eef-008aad1d3d99 None admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:11:26.965368 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d68cf81-5312-4d5a-a75d-1f78f7fb6bc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:11:26.966025 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d68cf81-5312-4d5a-a75d-1f78f7fb6bc8 None admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:11:26.966332 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d68cf81-5312-4d5a-a75d-1f78f7fb6bc8 None admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:11:26.966605 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d68cf81-5312-4d5a-a75d-1f78f7fb6bc8 None admin] PATH_INFO: `/v3/projects` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:11:26.967432 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d68cf81-5312-4d5a-a75d-1f78f7fb6bc8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79744) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 07:11:26.967743 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d68cf81-5312-4d5a-a75d-1f78f7fb6bc8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:11:26.969162 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d68cf81-5312-4d5a-a75d-1f78f7fb6bc8 None admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:11:26.981863 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 444/869] 10.222.0.21 () {56 vars in 1148 bytes} [Wed May 4 07:11:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 07:11:26.987790 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51bfda48-5ae0-4b93-95c4-7ed13a3561ec None admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:11:27.092085 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51bfda48-5ae0-4b93-95c4-7ed13a3561ec None admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:11:27.126197 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ea7929-bd13-4875-8af6-3eec434289c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:11:27.126847 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ea7929-bd13-4875-8af6-3eec434289c2 None admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:11:27.127126 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ea7929-bd13-4875-8af6-3eec434289c2 None admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:11:27.127419 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ea7929-bd13-4875-8af6-3eec434289c2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:11:27.128240 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ea7929-bd13-4875-8af6-3eec434289c2 None admin] RBAC: Adding query filter params (role.id=14041215d0f7476a8e90241a49338706, scope.project.id=c9f9c44db4984653b8d4b5f6b3b949f5, user.id=704cdbc22849413baa4e0189947ebebc) {{(pid=79745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 07:11:27.128609 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ea7929-bd13-4875-8af6-3eec434289c2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:11:27.130030 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ea7929-bd13-4875-8af6-3eec434289c2 None admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:11:27.137192 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 426/870] 10.222.0.21 () {56 vars in 1374 bytes} [Wed May 4 07:11:26 2022] GET /identity/v3/role_assignments?user.id=704cdbc22849413baa4e0189947ebebc&scope.project.id=c9f9c44db4984653b8d4b5f6b3b949f5&role.id=14041215d0f7476a8e90241a49338706 => generated 608 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 07:11:28.679866 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936b0a88-3302-4a11-9131-157ad8529ea7 None None] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:11:28.680877 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936b0a88-3302-4a11-9131-157ad8529ea7 None None] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:11:28.681353 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936b0a88-3302-4a11-9131-157ad8529ea7 None None] PATH_INFO: `/` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:11:28.683414 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 445/871] 10.222.0.21 () {54 vars in 926 bytes} [Wed May 4 07:11:28 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 07:11:28.688802 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbf3402-0158-42c4-ba80-2ce03ed8d3b9 None None] REQUEST_METHOD: `POST` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:11:28.689648 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbf3402-0158-42c4-ba80-2ce03ed8d3b9 None None] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:11:28.690120 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbf3402-0158-42c4-ba80-2ce03ed8d3b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:11:28.707311 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.auth.core [None req-cbbf3402-0158-42c4-ba80-2ce03ed8d3b9 None None] MFA Rules not processed for user `83c5e0dcb991496ea6dee38384514508`. Rule list: `[]` (Enabled: `True`). {{(pid=79745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:11:28.708798 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.fernet_utils [None req-cbbf3402-0158-42c4-ba80-2ce03ed8d3b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:11:28.783293 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 427/872] 10.222.0.21 () {58 vars in 1023 bytes} [Wed May 4 07:11:28 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 07:11:28.801227 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936b0a88-3302-4a11-9131-157ad8529ea7 None None] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:11:28.816481 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144166d5-2fd4-4f66-9309-9aa836c03561 None None] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:11:28.816792 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144166d5-2fd4-4f66-9309-9aa836c03561 None None] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:11:28.817029 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144166d5-2fd4-4f66-9309-9aa836c03561 None None] PATH_INFO: `/` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:11:28.818648 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 428/873] 10.222.0.21 () {54 vars in 926 bytes} [Wed May 4 07:11:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 07:11:28.823622 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39b8c66-dcb5-48b9-8889-b2f0e871a59e None None] REQUEST_METHOD: `POST` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:11:28.823904 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39b8c66-dcb5-48b9-8889-b2f0e871a59e None None] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:11:28.824183 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39b8c66-dcb5-48b9-8889-b2f0e871a59e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:11:28.841402 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.auth.core [None req-e39b8c66-dcb5-48b9-8889-b2f0e871a59e None None] MFA Rules not processed for user `83c5e0dcb991496ea6dee38384514508`. Rule list: `[]` (Enabled: `True`). {{(pid=79745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:11:28.842581 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.fernet_utils [None req-e39b8c66-dcb5-48b9-8889-b2f0e871a59e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:11:28.906076 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936b0a88-3302-4a11-9131-157ad8529ea7 None None] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:11:28.922787 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 429/874] 10.222.0.21 () {58 vars in 1023 bytes} [Wed May 4 07:11:28 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 04 07:11:28.938564 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39b8c66-dcb5-48b9-8889-b2f0e871a59e None None] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:11:28.945425 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04875c89-9a1c-4cf7-86b6-1a84c0b883c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:11:28.946479 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04875c89-9a1c-4cf7-86b6-1a84c0b883c2 None admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:11:28.946954 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04875c89-9a1c-4cf7-86b6-1a84c0b883c2 None admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:11:28.947442 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04875c89-9a1c-4cf7-86b6-1a84c0b883c2 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:11:28.948908 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04875c89-9a1c-4cf7-86b6-1a84c0b883c2 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:11:28.950484 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04875c89-9a1c-4cf7-86b6-1a84c0b883c2 None admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:11:28.973107 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application [None req-04875c89-9a1c-4cf7-86b6-1a84c0b883c2 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 04 07:11:28.973107 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 07:11:28.973107 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 04 07:11:28.973107 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 04 07:11:28.973107 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 04 07:11:28.973107 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 04 07:11:28.973107 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 04 07:11:28.973107 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 07:11:28.973107 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 04 07:11:28.973107 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application May 04 07:11:28.973107 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 04 07:11:28.973107 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application May 04 07:11:28.973107 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 07:11:28.973107 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 07:11:28.973107 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 07:11:28.973107 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 07:11:28.973107 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 07:11:28.974145 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 07:11:28.974145 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 07:11:28.974145 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 07:11:28.974145 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 07:11:28.974145 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 07:11:28.974145 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 07:11:28.974145 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 04 07:11:28.974145 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self._get_service(service_id) May 04 07:11:28.974145 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 04 07:11:28.974145 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 04 07:11:28.974145 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 07:11:28.974145 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 07:11:28.974145 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 07:11:28.974145 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 07:11:28.974145 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 07:11:28.974145 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.get_or_create( May 04 07:11:28.974998 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 07:11:28.974998 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application with Lock( May 04 07:11:28.974998 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 07:11:28.974998 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self._enter() May 04 07:11:28.974998 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 07:11:28.974998 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 07:11:28.974998 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 07:11:28.974998 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.creator() May 04 07:11:28.974998 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 07:11:28.974998 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application created_value = creator( May 04 07:11:28.974998 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 04 07:11:28.974998 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 07:11:28.974998 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 04 07:11:28.974998 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application May 04 07:11:28.976788 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 446/875] 10.222.0.21 () {56 vars in 1126 bytes} [Wed May 4 07:11:28 2022] GET /identity/v3/services/object-store => generated 93 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 07:11:28.978598 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da12a1bd-8b14-402e-95c2-83857d311518 None None] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:11:28.979083 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da12a1bd-8b14-402e-95c2-83857d311518 None None] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:11:28.980150 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da12a1bd-8b14-402e-95c2-83857d311518 None None] PATH_INFO: `/` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:11:28.985931 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 447/876] 10.222.0.21 () {54 vars in 926 bytes} [Wed May 4 07:11:28 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 07:11:28.987255 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da12a1bd-8b14-402e-95c2-83857d311518 None None] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:11:29.060614 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39b8c66-dcb5-48b9-8889-b2f0e871a59e None None] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:11:29.093435 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da12a1bd-8b14-402e-95c2-83857d311518 None None] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:11:29.094438 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f2a307-320c-43a2-a145-fb02a40f5154 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:11:29.095278 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f2a307-320c-43a2-a145-fb02a40f5154 None admin] REQUEST_METHOD: `POST` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:11:29.095558 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f2a307-320c-43a2-a145-fb02a40f5154 None admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:11:29.095827 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f2a307-320c-43a2-a145-fb02a40f5154 None admin] PATH_INFO: `/v3/services` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:11:29.096541 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f2a307-320c-43a2-a145-fb02a40f5154 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:11:29.097914 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f2a307-320c-43a2-a145-fb02a40f5154 None admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:11:29.115302 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 430/877] 10.222.0.21 () {60 vars in 1141 bytes} [Wed May 4 07:11:28 2022] POST /identity/v3/services => generated 251 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 07:11:29.115302 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61cca55-059a-4eb3-9a37-9ed6b69eee5a None None] REQUEST_METHOD: `POST` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:11:29.115302 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61cca55-059a-4eb3-9a37-9ed6b69eee5a None None] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:11:29.115302 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61cca55-059a-4eb3-9a37-9ed6b69eee5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:11:29.142432 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.auth.core [None req-d61cca55-059a-4eb3-9a37-9ed6b69eee5a None None] MFA Rules not processed for user `83c5e0dcb991496ea6dee38384514508`. Rule list: `[]` (Enabled: `True`). {{(pid=79745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:11:29.143489 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018a42b8-0c46-4dbb-a3dd-ea4cfa1bc6e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:11:29.143915 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.fernet_utils [None req-d61cca55-059a-4eb3-9a37-9ed6b69eee5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:11:29.144605 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018a42b8-0c46-4dbb-a3dd-ea4cfa1bc6e8 None admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:11:29.145111 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018a42b8-0c46-4dbb-a3dd-ea4cfa1bc6e8 None admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:11:29.145597 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018a42b8-0c46-4dbb-a3dd-ea4cfa1bc6e8 None admin] PATH_INFO: `/v3/services` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:11:29.146550 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018a42b8-0c46-4dbb-a3dd-ea4cfa1bc6e8 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=79744) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 07:11:29.147112 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018a42b8-0c46-4dbb-a3dd-ea4cfa1bc6e8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:11:29.148785 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018a42b8-0c46-4dbb-a3dd-ea4cfa1bc6e8 None admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:11:29.155307 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 448/878] 10.222.0.21 () {56 vars in 1122 bytes} [Wed May 4 07:11:28 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 07:11:29.161968 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018a42b8-0c46-4dbb-a3dd-ea4cfa1bc6e8 None admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:11:29.239723 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 431/879] 10.222.0.21 () {58 vars in 1023 bytes} [Wed May 4 07:11:29 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 07:11:29.256909 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61cca55-059a-4eb3-9a37-9ed6b69eee5a None None] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:11:29.291469 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018a42b8-0c46-4dbb-a3dd-ea4cfa1bc6e8 None admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:11:29.337980 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89e88e7-3c74-428d-ac91-2228f049b6ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:11:29.339640 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89e88e7-3c74-428d-ac91-2228f049b6ed None admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:11:29.340121 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89e88e7-3c74-428d-ac91-2228f049b6ed None admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:11:29.340607 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89e88e7-3c74-428d-ac91-2228f049b6ed None admin] PATH_INFO: `/v3/services` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:11:29.341408 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89e88e7-3c74-428d-ac91-2228f049b6ed None admin] RBAC: Adding query filter params (type=object-store) {{(pid=79744) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 07:11:29.341715 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89e88e7-3c74-428d-ac91-2228f049b6ed None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:11:29.343068 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89e88e7-3c74-428d-ac91-2228f049b6ed None admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:11:29.354955 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 449/880] 10.222.0.21 () {56 vars in 1122 bytes} [Wed May 4 07:11:29 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 07:11:29.382429 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61cca55-059a-4eb3-9a37-9ed6b69eee5a None None] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:11:29.421388 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d9eabf-6284-4bf4-8a32-a3e8786f8eac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:11:29.422072 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d9eabf-6284-4bf4-8a32-a3e8786f8eac None admin] REQUEST_METHOD: `POST` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:11:29.422348 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d9eabf-6284-4bf4-8a32-a3e8786f8eac None admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:11:29.422717 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d9eabf-6284-4bf4-8a32-a3e8786f8eac None admin] PATH_INFO: `/v3/services` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:11:29.423497 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d9eabf-6284-4bf4-8a32-a3e8786f8eac None admin] RBAC: Authorizing `identity:create_service()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:11:29.424941 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d9eabf-6284-4bf4-8a32-a3e8786f8eac None admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:11:29.443210 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 432/881] 10.222.0.21 () {60 vars in 1141 bytes} [Wed May 4 07:11:29 2022] POST /identity/v3/services => generated 269 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 07:11:29.501660 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a20f086-6ca4-45a8-94ed-bebc9681883f None None] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:11:29.501847 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a20f086-6ca4-45a8-94ed-bebc9681883f None None] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:11:29.502247 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a20f086-6ca4-45a8-94ed-bebc9681883f None None] PATH_INFO: `/` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:11:29.504147 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 450/882] 10.222.0.21 () {54 vars in 926 bytes} [Wed May 4 07:11:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 07:11:29.510441 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbdbf21-7b53-4dd2-8b60-29add40d4a5e None None] REQUEST_METHOD: `POST` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:11:29.511507 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbdbf21-7b53-4dd2-8b60-29add40d4a5e None None] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:11:29.511902 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbdbf21-7b53-4dd2-8b60-29add40d4a5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:11:29.529999 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.auth.core [None req-8dbdbf21-7b53-4dd2-8b60-29add40d4a5e None None] MFA Rules not processed for user `83c5e0dcb991496ea6dee38384514508`. Rule list: `[]` (Enabled: `True`). {{(pid=79745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:11:29.531271 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.fernet_utils [None req-8dbdbf21-7b53-4dd2-8b60-29add40d4a5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:11:29.620444 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 433/883] 10.222.0.21 () {58 vars in 1023 bytes} [Wed May 4 07:11:29 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 07:11:29.644006 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a20f086-6ca4-45a8-94ed-bebc9681883f None None] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:11:29.750673 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a20f086-6ca4-45a8-94ed-bebc9681883f None None] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:11:29.785600 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a28e268-f7d5-498b-a4c1-b016af2337cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:11:29.786413 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a28e268-f7d5-498b-a4c1-b016af2337cb None admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:11:29.786692 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a28e268-f7d5-498b-a4c1-b016af2337cb None admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:11:29.786965 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a28e268-f7d5-498b-a4c1-b016af2337cb None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:11:29.798817 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a28e268-f7d5-498b-a4c1-b016af2337cb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 07:11:29.807083 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application [None req-8a28e268-f7d5-498b-a4c1-b016af2337cb None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 04 07:11:29.807083 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 07:11:29.807083 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 07:11:29.807083 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 07:11:29.807083 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 07:11:29.807083 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 07:11:29.807083 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 07:11:29.807083 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 07:11:29.807083 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 07:11:29.807083 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 07:11:29.807083 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 07:11:29.807083 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 07:11:29.807083 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 07:11:29.807083 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 07:11:29.807083 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 07:11:29.807083 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 07:11:29.808750 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 07:11:29.808750 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 07:11:29.808750 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 07:11:29.808750 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 07:11:29.808750 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 07:11:29.808750 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 07:11:29.808750 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 07:11:29.808750 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 07:11:29.808750 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 07:11:29.808750 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.get_or_create( May 04 07:11:29.808750 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 07:11:29.808750 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application with Lock( May 04 07:11:29.808750 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 07:11:29.808750 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self._enter() May 04 07:11:29.808750 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 07:11:29.808750 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 07:11:29.809604 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 07:11:29.809604 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.creator() May 04 07:11:29.809604 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 07:11:29.809604 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application created_value = creator( May 04 07:11:29.809604 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 07:11:29.809604 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 07:11:29.809604 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 07:11:29.809604 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 07:11:29.809604 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 07:11:29.809604 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 07:11:29.809604 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 04 07:11:29.809604 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application May 04 07:11:29.809604 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 451/884] 10.222.0.21 () {56 vars in 1120 bytes} [Wed May 4 07:11:29 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 07:11:29.815102 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbdbf21-7b53-4dd2-8b60-29add40d4a5e None None] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:11:29.915644 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbdbf21-7b53-4dd2-8b60-29add40d4a5e None None] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:11:29.951377 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5823d0-8a96-4f65-8714-5873be104d8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:11:29.952328 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5823d0-8a96-4f65-8714-5873be104d8b None admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:11:29.952789 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5823d0-8a96-4f65-8714-5873be104d8b None admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:11:29.953239 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5823d0-8a96-4f65-8714-5873be104d8b None admin] PATH_INFO: `/v3/roles` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:11:29.954173 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5823d0-8a96-4f65-8714-5873be104d8b None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 07:11:29.954655 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5823d0-8a96-4f65-8714-5873be104d8b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:11:29.957488 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5823d0-8a96-4f65-8714-5873be104d8b None admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:11:29.966630 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 434/885] 10.222.0.21 () {56 vars in 1115 bytes} [Wed May 4 07:11:29 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 07:11:29.972395 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a28e268-f7d5-498b-a4c1-b016af2337cb None admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:11:30.076328 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a28e268-f7d5-498b-a4c1-b016af2337cb None admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:11:30.110589 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5891b4c8-7a56-4eb5-aa62-9884d8505c04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:11:30.111450 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5891b4c8-7a56-4eb5-aa62-9884d8505c04 None admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:11:30.111735 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5891b4c8-7a56-4eb5-aa62-9884d8505c04 None admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:11:30.112046 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5891b4c8-7a56-4eb5-aa62-9884d8505c04 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:11:30.122893 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5891b4c8-7a56-4eb5-aa62-9884d8505c04 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:11:30.124363 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5891b4c8-7a56-4eb5-aa62-9884d8505c04 None admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:11:30.141638 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application [None req-5891b4c8-7a56-4eb5-aa62-9884d8505c04 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 07:11:30.141638 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 07:11:30.141638 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 07:11:30.141638 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 07:11:30.141638 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 07:11:30.141638 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 07:11:30.141638 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 07:11:30.141638 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 07:11:30.141638 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 07:11:30.141638 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 07:11:30.141638 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 07:11:30.141638 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 07:11:30.141638 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 07:11:30.141638 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 07:11:30.141638 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 07:11:30.142570 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 07:11:30.142570 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 07:11:30.142570 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 07:11:30.142570 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 07:11:30.142570 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 07:11:30.142570 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 07:11:30.142570 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.get_or_create( May 04 07:11:30.142570 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 07:11:30.142570 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application with Lock( May 04 07:11:30.142570 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 07:11:30.142570 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self._enter() May 04 07:11:30.142570 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 07:11:30.142570 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 07:11:30.142570 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 07:11:30.142570 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.creator() May 04 07:11:30.142570 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 07:11:30.142570 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application created_value = creator( May 04 07:11:30.143526 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 07:11:30.143526 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 07:11:30.143526 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 07:11:30.143526 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application May 04 07:11:30.143526 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 452/886] 10.222.0.21 () {56 vars in 1108 bytes} [Wed May 4 07:11:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 07:11:30.148524 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5823d0-8a96-4f65-8714-5873be104d8b None admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:11:30.251503 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5823d0-8a96-4f65-8714-5873be104d8b None admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:11:30.284334 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c5a740-b663-46a0-9533-c7f0d62e6558 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:11:30.284987 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c5a740-b663-46a0-9533-c7f0d62e6558 None admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:11:30.285254 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c5a740-b663-46a0-9533-c7f0d62e6558 None admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:11:30.285527 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c5a740-b663-46a0-9533-c7f0d62e6558 None admin] PATH_INFO: `/v3/domains` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:11:30.286235 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c5a740-b663-46a0-9533-c7f0d62e6558 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 07:11:30.286534 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c5a740-b663-46a0-9533-c7f0d62e6558 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:11:30.287907 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c5a740-b663-46a0-9533-c7f0d62e6558 None admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:11:30.300474 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 435/887] 10.222.0.21 () {56 vars in 1109 bytes} [Wed May 4 07:11:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 07:11:30.305929 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5891b4c8-7a56-4eb5-aa62-9884d8505c04 None admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:11:30.422263 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5891b4c8-7a56-4eb5-aa62-9884d8505c04 None admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:11:30.463230 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb9bcc5-ebed-4c7d-b3f2-f7148225cac7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:11:30.463230 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb9bcc5-ebed-4c7d-b3f2-f7148225cac7 None admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:11:30.463230 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb9bcc5-ebed-4c7d-b3f2-f7148225cac7 None admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:11:30.463230 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb9bcc5-ebed-4c7d-b3f2-f7148225cac7 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:11:30.468816 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb9bcc5-ebed-4c7d-b3f2-f7148225cac7 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:11:30.470337 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb9bcc5-ebed-4c7d-b3f2-f7148225cac7 None admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:11:30.486056 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application [None req-9bb9bcc5-ebed-4c7d-b3f2-f7148225cac7 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 04 07:11:30.486056 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 07:11:30.486056 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 07:11:30.486056 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 07:11:30.486056 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 07:11:30.486056 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 07:11:30.486056 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 07:11:30.486056 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 07:11:30.486056 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 07:11:30.486056 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 07:11:30.486056 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 07:11:30.486056 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 07:11:30.486056 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 04 07:11:30.486056 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self._get_user(user_id) May 04 07:11:30.486056 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 04 07:11:30.486056 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 04 07:11:30.487088 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 07:11:30.487088 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 07:11:30.487088 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 04 07:11:30.487088 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 07:11:30.487088 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 04 07:11:30.487088 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 07:11:30.487088 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 07:11:30.487088 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 07:11:30.487088 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 07:11:30.487088 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.get_or_create( May 04 07:11:30.487088 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 07:11:30.487088 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application with Lock( May 04 07:11:30.487088 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 07:11:30.487088 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self._enter() May 04 07:11:30.487088 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 07:11:30.487088 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 07:11:30.487088 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 07:11:30.487088 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.creator() May 04 07:11:30.488785 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 07:11:30.488785 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application created_value = creator( May 04 07:11:30.488785 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 04 07:11:30.488785 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 04 07:11:30.488785 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 04 07:11:30.488785 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 04 07:11:30.488785 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 04 07:11:30.488785 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 04 07:11:30.488785 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 04 07:11:30.488785 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application May 04 07:11:30.488785 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 453/888] 10.222.0.21 () {56 vars in 1117 bytes} [Wed May 4 07:11:30 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 07:11:30.493329 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c5a740-b663-46a0-9533-c7f0d62e6558 None admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:11:30.601411 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c5a740-b663-46a0-9533-c7f0d62e6558 None admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:11:30.636434 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70fe7cd-64a1-45f7-b91a-a9559be0220e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:11:30.637104 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70fe7cd-64a1-45f7-b91a-a9559be0220e None admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:11:30.637383 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70fe7cd-64a1-45f7-b91a-a9559be0220e None admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:11:30.637657 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70fe7cd-64a1-45f7-b91a-a9559be0220e None admin] PATH_INFO: `/v3/users` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:11:30.638482 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70fe7cd-64a1-45f7-b91a-a9559be0220e None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 07:11:30.638790 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70fe7cd-64a1-45f7-b91a-a9559be0220e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:11:30.640235 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70fe7cd-64a1-45f7-b91a-a9559be0220e None admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:11:30.658163 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 436/889] 10.222.0.21 () {56 vars in 1149 bytes} [Wed May 4 07:11:30 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 07:11:30.664557 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb9bcc5-ebed-4c7d-b3f2-f7148225cac7 None admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:11:30.772869 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb9bcc5-ebed-4c7d-b3f2-f7148225cac7 None admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:11:30.810782 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f484a8da-e680-4490-822c-2ef8fca3a266 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:11:30.811912 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f484a8da-e680-4490-822c-2ef8fca3a266 None admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:11:30.812422 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f484a8da-e680-4490-822c-2ef8fca3a266 None admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:11:30.812905 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f484a8da-e680-4490-822c-2ef8fca3a266 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:11:30.883003 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f484a8da-e680-4490-822c-2ef8fca3a266 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:11:30.884881 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f484a8da-e680-4490-822c-2ef8fca3a266 None admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:11:30.992269 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 454/890] 10.222.0.21 () {58 vars in 1282 bytes} [Wed May 4 07:11:30 2022] GET /identity/v3/auth/tokens => generated 1362 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 04 07:11:30.998868 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70fe7cd-64a1-45f7-b91a-a9559be0220e None admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:11:31.111760 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70fe7cd-64a1-45f7-b91a-a9559be0220e None admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:11:31.147167 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc95631-e8d6-4245-8e09-4b6fe21dab64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:11:31.147952 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc95631-e8d6-4245-8e09-4b6fe21dab64 None admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:11:31.148229 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc95631-e8d6-4245-8e09-4b6fe21dab64 None admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:11:31.148503 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc95631-e8d6-4245-8e09-4b6fe21dab64 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:11:31.158970 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc95631-e8d6-4245-8e09-4b6fe21dab64 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:11:31.160487 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc95631-e8d6-4245-8e09-4b6fe21dab64 None admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:11:31.177894 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application [None req-bdc95631-e8d6-4245-8e09-4b6fe21dab64 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 07:11:31.177894 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 07:11:31.177894 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 07:11:31.177894 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 07:11:31.177894 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 07:11:31.177894 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 07:11:31.177894 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 07:11:31.177894 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 07:11:31.177894 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 07:11:31.177894 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 07:11:31.177894 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 07:11:31.177894 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 07:11:31.177894 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 07:11:31.177894 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 07:11:31.177894 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 07:11:31.178867 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 07:11:31.178867 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 07:11:31.178867 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 07:11:31.178867 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 07:11:31.178867 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 07:11:31.178867 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 07:11:31.178867 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self.get_or_create( May 04 07:11:31.178867 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 07:11:31.178867 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application with Lock( May 04 07:11:31.178867 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 07:11:31.178867 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self._enter() May 04 07:11:31.178867 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 07:11:31.178867 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 07:11:31.178867 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 07:11:31.178867 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self.creator() May 04 07:11:31.178867 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 07:11:31.178867 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application created_value = creator( May 04 07:11:31.179846 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 07:11:31.179846 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 07:11:31.179846 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 07:11:31.179846 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application May 04 07:11:31.179846 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 437/891] 10.222.0.21 () {56 vars in 1108 bytes} [Wed May 4 07:11:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 07:11:31.187349 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f484a8da-e680-4490-822c-2ef8fca3a266 None admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:11:31.294182 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f484a8da-e680-4490-822c-2ef8fca3a266 None admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:11:31.330492 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862b65ca-3a98-42f8-9e51-17c7d657c150 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:11:31.331637 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862b65ca-3a98-42f8-9e51-17c7d657c150 None admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:11:31.332140 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862b65ca-3a98-42f8-9e51-17c7d657c150 None admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:11:31.332624 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862b65ca-3a98-42f8-9e51-17c7d657c150 None admin] PATH_INFO: `/v3/domains` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:11:31.333565 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862b65ca-3a98-42f8-9e51-17c7d657c150 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79744) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 07:11:31.334083 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862b65ca-3a98-42f8-9e51-17c7d657c150 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:11:31.335685 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862b65ca-3a98-42f8-9e51-17c7d657c150 None admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:11:31.348671 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 455/892] 10.222.0.21 () {56 vars in 1109 bytes} [Wed May 4 07:11:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 07:11:31.354996 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc95631-e8d6-4245-8e09-4b6fe21dab64 None admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:11:31.462873 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc95631-e8d6-4245-8e09-4b6fe21dab64 None admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:11:31.501006 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd260a9-9955-49da-832b-ec1aecab57c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:11:31.501796 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd260a9-9955-49da-832b-ec1aecab57c2 None admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:11:31.502076 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd260a9-9955-49da-832b-ec1aecab57c2 None admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:11:31.502346 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd260a9-9955-49da-832b-ec1aecab57c2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:11:31.509609 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd260a9-9955-49da-832b-ec1aecab57c2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:11:31.512047 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd260a9-9955-49da-832b-ec1aecab57c2 None admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:11:31.527265 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application [None req-5dd260a9-9955-49da-832b-ec1aecab57c2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 04 07:11:31.527265 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 07:11:31.527265 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 07:11:31.527265 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 07:11:31.527265 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 07:11:31.527265 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 07:11:31.527265 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 07:11:31.527265 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 07:11:31.527265 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 07:11:31.527265 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 07:11:31.527265 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 07:11:31.527265 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 07:11:31.527265 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 04 07:11:31.527265 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self._get_project(project_id) May 04 07:11:31.527265 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 04 07:11:31.528289 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 04 07:11:31.528289 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 07:11:31.528289 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 07:11:31.528289 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 07:11:31.528289 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 07:11:31.528289 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 07:11:31.528289 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self.get_or_create( May 04 07:11:31.528289 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 07:11:31.528289 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application with Lock( May 04 07:11:31.528289 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 07:11:31.528289 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self._enter() May 04 07:11:31.528289 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 07:11:31.528289 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 07:11:31.528289 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 07:11:31.528289 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self.creator() May 04 07:11:31.528289 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 07:11:31.528289 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application created_value = creator( May 04 07:11:31.529204 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 04 07:11:31.529204 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 04 07:11:31.529204 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 04 07:11:31.529204 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 04 07:11:31.529204 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 04 07:11:31.529204 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 04 07:11:31.529204 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 04 07:11:31.529204 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application May 04 07:11:31.529204 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 438/893] 10.222.0.21 () {56 vars in 1111 bytes} [Wed May 4 07:11:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 07:11:31.536208 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862b65ca-3a98-42f8-9e51-17c7d657c150 None admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:11:31.643528 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c40b74-b373-4657-81ad-3d9a23e15574 None None] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:11:31.643889 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c40b74-b373-4657-81ad-3d9a23e15574 None None] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:11:31.644068 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c40b74-b373-4657-81ad-3d9a23e15574 None None] PATH_INFO: `/` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:11:31.645782 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 439/894] 10.222.0.21 () {54 vars in 926 bytes} [Wed May 4 07:11:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 07:11:31.647988 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862b65ca-3a98-42f8-9e51-17c7d657c150 None admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:11:31.652873 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa58704-9e5e-4d87-9fd7-e7201e4e0bd0 None None] REQUEST_METHOD: `POST` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:11:31.652873 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa58704-9e5e-4d87-9fd7-e7201e4e0bd0 None None] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:11:31.652873 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa58704-9e5e-4d87-9fd7-e7201e4e0bd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:11:31.669399 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.auth.core [None req-2aa58704-9e5e-4d87-9fd7-e7201e4e0bd0 None None] MFA Rules not processed for user `83c5e0dcb991496ea6dee38384514508`. Rule list: `[]` (Enabled: `True`). {{(pid=79745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:11:31.670583 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.fernet_utils [None req-2aa58704-9e5e-4d87-9fd7-e7201e4e0bd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:11:31.687536 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb9dcd0-fcf8-4f41-9bee-6a9d904f4541 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:11:31.688558 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb9dcd0-fcf8-4f41-9bee-6a9d904f4541 None admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:11:31.689062 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb9dcd0-fcf8-4f41-9bee-6a9d904f4541 None admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:11:31.689549 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb9dcd0-fcf8-4f41-9bee-6a9d904f4541 None admin] PATH_INFO: `/v3/projects` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:11:31.690541 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb9dcd0-fcf8-4f41-9bee-6a9d904f4541 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79744) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 07:11:31.691068 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb9dcd0-fcf8-4f41-9bee-6a9d904f4541 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:11:31.692707 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb9dcd0-fcf8-4f41-9bee-6a9d904f4541 None admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:11:31.705982 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 456/895] 10.222.0.21 () {56 vars in 1148 bytes} [Wed May 4 07:11:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 07:11:31.712150 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb9dcd0-fcf8-4f41-9bee-6a9d904f4541 None admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:11:31.738254 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 440/896] 10.222.0.21 () {58 vars in 1023 bytes} [Wed May 4 07:11:31 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 07:11:31.739612 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed31949-2ef3-4b17-bef5-d1eb3b152513 None None] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:11:31.739918 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed31949-2ef3-4b17-bef5-d1eb3b152513 None None] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:11:31.740145 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed31949-2ef3-4b17-bef5-d1eb3b152513 None None] PATH_INFO: `/` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:11:31.741614 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 441/897] 10.222.0.21 () {54 vars in 926 bytes} [Wed May 4 07:11:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 07:11:31.748690 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27aa8c32-7f0d-404f-b4e9-dd1bdd43a847 None None] REQUEST_METHOD: `POST` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:11:31.749084 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27aa8c32-7f0d-404f-b4e9-dd1bdd43a847 None None] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:11:31.749610 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27aa8c32-7f0d-404f-b4e9-dd1bdd43a847 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:11:31.769035 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.auth.core [None req-27aa8c32-7f0d-404f-b4e9-dd1bdd43a847 None None] MFA Rules not processed for user `83c5e0dcb991496ea6dee38384514508`. Rule list: `[]` (Enabled: `True`). {{(pid=79745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:11:31.770190 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.fernet_utils [None req-27aa8c32-7f0d-404f-b4e9-dd1bdd43a847 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:11:31.822548 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb9dcd0-fcf8-4f41-9bee-6a9d904f4541 None admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:11:31.836391 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 442/898] 10.222.0.21 () {58 vars in 1023 bytes} [Wed May 4 07:11:31 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 04 07:11:31.837219 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27aa8c32-7f0d-404f-b4e9-dd1bdd43a847 None None] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:11:31.857347 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b58cdd-e424-469c-97f8-3537ff6eef3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:11:31.858004 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b58cdd-e424-469c-97f8-3537ff6eef3d None admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:11:31.858514 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b58cdd-e424-469c-97f8-3537ff6eef3d None admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:11:31.858640 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b58cdd-e424-469c-97f8-3537ff6eef3d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:11:31.859398 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b58cdd-e424-469c-97f8-3537ff6eef3d None admin] RBAC: Adding query filter params (role.id=ad15e59c437846a4897f5821fc039560, scope.project.id=c9f9c44db4984653b8d4b5f6b3b949f5, user.id=704cdbc22849413baa4e0189947ebebc) {{(pid=79744) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 07:11:31.859712 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b58cdd-e424-469c-97f8-3537ff6eef3d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:11:31.861141 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b58cdd-e424-469c-97f8-3537ff6eef3d None admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:11:31.867189 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 457/899] 10.222.0.21 () {56 vars in 1374 bytes} [Wed May 4 07:11:31 2022] GET /identity/v3/role_assignments?user.id=704cdbc22849413baa4e0189947ebebc&scope.project.id=c9f9c44db4984653b8d4b5f6b3b949f5&role.id=ad15e59c437846a4897f5821fc039560 => generated 259 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 07:11:31.867786 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9237060-d7c0-4b32-b95a-007ae9b55ca0 None None] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:11:31.868081 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9237060-d7c0-4b32-b95a-007ae9b55ca0 None None] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:11:31.868344 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9237060-d7c0-4b32-b95a-007ae9b55ca0 None None] PATH_INFO: `/` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:11:31.871391 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 458/900] 10.222.0.21 () {54 vars in 926 bytes} [Wed May 4 07:11:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 07:11:31.871550 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9237060-d7c0-4b32-b95a-007ae9b55ca0 None None] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:11:31.941555 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27aa8c32-7f0d-404f-b4e9-dd1bdd43a847 None None] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:11:31.977158 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78898dc9-fe34-4b2d-b183-91abce14b3af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:11:31.977878 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78898dc9-fe34-4b2d-b183-91abce14b3af None admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:11:31.978152 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78898dc9-fe34-4b2d-b183-91abce14b3af None admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:11:31.978417 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78898dc9-fe34-4b2d-b183-91abce14b3af None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:11:31.979072 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78898dc9-fe34-4b2d-b183-91abce14b3af None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:11:31.980596 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78898dc9-fe34-4b2d-b183-91abce14b3af None admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:11:31.984075 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9237060-d7c0-4b32-b95a-007ae9b55ca0 None None] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:11:31.992944 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application [None req-78898dc9-fe34-4b2d-b183-91abce14b3af None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. May 04 07:11:31.992944 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 07:11:31.992944 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 04 07:11:31.992944 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 04 07:11:31.992944 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 04 07:11:31.992944 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 04 07:11:31.992944 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 04 07:11:31.992944 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 07:11:31.992944 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 04 07:11:31.992944 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application May 04 07:11:31.992944 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 04 07:11:31.992944 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application May 04 07:11:31.992944 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 07:11:31.992944 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 07:11:31.992944 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 07:11:31.992944 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 07:11:31.992944 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 07:11:31.994082 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 07:11:31.994082 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 07:11:31.994082 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 07:11:31.994082 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 07:11:31.994082 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 07:11:31.994082 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 07:11:31.994082 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 04 07:11:31.994082 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self._get_service(service_id) May 04 07:11:31.994082 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 04 07:11:31.994082 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 04 07:11:31.994082 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 07:11:31.994082 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 07:11:31.994082 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 07:11:31.994082 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 07:11:31.994082 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 07:11:31.994082 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self.get_or_create( May 04 07:11:31.994960 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 07:11:31.994960 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application with Lock( May 04 07:11:31.994960 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 07:11:31.994960 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self._enter() May 04 07:11:31.994960 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 07:11:31.994960 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 07:11:31.994960 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 07:11:31.994960 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self.creator() May 04 07:11:31.994960 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 07:11:31.994960 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application created_value = creator( May 04 07:11:31.994960 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 04 07:11:31.994960 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 07:11:31.994960 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 04 07:11:31.994960 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application May 04 07:11:31.994960 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 443/901] 10.222.0.21 () {56 vars in 1114 bytes} [Wed May 4 07:11:31 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 07:11:31.996607 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db54bcde-150b-48e7-9830-8a6d6964c3c8 None None] REQUEST_METHOD: `POST` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:11:31.996607 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db54bcde-150b-48e7-9830-8a6d6964c3c8 None None] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:11:31.996607 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db54bcde-150b-48e7-9830-8a6d6964c3c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:11:32.014048 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.auth.core [None req-db54bcde-150b-48e7-9830-8a6d6964c3c8 None None] MFA Rules not processed for user `83c5e0dcb991496ea6dee38384514508`. Rule list: `[]` (Enabled: `True`). {{(pid=79745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:11:32.016067 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.fernet_utils [None req-db54bcde-150b-48e7-9830-8a6d6964c3c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:11:32.029229 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab97a8b-934e-45f8-bd49-6acaae70709f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:11:32.029908 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab97a8b-934e-45f8-bd49-6acaae70709f None admin] REQUEST_METHOD: `POST` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:11:32.030181 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab97a8b-934e-45f8-bd49-6acaae70709f None admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:11:32.030447 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab97a8b-934e-45f8-bd49-6acaae70709f None admin] PATH_INFO: `/v3/services` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:11:32.031195 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab97a8b-934e-45f8-bd49-6acaae70709f None admin] RBAC: Authorizing `identity:create_service()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:11:32.032579 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab97a8b-934e-45f8-bd49-6acaae70709f None admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:11:32.047509 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 459/902] 10.222.0.21 () {60 vars in 1141 bytes} [Wed May 4 07:11:31 2022] POST /identity/v3/services => generated 241 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 07:11:32.048650 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab97a8b-934e-45f8-bd49-6acaae70709f None admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:11:32.099781 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 444/903] 10.222.0.21 () {58 vars in 1023 bytes} [Wed May 4 07:11:31 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 07:11:32.123057 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db54bcde-150b-48e7-9830-8a6d6964c3c8 None None] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:11:32.188313 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab97a8b-934e-45f8-bd49-6acaae70709f None admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:11:32.224914 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1598ea98-325a-4c25-98f2-d41aafb90c8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:11:32.225585 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1598ea98-325a-4c25-98f2-d41aafb90c8f None admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:11:32.225864 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1598ea98-325a-4c25-98f2-d41aafb90c8f None admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:11:32.226129 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1598ea98-325a-4c25-98f2-d41aafb90c8f None admin] PATH_INFO: `/v3/services` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:11:32.226895 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1598ea98-325a-4c25-98f2-d41aafb90c8f None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=79744) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 07:11:32.227294 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1598ea98-325a-4c25-98f2-d41aafb90c8f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:11:32.228771 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1598ea98-325a-4c25-98f2-d41aafb90c8f None admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:11:32.239608 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 460/904] 10.222.0.21 () {56 vars in 1114 bytes} [Wed May 4 07:11:32 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 07:11:32.240934 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1598ea98-325a-4c25-98f2-d41aafb90c8f None admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:11:32.259373 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db54bcde-150b-48e7-9830-8a6d6964c3c8 None None] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:11:32.296596 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd040c1-37ac-4ee0-8abd-02714211030b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:11:32.297605 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd040c1-37ac-4ee0-8abd-02714211030b None admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:11:32.297951 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd040c1-37ac-4ee0-8abd-02714211030b None admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:11:32.298282 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd040c1-37ac-4ee0-8abd-02714211030b None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:11:32.299019 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd040c1-37ac-4ee0-8abd-02714211030b None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:11:32.300465 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd040c1-37ac-4ee0-8abd-02714211030b None admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:11:32.313360 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application [None req-0dd040c1-37ac-4ee0-8abd-02714211030b None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 04 07:11:32.313360 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 07:11:32.313360 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 04 07:11:32.313360 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 04 07:11:32.313360 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 04 07:11:32.313360 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 04 07:11:32.313360 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 04 07:11:32.313360 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 07:11:32.313360 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 04 07:11:32.313360 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application May 04 07:11:32.313360 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 04 07:11:32.313360 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application May 04 07:11:32.313360 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 07:11:32.313360 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 07:11:32.313360 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 07:11:32.313360 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 07:11:32.314377 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 07:11:32.314377 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 07:11:32.314377 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 07:11:32.314377 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 07:11:32.314377 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 07:11:32.314377 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 07:11:32.314377 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 07:11:32.314377 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 04 07:11:32.314377 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self._get_service(service_id) May 04 07:11:32.314377 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 04 07:11:32.314377 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 04 07:11:32.314377 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 07:11:32.314377 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 07:11:32.314377 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 07:11:32.314377 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 07:11:32.314377 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 07:11:32.315740 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self.get_or_create( May 04 07:11:32.315740 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 07:11:32.315740 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application with Lock( May 04 07:11:32.315740 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 07:11:32.315740 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self._enter() May 04 07:11:32.315740 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 07:11:32.315740 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 07:11:32.315740 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 07:11:32.315740 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self.creator() May 04 07:11:32.315740 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 07:11:32.315740 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application created_value = creator( May 04 07:11:32.315740 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 04 07:11:32.315740 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 07:11:32.315740 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 04 07:11:32.315740 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application May 04 07:11:32.319270 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 445/905] 10.222.0.21 () {56 vars in 1132 bytes} [Wed May 4 07:11:32 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 07:11:32.320734 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd040c1-37ac-4ee0-8abd-02714211030b None admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:11:32.363630 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1598ea98-325a-4c25-98f2-d41aafb90c8f None admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:11:32.397810 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b0d986-45e8-4218-a6dc-d091da4e6db2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:11:32.398522 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b0d986-45e8-4218-a6dc-d091da4e6db2 None admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:11:32.398796 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b0d986-45e8-4218-a6dc-d091da4e6db2 None admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:11:32.399093 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b0d986-45e8-4218-a6dc-d091da4e6db2 None admin] PATH_INFO: `/v3/services` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:11:32.399826 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b0d986-45e8-4218-a6dc-d091da4e6db2 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=79744) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 07:11:32.400122 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b0d986-45e8-4218-a6dc-d091da4e6db2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:11:32.401570 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b0d986-45e8-4218-a6dc-d091da4e6db2 None admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:11:32.407100 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 461/906] 10.222.0.21 () {56 vars in 1114 bytes} [Wed May 4 07:11:32 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 07:11:32.412567 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b0d986-45e8-4218-a6dc-d091da4e6db2 None admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:11:32.436465 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd040c1-37ac-4ee0-8abd-02714211030b None admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:11:32.477913 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e8209f-87c2-4831-8cec-b6cf292b3f81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:11:32.479609 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e8209f-87c2-4831-8cec-b6cf292b3f81 None admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:11:32.480099 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e8209f-87c2-4831-8cec-b6cf292b3f81 None admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:11:32.480724 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e8209f-87c2-4831-8cec-b6cf292b3f81 None admin] PATH_INFO: `/v3/services` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:11:32.481948 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e8209f-87c2-4831-8cec-b6cf292b3f81 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=79745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 07:11:32.482470 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e8209f-87c2-4831-8cec-b6cf292b3f81 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:11:32.484463 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e8209f-87c2-4831-8cec-b6cf292b3f81 None admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:11:32.491233 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 446/907] 10.222.0.21 () {56 vars in 1126 bytes} [Wed May 4 07:11:32 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 07:11:32.497302 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e8209f-87c2-4831-8cec-b6cf292b3f81 None admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:11:32.535992 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b0d986-45e8-4218-a6dc-d091da4e6db2 None admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:11:32.569477 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fdaaba-7a70-42a3-8d78-e0f199871fa2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:11:32.570490 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fdaaba-7a70-42a3-8d78-e0f199871fa2 None admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:11:32.570975 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fdaaba-7a70-42a3-8d78-e0f199871fa2 None admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:11:32.571462 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fdaaba-7a70-42a3-8d78-e0f199871fa2 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:11:32.572452 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48fdaaba-7a70-42a3-8d78-e0f199871fa2 None admin] RBAC: Adding query filter params (interface=public, service_id=6a1db3387bc840fdb7e826162a131b48, region_id=RegionOne) {{(pid=79744) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 07:11:32.572990 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48fdaaba-7a70-42a3-8d78-e0f199871fa2 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:11:32.574762 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48fdaaba-7a70-42a3-8d78-e0f199871fa2 None admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:11:32.586917 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 462/908] 10.222.0.21 () {56 vars in 1251 bytes} [Wed May 4 07:11:32 2022] GET /identity/v3/endpoints?service_id=6a1db3387bc840fdb7e826162a131b48&interface=public®ion_id=RegionOne => generated 194 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 07:11:32.588305 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fdaaba-7a70-42a3-8d78-e0f199871fa2 None admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:11:32.595885 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e8209f-87c2-4831-8cec-b6cf292b3f81 None admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:11:32.630174 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20530e34-2fca-4e98-a909-9ef5254c0865 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:11:32.630882 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20530e34-2fca-4e98-a909-9ef5254c0865 None admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:11:32.631174 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20530e34-2fca-4e98-a909-9ef5254c0865 None admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:11:32.631488 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20530e34-2fca-4e98-a909-9ef5254c0865 None admin] PATH_INFO: `/v3/services` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:11:32.632444 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20530e34-2fca-4e98-a909-9ef5254c0865 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=79745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 07:11:32.632745 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20530e34-2fca-4e98-a909-9ef5254c0865 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:11:32.634103 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20530e34-2fca-4e98-a909-9ef5254c0865 None admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:11:32.644480 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 447/909] 10.222.0.21 () {56 vars in 1126 bytes} [Wed May 4 07:11:32 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 07:11:32.645764 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20530e34-2fca-4e98-a909-9ef5254c0865 None admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:11:32.692938 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fdaaba-7a70-42a3-8d78-e0f199871fa2 None admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:11:32.726662 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079f58fc-f9bf-400d-ad34-bece07d7bbde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:11:32.727747 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079f58fc-f9bf-400d-ad34-bece07d7bbde None admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:11:32.728274 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079f58fc-f9bf-400d-ad34-bece07d7bbde None admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:11:32.728756 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079f58fc-f9bf-400d-ad34-bece07d7bbde None admin] PATH_INFO: `/v3/services` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:11:32.730144 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079f58fc-f9bf-400d-ad34-bece07d7bbde None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:11:32.731730 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079f58fc-f9bf-400d-ad34-bece07d7bbde None admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:11:32.746963 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20530e34-2fca-4e98-a909-9ef5254c0865 None admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:11:32.747699 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 463/910] 10.222.0.21 () {56 vars in 1087 bytes} [Wed May 4 07:11:32 2022] GET /identity/v3/services => generated 1497 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 07:11:32.785709 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456ebce4-7b08-436d-8459-6b7163ac0414 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:11:32.786376 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456ebce4-7b08-436d-8459-6b7163ac0414 None admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:11:32.786651 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456ebce4-7b08-436d-8459-6b7163ac0414 None admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:11:32.786915 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456ebce4-7b08-436d-8459-6b7163ac0414 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:11:32.787741 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456ebce4-7b08-436d-8459-6b7163ac0414 None admin] RBAC: Adding query filter params (interface=public, service_id=018e98b0341c4581b23b9ebe4ccb7966, region_id=RegionOne) {{(pid=79745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 07:11:32.788047 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456ebce4-7b08-436d-8459-6b7163ac0414 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:11:32.789417 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456ebce4-7b08-436d-8459-6b7163ac0414 None admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:11:32.800551 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 448/911] 10.222.0.21 () {56 vars in 1251 bytes} [Wed May 4 07:11:32 2022] GET /identity/v3/endpoints?service_id=018e98b0341c4581b23b9ebe4ccb7966&interface=public®ion_id=RegionOne => generated 194 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 07:11:32.802125 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079f58fc-f9bf-400d-ad34-bece07d7bbde None admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:11:32.909536 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079f58fc-f9bf-400d-ad34-bece07d7bbde None admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:11:32.950624 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45aa9398-d884-49aa-a9d6-5594cf0bcc6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:11:32.951317 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45aa9398-d884-49aa-a9d6-5594cf0bcc6e None admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:11:32.951594 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45aa9398-d884-49aa-a9d6-5594cf0bcc6e None admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:11:32.951864 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45aa9398-d884-49aa-a9d6-5594cf0bcc6e None admin] PATH_INFO: `/v3/services` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:11:32.952541 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45aa9398-d884-49aa-a9d6-5594cf0bcc6e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:11:32.953893 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45aa9398-d884-49aa-a9d6-5594cf0bcc6e None admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:11:32.960124 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 464/912] 10.222.0.21 () {56 vars in 1087 bytes} [Wed May 4 07:11:32 2022] GET /identity/v3/services => generated 1497 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 07:11:34.243195 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4823184-bd35-4a5b-bd0c-7ae1b016c06d None None] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:11:34.243742 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4823184-bd35-4a5b-bd0c-7ae1b016c06d None None] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:11:34.243742 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4823184-bd35-4a5b-bd0c-7ae1b016c06d None None] PATH_INFO: `/` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:11:34.245686 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 449/913] 10.222.0.21 () {54 vars in 926 bytes} [Wed May 4 07:11:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 07:11:34.251370 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8b970a-29e6-4aa3-8806-fd049c45d0b7 None None] REQUEST_METHOD: `POST` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:11:34.251870 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8b970a-29e6-4aa3-8806-fd049c45d0b7 None None] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:11:34.251949 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8b970a-29e6-4aa3-8806-fd049c45d0b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:11:34.270956 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.auth.core [None req-fb8b970a-29e6-4aa3-8806-fd049c45d0b7 None None] MFA Rules not processed for user `83c5e0dcb991496ea6dee38384514508`. Rule list: `[]` (Enabled: `True`). {{(pid=79744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:11:34.272216 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.fernet_utils [None req-fb8b970a-29e6-4aa3-8806-fd049c45d0b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:11:34.342388 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 465/914] 10.222.0.21 () {58 vars in 1023 bytes} [Wed May 4 07:11:34 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 04 07:11:34.365208 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4823184-bd35-4a5b-bd0c-7ae1b016c06d None None] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:11:34.458653 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6a93aa-fa01-456d-9e9d-b87c7d9f9bdd None None] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:11:34.458945 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6a93aa-fa01-456d-9e9d-b87c7d9f9bdd None None] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:11:34.459274 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6a93aa-fa01-456d-9e9d-b87c7d9f9bdd None None] PATH_INFO: `/` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:11:34.460881 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 466/915] 10.222.0.21 () {54 vars in 926 bytes} [Wed May 4 07:11:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 07:11:34.466641 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4fbc7c-8f5a-487b-aa89-1757aef01aa1 None None] REQUEST_METHOD: `POST` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:11:34.466922 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4fbc7c-8f5a-487b-aa89-1757aef01aa1 None None] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:11:34.467238 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4fbc7c-8f5a-487b-aa89-1757aef01aa1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:11:34.469780 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4823184-bd35-4a5b-bd0c-7ae1b016c06d None None] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:11:34.485049 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.auth.core [None req-6d4fbc7c-8f5a-487b-aa89-1757aef01aa1 None None] MFA Rules not processed for user `83c5e0dcb991496ea6dee38384514508`. Rule list: `[]` (Enabled: `True`). {{(pid=79744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:11:34.486549 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.fernet_utils [None req-6d4fbc7c-8f5a-487b-aa89-1757aef01aa1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:11:34.508941 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388b5d4e-4c06-4729-8221-a49d7441b06e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:11:34.509677 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388b5d4e-4c06-4729-8221-a49d7441b06e None admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:11:34.509955 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388b5d4e-4c06-4729-8221-a49d7441b06e None admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:11:34.510227 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388b5d4e-4c06-4729-8221-a49d7441b06e None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:11:34.521245 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388b5d4e-4c06-4729-8221-a49d7441b06e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 07:11:34.529743 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application [None req-388b5d4e-4c06-4729-8221-a49d7441b06e None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 04 07:11:34.529743 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 07:11:34.529743 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 07:11:34.529743 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 07:11:34.529743 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 07:11:34.529743 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 07:11:34.529743 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 07:11:34.529743 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 07:11:34.529743 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 07:11:34.529743 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 07:11:34.529743 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 07:11:34.529743 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 07:11:34.529743 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 07:11:34.529743 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 07:11:34.529743 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 07:11:34.529743 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 07:11:34.530917 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 07:11:34.530917 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 07:11:34.530917 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 07:11:34.530917 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 07:11:34.530917 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 07:11:34.530917 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 07:11:34.530917 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 07:11:34.530917 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 07:11:34.530917 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 07:11:34.530917 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self.get_or_create( May 04 07:11:34.530917 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 07:11:34.530917 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application with Lock( May 04 07:11:34.530917 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 07:11:34.530917 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self._enter() May 04 07:11:34.530917 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 07:11:34.530917 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 07:11:34.532241 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 07:11:34.532241 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self.creator() May 04 07:11:34.532241 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 07:11:34.532241 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application created_value = creator( May 04 07:11:34.532241 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 07:11:34.532241 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 07:11:34.532241 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 07:11:34.532241 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 07:11:34.532241 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 07:11:34.532241 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 07:11:34.532241 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 04 07:11:34.532241 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application May 04 07:11:34.532241 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 450/916] 10.222.0.21 () {56 vars in 1120 bytes} [Wed May 4 07:11:34 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 07:11:34.537139 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388b5d4e-4c06-4729-8221-a49d7441b06e None admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:11:34.567250 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 467/917] 10.222.0.21 () {58 vars in 1023 bytes} [Wed May 4 07:11:34 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 04 07:11:34.587479 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4fbc7c-8f5a-487b-aa89-1757aef01aa1 None None] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:11:34.660857 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388b5d4e-4c06-4729-8221-a49d7441b06e None admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:11:34.701214 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4fbc7c-8f5a-487b-aa89-1757aef01aa1 None None] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:11:34.706665 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed7b53a-33b7-47ae-95c7-f60cde1a0404 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:11:34.707446 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed7b53a-33b7-47ae-95c7-f60cde1a0404 None admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:11:34.707812 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed7b53a-33b7-47ae-95c7-f60cde1a0404 None admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:11:34.708149 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed7b53a-33b7-47ae-95c7-f60cde1a0404 None admin] PATH_INFO: `/v3/roles` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:11:34.708963 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed7b53a-33b7-47ae-95c7-f60cde1a0404 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 07:11:34.709334 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed7b53a-33b7-47ae-95c7-f60cde1a0404 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:11:34.711242 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed7b53a-33b7-47ae-95c7-f60cde1a0404 None admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:11:34.722820 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 451/918] 10.222.0.21 () {56 vars in 1115 bytes} [Wed May 4 07:11:34 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 07:11:34.730036 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed7b53a-33b7-47ae-95c7-f60cde1a0404 None admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:11:34.741844 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d759d15d-ba95-4ad3-a289-8dff9039cac9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:11:34.742653 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d759d15d-ba95-4ad3-a289-8dff9039cac9 None admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:11:34.742938 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d759d15d-ba95-4ad3-a289-8dff9039cac9 None admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:11:34.743251 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d759d15d-ba95-4ad3-a289-8dff9039cac9 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:11:34.743909 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d759d15d-ba95-4ad3-a289-8dff9039cac9 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:11:34.745871 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d759d15d-ba95-4ad3-a289-8dff9039cac9 None admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:11:34.758301 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application [None req-d759d15d-ba95-4ad3-a289-8dff9039cac9 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 04 07:11:34.758301 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 07:11:34.758301 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 04 07:11:34.758301 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 04 07:11:34.758301 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 04 07:11:34.758301 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 04 07:11:34.758301 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 04 07:11:34.758301 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 07:11:34.758301 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 04 07:11:34.758301 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application May 04 07:11:34.758301 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 04 07:11:34.758301 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application May 04 07:11:34.758301 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 07:11:34.758301 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 07:11:34.758301 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 07:11:34.758301 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 07:11:34.758301 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 07:11:34.760745 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 07:11:34.760745 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 07:11:34.760745 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 07:11:34.760745 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 07:11:34.760745 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 07:11:34.760745 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 07:11:34.760745 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 04 07:11:34.760745 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self._get_service(service_id) May 04 07:11:34.760745 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 04 07:11:34.760745 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 04 07:11:34.760745 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 07:11:34.760745 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 07:11:34.760745 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 07:11:34.760745 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 07:11:34.760745 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 07:11:34.760745 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.get_or_create( May 04 07:11:34.762749 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 07:11:34.762749 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application with Lock( May 04 07:11:34.762749 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 07:11:34.762749 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self._enter() May 04 07:11:34.762749 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 07:11:34.762749 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 07:11:34.762749 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 07:11:34.762749 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.creator() May 04 07:11:34.762749 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 07:11:34.762749 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application created_value = creator( May 04 07:11:34.762749 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 04 07:11:34.762749 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 07:11:34.762749 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 04 07:11:34.762749 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application May 04 07:11:34.762749 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 468/919] 10.222.0.21 () {56 vars in 1126 bytes} [Wed May 4 07:11:34 2022] GET /identity/v3/services/object-store => generated 93 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 07:11:34.767262 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d759d15d-ba95-4ad3-a289-8dff9039cac9 None admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:11:34.836382 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed7b53a-33b7-47ae-95c7-f60cde1a0404 None admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:11:34.874082 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3eda96-b598-46ae-8872-634b4c75b630 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:11:34.875495 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3eda96-b598-46ae-8872-634b4c75b630 None admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:11:34.875932 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3eda96-b598-46ae-8872-634b4c75b630 None admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:11:34.876540 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3eda96-b598-46ae-8872-634b4c75b630 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:11:34.893721 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d759d15d-ba95-4ad3-a289-8dff9039cac9 None admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:11:34.893933 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3eda96-b598-46ae-8872-634b4c75b630 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:11:34.895836 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3eda96-b598-46ae-8872-634b4c75b630 None admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:11:34.919891 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application [None req-7a3eda96-b598-46ae-8872-634b4c75b630 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 07:11:34.919891 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 07:11:34.919891 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 07:11:34.919891 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 07:11:34.919891 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 07:11:34.919891 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 07:11:34.919891 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 07:11:34.919891 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 07:11:34.919891 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 07:11:34.919891 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 07:11:34.919891 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 07:11:34.919891 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 07:11:34.919891 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 07:11:34.919891 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 07:11:34.919891 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 07:11:34.921054 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 07:11:34.921054 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 07:11:34.921054 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 07:11:34.921054 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 07:11:34.921054 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 07:11:34.921054 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 07:11:34.921054 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self.get_or_create( May 04 07:11:34.921054 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 07:11:34.921054 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application with Lock( May 04 07:11:34.921054 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 07:11:34.921054 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self._enter() May 04 07:11:34.921054 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 07:11:34.921054 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 07:11:34.921054 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 07:11:34.921054 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self.creator() May 04 07:11:34.921054 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 07:11:34.921054 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application created_value = creator( May 04 07:11:34.922151 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 07:11:34.922151 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 07:11:34.922151 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 07:11:34.922151 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application May 04 07:11:34.929433 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 452/920] 10.222.0.21 () {56 vars in 1108 bytes} [Wed May 4 07:11:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 07:11:34.930157 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3eda96-b598-46ae-8872-634b4c75b630 None admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:11:34.937814 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881aa9a7-4abd-4ced-9ee4-00c789dccea7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:11:34.938482 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881aa9a7-4abd-4ced-9ee4-00c789dccea7 None admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:11:34.938760 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881aa9a7-4abd-4ced-9ee4-00c789dccea7 None admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:11:34.939032 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881aa9a7-4abd-4ced-9ee4-00c789dccea7 None admin] PATH_INFO: `/v3/services` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:11:34.939955 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881aa9a7-4abd-4ced-9ee4-00c789dccea7 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=79744) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 07:11:34.940324 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881aa9a7-4abd-4ced-9ee4-00c789dccea7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:11:34.941751 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881aa9a7-4abd-4ced-9ee4-00c789dccea7 None admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:11:34.951343 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 469/921] 10.222.0.21 () {56 vars in 1122 bytes} [Wed May 4 07:11:34 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 07:11:34.953155 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881aa9a7-4abd-4ced-9ee4-00c789dccea7 None admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:11:35.058984 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881aa9a7-4abd-4ced-9ee4-00c789dccea7 None admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:11:35.062039 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3eda96-b598-46ae-8872-634b4c75b630 None admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:11:35.093521 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e354bcaa-67ec-4738-af04-da4b5bb481e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:11:35.094208 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e354bcaa-67ec-4738-af04-da4b5bb481e2 None admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:11:35.094487 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e354bcaa-67ec-4738-af04-da4b5bb481e2 None admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:11:35.094755 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e354bcaa-67ec-4738-af04-da4b5bb481e2 None admin] PATH_INFO: `/v3/services` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:11:35.095513 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e354bcaa-67ec-4738-af04-da4b5bb481e2 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=79744) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 07:11:35.095816 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e354bcaa-67ec-4738-af04-da4b5bb481e2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:11:35.097215 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e354bcaa-67ec-4738-af04-da4b5bb481e2 None admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:11:35.102628 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 470/922] 10.222.0.21 () {56 vars in 1122 bytes} [Wed May 4 07:11:34 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 07:11:35.104196 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68134ac1-fa5a-4c0c-b596-0a2eabcc1ab9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:11:35.104818 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7888b8-311c-43d5-a526-4977c8b2b967 None None] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:11:35.105110 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7888b8-311c-43d5-a526-4977c8b2b967 None None] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:11:35.105380 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7888b8-311c-43d5-a526-4977c8b2b967 None None] PATH_INFO: `/` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:11:35.105749 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68134ac1-fa5a-4c0c-b596-0a2eabcc1ab9 None admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:11:35.106180 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68134ac1-fa5a-4c0c-b596-0a2eabcc1ab9 None admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:11:35.106592 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68134ac1-fa5a-4c0c-b596-0a2eabcc1ab9 None admin] PATH_INFO: `/v3/domains` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:11:35.107540 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68134ac1-fa5a-4c0c-b596-0a2eabcc1ab9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 07:11:35.107987 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68134ac1-fa5a-4c0c-b596-0a2eabcc1ab9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:11:35.109564 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68134ac1-fa5a-4c0c-b596-0a2eabcc1ab9 None admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:11:35.111397 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 471/923] 10.222.0.21 () {54 vars in 926 bytes} [Wed May 4 07:11:35 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 07:11:35.112835 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7888b8-311c-43d5-a526-4977c8b2b967 None None] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:11:35.125656 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 453/924] 10.222.0.21 () {56 vars in 1109 bytes} [Wed May 4 07:11:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 07:11:35.127008 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3e4e85-0e7a-4e1e-ba7d-07e79d831d96 None None] REQUEST_METHOD: `POST` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:11:35.127342 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3e4e85-0e7a-4e1e-ba7d-07e79d831d96 None None] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:11:35.127612 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3e4e85-0e7a-4e1e-ba7d-07e79d831d96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:11:35.145929 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.auth.core [None req-5f3e4e85-0e7a-4e1e-ba7d-07e79d831d96 None None] MFA Rules not processed for user `83c5e0dcb991496ea6dee38384514508`. Rule list: `[]` (Enabled: `True`). {{(pid=79745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:11:35.147207 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.fernet_utils [None req-5f3e4e85-0e7a-4e1e-ba7d-07e79d831d96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:11:35.212749 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 454/925] 10.222.0.21 () {58 vars in 1023 bytes} [Wed May 4 07:11:35 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 07:11:35.214313 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3e4e85-0e7a-4e1e-ba7d-07e79d831d96 None None] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:11:35.224526 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7888b8-311c-43d5-a526-4977c8b2b967 None None] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:11:35.263001 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fcb1f9-2ac8-4069-bc28-7051ca7eea99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:11:35.263710 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fcb1f9-2ac8-4069-bc28-7051ca7eea99 None admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:11:35.263951 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fcb1f9-2ac8-4069-bc28-7051ca7eea99 None admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:11:35.264227 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fcb1f9-2ac8-4069-bc28-7051ca7eea99 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:11:35.265005 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75fcb1f9-2ac8-4069-bc28-7051ca7eea99 None admin] RBAC: Adding query filter params (interface=public, service_id=8cfd2351dadb4607a691fe828cba37ac, region_id=RegionOne) {{(pid=79744) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 07:11:35.265315 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75fcb1f9-2ac8-4069-bc28-7051ca7eea99 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:11:35.266668 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75fcb1f9-2ac8-4069-bc28-7051ca7eea99 None admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:11:35.277165 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 472/926] 10.222.0.21 () {56 vars in 1251 bytes} [Wed May 4 07:11:35 2022] GET /identity/v3/endpoints?service_id=8cfd2351dadb4607a691fe828cba37ac&interface=public®ion_id=RegionOne => generated 194 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 07:11:35.277165 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fcb1f9-2ac8-4069-bc28-7051ca7eea99 None admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:11:35.315649 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3e4e85-0e7a-4e1e-ba7d-07e79d831d96 None None] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:11:35.348341 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c69f71-4f0a-43aa-b975-c9ce2e808598 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:11:35.349143 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c69f71-4f0a-43aa-b975-c9ce2e808598 None admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:11:35.349418 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c69f71-4f0a-43aa-b975-c9ce2e808598 None admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:11:35.349685 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c69f71-4f0a-43aa-b975-c9ce2e808598 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:11:35.356550 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c69f71-4f0a-43aa-b975-c9ce2e808598 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:11:35.357984 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c69f71-4f0a-43aa-b975-c9ce2e808598 None admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:11:35.369346 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fcb1f9-2ac8-4069-bc28-7051ca7eea99 None admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:11:35.372895 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application [None req-c1c69f71-4f0a-43aa-b975-c9ce2e808598 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 04 07:11:35.372895 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 07:11:35.372895 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 07:11:35.372895 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 07:11:35.372895 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 07:11:35.372895 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 07:11:35.372895 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 07:11:35.372895 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 07:11:35.372895 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 07:11:35.372895 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 07:11:35.372895 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 07:11:35.372895 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 07:11:35.372895 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 04 07:11:35.372895 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self._get_user(user_id) May 04 07:11:35.372895 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 04 07:11:35.372895 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 04 07:11:35.374023 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 07:11:35.374023 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 07:11:35.374023 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 04 07:11:35.374023 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 07:11:35.374023 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 04 07:11:35.374023 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 07:11:35.374023 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 07:11:35.374023 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 07:11:35.374023 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 07:11:35.374023 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self.get_or_create( May 04 07:11:35.374023 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 07:11:35.374023 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application with Lock( May 04 07:11:35.374023 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 07:11:35.374023 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self._enter() May 04 07:11:35.374023 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 07:11:35.374023 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 07:11:35.374023 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 07:11:35.374023 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self.creator() May 04 07:11:35.374984 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 07:11:35.374984 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application created_value = creator( May 04 07:11:35.374984 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 04 07:11:35.374984 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 04 07:11:35.374984 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 04 07:11:35.374984 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 04 07:11:35.374984 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 04 07:11:35.374984 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 04 07:11:35.374984 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 04 07:11:35.374984 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application May 04 07:11:35.374984 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 455/927] 10.222.0.21 () {56 vars in 1117 bytes} [Wed May 4 07:11:35 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 07:11:35.374984 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c69f71-4f0a-43aa-b975-c9ce2e808598 None admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:11:35.402129 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6abba3-bdde-443a-b527-b35a3b468430 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:11:35.402910 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6abba3-bdde-443a-b527-b35a3b468430 None admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:11:35.403213 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6abba3-bdde-443a-b527-b35a3b468430 None admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:11:35.403485 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6abba3-bdde-443a-b527-b35a3b468430 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:11:35.404122 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6abba3-bdde-443a-b527-b35a3b468430 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:11:35.405468 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6abba3-bdde-443a-b527-b35a3b468430 None admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:11:35.416740 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application [None req-0a6abba3-bdde-443a-b527-b35a3b468430 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. May 04 07:11:35.416740 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 07:11:35.416740 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 04 07:11:35.416740 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 04 07:11:35.416740 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 04 07:11:35.416740 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 04 07:11:35.416740 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 04 07:11:35.416740 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 07:11:35.416740 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 04 07:11:35.416740 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application May 04 07:11:35.416740 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 04 07:11:35.416740 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application May 04 07:11:35.416740 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 07:11:35.416740 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 07:11:35.416740 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 07:11:35.416740 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 07:11:35.416740 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 07:11:35.417762 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 07:11:35.417762 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 07:11:35.417762 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 07:11:35.417762 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 07:11:35.417762 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 07:11:35.417762 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 07:11:35.417762 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 04 07:11:35.417762 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self._get_service(service_id) May 04 07:11:35.417762 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 04 07:11:35.417762 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 04 07:11:35.417762 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 07:11:35.417762 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 07:11:35.417762 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 07:11:35.417762 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 07:11:35.417762 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 07:11:35.417762 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.get_or_create( May 04 07:11:35.418629 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 07:11:35.418629 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application with Lock( May 04 07:11:35.418629 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 07:11:35.418629 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self._enter() May 04 07:11:35.418629 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 07:11:35.418629 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 07:11:35.418629 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 07:11:35.418629 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.creator() May 04 07:11:35.418629 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 07:11:35.418629 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application created_value = creator( May 04 07:11:35.418629 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 04 07:11:35.418629 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 07:11:35.418629 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 04 07:11:35.418629 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application May 04 07:11:35.418629 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 473/928] 10.222.0.21 () {56 vars in 1114 bytes} [Wed May 4 07:11:35 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 146 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 07:11:35.419977 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fdb47f-d5eb-4b9d-8afe-a557c09a5eed None None] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:11:35.419977 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fdb47f-d5eb-4b9d-8afe-a557c09a5eed None None] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:11:35.419977 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fdb47f-d5eb-4b9d-8afe-a557c09a5eed None None] PATH_INFO: `/` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:11:35.421035 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 474/929] 10.222.0.21 () {54 vars in 926 bytes} [Wed May 4 07:11:35 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 07:11:35.421558 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fdb47f-d5eb-4b9d-8afe-a557c09a5eed None None] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:11:35.474589 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c69f71-4f0a-43aa-b975-c9ce2e808598 None admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:11:35.506725 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0f5984-a3d9-4768-a53e-ae8e5bcf6bf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:11:35.507660 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0f5984-a3d9-4768-a53e-ae8e5bcf6bf2 None admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:11:35.507940 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0f5984-a3d9-4768-a53e-ae8e5bcf6bf2 None admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:11:35.508213 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0f5984-a3d9-4768-a53e-ae8e5bcf6bf2 None admin] PATH_INFO: `/v3/services` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:11:35.508889 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0f5984-a3d9-4768-a53e-ae8e5bcf6bf2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:11:35.510246 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0f5984-a3d9-4768-a53e-ae8e5bcf6bf2 None admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:11:35.516205 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 456/930] 10.222.0.21 () {56 vars in 1087 bytes} [Wed May 4 07:11:35 2022] GET /identity/v3/services => generated 1497 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 07:11:35.517485 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f4f80a-0977-4c71-8d90-28be300bcb28 None None] REQUEST_METHOD: `POST` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:11:35.517776 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f4f80a-0977-4c71-8d90-28be300bcb28 None None] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:11:35.518048 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f4f80a-0977-4c71-8d90-28be300bcb28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:11:35.524276 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fdb47f-d5eb-4b9d-8afe-a557c09a5eed None None] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:11:35.540028 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.auth.core [None req-95f4f80a-0977-4c71-8d90-28be300bcb28 None None] MFA Rules not processed for user `83c5e0dcb991496ea6dee38384514508`. Rule list: `[]` (Enabled: `True`). {{(pid=79745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:11:35.541244 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.fernet_utils [None req-95f4f80a-0977-4c71-8d90-28be300bcb28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:11:35.566399 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062d078b-6460-450b-a7de-bd4ddf1b8743 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:11:35.566990 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062d078b-6460-450b-a7de-bd4ddf1b8743 None admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:11:35.567294 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062d078b-6460-450b-a7de-bd4ddf1b8743 None admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:11:35.567555 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062d078b-6460-450b-a7de-bd4ddf1b8743 None admin] PATH_INFO: `/v3/users` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:11:35.568393 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062d078b-6460-450b-a7de-bd4ddf1b8743 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79744) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 07:11:35.568695 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062d078b-6460-450b-a7de-bd4ddf1b8743 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:11:35.570145 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062d078b-6460-450b-a7de-bd4ddf1b8743 None admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:11:35.590067 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 475/931] 10.222.0.21 () {56 vars in 1149 bytes} [Wed May 4 07:11:35 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 07:11:35.590941 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062d078b-6460-450b-a7de-bd4ddf1b8743 None admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:11:35.621356 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 457/932] 10.222.0.21 () {58 vars in 1023 bytes} [Wed May 4 07:11:35 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 07:11:35.622232 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f4f80a-0977-4c71-8d90-28be300bcb28 None None] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:11:35.724215 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062d078b-6460-450b-a7de-bd4ddf1b8743 None admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:11:35.736057 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f4f80a-0977-4c71-8d90-28be300bcb28 None None] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:11:35.759435 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab3edc4-bea0-4b94-a86e-58db78f99d75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:11:35.760962 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab3edc4-bea0-4b94-a86e-58db78f99d75 None admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:11:35.761474 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab3edc4-bea0-4b94-a86e-58db78f99d75 None admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:11:35.762015 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab3edc4-bea0-4b94-a86e-58db78f99d75 None admin] PATH_INFO: `/v3/services` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:11:35.762958 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab3edc4-bea0-4b94-a86e-58db78f99d75 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=79744) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 07:11:35.763392 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab3edc4-bea0-4b94-a86e-58db78f99d75 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:11:35.764756 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab3edc4-bea0-4b94-a86e-58db78f99d75 None admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:11:35.773706 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 476/933] 10.222.0.21 () {56 vars in 1114 bytes} [Wed May 4 07:11:35 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 07:11:35.773706 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab3edc4-bea0-4b94-a86e-58db78f99d75 None admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:11:35.776933 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7454b85b-07cc-4ba2-a132-9eee8dbae9f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:11:35.777798 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7454b85b-07cc-4ba2-a132-9eee8dbae9f4 None admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:11:35.778083 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7454b85b-07cc-4ba2-a132-9eee8dbae9f4 None admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:11:35.778356 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7454b85b-07cc-4ba2-a132-9eee8dbae9f4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:11:35.788309 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7454b85b-07cc-4ba2-a132-9eee8dbae9f4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:11:35.789755 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7454b85b-07cc-4ba2-a132-9eee8dbae9f4 None admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:11:35.810402 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application [None req-7454b85b-07cc-4ba2-a132-9eee8dbae9f4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 07:11:35.810402 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 07:11:35.810402 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 07:11:35.810402 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 07:11:35.810402 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 07:11:35.810402 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 07:11:35.810402 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 07:11:35.810402 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 07:11:35.810402 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 07:11:35.810402 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 07:11:35.810402 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 07:11:35.810402 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 07:11:35.810402 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 07:11:35.810402 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 07:11:35.810402 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 07:11:35.811353 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 07:11:35.811353 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 07:11:35.811353 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 07:11:35.811353 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 07:11:35.811353 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 07:11:35.811353 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 07:11:35.811353 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self.get_or_create( May 04 07:11:35.811353 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 07:11:35.811353 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application with Lock( May 04 07:11:35.811353 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 07:11:35.811353 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self._enter() May 04 07:11:35.811353 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 07:11:35.811353 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 07:11:35.811353 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 07:11:35.811353 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self.creator() May 04 07:11:35.811353 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 07:11:35.811353 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application created_value = creator( May 04 07:11:35.812276 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 07:11:35.812276 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 07:11:35.812276 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 07:11:35.812276 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application May 04 07:11:35.812276 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 458/934] 10.222.0.21 () {56 vars in 1108 bytes} [Wed May 4 07:11:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 07:11:35.812992 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7454b85b-07cc-4ba2-a132-9eee8dbae9f4 None admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:11:35.875747 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab3edc4-bea0-4b94-a86e-58db78f99d75 None admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:11:35.908690 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9d3347-fd8f-4514-ad92-00cc3829a381 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:11:35.909495 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9d3347-fd8f-4514-ad92-00cc3829a381 None admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:11:35.909772 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9d3347-fd8f-4514-ad92-00cc3829a381 None admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:11:35.910043 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9d3347-fd8f-4514-ad92-00cc3829a381 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:11:35.910686 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9d3347-fd8f-4514-ad92-00cc3829a381 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:11:35.912058 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9d3347-fd8f-4514-ad92-00cc3829a381 None admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:11:35.914384 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7454b85b-07cc-4ba2-a132-9eee8dbae9f4 None admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:11:35.924901 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application [None req-cb9d3347-fd8f-4514-ad92-00cc3829a381 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 04 07:11:35.924901 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 07:11:35.924901 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 04 07:11:35.924901 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 04 07:11:35.924901 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 04 07:11:35.924901 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 04 07:11:35.924901 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 04 07:11:35.924901 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 07:11:35.924901 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 04 07:11:35.924901 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application May 04 07:11:35.924901 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 04 07:11:35.924901 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application May 04 07:11:35.924901 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 07:11:35.924901 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 07:11:35.924901 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 07:11:35.924901 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 07:11:35.926038 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 07:11:35.926038 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 07:11:35.926038 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 07:11:35.926038 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 07:11:35.926038 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 07:11:35.926038 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 07:11:35.926038 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 07:11:35.926038 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 04 07:11:35.926038 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self._get_service(service_id) May 04 07:11:35.926038 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 04 07:11:35.926038 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 04 07:11:35.926038 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 07:11:35.926038 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 07:11:35.926038 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 07:11:35.926038 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 07:11:35.926038 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 07:11:35.926918 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.get_or_create( May 04 07:11:35.926918 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 07:11:35.926918 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application with Lock( May 04 07:11:35.926918 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 07:11:35.926918 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self._enter() May 04 07:11:35.926918 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 07:11:35.926918 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 07:11:35.926918 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 07:11:35.926918 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.creator() May 04 07:11:35.926918 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 07:11:35.926918 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application created_value = creator( May 04 07:11:35.926918 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 04 07:11:35.926918 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 07:11:35.926918 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 04 07:11:35.926918 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application May 04 07:11:35.926918 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 477/935] 10.222.0.21 () {56 vars in 1132 bytes} [Wed May 4 07:11:35 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 07:11:35.928392 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9d3347-fd8f-4514-ad92-00cc3829a381 None admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:11:35.958604 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b5c99b-56d8-4711-b4f5-0f86132084c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:11:35.959403 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b5c99b-56d8-4711-b4f5-0f86132084c4 None admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:11:35.959687 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b5c99b-56d8-4711-b4f5-0f86132084c4 None admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:11:35.959995 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b5c99b-56d8-4711-b4f5-0f86132084c4 None admin] PATH_INFO: `/v3/services` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:11:35.960697 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b5c99b-56d8-4711-b4f5-0f86132084c4 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=79745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 07:11:35.961004 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b5c99b-56d8-4711-b4f5-0f86132084c4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:11:35.962367 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b5c99b-56d8-4711-b4f5-0f86132084c4 None admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:11:35.972493 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 459/936] 10.222.0.21 () {56 vars in 1114 bytes} [Wed May 4 07:11:35 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 07:11:35.972493 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b5c99b-56d8-4711-b4f5-0f86132084c4 None admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:11:36.030950 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9d3347-fd8f-4514-ad92-00cc3829a381 None admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:11:36.062858 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322ff751-17d5-4a57-9103-7f1a392e19e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:11:36.063549 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322ff751-17d5-4a57-9103-7f1a392e19e4 None admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:11:36.063827 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322ff751-17d5-4a57-9103-7f1a392e19e4 None admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:11:36.064101 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322ff751-17d5-4a57-9103-7f1a392e19e4 None admin] PATH_INFO: `/v3/domains` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:11:36.064813 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322ff751-17d5-4a57-9103-7f1a392e19e4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79744) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 07:11:36.065120 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322ff751-17d5-4a57-9103-7f1a392e19e4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:11:36.066469 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322ff751-17d5-4a57-9103-7f1a392e19e4 None admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:11:36.076186 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b5c99b-56d8-4711-b4f5-0f86132084c4 None admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:11:36.078480 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 478/937] 10.222.0.21 () {56 vars in 1109 bytes} [Wed May 4 07:11:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 07:11:36.079265 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322ff751-17d5-4a57-9103-7f1a392e19e4 None admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:11:36.116643 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090046fe-4081-4782-ba53-075478398617 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:11:36.117302 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090046fe-4081-4782-ba53-075478398617 None admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:11:36.117585 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090046fe-4081-4782-ba53-075478398617 None admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:11:36.118034 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090046fe-4081-4782-ba53-075478398617 None admin] PATH_INFO: `/v3/services` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:11:36.118744 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090046fe-4081-4782-ba53-075478398617 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=79745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 07:11:36.119051 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090046fe-4081-4782-ba53-075478398617 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:11:36.121541 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090046fe-4081-4782-ba53-075478398617 None admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:11:36.130788 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 460/938] 10.222.0.21 () {56 vars in 1126 bytes} [Wed May 4 07:11:35 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 07:11:36.130788 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090046fe-4081-4782-ba53-075478398617 None admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:11:36.179041 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322ff751-17d5-4a57-9103-7f1a392e19e4 None admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:11:36.212174 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12b8177-f97b-41f1-bc60-10d690c304fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:11:36.212833 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12b8177-f97b-41f1-bc60-10d690c304fd None admin] REQUEST_METHOD: `POST` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:11:36.213110 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12b8177-f97b-41f1-bc60-10d690c304fd None admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:11:36.213382 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12b8177-f97b-41f1-bc60-10d690c304fd None admin] PATH_INFO: `/v3/endpoints` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:11:36.214697 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12b8177-f97b-41f1-bc60-10d690c304fd None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:11:36.216089 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12b8177-f97b-41f1-bc60-10d690c304fd None admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:11:36.243179 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 479/939] 10.222.0.21 () {60 vars in 1144 bytes} [Wed May 4 07:11:36 2022] POST /identity/v3/endpoints => generated 346 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 07:11:36.243398 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090046fe-4081-4782-ba53-075478398617 None admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:11:36.243523 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12b8177-f97b-41f1-bc60-10d690c304fd None admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:11:36.290743 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35d7c1c-2be1-4c04-953d-161bd57dbc26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:11:36.292541 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35d7c1c-2be1-4c04-953d-161bd57dbc26 None admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:11:36.292870 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35d7c1c-2be1-4c04-953d-161bd57dbc26 None admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:11:36.293147 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35d7c1c-2be1-4c04-953d-161bd57dbc26 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:11:36.303251 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35d7c1c-2be1-4c04-953d-161bd57dbc26 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:11:36.305379 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35d7c1c-2be1-4c04-953d-161bd57dbc26 None admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:11:36.324676 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application [None req-d35d7c1c-2be1-4c04-953d-161bd57dbc26 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 04 07:11:36.324676 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 07:11:36.324676 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 07:11:36.324676 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 07:11:36.324676 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 07:11:36.324676 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 07:11:36.324676 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 07:11:36.324676 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 07:11:36.324676 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 07:11:36.324676 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 07:11:36.324676 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 07:11:36.324676 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 07:11:36.324676 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 04 07:11:36.324676 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self._get_project(project_id) May 04 07:11:36.324676 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 04 07:11:36.326068 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 04 07:11:36.326068 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 07:11:36.326068 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 07:11:36.326068 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 07:11:36.326068 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 07:11:36.326068 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 07:11:36.326068 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self.get_or_create( May 04 07:11:36.326068 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 07:11:36.326068 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application with Lock( May 04 07:11:36.326068 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 07:11:36.326068 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self._enter() May 04 07:11:36.326068 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 07:11:36.326068 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 07:11:36.326068 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 07:11:36.326068 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self.creator() May 04 07:11:36.326068 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 07:11:36.326068 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application created_value = creator( May 04 07:11:36.326989 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 04 07:11:36.326989 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 04 07:11:36.326989 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 04 07:11:36.326989 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 04 07:11:36.326989 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 04 07:11:36.326989 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 04 07:11:36.326989 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 04 07:11:36.326989 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application May 04 07:11:36.326989 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 461/940] 10.222.0.21 () {56 vars in 1111 bytes} [Wed May 4 07:11:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 07:11:36.331782 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35d7c1c-2be1-4c04-953d-161bd57dbc26 None admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:11:36.356000 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12b8177-f97b-41f1-bc60-10d690c304fd None admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:11:36.392222 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bf28dc-1108-44ab-b355-7ef5d2086012 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:11:36.392864 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bf28dc-1108-44ab-b355-7ef5d2086012 None admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:11:36.393150 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bf28dc-1108-44ab-b355-7ef5d2086012 None admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:11:36.393455 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bf28dc-1108-44ab-b355-7ef5d2086012 None admin] PATH_INFO: `/v3/services` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:11:36.394124 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82bf28dc-1108-44ab-b355-7ef5d2086012 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=79744) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 07:11:36.394428 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82bf28dc-1108-44ab-b355-7ef5d2086012 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:11:36.395900 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82bf28dc-1108-44ab-b355-7ef5d2086012 None admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:11:36.402075 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 480/941] 10.222.0.21 () {56 vars in 1126 bytes} [Wed May 4 07:11:36 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 07:11:36.407805 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bf28dc-1108-44ab-b355-7ef5d2086012 None admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:11:36.451258 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35d7c1c-2be1-4c04-953d-161bd57dbc26 None admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:11:36.484842 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb793aa-3b2f-4872-a9e7-54bc43be76d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:11:36.485887 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb793aa-3b2f-4872-a9e7-54bc43be76d5 None admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:11:36.486482 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb793aa-3b2f-4872-a9e7-54bc43be76d5 None admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:11:36.486955 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb793aa-3b2f-4872-a9e7-54bc43be76d5 None admin] PATH_INFO: `/v3/projects` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:11:36.488014 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb793aa-3b2f-4872-a9e7-54bc43be76d5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 07:11:36.488323 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb793aa-3b2f-4872-a9e7-54bc43be76d5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:11:36.490834 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb793aa-3b2f-4872-a9e7-54bc43be76d5 None admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:11:36.502829 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 462/942] 10.222.0.21 () {56 vars in 1148 bytes} [Wed May 4 07:11:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 07:11:36.509213 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb793aa-3b2f-4872-a9e7-54bc43be76d5 None admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:11:36.527836 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bf28dc-1108-44ab-b355-7ef5d2086012 None admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:11:36.569398 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a912cc48-b863-4d34-b149-04c7b09915ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:11:36.570335 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a912cc48-b863-4d34-b149-04c7b09915ce None admin] REQUEST_METHOD: `POST` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:11:36.570615 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a912cc48-b863-4d34-b149-04c7b09915ce None admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:11:36.571046 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a912cc48-b863-4d34-b149-04c7b09915ce None admin] PATH_INFO: `/v3/endpoints` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:11:36.572136 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a912cc48-b863-4d34-b149-04c7b09915ce None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:11:36.574352 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a912cc48-b863-4d34-b149-04c7b09915ce None admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:11:36.599766 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 481/943] 10.222.0.21 () {60 vars in 1144 bytes} [Wed May 4 07:11:36 2022] POST /identity/v3/endpoints => generated 347 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 07:11:36.617020 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb793aa-3b2f-4872-a9e7-54bc43be76d5 None admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:11:36.665705 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c14f9b1-2a52-496b-9b2d-a478b28ed8fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:11:36.666533 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c14f9b1-2a52-496b-9b2d-a478b28ed8fa None admin] REQUEST_METHOD: `PUT` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:11:36.667510 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c14f9b1-2a52-496b-9b2d-a478b28ed8fa None admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:11:36.667849 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c14f9b1-2a52-496b-9b2d-a478b28ed8fa None admin] PATH_INFO: `/v3/projects/c9f9c44db4984653b8d4b5f6b3b949f5/users/704cdbc22849413baa4e0189947ebebc/roles/ad15e59c437846a4897f5821fc039560` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:11:36.670291 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c14f9b1-2a52-496b-9b2d-a478b28ed8fa None admin] RBAC: Authorizing `identity:create_grant(project_id=c9f9c44db4984653b8d4b5f6b3b949f5, user_id=704cdbc22849413baa4e0189947ebebc, role_id=ad15e59c437846a4897f5821fc039560)` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:11:36.671874 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c14f9b1-2a52-496b-9b2d-a478b28ed8fa None admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:11:36.691904 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 463/944] 10.222.0.21 () {58 vars in 1439 bytes} [Wed May 4 07:11:36 2022] PUT /identity/v3/projects/c9f9c44db4984653b8d4b5f6b3b949f5/users/704cdbc22849413baa4e0189947ebebc/roles/ad15e59c437846a4897f5821fc039560 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 07:11:37.788939 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d760202-c2ac-4866-abf2-5aaf8af0ce43 None None] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:11:37.789485 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d760202-c2ac-4866-abf2-5aaf8af0ce43 None None] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:11:37.789485 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d760202-c2ac-4866-abf2-5aaf8af0ce43 None None] PATH_INFO: `/` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:11:37.791084 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 482/945] 10.222.0.21 () {54 vars in 926 bytes} [Wed May 4 07:11:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 04 07:11:37.797136 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26b8a03-8cc6-4c88-bf88-fc39a850f4aa None None] REQUEST_METHOD: `POST` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:11:37.797588 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26b8a03-8cc6-4c88-bf88-fc39a850f4aa None None] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:11:37.797677 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26b8a03-8cc6-4c88-bf88-fc39a850f4aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:11:37.814835 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.auth.core [None req-d26b8a03-8cc6-4c88-bf88-fc39a850f4aa None None] MFA Rules not processed for user `83c5e0dcb991496ea6dee38384514508`. Rule list: `[]` (Enabled: `True`). {{(pid=79745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:11:37.816029 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.fernet_utils [None req-d26b8a03-8cc6-4c88-bf88-fc39a850f4aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:11:37.891261 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 464/946] 10.222.0.21 () {58 vars in 1023 bytes} [Wed May 4 07:11:37 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 07:11:37.907507 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d760202-c2ac-4866-abf2-5aaf8af0ce43 None None] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:11:38.013592 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d760202-c2ac-4866-abf2-5aaf8af0ce43 None None] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:11:38.051140 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e6642c-4cf5-4930-a5f8-8b7c1e51c8fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:11:38.052333 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e6642c-4cf5-4930-a5f8-8b7c1e51c8fc None admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:11:38.052817 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e6642c-4cf5-4930-a5f8-8b7c1e51c8fc None admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:11:38.053336 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e6642c-4cf5-4930-a5f8-8b7c1e51c8fc None admin] PATH_INFO: `/v3/services/object-store` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:11:38.054183 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e6642c-4cf5-4930-a5f8-8b7c1e51c8fc None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:11:38.055791 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e6642c-4cf5-4930-a5f8-8b7c1e51c8fc None admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:11:38.067982 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application [None req-d5e6642c-4cf5-4930-a5f8-8b7c1e51c8fc None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 04 07:11:38.067982 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 07:11:38.067982 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 04 07:11:38.067982 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 04 07:11:38.067982 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 04 07:11:38.067982 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 04 07:11:38.067982 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 04 07:11:38.067982 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 07:11:38.067982 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 04 07:11:38.067982 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application May 04 07:11:38.067982 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 04 07:11:38.067982 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application May 04 07:11:38.067982 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 07:11:38.067982 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 07:11:38.067982 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 07:11:38.067982 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 07:11:38.067982 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 07:11:38.068994 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 07:11:38.068994 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 07:11:38.068994 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 07:11:38.068994 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 07:11:38.068994 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 07:11:38.068994 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 07:11:38.068994 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 04 07:11:38.068994 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self._get_service(service_id) May 04 07:11:38.068994 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 04 07:11:38.068994 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 04 07:11:38.068994 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 07:11:38.068994 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 07:11:38.068994 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 07:11:38.068994 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 07:11:38.068994 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 07:11:38.068994 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.get_or_create( May 04 07:11:38.069960 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 07:11:38.069960 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application with Lock( May 04 07:11:38.069960 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 07:11:38.069960 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self._enter() May 04 07:11:38.069960 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 07:11:38.069960 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 07:11:38.069960 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 07:11:38.069960 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.creator() May 04 07:11:38.069960 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 07:11:38.069960 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application created_value = creator( May 04 07:11:38.069960 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 04 07:11:38.069960 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 07:11:38.069960 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 04 07:11:38.069960 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application May 04 07:11:38.072801 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 483/947] 10.222.0.21 () {56 vars in 1126 bytes} [Wed May 4 07:11:37 2022] GET /identity/v3/services/object-store => generated 93 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 07:11:38.083178 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26b8a03-8cc6-4c88-bf88-fc39a850f4aa None None] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:11:38.176893 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26b8a03-8cc6-4c88-bf88-fc39a850f4aa None None] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:11:38.210519 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2eff13c-9a4e-4219-b478-8f7266d3d904 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:11:38.211202 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2eff13c-9a4e-4219-b478-8f7266d3d904 None admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:11:38.211480 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2eff13c-9a4e-4219-b478-8f7266d3d904 None admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:11:38.211750 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2eff13c-9a4e-4219-b478-8f7266d3d904 None admin] PATH_INFO: `/v3/services` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:11:38.212457 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2eff13c-9a4e-4219-b478-8f7266d3d904 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=79745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 07:11:38.212757 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2eff13c-9a4e-4219-b478-8f7266d3d904 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:11:38.214386 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2eff13c-9a4e-4219-b478-8f7266d3d904 None admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:11:38.223258 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 465/948] 10.222.0.21 () {56 vars in 1122 bytes} [Wed May 4 07:11:38 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 07:11:38.225304 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e6642c-4cf5-4930-a5f8-8b7c1e51c8fc None admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:11:38.329642 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e6642c-4cf5-4930-a5f8-8b7c1e51c8fc None admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:11:38.368919 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575a0f36-bb50-4446-b9e2-384c6745c248 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:11:38.369589 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575a0f36-bb50-4446-b9e2-384c6745c248 None admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:11:38.370643 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575a0f36-bb50-4446-b9e2-384c6745c248 None admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:11:38.371250 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575a0f36-bb50-4446-b9e2-384c6745c248 None admin] PATH_INFO: `/v3/services` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:11:38.371533 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575a0f36-bb50-4446-b9e2-384c6745c248 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=79744) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 07:11:38.371838 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575a0f36-bb50-4446-b9e2-384c6745c248 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:11:38.373197 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575a0f36-bb50-4446-b9e2-384c6745c248 None admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:11:38.378598 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 484/949] 10.222.0.21 () {56 vars in 1122 bytes} [Wed May 4 07:11:38 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 07:11:38.384315 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2eff13c-9a4e-4219-b478-8f7266d3d904 None admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:11:38.484074 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2eff13c-9a4e-4219-b478-8f7266d3d904 None admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:11:38.522336 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74399ca-1669-466c-b9c2-deeee5817486 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:11:38.523003 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74399ca-1669-466c-b9c2-deeee5817486 None admin] REQUEST_METHOD: `POST` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:11:38.523307 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74399ca-1669-466c-b9c2-deeee5817486 None admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:11:38.523579 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74399ca-1669-466c-b9c2-deeee5817486 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:11:38.524333 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74399ca-1669-466c-b9c2-deeee5817486 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:11:38.525712 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74399ca-1669-466c-b9c2-deeee5817486 None admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:11:38.555327 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 466/950] 10.222.0.21 () {60 vars in 1144 bytes} [Wed May 4 07:11:38 2022] POST /identity/v3/endpoints => generated 349 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 07:11:38.701884 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2769fc61-9a61-4ce9-813a-d502c47df9d1 None None] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:11:38.701884 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2769fc61-9a61-4ce9-813a-d502c47df9d1 None None] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:11:38.701884 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2769fc61-9a61-4ce9-813a-d502c47df9d1 None None] PATH_INFO: `/` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:11:38.701884 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 485/951] 10.222.0.21 () {54 vars in 926 bytes} [Wed May 4 07:11:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 07:11:38.708492 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e38035c-d380-4483-bc61-0eb9ebeb31b4 None None] REQUEST_METHOD: `POST` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:11:38.708792 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e38035c-d380-4483-bc61-0eb9ebeb31b4 None None] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:11:38.709043 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e38035c-d380-4483-bc61-0eb9ebeb31b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:11:38.732310 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.auth.core [None req-6e38035c-d380-4483-bc61-0eb9ebeb31b4 None None] MFA Rules not processed for user `83c5e0dcb991496ea6dee38384514508`. Rule list: `[]` (Enabled: `True`). {{(pid=79745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:11:38.733589 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.fernet_utils [None req-6e38035c-d380-4483-bc61-0eb9ebeb31b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:11:38.809926 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 467/952] 10.222.0.21 () {58 vars in 1023 bytes} [Wed May 4 07:11:38 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 07:11:38.835127 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2769fc61-9a61-4ce9-813a-d502c47df9d1 None None] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:11:38.923173 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4199f8bd-acd5-476c-b0b4-41d8b2958cca None None] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:11:38.923173 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4199f8bd-acd5-476c-b0b4-41d8b2958cca None None] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:11:38.923173 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4199f8bd-acd5-476c-b0b4-41d8b2958cca None None] PATH_INFO: `/` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:11:38.923173 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 468/953] 10.222.0.21 () {54 vars in 926 bytes} [Wed May 4 07:11:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 07:11:38.924092 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715a5d7a-8088-4fc4-b3b8-6113d4d8b2bc None None] REQUEST_METHOD: `POST` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:11:38.924372 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715a5d7a-8088-4fc4-b3b8-6113d4d8b2bc None None] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:11:38.924651 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715a5d7a-8088-4fc4-b3b8-6113d4d8b2bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:11:38.941360 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.auth.core [None req-715a5d7a-8088-4fc4-b3b8-6113d4d8b2bc None None] MFA Rules not processed for user `83c5e0dcb991496ea6dee38384514508`. Rule list: `[]` (Enabled: `True`). {{(pid=79745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:11:38.942521 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.fernet_utils [None req-715a5d7a-8088-4fc4-b3b8-6113d4d8b2bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:11:38.949896 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2769fc61-9a61-4ce9-813a-d502c47df9d1 None None] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:11:38.983965 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361e3224-fa37-49a3-b416-2682e87e1b90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:11:38.984541 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361e3224-fa37-49a3-b416-2682e87e1b90 None admin] REQUEST_METHOD: `POST` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:11:38.984813 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361e3224-fa37-49a3-b416-2682e87e1b90 None admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:11:38.985079 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361e3224-fa37-49a3-b416-2682e87e1b90 None admin] PATH_INFO: `/v3/projects` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:11:38.985768 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361e3224-fa37-49a3-b416-2682e87e1b90 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:11:38.987193 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361e3224-fa37-49a3-b416-2682e87e1b90 None admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:11:38.988546 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: WARNING keystone.server.flask.common [None req-361e3224-fa37-49a3-b416-2682e87e1b90 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. May 04 07:11:39.008019 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.sql.core [None req-361e3224-fa37-49a3-b416-2682e87e1b90 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") May 04 07:11:39.008019 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] May 04 07:11:39.008019 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [parameters: {'id': '5cda130056234e3a96a04126f97473fa', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] May 04 07:11:39.008019 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=79744) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} May 04 07:11:39.019302 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 469/954] 10.222.0.21 () {58 vars in 1023 bytes} [Wed May 4 07:11:38 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 04 07:11:39.025362 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application [None req-361e3224-fa37-49a3-b416-2682e87e1b90 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 5cda130056234e3a96a04126f97473fa.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 5cda130056234e3a96a04126f97473fa. May 04 07:11:39.025362 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 07:11:39.025362 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 04 07:11:39.025362 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application self.dialect.do_execute( May 04 07:11:39.025362 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 04 07:11:39.025362 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 04 07:11:39.025362 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 04 07:11:39.025362 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application result = self._query(query) May 04 07:11:39.025362 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 04 07:11:39.025362 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application conn.query(q) May 04 07:11:39.025362 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 04 07:11:39.025362 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 04 07:11:39.025362 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 04 07:11:39.028669 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application result.read() May 04 07:11:39.028669 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 04 07:11:39.028669 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 04 07:11:39.028669 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 04 07:11:39.028669 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application packet.raise_for_error() May 04 07:11:39.028669 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 04 07:11:39.028669 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 04 07:11:39.028669 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 04 07:11:39.028669 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 04 07:11:39.028669 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") May 04 07:11:39.028669 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application May 04 07:11:39.028669 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: May 04 07:11:39.028669 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application May 04 07:11:39.028669 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 07:11:39.028669 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper May 04 07:11:39.028669 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return method(*args, **kwargs) May 04 07:11:39.028669 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project May 04 07:11:39.028669 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return project_ref.to_dict() May 04 07:11:39.030005 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 04 07:11:39.030005 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application next(self.gen) May 04 07:11:39.030005 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope May 04 07:11:39.030005 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application yield resource May 04 07:11:39.030005 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 04 07:11:39.030005 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application next(self.gen) May 04 07:11:39.030005 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session May 04 07:11:39.030005 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application self.session.rollback() May 04 07:11:39.030005 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 04 07:11:39.030005 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application self.force_reraise() May 04 07:11:39.030005 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 04 07:11:39.030005 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application raise self.value May 04 07:11:39.030005 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session May 04 07:11:39.030005 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) May 04 07:11:39.030005 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction May 04 07:11:39.030005 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application session.commit() May 04 07:11:39.030005 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit May 04 07:11:39.031451 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) May 04 07:11:39.031451 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit May 04 07:11:39.031451 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application self._prepare_impl() May 04 07:11:39.031451 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl May 04 07:11:39.031451 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application self.session.flush() May 04 07:11:39.031451 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 04 07:11:39.031451 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application self._flush(objects) May 04 07:11:39.031451 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 04 07:11:39.031451 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) May 04 07:11:39.031451 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 04 07:11:39.031451 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application compat.raise_( May 04 07:11:39.031451 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 04 07:11:39.031451 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application raise exception May 04 07:11:39.031451 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 04 07:11:39.031451 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application flush_context.execute() May 04 07:11:39.031451 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 04 07:11:39.031451 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application rec.execute(self) May 04 07:11:39.038383 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 04 07:11:39.038383 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( May 04 07:11:39.038383 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 04 07:11:39.038383 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application _emit_insert_statements( May 04 07:11:39.038383 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements May 04 07:11:39.038383 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application c = connection._execute_20( May 04 07:11:39.038383 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 04 07:11:39.038383 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) May 04 07:11:39.038383 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 04 07:11:39.038383 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return connection._execute_clauseelement( May 04 07:11:39.038383 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 04 07:11:39.038383 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application ret = self._execute_context( May 04 07:11:39.038383 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 04 07:11:39.038383 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application self._handle_dbapi_exception( May 04 07:11:39.038383 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 04 07:11:39.039238 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 04 07:11:39.039238 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 04 07:11:39.039238 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application raise exception May 04 07:11:39.039238 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 04 07:11:39.039238 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application self.dialect.do_execute( May 04 07:11:39.039238 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 04 07:11:39.039238 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 04 07:11:39.039238 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 04 07:11:39.039238 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application result = self._query(query) May 04 07:11:39.039238 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 04 07:11:39.039238 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application conn.query(q) May 04 07:11:39.039238 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 04 07:11:39.039238 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 04 07:11:39.039238 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 04 07:11:39.039238 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application result.read() May 04 07:11:39.039238 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 04 07:11:39.039238 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 04 07:11:39.040430 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 04 07:11:39.040430 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application packet.raise_for_error() May 04 07:11:39.040430 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 04 07:11:39.040430 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 04 07:11:39.040430 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 04 07:11:39.040430 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 04 07:11:39.040430 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") May 04 07:11:39.040430 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] May 04 07:11:39.040430 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application [parameters: {'id': '5cda130056234e3a96a04126f97473fa', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] May 04 07:11:39.040430 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) May 04 07:11:39.040430 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application May 04 07:11:39.040430 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 04 07:11:39.040430 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application May 04 07:11:39.040430 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 07:11:39.040430 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project May 04 07:11:39.041252 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) May 04 07:11:39.041252 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper May 04 07:11:39.041252 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, May 04 07:11:39.041252 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. May 04 07:11:39.041252 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application May 04 07:11:39.041252 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 04 07:11:39.041252 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application May 04 07:11:39.041252 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 07:11:39.041252 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 07:11:39.041252 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 07:11:39.041252 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 07:11:39.041252 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 07:11:39.041252 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 07:11:39.041252 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 07:11:39.041252 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 07:11:39.041252 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 07:11:39.041252 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 07:11:39.044571 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 07:11:39.044571 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post May 04 07:11:39.044571 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( May 04 07:11:39.044571 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 07:11:39.044571 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 07:11:39.044571 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project May 04 07:11:39.044571 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application raise exception.Conflict( May 04 07:11:39.044571 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 5cda130056234e3a96a04126f97473fa. May 04 07:11:39.044571 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application May 04 07:11:39.044571 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 486/955] 10.222.0.21 () {60 vars in 1140 bytes} [Wed May 4 07:11:38 2022] POST /identity/v3/projects => generated 262 bytes in 193 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) May 04 07:11:39.045147 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715a5d7a-8088-4fc4-b3b8-6113d4d8b2bc None None] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:11:39.045233 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361e3224-fa37-49a3-b416-2682e87e1b90 None admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:11:39.138098 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361e3224-fa37-49a3-b416-2682e87e1b90 None admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:11:39.161543 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715a5d7a-8088-4fc4-b3b8-6113d4d8b2bc None None] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:11:39.175646 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba78a76-0229-42b4-8882-064946b364bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:11:39.176435 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba78a76-0229-42b4-8882-064946b364bb None admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:11:39.176711 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba78a76-0229-42b4-8882-064946b364bb None admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:11:39.176981 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba78a76-0229-42b4-8882-064946b364bb None admin] PATH_INFO: `/v3/projects/service` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:11:39.183678 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba78a76-0229-42b4-8882-064946b364bb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:11:39.185288 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba78a76-0229-42b4-8882-064946b364bb None admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:11:39.195761 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03795d2-b7a3-4da9-8b03-a2085c13d4e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:11:39.196652 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03795d2-b7a3-4da9-8b03-a2085c13d4e8 None admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:11:39.197030 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03795d2-b7a3-4da9-8b03-a2085c13d4e8 None admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:11:39.197413 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03795d2-b7a3-4da9-8b03-a2085c13d4e8 None admin] PATH_INFO: `/v3/services/compute` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:11:39.198230 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03795d2-b7a3-4da9-8b03-a2085c13d4e8 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:11:39.199323 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application [None req-6ba78a76-0229-42b4-8882-064946b364bb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 04 07:11:39.199323 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 07:11:39.199323 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 07:11:39.199323 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 07:11:39.199323 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 07:11:39.199323 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 07:11:39.199323 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 07:11:39.199323 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 07:11:39.199323 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 07:11:39.199323 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 07:11:39.199323 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 07:11:39.199323 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 07:11:39.199323 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 04 07:11:39.199323 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self._get_project(project_id) May 04 07:11:39.199323 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 04 07:11:39.200309 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 04 07:11:39.200309 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 07:11:39.200309 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 07:11:39.200309 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 07:11:39.200309 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 07:11:39.200309 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 07:11:39.200309 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.get_or_create( May 04 07:11:39.200309 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 07:11:39.200309 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application with Lock( May 04 07:11:39.200309 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 07:11:39.200309 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self._enter() May 04 07:11:39.200309 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 07:11:39.200309 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 07:11:39.200309 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 07:11:39.200309 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.creator() May 04 07:11:39.200309 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 07:11:39.200309 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application created_value = creator( May 04 07:11:39.201333 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 04 07:11:39.201333 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 04 07:11:39.201333 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 04 07:11:39.201333 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 04 07:11:39.201333 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 04 07:11:39.201333 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 04 07:11:39.201333 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 04 07:11:39.201333 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application May 04 07:11:39.201333 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 487/956] 10.222.0.21 () {56 vars in 1111 bytes} [Wed May 4 07:11:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 07:11:39.202100 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab89af11-6dc5-4e0e-9f64-c84cd2dc3b10 None None] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:11:39.202381 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab89af11-6dc5-4e0e-9f64-c84cd2dc3b10 None None] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:11:39.202654 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab89af11-6dc5-4e0e-9f64-c84cd2dc3b10 None None] PATH_INFO: `/` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:11:39.205485 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03795d2-b7a3-4da9-8b03-a2085c13d4e8 None admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:11:39.206864 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 488/957] 10.222.0.21 () {54 vars in 926 bytes} [Wed May 4 07:11:39 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 07:11:39.211250 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab89af11-6dc5-4e0e-9f64-c84cd2dc3b10 None None] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:11:39.217875 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application [None req-d03795d2-b7a3-4da9-8b03-a2085c13d4e8 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. May 04 07:11:39.217875 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 07:11:39.217875 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 04 07:11:39.217875 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 04 07:11:39.217875 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 04 07:11:39.217875 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 04 07:11:39.217875 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 04 07:11:39.217875 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 07:11:39.217875 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 04 07:11:39.217875 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application May 04 07:11:39.217875 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 04 07:11:39.217875 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application May 04 07:11:39.217875 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 07:11:39.217875 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 07:11:39.217875 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 07:11:39.217875 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 07:11:39.217875 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 07:11:39.225353 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 07:11:39.225353 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 07:11:39.225353 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 07:11:39.225353 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 07:11:39.225353 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 07:11:39.225353 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 07:11:39.225353 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 04 07:11:39.225353 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self._get_service(service_id) May 04 07:11:39.225353 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 04 07:11:39.225353 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 04 07:11:39.225353 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 07:11:39.225353 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 07:11:39.225353 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 07:11:39.225353 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 07:11:39.225353 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 07:11:39.225353 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self.get_or_create( May 04 07:11:39.227422 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 07:11:39.227422 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application with Lock( May 04 07:11:39.227422 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 07:11:39.227422 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self._enter() May 04 07:11:39.227422 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 07:11:39.227422 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 07:11:39.227422 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 07:11:39.227422 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self.creator() May 04 07:11:39.227422 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 07:11:39.227422 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application created_value = creator( May 04 07:11:39.227422 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 04 07:11:39.227422 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 07:11:39.227422 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 04 07:11:39.227422 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application May 04 07:11:39.227422 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 470/958] 10.222.0.21 () {56 vars in 1111 bytes} [Wed May 4 07:11:39 2022] GET /identity/v3/services/compute => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 07:11:39.231201 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9e4b1c-fce6-46e8-8a3d-6a065bf1ca6e None None] REQUEST_METHOD: `POST` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:11:39.231201 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9e4b1c-fce6-46e8-8a3d-6a065bf1ca6e None None] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:11:39.231201 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9e4b1c-fce6-46e8-8a3d-6a065bf1ca6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:11:39.240244 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.auth.core [None req-bf9e4b1c-fce6-46e8-8a3d-6a065bf1ca6e None None] MFA Rules not processed for user `83c5e0dcb991496ea6dee38384514508`. Rule list: `[]` (Enabled: `True`). {{(pid=79745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:11:39.241302 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.fernet_utils [None req-bf9e4b1c-fce6-46e8-8a3d-6a065bf1ca6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:11:39.306938 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 471/959] 10.222.0.21 () {58 vars in 1023 bytes} [Wed May 4 07:11:39 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 07:11:39.308474 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9e4b1c-fce6-46e8-8a3d-6a065bf1ca6e None None] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:11:39.324116 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab89af11-6dc5-4e0e-9f64-c84cd2dc3b10 None None] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:11:39.363923 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af1ca3e-12d0-4ab1-af56-7bff934517b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:11:39.364614 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af1ca3e-12d0-4ab1-af56-7bff934517b8 None admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:11:39.364905 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af1ca3e-12d0-4ab1-af56-7bff934517b8 None admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:11:39.365167 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af1ca3e-12d0-4ab1-af56-7bff934517b8 None admin] PATH_INFO: `/v3/projects` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:11:39.365909 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af1ca3e-12d0-4ab1-af56-7bff934517b8 None admin] RBAC: Adding query filter params (name=service) {{(pid=79744) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 07:11:39.366210 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af1ca3e-12d0-4ab1-af56-7bff934517b8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:11:39.367668 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af1ca3e-12d0-4ab1-af56-7bff934517b8 None admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:11:39.385306 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 489/960] 10.222.0.21 () {56 vars in 1112 bytes} [Wed May 4 07:11:39 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 07:11:39.386476 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af1ca3e-12d0-4ab1-af56-7bff934517b8 None admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:11:39.415194 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9e4b1c-fce6-46e8-8a3d-6a065bf1ca6e None None] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:11:39.463138 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44dd7f4d-ad49-4b85-8069-f45a1c1c8ace None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:11:39.464447 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44dd7f4d-ad49-4b85-8069-f45a1c1c8ace None admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:11:39.464834 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44dd7f4d-ad49-4b85-8069-f45a1c1c8ace None admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:11:39.465098 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44dd7f4d-ad49-4b85-8069-f45a1c1c8ace None admin] PATH_INFO: `/v3/services` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:11:39.466499 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44dd7f4d-ad49-4b85-8069-f45a1c1c8ace None admin] RBAC: Adding query filter params (name=compute) {{(pid=79745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 07:11:39.466815 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44dd7f4d-ad49-4b85-8069-f45a1c1c8ace None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:11:39.468248 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44dd7f4d-ad49-4b85-8069-f45a1c1c8ace None admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:11:39.480419 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 472/961] 10.222.0.21 () {56 vars in 1112 bytes} [Wed May 4 07:11:39 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 07:11:39.482093 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44dd7f4d-ad49-4b85-8069-f45a1c1c8ace None admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:11:39.533064 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af1ca3e-12d0-4ab1-af56-7bff934517b8 None admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:11:39.570962 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714b9bea-abbc-4b91-9a0c-0e6e7aba2717 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:11:39.571706 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714b9bea-abbc-4b91-9a0c-0e6e7aba2717 None admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:11:39.571980 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714b9bea-abbc-4b91-9a0c-0e6e7aba2717 None admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:11:39.572243 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714b9bea-abbc-4b91-9a0c-0e6e7aba2717 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:11:39.589594 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714b9bea-abbc-4b91-9a0c-0e6e7aba2717 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 07:11:39.594490 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44dd7f4d-ad49-4b85-8069-f45a1c1c8ace None admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:11:39.597685 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application [None req-714b9bea-abbc-4b91-9a0c-0e6e7aba2717 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 04 07:11:39.597685 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 07:11:39.597685 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 07:11:39.597685 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 07:11:39.597685 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 07:11:39.597685 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 07:11:39.597685 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 07:11:39.597685 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 07:11:39.597685 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 07:11:39.597685 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 07:11:39.597685 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 07:11:39.597685 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 07:11:39.597685 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 07:11:39.597685 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 07:11:39.597685 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 07:11:39.597685 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 07:11:39.598618 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 07:11:39.598618 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 07:11:39.598618 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 07:11:39.598618 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 07:11:39.598618 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 07:11:39.598618 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 07:11:39.598618 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 07:11:39.598618 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 07:11:39.598618 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 07:11:39.598618 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.get_or_create( May 04 07:11:39.598618 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 07:11:39.598618 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application with Lock( May 04 07:11:39.598618 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 07:11:39.598618 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self._enter() May 04 07:11:39.598618 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 07:11:39.598618 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 07:11:39.599509 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 07:11:39.599509 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.creator() May 04 07:11:39.599509 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 07:11:39.599509 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application created_value = creator( May 04 07:11:39.599509 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 07:11:39.599509 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 07:11:39.599509 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 07:11:39.599509 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 07:11:39.599509 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 07:11:39.599509 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 07:11:39.599509 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 04 07:11:39.599509 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application May 04 07:11:39.600329 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 490/962] 10.222.0.21 () {56 vars in 1120 bytes} [Wed May 4 07:11:39 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 07:11:39.609686 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714b9bea-abbc-4b91-9a0c-0e6e7aba2717 None admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:11:39.646042 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d478cace-67e9-4123-840c-171041b7b7d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:11:39.646950 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d478cace-67e9-4123-840c-171041b7b7d6 None admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:11:39.647340 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d478cace-67e9-4123-840c-171041b7b7d6 None admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:11:39.647677 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d478cace-67e9-4123-840c-171041b7b7d6 None admin] PATH_INFO: `/v3/services` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:11:39.648446 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d478cace-67e9-4123-840c-171041b7b7d6 None admin] RBAC: Adding query filter params (type=compute) {{(pid=79745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 07:11:39.649361 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d478cace-67e9-4123-840c-171041b7b7d6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:11:39.650587 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d478cace-67e9-4123-840c-171041b7b7d6 None admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:11:39.657323 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 473/963] 10.222.0.21 () {56 vars in 1112 bytes} [Wed May 4 07:11:39 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 07:11:39.735606 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714b9bea-abbc-4b91-9a0c-0e6e7aba2717 None admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:11:39.776888 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f38e14-5f5f-41a4-a742-d0e8e362a4dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:11:39.777731 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f38e14-5f5f-41a4-a742-d0e8e362a4dd None admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:11:39.778078 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f38e14-5f5f-41a4-a742-d0e8e362a4dd None admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:11:39.778484 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f38e14-5f5f-41a4-a742-d0e8e362a4dd None admin] PATH_INFO: `/v3/roles` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:11:39.779367 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f38e14-5f5f-41a4-a742-d0e8e362a4dd None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79744) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 07:11:39.779769 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f38e14-5f5f-41a4-a742-d0e8e362a4dd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:11:39.781261 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f38e14-5f5f-41a4-a742-d0e8e362a4dd None admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:11:39.792125 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 491/964] 10.222.0.21 () {56 vars in 1115 bytes} [Wed May 4 07:11:39 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 07:11:39.797683 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d478cace-67e9-4123-840c-171041b7b7d6 None admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:11:39.905574 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d478cace-67e9-4123-840c-171041b7b7d6 None admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:11:39.942760 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4941200-7d52-4998-946e-8e6ce889cdf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:11:39.943867 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4941200-7d52-4998-946e-8e6ce889cdf4 None admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:11:39.944295 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4941200-7d52-4998-946e-8e6ce889cdf4 None admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:11:39.944714 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4941200-7d52-4998-946e-8e6ce889cdf4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:11:39.955483 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4941200-7d52-4998-946e-8e6ce889cdf4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:11:39.957095 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4941200-7d52-4998-946e-8e6ce889cdf4 None admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:11:39.975427 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application [None req-d4941200-7d52-4998-946e-8e6ce889cdf4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 07:11:39.975427 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 07:11:39.975427 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 07:11:39.975427 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 07:11:39.975427 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 07:11:39.975427 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 07:11:39.975427 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 07:11:39.975427 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 07:11:39.975427 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 07:11:39.975427 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 07:11:39.975427 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 07:11:39.975427 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 07:11:39.975427 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 07:11:39.975427 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 07:11:39.975427 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 07:11:39.976556 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 07:11:39.976556 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 07:11:39.976556 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 07:11:39.976556 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 07:11:39.976556 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 07:11:39.976556 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 07:11:39.976556 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self.get_or_create( May 04 07:11:39.976556 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 07:11:39.976556 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application with Lock( May 04 07:11:39.976556 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 07:11:39.976556 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self._enter() May 04 07:11:39.976556 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 07:11:39.976556 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 07:11:39.976556 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 07:11:39.976556 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self.creator() May 04 07:11:39.976556 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 07:11:39.976556 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application created_value = creator( May 04 07:11:39.977724 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 07:11:39.977724 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 07:11:39.977724 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 07:11:39.977724 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application May 04 07:11:39.980215 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 474/965] 10.222.0.21 () {56 vars in 1108 bytes} [Wed May 4 07:11:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 07:11:39.991255 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f38e14-5f5f-41a4-a742-d0e8e362a4dd None admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:11:40.092191 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f38e14-5f5f-41a4-a742-d0e8e362a4dd None admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:11:40.125215 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac23ea05-8cf4-4d21-9b20-0f638384eb77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:11:40.126040 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac23ea05-8cf4-4d21-9b20-0f638384eb77 None admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:11:40.126457 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac23ea05-8cf4-4d21-9b20-0f638384eb77 None admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:11:40.126821 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac23ea05-8cf4-4d21-9b20-0f638384eb77 None admin] PATH_INFO: `/v3/domains` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:11:40.127753 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac23ea05-8cf4-4d21-9b20-0f638384eb77 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79744) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 07:11:40.128156 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac23ea05-8cf4-4d21-9b20-0f638384eb77 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:11:40.129590 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac23ea05-8cf4-4d21-9b20-0f638384eb77 None admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:11:40.146461 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 492/966] 10.222.0.21 () {56 vars in 1109 bytes} [Wed May 4 07:11:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 07:11:40.147917 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4941200-7d52-4998-946e-8e6ce889cdf4 None admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:11:40.246853 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4941200-7d52-4998-946e-8e6ce889cdf4 None admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:11:40.285228 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043044a3-d905-498a-8a90-d3b22138cfd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:11:40.286037 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043044a3-d905-498a-8a90-d3b22138cfd5 None admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:11:40.286315 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043044a3-d905-498a-8a90-d3b22138cfd5 None admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:11:40.286588 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043044a3-d905-498a-8a90-d3b22138cfd5 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:11:40.294294 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043044a3-d905-498a-8a90-d3b22138cfd5 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:11:40.296429 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043044a3-d905-498a-8a90-d3b22138cfd5 None admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:11:40.311936 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application [None req-043044a3-d905-498a-8a90-d3b22138cfd5 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 04 07:11:40.311936 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 07:11:40.311936 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 07:11:40.311936 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 07:11:40.311936 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 07:11:40.311936 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 07:11:40.311936 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 07:11:40.311936 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 07:11:40.311936 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 07:11:40.311936 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 07:11:40.311936 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 07:11:40.311936 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 07:11:40.311936 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 04 07:11:40.311936 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self._get_user(user_id) May 04 07:11:40.311936 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 04 07:11:40.311936 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 04 07:11:40.313130 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 07:11:40.313130 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 07:11:40.313130 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 04 07:11:40.313130 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 07:11:40.313130 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 04 07:11:40.313130 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 07:11:40.313130 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 07:11:40.313130 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 07:11:40.313130 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 07:11:40.313130 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self.get_or_create( May 04 07:11:40.313130 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 07:11:40.313130 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application with Lock( May 04 07:11:40.313130 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 07:11:40.313130 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self._enter() May 04 07:11:40.313130 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 07:11:40.313130 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 07:11:40.313130 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 07:11:40.313130 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self.creator() May 04 07:11:40.314300 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 07:11:40.314300 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application created_value = creator( May 04 07:11:40.314300 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 04 07:11:40.314300 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 04 07:11:40.314300 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 04 07:11:40.314300 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 04 07:11:40.314300 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 04 07:11:40.314300 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 04 07:11:40.314300 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 04 07:11:40.314300 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application May 04 07:11:40.314300 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 475/967] 10.222.0.21 () {56 vars in 1117 bytes} [Wed May 4 07:11:40 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 07:11:40.320342 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac23ea05-8cf4-4d21-9b20-0f638384eb77 None admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:11:40.424437 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac23ea05-8cf4-4d21-9b20-0f638384eb77 None admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:11:40.461115 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b665d5-9638-48da-9e4b-c7efeffb85f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:11:40.461967 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b665d5-9638-48da-9e4b-c7efeffb85f1 None admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:11:40.462418 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b665d5-9638-48da-9e4b-c7efeffb85f1 None admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:11:40.462841 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b665d5-9638-48da-9e4b-c7efeffb85f1 None admin] PATH_INFO: `/v3/users` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:11:40.465036 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b665d5-9638-48da-9e4b-c7efeffb85f1 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79744) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 07:11:40.465502 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b665d5-9638-48da-9e4b-c7efeffb85f1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:11:40.467056 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b665d5-9638-48da-9e4b-c7efeffb85f1 None admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:11:40.485907 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 493/968] 10.222.0.21 () {56 vars in 1149 bytes} [Wed May 4 07:11:40 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 07:11:40.495186 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043044a3-d905-498a-8a90-d3b22138cfd5 None admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:11:40.592910 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043044a3-d905-498a-8a90-d3b22138cfd5 None admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:11:40.626647 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe69c96-1ba5-4102-8719-81ececaa9ace None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:11:40.627317 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe69c96-1ba5-4102-8719-81ececaa9ace None admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:11:40.627600 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe69c96-1ba5-4102-8719-81ececaa9ace None admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:11:40.627871 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe69c96-1ba5-4102-8719-81ececaa9ace None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:11:40.695241 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe69c96-1ba5-4102-8719-81ececaa9ace None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:11:40.696614 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe69c96-1ba5-4102-8719-81ececaa9ace None admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:11:40.801163 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 476/969] 10.222.0.21 () {58 vars in 1282 bytes} [Wed May 4 07:11:40 2022] GET /identity/v3/auth/tokens => generated 1464 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 04 07:11:40.806860 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b665d5-9638-48da-9e4b-c7efeffb85f1 None admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:11:40.914496 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b665d5-9638-48da-9e4b-c7efeffb85f1 None admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:11:40.946461 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56886176-5152-4233-ae9e-84dcc0e6481e None None] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:11:40.946953 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56886176-5152-4233-ae9e-84dcc0e6481e None None] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:11:40.946953 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56886176-5152-4233-ae9e-84dcc0e6481e None None] PATH_INFO: `/` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:11:40.948654 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 477/970] 10.222.0.21 () {54 vars in 926 bytes} [Wed May 4 07:11:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 04 07:11:40.950772 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7df9caa-a4d0-470c-803d-d5c5a035327f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:11:40.954959 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7df9caa-a4d0-470c-803d-d5c5a035327f None admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:11:40.954959 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7df9caa-a4d0-470c-803d-d5c5a035327f None admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:11:40.954959 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7df9caa-a4d0-470c-803d-d5c5a035327f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:11:40.956465 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f90e285-0f8c-443d-ae50-8eefb7357836 None None] REQUEST_METHOD: `POST` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:11:40.956746 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f90e285-0f8c-443d-ae50-8eefb7357836 None None] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:11:40.957018 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f90e285-0f8c-443d-ae50-8eefb7357836 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:11:40.969294 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7df9caa-a4d0-470c-803d-d5c5a035327f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:11:40.970514 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7df9caa-a4d0-470c-803d-d5c5a035327f None admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:11:40.975520 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.auth.core [None req-7f90e285-0f8c-443d-ae50-8eefb7357836 None None] MFA Rules not processed for user `83c5e0dcb991496ea6dee38384514508`. Rule list: `[]` (Enabled: `True`). {{(pid=79745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:11:40.976905 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.fernet_utils [None req-7f90e285-0f8c-443d-ae50-8eefb7357836 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:11:40.991042 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application [None req-c7df9caa-a4d0-470c-803d-d5c5a035327f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 07:11:40.991042 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 07:11:40.991042 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 07:11:40.991042 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 07:11:40.991042 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 07:11:40.991042 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 07:11:40.991042 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 07:11:40.991042 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 07:11:40.991042 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 07:11:40.991042 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 07:11:40.991042 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 07:11:40.991042 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 07:11:40.991042 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 07:11:40.991042 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 07:11:40.991042 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 07:11:40.992701 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 07:11:40.992701 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 07:11:40.992701 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 07:11:40.992701 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 07:11:40.992701 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 07:11:40.992701 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 07:11:40.992701 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.get_or_create( May 04 07:11:40.992701 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 07:11:40.992701 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application with Lock( May 04 07:11:40.992701 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 07:11:40.992701 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self._enter() May 04 07:11:40.992701 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 07:11:40.992701 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 07:11:40.992701 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 07:11:40.992701 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.creator() May 04 07:11:40.992701 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 07:11:40.992701 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application created_value = creator( May 04 07:11:40.993650 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 07:11:40.993650 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 07:11:40.993650 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 07:11:40.993650 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application May 04 07:11:40.993650 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 494/971] 10.222.0.21 () {56 vars in 1108 bytes} [Wed May 4 07:11:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 07:11:40.998078 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7df9caa-a4d0-470c-803d-d5c5a035327f None admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:11:41.059406 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 478/972] 10.222.0.21 () {58 vars in 1023 bytes} [Wed May 4 07:11:40 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 07:11:41.076266 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f90e285-0f8c-443d-ae50-8eefb7357836 None None] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:11:41.112883 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7df9caa-a4d0-470c-803d-d5c5a035327f None admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:11:41.149642 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f40964e-e98c-4fc1-8abf-b6c8e60cc37c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:11:41.150315 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f40964e-e98c-4fc1-8abf-b6c8e60cc37c None admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:11:41.150613 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f40964e-e98c-4fc1-8abf-b6c8e60cc37c None admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:11:41.150893 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f40964e-e98c-4fc1-8abf-b6c8e60cc37c None admin] PATH_INFO: `/v3/domains` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:11:41.152808 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f40964e-e98c-4fc1-8abf-b6c8e60cc37c None admin] RBAC: Adding query filter params (name=Default) {{(pid=79744) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 07:11:41.153124 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f40964e-e98c-4fc1-8abf-b6c8e60cc37c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:11:41.154565 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f40964e-e98c-4fc1-8abf-b6c8e60cc37c None admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:11:41.166515 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 495/973] 10.222.0.21 () {56 vars in 1109 bytes} [Wed May 4 07:11:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 07:11:41.173054 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f40964e-e98c-4fc1-8abf-b6c8e60cc37c None admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:11:41.184247 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f90e285-0f8c-443d-ae50-8eefb7357836 None None] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:11:41.229852 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619b1659-f481-47b3-954c-d2256a4fed89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:11:41.230809 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619b1659-f481-47b3-954c-d2256a4fed89 None admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:11:41.231166 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619b1659-f481-47b3-954c-d2256a4fed89 None admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:11:41.231452 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619b1659-f481-47b3-954c-d2256a4fed89 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:11:41.232498 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619b1659-f481-47b3-954c-d2256a4fed89 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:11:41.234189 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619b1659-f481-47b3-954c-d2256a4fed89 None admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:11:41.250746 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application [None req-619b1659-f481-47b3-954c-d2256a4fed89 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 04 07:11:41.250746 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 07:11:41.250746 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 04 07:11:41.250746 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 04 07:11:41.250746 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 04 07:11:41.250746 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 04 07:11:41.250746 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 04 07:11:41.250746 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 07:11:41.250746 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 04 07:11:41.250746 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application May 04 07:11:41.250746 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 04 07:11:41.250746 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application May 04 07:11:41.250746 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 07:11:41.250746 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 07:11:41.250746 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 07:11:41.250746 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 07:11:41.250746 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 07:11:41.252051 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 07:11:41.252051 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 07:11:41.252051 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 07:11:41.252051 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 07:11:41.252051 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 07:11:41.252051 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 07:11:41.252051 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 04 07:11:41.252051 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self._get_service(service_id) May 04 07:11:41.252051 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 04 07:11:41.252051 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 04 07:11:41.252051 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 07:11:41.252051 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 07:11:41.252051 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 07:11:41.252051 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 07:11:41.252051 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 07:11:41.252051 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self.get_or_create( May 04 07:11:41.253561 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 07:11:41.253561 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application with Lock( May 04 07:11:41.253561 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 07:11:41.253561 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self._enter() May 04 07:11:41.253561 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 07:11:41.253561 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 07:11:41.253561 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 07:11:41.253561 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self.creator() May 04 07:11:41.253561 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 07:11:41.253561 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application created_value = creator( May 04 07:11:41.253561 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 04 07:11:41.253561 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 07:11:41.253561 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 04 07:11:41.253561 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application May 04 07:11:41.253561 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 479/974] 10.222.0.21 () {56 vars in 1126 bytes} [Wed May 4 07:11:41 2022] GET /identity/v3/services/object-store => generated 93 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 07:11:41.257922 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619b1659-f481-47b3-954c-d2256a4fed89 None admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:11:41.294163 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f40964e-e98c-4fc1-8abf-b6c8e60cc37c None admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:11:41.327990 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aceb580-26e7-45b2-a388-6d5feb211635 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:11:41.329204 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aceb580-26e7-45b2-a388-6d5feb211635 None admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:11:41.329676 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aceb580-26e7-45b2-a388-6d5feb211635 None admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:11:41.330162 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aceb580-26e7-45b2-a388-6d5feb211635 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:11:41.337008 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aceb580-26e7-45b2-a388-6d5feb211635 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:11:41.338514 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aceb580-26e7-45b2-a388-6d5feb211635 None admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:11:41.352930 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application [None req-3aceb580-26e7-45b2-a388-6d5feb211635 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 04 07:11:41.352930 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 07:11:41.352930 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 07:11:41.352930 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 07:11:41.352930 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 07:11:41.352930 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 07:11:41.352930 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 07:11:41.352930 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 07:11:41.352930 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 07:11:41.352930 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 07:11:41.352930 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 07:11:41.352930 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 07:11:41.352930 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 04 07:11:41.352930 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self._get_project(project_id) May 04 07:11:41.352930 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 04 07:11:41.353897 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 04 07:11:41.353897 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 07:11:41.353897 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 07:11:41.353897 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 07:11:41.353897 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 07:11:41.353897 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 07:11:41.353897 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.get_or_create( May 04 07:11:41.353897 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 07:11:41.353897 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application with Lock( May 04 07:11:41.353897 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 07:11:41.353897 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self._enter() May 04 07:11:41.353897 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 07:11:41.353897 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 07:11:41.353897 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 07:11:41.353897 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.creator() May 04 07:11:41.353897 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 07:11:41.353897 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application created_value = creator( May 04 07:11:41.354943 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 04 07:11:41.354943 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 04 07:11:41.354943 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 04 07:11:41.354943 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 04 07:11:41.354943 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 04 07:11:41.354943 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 04 07:11:41.354943 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 04 07:11:41.354943 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application May 04 07:11:41.359285 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 496/975] 10.222.0.21 () {56 vars in 1111 bytes} [Wed May 4 07:11:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 07:11:41.360579 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aceb580-26e7-45b2-a388-6d5feb211635 None admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:11:41.376235 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619b1659-f481-47b3-954c-d2256a4fed89 None admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:11:41.414491 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07fe6c2d-a067-43ee-9f6b-2a3a85ac0c49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:11:41.415528 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fe6c2d-a067-43ee-9f6b-2a3a85ac0c49 None admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:11:41.416008 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fe6c2d-a067-43ee-9f6b-2a3a85ac0c49 None admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:11:41.416542 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fe6c2d-a067-43ee-9f6b-2a3a85ac0c49 None admin] PATH_INFO: `/v3/services` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:11:41.417496 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07fe6c2d-a067-43ee-9f6b-2a3a85ac0c49 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=79745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 07:11:41.417998 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07fe6c2d-a067-43ee-9f6b-2a3a85ac0c49 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:11:41.419613 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07fe6c2d-a067-43ee-9f6b-2a3a85ac0c49 None admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:11:41.429341 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 480/976] 10.222.0.21 () {56 vars in 1122 bytes} [Wed May 4 07:11:41 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 07:11:41.430492 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07fe6c2d-a067-43ee-9f6b-2a3a85ac0c49 None admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:11:41.486511 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aceb580-26e7-45b2-a388-6d5feb211635 None admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:11:41.524141 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a0e9e3-2fd9-49e7-ab1f-5b1fbd86bbd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:11:41.524907 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a0e9e3-2fd9-49e7-ab1f-5b1fbd86bbd4 None admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:11:41.525188 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a0e9e3-2fd9-49e7-ab1f-5b1fbd86bbd4 None admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:11:41.525457 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a0e9e3-2fd9-49e7-ab1f-5b1fbd86bbd4 None admin] PATH_INFO: `/v3/projects` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:11:41.526851 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a0e9e3-2fd9-49e7-ab1f-5b1fbd86bbd4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79744) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 07:11:41.527368 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a0e9e3-2fd9-49e7-ab1f-5b1fbd86bbd4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:11:41.529394 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a0e9e3-2fd9-49e7-ab1f-5b1fbd86bbd4 None admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:11:41.546780 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07fe6c2d-a067-43ee-9f6b-2a3a85ac0c49 None admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:11:41.550359 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 497/977] 10.222.0.21 () {56 vars in 1148 bytes} [Wed May 4 07:11:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 07:11:41.552519 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a0e9e3-2fd9-49e7-ab1f-5b1fbd86bbd4 None admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:11:41.583541 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23948c96-1e25-4815-9b04-19045aeac6ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:11:41.584560 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23948c96-1e25-4815-9b04-19045aeac6ca None admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:11:41.585055 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23948c96-1e25-4815-9b04-19045aeac6ca None admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:11:41.585550 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23948c96-1e25-4815-9b04-19045aeac6ca None admin] PATH_INFO: `/v3/services` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:11:41.586437 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23948c96-1e25-4815-9b04-19045aeac6ca None admin] RBAC: Adding query filter params (type=object-store) {{(pid=79745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 07:11:41.586946 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23948c96-1e25-4815-9b04-19045aeac6ca None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:11:41.588623 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23948c96-1e25-4815-9b04-19045aeac6ca None admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:11:41.598558 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 481/978] 10.222.0.21 () {56 vars in 1122 bytes} [Wed May 4 07:11:41 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 07:11:41.599821 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23948c96-1e25-4815-9b04-19045aeac6ca None admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:11:41.672475 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a0e9e3-2fd9-49e7-ab1f-5b1fbd86bbd4 None admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:11:41.699331 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23948c96-1e25-4815-9b04-19045aeac6ca None admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:11:41.717356 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f98cfd6-9020-4cf7-b768-f2a6e98d34ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:11:41.718030 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f98cfd6-9020-4cf7-b768-f2a6e98d34ee None admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:11:41.718305 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f98cfd6-9020-4cf7-b768-f2a6e98d34ee None admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:11:41.718571 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f98cfd6-9020-4cf7-b768-f2a6e98d34ee None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:11:41.719480 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f98cfd6-9020-4cf7-b768-f2a6e98d34ee None admin] RBAC: Adding query filter params (role.id=ad15e59c437846a4897f5821fc039560, scope.project.id=c9f9c44db4984653b8d4b5f6b3b949f5, user.id=704cdbc22849413baa4e0189947ebebc) {{(pid=79744) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 07:11:41.719744 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f98cfd6-9020-4cf7-b768-f2a6e98d34ee None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:11:41.721217 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f98cfd6-9020-4cf7-b768-f2a6e98d34ee None admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:11:41.735192 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 498/979] 10.222.0.21 () {56 vars in 1374 bytes} [Wed May 4 07:11:41 2022] GET /identity/v3/role_assignments?user.id=704cdbc22849413baa4e0189947ebebc&scope.project.id=c9f9c44db4984653b8d4b5f6b3b949f5&role.id=ad15e59c437846a4897f5821fc039560 => generated 608 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 07:11:41.749282 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b134aea-74be-46d3-b867-71585eb91087 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:11:41.749870 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b134aea-74be-46d3-b867-71585eb91087 None admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:11:41.750144 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b134aea-74be-46d3-b867-71585eb91087 None admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:11:41.750407 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b134aea-74be-46d3-b867-71585eb91087 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:11:41.751236 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b134aea-74be-46d3-b867-71585eb91087 None admin] RBAC: Adding query filter params (interface=admin, service_id=8cfd2351dadb4607a691fe828cba37ac, region_id=RegionOne) {{(pid=79745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 07:11:41.751612 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b134aea-74be-46d3-b867-71585eb91087 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:11:41.753015 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b134aea-74be-46d3-b867-71585eb91087 None admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:11:41.759557 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 482/980] 10.222.0.21 () {56 vars in 1249 bytes} [Wed May 4 07:11:41 2022] GET /identity/v3/endpoints?service_id=8cfd2351dadb4607a691fe828cba37ac&interface=admin®ion_id=RegionOne => generated 193 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 07:11:41.765767 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f98cfd6-9020-4cf7-b768-f2a6e98d34ee None admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:11:41.869578 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f98cfd6-9020-4cf7-b768-f2a6e98d34ee None admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:11:41.913926 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0003551c-6e8a-4c1f-bc78-4016ec4f1840 None None] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:11:41.914276 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0003551c-6e8a-4c1f-bc78-4016ec4f1840 None None] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:11:41.914478 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0003551c-6e8a-4c1f-bc78-4016ec4f1840 None None] PATH_INFO: `/` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:11:41.916119 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e82b35e-2021-40ce-b630-0c4fabff3662 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:11:41.916376 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 483/981] 10.222.0.21 () {54 vars in 926 bytes} [Wed May 4 07:11:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 07:11:41.917790 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e82b35e-2021-40ce-b630-0c4fabff3662 None admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:11:41.918276 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e82b35e-2021-40ce-b630-0c4fabff3662 None admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:11:41.918808 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e82b35e-2021-40ce-b630-0c4fabff3662 None admin] PATH_INFO: `/v3/services` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:11:41.919758 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e82b35e-2021-40ce-b630-0c4fabff3662 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:11:41.921424 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e82b35e-2021-40ce-b630-0c4fabff3662 None admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:11:41.923340 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d3d8e5-3d1d-48b3-aa6c-23ff09b62de0 None None] REQUEST_METHOD: `POST` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:11:41.923631 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d3d8e5-3d1d-48b3-aa6c-23ff09b62de0 None None] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:11:41.923912 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d3d8e5-3d1d-48b3-aa6c-23ff09b62de0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:11:41.931345 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 499/982] 10.222.0.21 () {56 vars in 1087 bytes} [Wed May 4 07:11:41 2022] GET /identity/v3/services => generated 1497 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 07:11:41.942615 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.auth.core [None req-60d3d8e5-3d1d-48b3-aa6c-23ff09b62de0 None None] MFA Rules not processed for user `83c5e0dcb991496ea6dee38384514508`. Rule list: `[]` (Enabled: `True`). {{(pid=79745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:11:41.943922 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.fernet_utils [None req-60d3d8e5-3d1d-48b3-aa6c-23ff09b62de0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:11:42.023822 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 484/983] 10.222.0.21 () {58 vars in 1023 bytes} [Wed May 4 07:11:41 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 04 07:11:42.052420 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e82b35e-2021-40ce-b630-0c4fabff3662 None admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:11:42.091462 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce1415c-77a8-477a-8569-3f34dc3164ed None None] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:11:42.091749 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce1415c-77a8-477a-8569-3f34dc3164ed None None] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:11:42.092039 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce1415c-77a8-477a-8569-3f34dc3164ed None None] PATH_INFO: `/` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:11:42.093705 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 485/984] 10.222.0.21 () {54 vars in 926 bytes} [Wed May 4 07:11:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 04 07:11:42.099170 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697a7789-8b43-448e-9c42-a21461048bf3 None None] REQUEST_METHOD: `POST` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:11:42.099471 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697a7789-8b43-448e-9c42-a21461048bf3 None None] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:11:42.099753 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697a7789-8b43-448e-9c42-a21461048bf3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:11:42.117428 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.auth.core [None req-697a7789-8b43-448e-9c42-a21461048bf3 None None] MFA Rules not processed for user `83c5e0dcb991496ea6dee38384514508`. Rule list: `[]` (Enabled: `True`). {{(pid=79745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:11:42.118642 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.fernet_utils [None req-697a7789-8b43-448e-9c42-a21461048bf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:11:42.170921 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e82b35e-2021-40ce-b630-0c4fabff3662 None admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:11:42.206055 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eae8bca-9761-455b-922e-bb25363dc091 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:11:42.206623 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eae8bca-9761-455b-922e-bb25363dc091 None admin] REQUEST_METHOD: `POST` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:11:42.206852 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 486/985] 10.222.0.21 () {58 vars in 1023 bytes} [Wed May 4 07:11:42 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 04 07:11:42.206977 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eae8bca-9761-455b-922e-bb25363dc091 None admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:11:42.211189 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eae8bca-9761-455b-922e-bb25363dc091 None admin] PATH_INFO: `/v3/users` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:11:42.211189 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eae8bca-9761-455b-922e-bb25363dc091 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:11:42.211189 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eae8bca-9761-455b-922e-bb25363dc091 None admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:11:42.224692 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.sql.core [None req-9eae8bca-9761-455b-922e-bb25363dc091 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") May 04 07:11:42.224692 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] May 04 07:11:42.224692 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [parameters: {'user_id': 'cb5684e27cd0436a86dad11823a073b8', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] May 04 07:11:42.224692 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=79744) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} May 04 07:11:42.233359 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697a7789-8b43-448e-9c42-a21461048bf3 None None] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:11:42.234000 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application [None req-9eae8bca-9761-455b-922e-bb25363dc091 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. May 04 07:11:42.234000 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 07:11:42.234000 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 04 07:11:42.234000 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application self.dialect.do_execute( May 04 07:11:42.234000 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 04 07:11:42.234000 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 04 07:11:42.234000 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 04 07:11:42.234000 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application result = self._query(query) May 04 07:11:42.234000 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 04 07:11:42.234000 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application conn.query(q) May 04 07:11:42.234000 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 04 07:11:42.234000 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 04 07:11:42.234000 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 04 07:11:42.234000 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application result.read() May 04 07:11:42.234000 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 04 07:11:42.235092 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 04 07:11:42.235092 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 04 07:11:42.235092 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application packet.raise_for_error() May 04 07:11:42.235092 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 04 07:11:42.235092 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 04 07:11:42.235092 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 04 07:11:42.235092 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 04 07:11:42.235092 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") May 04 07:11:42.235092 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application May 04 07:11:42.235092 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: May 04 07:11:42.235092 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application May 04 07:11:42.235092 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 07:11:42.235092 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper May 04 07:11:42.235092 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return method(*args, **kwargs) May 04 07:11:42.235092 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user May 04 07:11:42.235092 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) May 04 07:11:42.235092 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 04 07:11:42.235092 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application next(self.gen) May 04 07:11:42.236326 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope May 04 07:11:42.236326 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application yield resource May 04 07:11:42.236326 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 04 07:11:42.236326 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application next(self.gen) May 04 07:11:42.236326 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session May 04 07:11:42.236326 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application self.session.rollback() May 04 07:11:42.236326 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 04 07:11:42.236326 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application self.force_reraise() May 04 07:11:42.236326 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 04 07:11:42.236326 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application raise self.value May 04 07:11:42.236326 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session May 04 07:11:42.236326 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) May 04 07:11:42.236326 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction May 04 07:11:42.236326 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application session.commit() May 04 07:11:42.236326 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit May 04 07:11:42.236326 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) May 04 07:11:42.236326 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit May 04 07:11:42.237483 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application self._prepare_impl() May 04 07:11:42.237483 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl May 04 07:11:42.237483 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application self.session.flush() May 04 07:11:42.237483 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 04 07:11:42.237483 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application self._flush(objects) May 04 07:11:42.237483 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 04 07:11:42.237483 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) May 04 07:11:42.237483 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 04 07:11:42.237483 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application compat.raise_( May 04 07:11:42.237483 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 04 07:11:42.237483 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application raise exception May 04 07:11:42.237483 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 04 07:11:42.237483 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application flush_context.execute() May 04 07:11:42.237483 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 04 07:11:42.237483 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application rec.execute(self) May 04 07:11:42.237483 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 04 07:11:42.237483 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( May 04 07:11:42.238603 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 04 07:11:42.238603 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application _emit_insert_statements( May 04 07:11:42.238603 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements May 04 07:11:42.238603 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application result = connection._execute_20( May 04 07:11:42.238603 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 04 07:11:42.238603 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) May 04 07:11:42.238603 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 04 07:11:42.238603 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return connection._execute_clauseelement( May 04 07:11:42.238603 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 04 07:11:42.238603 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application ret = self._execute_context( May 04 07:11:42.238603 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 04 07:11:42.238603 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application self._handle_dbapi_exception( May 04 07:11:42.238603 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 04 07:11:42.238603 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 04 07:11:42.238603 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 04 07:11:42.238603 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application raise exception May 04 07:11:42.239686 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 04 07:11:42.239686 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application self.dialect.do_execute( May 04 07:11:42.239686 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 04 07:11:42.239686 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 04 07:11:42.239686 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 04 07:11:42.239686 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application result = self._query(query) May 04 07:11:42.239686 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 04 07:11:42.239686 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application conn.query(q) May 04 07:11:42.239686 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 04 07:11:42.239686 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 04 07:11:42.239686 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 04 07:11:42.239686 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application result.read() May 04 07:11:42.239686 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 04 07:11:42.239686 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 04 07:11:42.239686 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 04 07:11:42.239686 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application packet.raise_for_error() May 04 07:11:42.240719 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 04 07:11:42.240719 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 04 07:11:42.240719 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 04 07:11:42.240719 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 04 07:11:42.240719 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") May 04 07:11:42.240719 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] May 04 07:11:42.240719 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application [parameters: {'user_id': 'cb5684e27cd0436a86dad11823a073b8', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] May 04 07:11:42.240719 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) May 04 07:11:42.240719 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application May 04 07:11:42.240719 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 04 07:11:42.240719 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application May 04 07:11:42.240719 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 07:11:42.240719 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 07:11:42.240719 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 07:11:42.240719 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 07:11:42.241788 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 07:11:42.241788 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 07:11:42.241788 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 07:11:42.241788 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 07:11:42.241788 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 07:11:42.241788 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 07:11:42.241788 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 07:11:42.241788 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post May 04 07:11:42.241788 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( May 04 07:11:42.241788 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 07:11:42.241788 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 07:11:42.241788 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 04 07:11:42.241788 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 07:11:42.241788 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 04 07:11:42.241788 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 07:11:42.241788 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user May 04 07:11:42.241788 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) May 04 07:11:42.242955 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects May 04 07:11:42.242955 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) May 04 07:11:42.242955 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper May 04 07:11:42.242955 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, May 04 07:11:42.242955 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. May 04 07:11:42.242955 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application May 04 07:11:42.246978 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 500/986] 10.222.0.21 () {60 vars in 1131 bytes} [Wed May 4 07:11:42 2022] POST /identity/v3/users => generated 160 bytes in 195 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) May 04 07:11:42.252762 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eae8bca-9761-455b-922e-bb25363dc091 None admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:11:42.349505 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697a7789-8b43-448e-9c42-a21461048bf3 None None] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:11:42.384015 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eae8bca-9761-455b-922e-bb25363dc091 None admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:11:42.385370 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2714b31e-cc80-4042-a29e-73a4b7a860ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:11:42.386163 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2714b31e-cc80-4042-a29e-73a4b7a860ec None admin] REQUEST_METHOD: `POST` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:11:42.386551 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2714b31e-cc80-4042-a29e-73a4b7a860ec None admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:11:42.386930 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2714b31e-cc80-4042-a29e-73a4b7a860ec None admin] PATH_INFO: `/v3/services` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:11:42.387812 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2714b31e-cc80-4042-a29e-73a4b7a860ec None admin] RBAC: Authorizing `identity:create_service()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:11:42.389288 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2714b31e-cc80-4042-a29e-73a4b7a860ec None admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:11:42.411467 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 487/987] 10.222.0.21 () {60 vars in 1141 bytes} [Wed May 4 07:11:42 2022] POST /identity/v3/services => generated 242 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 07:11:42.437110 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5334b9ed-1360-42e2-a15c-32bd3651e698 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:11:42.437999 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5334b9ed-1360-42e2-a15c-32bd3651e698 None admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:11:42.438283 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5334b9ed-1360-42e2-a15c-32bd3651e698 None admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:11:42.438557 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5334b9ed-1360-42e2-a15c-32bd3651e698 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:11:42.447360 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5334b9ed-1360-42e2-a15c-32bd3651e698 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:11:42.449913 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5334b9ed-1360-42e2-a15c-32bd3651e698 None admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:11:42.467125 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application [None req-5334b9ed-1360-42e2-a15c-32bd3651e698 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 04 07:11:42.467125 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 07:11:42.467125 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 07:11:42.467125 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 07:11:42.467125 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 07:11:42.467125 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 07:11:42.467125 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 07:11:42.467125 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 07:11:42.467125 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 07:11:42.467125 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 07:11:42.467125 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 07:11:42.467125 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 07:11:42.467125 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 04 07:11:42.467125 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self._get_user(user_id) May 04 07:11:42.467125 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 04 07:11:42.467125 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 04 07:11:42.469363 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 07:11:42.469363 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 07:11:42.469363 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 04 07:11:42.469363 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 07:11:42.469363 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 04 07:11:42.469363 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 07:11:42.469363 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 07:11:42.469363 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 07:11:42.469363 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 07:11:42.469363 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.get_or_create( May 04 07:11:42.469363 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 07:11:42.469363 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application with Lock( May 04 07:11:42.469363 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 07:11:42.469363 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self._enter() May 04 07:11:42.469363 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 07:11:42.469363 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 07:11:42.469363 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 07:11:42.469363 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.creator() May 04 07:11:42.471826 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 07:11:42.471826 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application created_value = creator( May 04 07:11:42.471826 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 04 07:11:42.471826 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 04 07:11:42.471826 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 04 07:11:42.471826 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 04 07:11:42.471826 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 04 07:11:42.471826 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 04 07:11:42.471826 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 04 07:11:42.471826 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application May 04 07:11:42.471826 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 501/988] 10.222.0.21 () {56 vars in 1099 bytes} [Wed May 4 07:11:42 2022] GET /identity/v3/users/cinder => generated 84 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 07:11:42.475194 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2714b31e-cc80-4042-a29e-73a4b7a860ec None admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:11:42.587182 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2714b31e-cc80-4042-a29e-73a4b7a860ec None admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:11:42.628294 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72374737-bf87-4bc4-a1b9-857ae87bae8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:11:42.628890 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72374737-bf87-4bc4-a1b9-857ae87bae8b None admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:11:42.629215 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72374737-bf87-4bc4-a1b9-857ae87bae8b None admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:11:42.629446 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72374737-bf87-4bc4-a1b9-857ae87bae8b None admin] PATH_INFO: `/v3/users` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:11:42.630248 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72374737-bf87-4bc4-a1b9-857ae87bae8b None admin] RBAC: Adding query filter params (name=cinder) {{(pid=79745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 07:11:42.630551 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72374737-bf87-4bc4-a1b9-857ae87bae8b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:11:42.632279 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72374737-bf87-4bc4-a1b9-857ae87bae8b None admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:11:42.670150 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 488/989] 10.222.0.21 () {56 vars in 1101 bytes} [Wed May 4 07:11:42 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 07:11:44.111423 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acedd64e-bc22-4f02-b023-2971657a033f None None] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:11:44.112115 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acedd64e-bc22-4f02-b023-2971657a033f None None] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:11:44.112115 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acedd64e-bc22-4f02-b023-2971657a033f None None] PATH_INFO: `/` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:11:44.113365 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 502/990] 10.222.0.21 () {54 vars in 926 bytes} [Wed May 4 07:11:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 07:11:44.119382 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3eade29-83e3-4805-a8a4-22088e0a8394 None None] REQUEST_METHOD: `POST` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:11:44.120176 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3eade29-83e3-4805-a8a4-22088e0a8394 None None] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:11:44.120176 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3eade29-83e3-4805-a8a4-22088e0a8394 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:11:44.138479 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.auth.core [None req-b3eade29-83e3-4805-a8a4-22088e0a8394 None None] MFA Rules not processed for user `83c5e0dcb991496ea6dee38384514508`. Rule list: `[]` (Enabled: `True`). {{(pid=79745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:11:44.139690 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.fernet_utils [None req-b3eade29-83e3-4805-a8a4-22088e0a8394 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:11:44.203786 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 489/991] 10.222.0.21 () {58 vars in 1023 bytes} [Wed May 4 07:11:44 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 07:11:44.225501 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acedd64e-bc22-4f02-b023-2971657a033f None None] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:11:44.321566 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29d12f4-16bf-49cf-9b82-0a1021a12061 None None] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:11:44.321934 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29d12f4-16bf-49cf-9b82-0a1021a12061 None None] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:11:44.322292 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29d12f4-16bf-49cf-9b82-0a1021a12061 None None] PATH_INFO: `/` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:11:44.323911 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 490/992] 10.222.0.21 () {54 vars in 926 bytes} [Wed May 4 07:11:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 04 07:11:44.328159 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acedd64e-bc22-4f02-b023-2971657a033f None None] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:11:44.328743 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ed83de-dbfb-48f8-b6da-00e47453dd4d None None] REQUEST_METHOD: `POST` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:11:44.329024 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ed83de-dbfb-48f8-b6da-00e47453dd4d None None] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:11:44.329295 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ed83de-dbfb-48f8-b6da-00e47453dd4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:11:44.345885 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.auth.core [None req-87ed83de-dbfb-48f8-b6da-00e47453dd4d None None] MFA Rules not processed for user `83c5e0dcb991496ea6dee38384514508`. Rule list: `[]` (Enabled: `True`). {{(pid=79745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:11:44.347032 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.fernet_utils [None req-87ed83de-dbfb-48f8-b6da-00e47453dd4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:11:44.364749 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4247c0-410c-4443-8996-9f058ddde839 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:11:44.365457 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4247c0-410c-4443-8996-9f058ddde839 None admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:11:44.365729 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4247c0-410c-4443-8996-9f058ddde839 None admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:11:44.365989 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4247c0-410c-4443-8996-9f058ddde839 None admin] PATH_INFO: `/v3/services/image` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:11:44.366627 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4247c0-410c-4443-8996-9f058ddde839 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:11:44.367981 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4247c0-410c-4443-8996-9f058ddde839 None admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:11:44.379367 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application [None req-8f4247c0-410c-4443-8996-9f058ddde839 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. May 04 07:11:44.379367 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 07:11:44.379367 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 04 07:11:44.379367 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 04 07:11:44.379367 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 04 07:11:44.379367 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 04 07:11:44.379367 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 04 07:11:44.379367 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 07:11:44.379367 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 04 07:11:44.379367 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application May 04 07:11:44.379367 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 04 07:11:44.379367 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application May 04 07:11:44.379367 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 07:11:44.379367 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 07:11:44.379367 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 07:11:44.379367 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 07:11:44.379367 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 07:11:44.380396 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 07:11:44.380396 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 07:11:44.380396 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 07:11:44.380396 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 07:11:44.380396 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 07:11:44.380396 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 07:11:44.380396 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 04 07:11:44.380396 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self._get_service(service_id) May 04 07:11:44.380396 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 04 07:11:44.380396 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 04 07:11:44.380396 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 07:11:44.380396 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 07:11:44.380396 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 07:11:44.380396 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 07:11:44.380396 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 07:11:44.380396 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.get_or_create( May 04 07:11:44.381278 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 07:11:44.381278 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application with Lock( May 04 07:11:44.381278 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 07:11:44.381278 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self._enter() May 04 07:11:44.381278 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 07:11:44.381278 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 07:11:44.381278 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 07:11:44.381278 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.creator() May 04 07:11:44.381278 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 07:11:44.381278 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application created_value = creator( May 04 07:11:44.381278 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 04 07:11:44.381278 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 07:11:44.381278 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 04 07:11:44.381278 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application May 04 07:11:44.381278 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 503/993] 10.222.0.21 () {56 vars in 1105 bytes} [Wed May 4 07:11:44 2022] GET /identity/v3/services/image => generated 86 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 07:11:44.386611 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4247c0-410c-4443-8996-9f058ddde839 None admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:11:44.420476 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 491/994] 10.222.0.21 () {58 vars in 1023 bytes} [Wed May 4 07:11:44 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 07:11:44.443518 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ed83de-dbfb-48f8-b6da-00e47453dd4d None None] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:11:44.492991 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4247c0-410c-4443-8996-9f058ddde839 None admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:11:44.529201 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2635bc13-2568-4fbd-9af6-0777d8215fb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:11:44.530143 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2635bc13-2568-4fbd-9af6-0777d8215fb4 None admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:11:44.530650 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2635bc13-2568-4fbd-9af6-0777d8215fb4 None admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:11:44.530927 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2635bc13-2568-4fbd-9af6-0777d8215fb4 None admin] PATH_INFO: `/v3/services` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:11:44.531649 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2635bc13-2568-4fbd-9af6-0777d8215fb4 None admin] RBAC: Adding query filter params (name=image) {{(pid=79744) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 07:11:44.531966 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2635bc13-2568-4fbd-9af6-0777d8215fb4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:11:44.533304 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2635bc13-2568-4fbd-9af6-0777d8215fb4 None admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:11:44.542735 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 504/995] 10.222.0.21 () {56 vars in 1108 bytes} [Wed May 4 07:11:44 2022] GET /identity/v3/services?name=image => generated 122 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 07:11:44.542915 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ed83de-dbfb-48f8-b6da-00e47453dd4d None None] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:11:44.543982 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2635bc13-2568-4fbd-9af6-0777d8215fb4 None admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:11:44.584027 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01691177-b32d-4309-8e82-69708bf632cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:11:44.584843 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01691177-b32d-4309-8e82-69708bf632cc None admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:11:44.585117 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01691177-b32d-4309-8e82-69708bf632cc None admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:11:44.585385 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01691177-b32d-4309-8e82-69708bf632cc None admin] PATH_INFO: `/v3/services/object-store` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:11:44.586039 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01691177-b32d-4309-8e82-69708bf632cc None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:11:44.587795 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01691177-b32d-4309-8e82-69708bf632cc None admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:11:44.600505 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application [None req-01691177-b32d-4309-8e82-69708bf632cc None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 04 07:11:44.600505 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 07:11:44.600505 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 04 07:11:44.600505 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 04 07:11:44.600505 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 04 07:11:44.600505 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 04 07:11:44.600505 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 04 07:11:44.600505 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 07:11:44.600505 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 04 07:11:44.600505 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application May 04 07:11:44.600505 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 04 07:11:44.600505 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application May 04 07:11:44.600505 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 07:11:44.600505 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 07:11:44.600505 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 07:11:44.600505 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 07:11:44.600505 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 07:11:44.601571 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 07:11:44.601571 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 07:11:44.601571 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 07:11:44.601571 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 07:11:44.601571 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 07:11:44.601571 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 07:11:44.601571 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 04 07:11:44.601571 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self._get_service(service_id) May 04 07:11:44.601571 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 04 07:11:44.601571 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 04 07:11:44.601571 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 07:11:44.601571 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 07:11:44.601571 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 07:11:44.601571 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 07:11:44.601571 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 07:11:44.601571 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self.get_or_create( May 04 07:11:44.608097 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 07:11:44.608097 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application with Lock( May 04 07:11:44.608097 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 07:11:44.608097 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self._enter() May 04 07:11:44.608097 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 07:11:44.608097 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 07:11:44.608097 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 07:11:44.608097 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self.creator() May 04 07:11:44.608097 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 07:11:44.608097 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application created_value = creator( May 04 07:11:44.608097 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 04 07:11:44.608097 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 07:11:44.608097 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 04 07:11:44.608097 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application May 04 07:11:44.608097 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 492/996] 10.222.0.21 () {56 vars in 1126 bytes} [Wed May 4 07:11:44 2022] GET /identity/v3/services/object-store => generated 93 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 07:11:44.610538 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01691177-b32d-4309-8e82-69708bf632cc None admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:11:44.669329 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2635bc13-2568-4fbd-9af6-0777d8215fb4 None admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:11:44.704205 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9632a704-8756-4a82-a632-efd572c69c86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:11:44.704832 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9632a704-8756-4a82-a632-efd572c69c86 None admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:11:44.705112 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9632a704-8756-4a82-a632-efd572c69c86 None admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:11:44.705386 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9632a704-8756-4a82-a632-efd572c69c86 None admin] PATH_INFO: `/v3/services` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:11:44.706095 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9632a704-8756-4a82-a632-efd572c69c86 None admin] RBAC: Adding query filter params (type=image) {{(pid=79744) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 07:11:44.706406 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9632a704-8756-4a82-a632-efd572c69c86 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:11:44.707801 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9632a704-8756-4a82-a632-efd572c69c86 None admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:11:44.712265 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 505/997] 10.222.0.21 () {56 vars in 1108 bytes} [Wed May 4 07:11:44 2022] GET /identity/v3/services?type=image => generated 122 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 07:11:44.712741 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01691177-b32d-4309-8e82-69708bf632cc None admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:11:44.751136 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734a7f99-96b7-4ea3-9930-73a8281e704b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:11:44.751890 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734a7f99-96b7-4ea3-9930-73a8281e704b None admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:11:44.752168 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734a7f99-96b7-4ea3-9930-73a8281e704b None admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:11:44.752435 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734a7f99-96b7-4ea3-9930-73a8281e704b None admin] PATH_INFO: `/v3/services` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:11:44.752667 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8187bd3-aeae-4e22-810c-13e9303c3e54 None None] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:11:44.752959 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8187bd3-aeae-4e22-810c-13e9303c3e54 None None] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:11:44.753158 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734a7f99-96b7-4ea3-9930-73a8281e704b None admin] RBAC: Adding query filter params (name=object-store) {{(pid=79745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 07:11:44.753265 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8187bd3-aeae-4e22-810c-13e9303c3e54 None None] PATH_INFO: `/` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:11:44.753459 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734a7f99-96b7-4ea3-9930-73a8281e704b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:11:44.754836 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 506/998] 10.222.0.21 () {54 vars in 926 bytes} [Wed May 4 07:11:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 04 07:11:44.754957 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734a7f99-96b7-4ea3-9930-73a8281e704b None admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:11:44.760992 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9dc4ce-56ff-4979-a856-34f43b271098 None None] REQUEST_METHOD: `POST` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:11:44.766091 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9dc4ce-56ff-4979-a856-34f43b271098 None None] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:11:44.766269 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 493/999] 10.222.0.21 () {56 vars in 1122 bytes} [Wed May 4 07:11:44 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 07:11:44.766391 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9dc4ce-56ff-4979-a856-34f43b271098 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:11:44.768012 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734a7f99-96b7-4ea3-9930-73a8281e704b None admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:11:44.783054 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.auth.core [None req-6d9dc4ce-56ff-4979-a856-34f43b271098 None None] MFA Rules not processed for user `83c5e0dcb991496ea6dee38384514508`. Rule list: `[]` (Enabled: `True`). {{(pid=79744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:11:44.785792 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.fernet_utils [None req-6d9dc4ce-56ff-4979-a856-34f43b271098 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:11:44.859573 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 507/1000] 10.222.0.21 () {58 vars in 1023 bytes} [Wed May 4 07:11:44 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 04 07:11:44.869538 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734a7f99-96b7-4ea3-9930-73a8281e704b None admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:11:44.883189 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9dc4ce-56ff-4979-a856-34f43b271098 None None] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:11:44.906245 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f948834f-db40-4831-b15c-7f07f0ca7a2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:11:44.907760 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f948834f-db40-4831-b15c-7f07f0ca7a2f None admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:11:44.908046 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f948834f-db40-4831-b15c-7f07f0ca7a2f None admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:11:44.908322 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f948834f-db40-4831-b15c-7f07f0ca7a2f None admin] PATH_INFO: `/v3/services` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:11:44.909189 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f948834f-db40-4831-b15c-7f07f0ca7a2f None admin] RBAC: Adding query filter params (type=object-store) {{(pid=79745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 07:11:44.909503 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f948834f-db40-4831-b15c-7f07f0ca7a2f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:11:44.910866 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f948834f-db40-4831-b15c-7f07f0ca7a2f None admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:11:44.915690 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 494/1001] 10.222.0.21 () {56 vars in 1122 bytes} [Wed May 4 07:11:44 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 07:11:44.934431 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f948834f-db40-4831-b15c-7f07f0ca7a2f None admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:11:44.984507 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9dc4ce-56ff-4979-a856-34f43b271098 None None] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:11:45.018350 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6140e57b-c496-4d88-b018-7606d154262c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:11:45.019159 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6140e57b-c496-4d88-b018-7606d154262c None admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:11:45.019483 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6140e57b-c496-4d88-b018-7606d154262c None admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:11:45.019753 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6140e57b-c496-4d88-b018-7606d154262c None admin] PATH_INFO: `/v3/services/compute` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:11:45.020408 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6140e57b-c496-4d88-b018-7606d154262c None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:11:45.021771 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6140e57b-c496-4d88-b018-7606d154262c None admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:11:45.036039 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application [None req-6140e57b-c496-4d88-b018-7606d154262c None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. May 04 07:11:45.036039 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 07:11:45.036039 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 04 07:11:45.036039 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 04 07:11:45.036039 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 04 07:11:45.036039 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 04 07:11:45.036039 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 04 07:11:45.036039 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 07:11:45.036039 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 04 07:11:45.036039 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application May 04 07:11:45.036039 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 04 07:11:45.036039 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application May 04 07:11:45.036039 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 07:11:45.036039 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 07:11:45.036039 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 07:11:45.036039 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 07:11:45.036039 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 07:11:45.037225 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 07:11:45.037225 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 07:11:45.037225 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 07:11:45.037225 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 07:11:45.037225 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 07:11:45.037225 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 07:11:45.037225 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 04 07:11:45.037225 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self._get_service(service_id) May 04 07:11:45.037225 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 04 07:11:45.037225 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 04 07:11:45.037225 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 07:11:45.037225 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 07:11:45.037225 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 07:11:45.037225 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 07:11:45.037225 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 07:11:45.037225 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.get_or_create( May 04 07:11:45.038227 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 07:11:45.038227 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application with Lock( May 04 07:11:45.038227 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 07:11:45.038227 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self._enter() May 04 07:11:45.038227 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 07:11:45.038227 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 07:11:45.038227 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 07:11:45.038227 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.creator() May 04 07:11:45.038227 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 07:11:45.038227 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application created_value = creator( May 04 07:11:45.038227 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 04 07:11:45.038227 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 07:11:45.038227 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 04 07:11:45.038227 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application May 04 07:11:45.042204 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f948834f-db40-4831-b15c-7f07f0ca7a2f None admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:11:45.043664 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 508/1002] 10.222.0.21 () {56 vars in 1111 bytes} [Wed May 4 07:11:44 2022] GET /identity/v3/services/compute => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 07:11:45.044556 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6140e57b-c496-4d88-b018-7606d154262c None admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:11:45.077243 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de1febd-af2e-454f-b0f1-418914d40705 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:11:45.078136 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de1febd-af2e-454f-b0f1-418914d40705 None admin] REQUEST_METHOD: `POST` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:11:45.078603 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de1febd-af2e-454f-b0f1-418914d40705 None admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:11:45.078876 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de1febd-af2e-454f-b0f1-418914d40705 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:11:45.079640 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de1febd-af2e-454f-b0f1-418914d40705 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:11:45.080993 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de1febd-af2e-454f-b0f1-418914d40705 None admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:11:45.096852 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 495/1003] 10.222.0.21 () {60 vars in 1144 bytes} [Wed May 4 07:11:44 2022] POST /identity/v3/endpoints => generated 325 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 07:11:45.147412 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6140e57b-c496-4d88-b018-7606d154262c None admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:11:45.190791 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c096fa1d-a2b6-4fc2-9ad5-b8efa4939f79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:11:45.191409 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c096fa1d-a2b6-4fc2-9ad5-b8efa4939f79 None admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:11:45.191689 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c096fa1d-a2b6-4fc2-9ad5-b8efa4939f79 None admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:11:45.191964 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c096fa1d-a2b6-4fc2-9ad5-b8efa4939f79 None admin] PATH_INFO: `/v3/services` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:11:45.192677 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c096fa1d-a2b6-4fc2-9ad5-b8efa4939f79 None admin] RBAC: Adding query filter params (name=compute) {{(pid=79744) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 07:11:45.192982 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c096fa1d-a2b6-4fc2-9ad5-b8efa4939f79 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:11:45.194358 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c096fa1d-a2b6-4fc2-9ad5-b8efa4939f79 None admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:11:45.200242 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 509/1004] 10.222.0.21 () {56 vars in 1112 bytes} [Wed May 4 07:11:45 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 07:11:45.205742 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de1febd-af2e-454f-b0f1-418914d40705 None admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:11:45.311537 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de1febd-af2e-454f-b0f1-418914d40705 None admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:11:45.345446 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d469865-4110-4d7e-acfa-57533c7e807e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:11:45.346345 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d469865-4110-4d7e-acfa-57533c7e807e None admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:11:45.346781 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d469865-4110-4d7e-acfa-57533c7e807e None admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:11:45.347282 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d469865-4110-4d7e-acfa-57533c7e807e None admin] PATH_INFO: `/v3/services` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:11:45.348134 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d469865-4110-4d7e-acfa-57533c7e807e None admin] RBAC: Adding query filter params (type=compute) {{(pid=79745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 07:11:45.348590 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d469865-4110-4d7e-acfa-57533c7e807e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:11:45.350101 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d469865-4110-4d7e-acfa-57533c7e807e None admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:11:45.356400 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 496/1005] 10.222.0.21 () {56 vars in 1112 bytes} [Wed May 4 07:11:45 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 07:11:45.361881 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c096fa1d-a2b6-4fc2-9ad5-b8efa4939f79 None admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:11:45.459679 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c096fa1d-a2b6-4fc2-9ad5-b8efa4939f79 None admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:11:45.493433 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3bee61-7224-4f1e-91ee-da9cbb9f5808 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:11:45.494093 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3bee61-7224-4f1e-91ee-da9cbb9f5808 None admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:11:45.494373 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3bee61-7224-4f1e-91ee-da9cbb9f5808 None admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:11:45.494831 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3bee61-7224-4f1e-91ee-da9cbb9f5808 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:11:45.495677 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3bee61-7224-4f1e-91ee-da9cbb9f5808 None admin] RBAC: Adding query filter params (interface=public, service_id=17642b10443c45f7839731bdec3ae78b, region_id=RegionOne) {{(pid=79744) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 07:11:45.495990 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3bee61-7224-4f1e-91ee-da9cbb9f5808 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:11:45.497339 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3bee61-7224-4f1e-91ee-da9cbb9f5808 None admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:11:45.506784 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 510/1006] 10.222.0.21 () {56 vars in 1251 bytes} [Wed May 4 07:11:45 2022] GET /identity/v3/endpoints?service_id=17642b10443c45f7839731bdec3ae78b&interface=public®ion_id=RegionOne => generated 194 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 07:11:45.508310 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d469865-4110-4d7e-acfa-57533c7e807e None admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:11:45.603692 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d469865-4110-4d7e-acfa-57533c7e807e None admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:11:45.635030 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c6416c-427d-4f05-9861-e6050579c682 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:11:45.636224 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c6416c-427d-4f05-9861-e6050579c682 None admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:11:45.636501 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c6416c-427d-4f05-9861-e6050579c682 None admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:11:45.636769 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c6416c-427d-4f05-9861-e6050579c682 None admin] PATH_INFO: `/v3/services` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:11:45.637438 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c6416c-427d-4f05-9861-e6050579c682 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:11:45.638781 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c6416c-427d-4f05-9861-e6050579c682 None admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:11:45.644919 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 497/1007] 10.222.0.21 () {56 vars in 1087 bytes} [Wed May 4 07:11:45 2022] GET /identity/v3/services => generated 1727 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 07:11:46.988657 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7ce3c1-eff5-41db-9b1b-5db5a0ca7fa9 None None] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:11:46.989200 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7ce3c1-eff5-41db-9b1b-5db5a0ca7fa9 None None] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:11:46.989200 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7ce3c1-eff5-41db-9b1b-5db5a0ca7fa9 None None] PATH_INFO: `/` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:11:46.990598 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 511/1008] 10.222.0.21 () {54 vars in 926 bytes} [Wed May 4 07:11:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 07:11:46.995850 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9271b5fc-3d73-43b9-9d1c-ef3bd33a29bc None None] REQUEST_METHOD: `POST` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:11:46.996273 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9271b5fc-3d73-43b9-9d1c-ef3bd33a29bc None None] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:11:46.996438 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9271b5fc-3d73-43b9-9d1c-ef3bd33a29bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:11:47.013769 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.auth.core [None req-9271b5fc-3d73-43b9-9d1c-ef3bd33a29bc None None] MFA Rules not processed for user `83c5e0dcb991496ea6dee38384514508`. Rule list: `[]` (Enabled: `True`). {{(pid=79745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:11:47.014923 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.fernet_utils [None req-9271b5fc-3d73-43b9-9d1c-ef3bd33a29bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:11:47.081091 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 498/1009] 10.222.0.21 () {58 vars in 1023 bytes} [Wed May 4 07:11:46 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 07:11:47.103568 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7ce3c1-eff5-41db-9b1b-5db5a0ca7fa9 None None] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:11:47.204515 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7ce3c1-eff5-41db-9b1b-5db5a0ca7fa9 None None] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:11:47.238433 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b42790b-6248-4f5a-a713-03a6067450c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:11:47.239178 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b42790b-6248-4f5a-a713-03a6067450c3 None admin] REQUEST_METHOD: `POST` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:11:47.239403 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b42790b-6248-4f5a-a713-03a6067450c3 None admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:11:47.239669 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b42790b-6248-4f5a-a713-03a6067450c3 None admin] PATH_INFO: `/v3/services` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:11:47.240389 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b42790b-6248-4f5a-a713-03a6067450c3 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:11:47.241723 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b42790b-6248-4f5a-a713-03a6067450c3 None admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:11:47.259302 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 512/1010] 10.222.0.21 () {60 vars in 1141 bytes} [Wed May 4 07:11:47 2022] POST /identity/v3/services => generated 242 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 07:11:47.382308 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3be721-ae41-4d8e-ba85-c6a06d80f11a None None] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:11:47.382675 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3be721-ae41-4d8e-ba85-c6a06d80f11a None None] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:11:47.382860 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3be721-ae41-4d8e-ba85-c6a06d80f11a None None] PATH_INFO: `/` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:11:47.384464 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 499/1011] 10.222.0.21 () {54 vars in 926 bytes} [Wed May 4 07:11:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 07:11:47.390001 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f2c518-e86d-4f51-b972-0ea90fc15457 None None] REQUEST_METHOD: `POST` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:11:47.390282 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f2c518-e86d-4f51-b972-0ea90fc15457 None None] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:11:47.390562 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f2c518-e86d-4f51-b972-0ea90fc15457 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:11:47.408616 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.auth.core [None req-a6f2c518-e86d-4f51-b972-0ea90fc15457 None None] MFA Rules not processed for user `83c5e0dcb991496ea6dee38384514508`. Rule list: `[]` (Enabled: `True`). {{(pid=79744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:11:47.409821 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.fernet_utils [None req-a6f2c518-e86d-4f51-b972-0ea90fc15457 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:11:47.491368 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 513/1012] 10.222.0.21 () {58 vars in 1023 bytes} [Wed May 4 07:11:47 2022] POST /identity/v3/auth/tokens => generated 1803 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 07:11:47.514815 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3be721-ae41-4d8e-ba85-c6a06d80f11a None None] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:11:47.610804 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3be721-ae41-4d8e-ba85-c6a06d80f11a None None] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:11:47.644710 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41ddd66-6ab5-4159-b93d-8d402e0dd8f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:11:47.645491 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41ddd66-6ab5-4159-b93d-8d402e0dd8f6 None admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:11:47.645764 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41ddd66-6ab5-4159-b93d-8d402e0dd8f6 None admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:11:47.646030 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41ddd66-6ab5-4159-b93d-8d402e0dd8f6 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:11:47.647205 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41ddd66-6ab5-4159-b93d-8d402e0dd8f6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:11:47.648626 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41ddd66-6ab5-4159-b93d-8d402e0dd8f6 None admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:11:47.650361 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 500/1013] 10.222.0.21 () {56 vars in 1108 bytes} [Wed May 4 07:11:47 2022] GET /identity/v3/domains/default => generated 199 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 07:11:47.656812 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f2c518-e86d-4f51-b972-0ea90fc15457 None None] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:11:47.758140 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f2c518-e86d-4f51-b972-0ea90fc15457 None None] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:11:47.790512 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabed538-5392-4678-8dee-c8253b2d1ef5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:11:47.791183 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabed538-5392-4678-8dee-c8253b2d1ef5 None admin] REQUEST_METHOD: `POST` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:11:47.791487 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabed538-5392-4678-8dee-c8253b2d1ef5 None admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:11:47.791812 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabed538-5392-4678-8dee-c8253b2d1ef5 None admin] PATH_INFO: `/v3/projects` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:11:47.792520 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eabed538-5392-4678-8dee-c8253b2d1ef5 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:11:47.793917 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eabed538-5392-4678-8dee-c8253b2d1ef5 None admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:11:47.827162 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 514/1014] 10.222.0.21 () {60 vars in 1141 bytes} [Wed May 4 07:11:47 2022] POST /identity/v3/projects => generated 311 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 07:11:47.909607 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d36780-3864-4b54-9261-f784de745967 None None] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:11:47.909945 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d36780-3864-4b54-9261-f784de745967 None None] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:11:47.910161 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d36780-3864-4b54-9261-f784de745967 None None] PATH_INFO: `/` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:11:47.911747 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 501/1015] 10.222.0.21 () {54 vars in 926 bytes} [Wed May 4 07:11:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 07:11:47.917092 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82ea0e3-e316-4d82-85c2-3cf2467fd8ee None None] REQUEST_METHOD: `POST` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:11:47.917395 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82ea0e3-e316-4d82-85c2-3cf2467fd8ee None None] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:11:47.917633 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82ea0e3-e316-4d82-85c2-3cf2467fd8ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:11:47.935347 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.auth.core [None req-d82ea0e3-e316-4d82-85c2-3cf2467fd8ee None None] MFA Rules not processed for user `83c5e0dcb991496ea6dee38384514508`. Rule list: `[]` (Enabled: `True`). {{(pid=79744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:11:47.936551 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.fernet_utils [None req-d82ea0e3-e316-4d82-85c2-3cf2467fd8ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:11:48.011646 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 515/1016] 10.222.0.21 () {58 vars in 1023 bytes} [Wed May 4 07:11:47 2022] POST /identity/v3/auth/tokens => generated 1803 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 07:11:48.034976 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d36780-3864-4b54-9261-f784de745967 None None] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:11:48.133974 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d36780-3864-4b54-9261-f784de745967 None None] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:11:48.166212 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75c5990-0ea7-427e-a79a-7cc1b67037c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:11:48.167799 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75c5990-0ea7-427e-a79a-7cc1b67037c6 None admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:11:48.168076 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75c5990-0ea7-427e-a79a-7cc1b67037c6 None admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:11:48.168344 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75c5990-0ea7-427e-a79a-7cc1b67037c6 None admin] PATH_INFO: `/v3/services/compute` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:11:48.168987 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75c5990-0ea7-427e-a79a-7cc1b67037c6 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:11:48.170336 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75c5990-0ea7-427e-a79a-7cc1b67037c6 None admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:11:48.181900 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application [None req-b75c5990-0ea7-427e-a79a-7cc1b67037c6 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. May 04 07:11:48.181900 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 07:11:48.181900 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 04 07:11:48.181900 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 04 07:11:48.181900 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 04 07:11:48.181900 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 04 07:11:48.181900 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 04 07:11:48.181900 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 07:11:48.181900 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 04 07:11:48.181900 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application May 04 07:11:48.181900 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 04 07:11:48.181900 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application May 04 07:11:48.181900 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 07:11:48.181900 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 07:11:48.181900 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 07:11:48.181900 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 07:11:48.181900 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 07:11:48.183109 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 07:11:48.183109 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 07:11:48.183109 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 07:11:48.183109 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 07:11:48.183109 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 07:11:48.183109 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 07:11:48.183109 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 04 07:11:48.183109 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self._get_service(service_id) May 04 07:11:48.183109 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 04 07:11:48.183109 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 04 07:11:48.183109 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 07:11:48.183109 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 07:11:48.183109 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 07:11:48.183109 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 07:11:48.183109 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 07:11:48.183109 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self.get_or_create( May 04 07:11:48.184011 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 07:11:48.184011 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application with Lock( May 04 07:11:48.184011 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 07:11:48.184011 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self._enter() May 04 07:11:48.184011 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 07:11:48.184011 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 07:11:48.184011 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 07:11:48.184011 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self.creator() May 04 07:11:48.184011 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 07:11:48.184011 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application created_value = creator( May 04 07:11:48.184011 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 04 07:11:48.184011 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 07:11:48.184011 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 04 07:11:48.184011 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application May 04 07:11:48.184011 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 502/1017] 10.222.0.21 () {56 vars in 1111 bytes} [Wed May 4 07:11:48 2022] GET /identity/v3/services/compute => generated 88 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 07:11:48.189460 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82ea0e3-e316-4d82-85c2-3cf2467fd8ee None None] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:11:48.284941 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82ea0e3-e316-4d82-85c2-3cf2467fd8ee None None] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:11:48.317722 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b66b8e-ecbe-41bf-94ea-5c59acd98caf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:11:48.318701 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b66b8e-ecbe-41bf-94ea-5c59acd98caf None admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:11:48.319182 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b66b8e-ecbe-41bf-94ea-5c59acd98caf None admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:11:48.319761 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b66b8e-ecbe-41bf-94ea-5c59acd98caf None admin] PATH_INFO: `/v3/services` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:11:48.320626 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b66b8e-ecbe-41bf-94ea-5c59acd98caf None admin] RBAC: Adding query filter params (name=compute) {{(pid=79744) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 07:11:48.321101 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b66b8e-ecbe-41bf-94ea-5c59acd98caf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:11:48.322630 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b66b8e-ecbe-41bf-94ea-5c59acd98caf None admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:11:48.332083 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 516/1018] 10.222.0.21 () {56 vars in 1112 bytes} [Wed May 4 07:11:48 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 07:11:48.333594 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75c5990-0ea7-427e-a79a-7cc1b67037c6 None admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:11:48.429615 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75c5990-0ea7-427e-a79a-7cc1b67037c6 None admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:11:48.475253 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e1302c-d279-4c2e-a665-43c6d005a799 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:11:48.476244 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e1302c-d279-4c2e-a665-43c6d005a799 None admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:11:48.476740 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e1302c-d279-4c2e-a665-43c6d005a799 None admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:11:48.477204 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e1302c-d279-4c2e-a665-43c6d005a799 None admin] PATH_INFO: `/v3/services` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:11:48.478105 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e1302c-d279-4c2e-a665-43c6d005a799 None admin] RBAC: Adding query filter params (type=compute) {{(pid=79745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 07:11:48.478614 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e1302c-d279-4c2e-a665-43c6d005a799 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:11:48.480706 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e1302c-d279-4c2e-a665-43c6d005a799 None admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:11:48.485451 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 503/1019] 10.222.0.21 () {56 vars in 1112 bytes} [Wed May 4 07:11:48 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 07:11:48.491258 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b66b8e-ecbe-41bf-94ea-5c59acd98caf None admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:11:48.600864 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b66b8e-ecbe-41bf-94ea-5c59acd98caf None admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:11:48.633139 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b21583-5911-4eac-9b17-2ed16d83ecde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:11:48.633783 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b21583-5911-4eac-9b17-2ed16d83ecde None admin] REQUEST_METHOD: `POST` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:11:48.634059 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b21583-5911-4eac-9b17-2ed16d83ecde None admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:11:48.634328 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b21583-5911-4eac-9b17-2ed16d83ecde None admin] PATH_INFO: `/v3/endpoints` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:11:48.635546 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b21583-5911-4eac-9b17-2ed16d83ecde None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:11:48.636893 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b21583-5911-4eac-9b17-2ed16d83ecde None admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:11:48.663191 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 517/1020] 10.222.0.21 () {60 vars in 1144 bytes} [Wed May 4 07:11:48 2022] POST /identity/v3/endpoints => generated 334 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 07:11:49.558172 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e89bc6-8f63-474f-822c-cac2e8cae2f9 None None] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:11:49.558846 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e89bc6-8f63-474f-822c-cac2e8cae2f9 None None] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:11:49.558846 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e89bc6-8f63-474f-822c-cac2e8cae2f9 None None] PATH_INFO: `/` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:11:49.560237 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 504/1021] 10.222.0.21 () {54 vars in 926 bytes} [Wed May 4 07:11:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 07:11:49.565246 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c406b2-7604-47b2-bc1c-1478733ead68 None None] REQUEST_METHOD: `POST` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:11:49.565739 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c406b2-7604-47b2-bc1c-1478733ead68 None None] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:11:49.565893 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c406b2-7604-47b2-bc1c-1478733ead68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:11:49.582569 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.auth.core [None req-74c406b2-7604-47b2-bc1c-1478733ead68 None None] MFA Rules not processed for user `83c5e0dcb991496ea6dee38384514508`. Rule list: `[]` (Enabled: `True`). {{(pid=79744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:11:49.583756 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.fernet_utils [None req-74c406b2-7604-47b2-bc1c-1478733ead68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:11:49.654617 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 518/1022] 10.222.0.21 () {58 vars in 1023 bytes} [Wed May 4 07:11:49 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 04 07:11:49.676926 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e89bc6-8f63-474f-822c-cac2e8cae2f9 None None] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:11:49.775023 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e89bc6-8f63-474f-822c-cac2e8cae2f9 None None] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:11:49.807694 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fb00ce-357e-43eb-b391-1b85f43cc3d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:11:49.808417 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fb00ce-357e-43eb-b391-1b85f43cc3d2 None admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:11:49.808692 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fb00ce-357e-43eb-b391-1b85f43cc3d2 None admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:11:49.808960 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fb00ce-357e-43eb-b391-1b85f43cc3d2 None admin] PATH_INFO: `/v3/services/image` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:11:49.809603 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88fb00ce-357e-43eb-b391-1b85f43cc3d2 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:11:49.810960 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88fb00ce-357e-43eb-b391-1b85f43cc3d2 None admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:11:49.822135 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application [None req-88fb00ce-357e-43eb-b391-1b85f43cc3d2 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. May 04 07:11:49.822135 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 07:11:49.822135 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 04 07:11:49.822135 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 04 07:11:49.822135 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 04 07:11:49.822135 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 04 07:11:49.822135 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 04 07:11:49.822135 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 07:11:49.822135 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 04 07:11:49.822135 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application May 04 07:11:49.822135 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 04 07:11:49.822135 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application May 04 07:11:49.822135 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 07:11:49.822135 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 07:11:49.822135 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 07:11:49.822135 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 07:11:49.822135 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 07:11:49.823931 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 07:11:49.823931 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 07:11:49.823931 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 07:11:49.823931 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 07:11:49.823931 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 07:11:49.823931 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 07:11:49.823931 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 04 07:11:49.823931 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self._get_service(service_id) May 04 07:11:49.823931 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 04 07:11:49.823931 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 04 07:11:49.823931 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 07:11:49.823931 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 07:11:49.823931 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 07:11:49.823931 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 07:11:49.823931 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 07:11:49.823931 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self.get_or_create( May 04 07:11:49.824804 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 07:11:49.824804 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application with Lock( May 04 07:11:49.824804 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 07:11:49.824804 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self._enter() May 04 07:11:49.824804 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 07:11:49.824804 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 07:11:49.824804 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 07:11:49.824804 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self.creator() May 04 07:11:49.824804 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 07:11:49.824804 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application created_value = creator( May 04 07:11:49.824804 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 04 07:11:49.824804 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 07:11:49.824804 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 04 07:11:49.824804 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application May 04 07:11:49.824804 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 505/1023] 10.222.0.21 () {56 vars in 1105 bytes} [Wed May 4 07:11:49 2022] GET /identity/v3/services/image => generated 86 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 07:11:49.831599 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c406b2-7604-47b2-bc1c-1478733ead68 None None] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:11:49.930848 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c406b2-7604-47b2-bc1c-1478733ead68 None None] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:11:49.968167 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257e8989-3d22-4a22-b8cc-434cef1aa284 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:11:49.968858 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257e8989-3d22-4a22-b8cc-434cef1aa284 None admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:11:49.969137 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257e8989-3d22-4a22-b8cc-434cef1aa284 None admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:11:49.969409 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257e8989-3d22-4a22-b8cc-434cef1aa284 None admin] PATH_INFO: `/v3/services` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:11:49.970140 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257e8989-3d22-4a22-b8cc-434cef1aa284 None admin] RBAC: Adding query filter params (name=image) {{(pid=79744) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 07:11:49.970449 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257e8989-3d22-4a22-b8cc-434cef1aa284 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:11:49.971882 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257e8989-3d22-4a22-b8cc-434cef1aa284 None admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:11:49.982794 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 519/1024] 10.222.0.21 () {56 vars in 1108 bytes} [Wed May 4 07:11:49 2022] GET /identity/v3/services?name=image => generated 122 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 07:11:49.984168 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fb00ce-357e-43eb-b391-1b85f43cc3d2 None admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:11:50.083713 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fb00ce-357e-43eb-b391-1b85f43cc3d2 None admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:11:50.116661 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4bf7296-c87e-4853-86d4-20706bb93fb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:11:50.117324 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bf7296-c87e-4853-86d4-20706bb93fb8 None admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:11:50.117605 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bf7296-c87e-4853-86d4-20706bb93fb8 None admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:11:50.117880 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bf7296-c87e-4853-86d4-20706bb93fb8 None admin] PATH_INFO: `/v3/services` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:11:50.118583 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4bf7296-c87e-4853-86d4-20706bb93fb8 None admin] RBAC: Adding query filter params (type=image) {{(pid=79745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 07:11:50.118890 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4bf7296-c87e-4853-86d4-20706bb93fb8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:11:50.120933 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4bf7296-c87e-4853-86d4-20706bb93fb8 None admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:11:50.130534 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 506/1025] 10.222.0.21 () {56 vars in 1108 bytes} [Wed May 4 07:11:49 2022] GET /identity/v3/services?type=image => generated 350 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 07:11:50.131765 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257e8989-3d22-4a22-b8cc-434cef1aa284 None admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:11:50.153334 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba459cc7-363c-4ed1-8f10-9b46b38a61e8 None None] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:11:50.153645 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba459cc7-363c-4ed1-8f10-9b46b38a61e8 None None] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:11:50.153890 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba459cc7-363c-4ed1-8f10-9b46b38a61e8 None None] PATH_INFO: `/` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:11:50.155769 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 507/1026] 10.222.0.21 () {54 vars in 926 bytes} [Wed May 4 07:11:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 07:11:50.160678 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af97a2b-a9ca-4a7a-999a-7402acc1959b None None] REQUEST_METHOD: `POST` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:11:50.160953 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af97a2b-a9ca-4a7a-999a-7402acc1959b None None] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:11:50.161223 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af97a2b-a9ca-4a7a-999a-7402acc1959b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:11:50.178148 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.auth.core [None req-5af97a2b-a9ca-4a7a-999a-7402acc1959b None None] MFA Rules not processed for user `83c5e0dcb991496ea6dee38384514508`. Rule list: `[]` (Enabled: `True`). {{(pid=79745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:11:50.179660 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.fernet_utils [None req-5af97a2b-a9ca-4a7a-999a-7402acc1959b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:11:50.233566 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257e8989-3d22-4a22-b8cc-434cef1aa284 None admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:11:50.247190 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 508/1027] 10.222.0.21 () {58 vars in 1023 bytes} [Wed May 4 07:11:50 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 04 07:11:50.266396 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08c85fa-4811-4e88-bcd1-ee0851a83475 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:11:50.267055 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08c85fa-4811-4e88-bcd1-ee0851a83475 None admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:11:50.267388 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08c85fa-4811-4e88-bcd1-ee0851a83475 None admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:11:50.267662 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08c85fa-4811-4e88-bcd1-ee0851a83475 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:11:50.268442 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08c85fa-4811-4e88-bcd1-ee0851a83475 None admin] RBAC: Adding query filter params (interface=public, service_id=eb5c4a130b284bd6aac0641213427c4f, region_id=RegionOne) {{(pid=79744) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 07:11:50.268751 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08c85fa-4811-4e88-bcd1-ee0851a83475 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:11:50.270243 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af97a2b-a9ca-4a7a-999a-7402acc1959b None None] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:11:50.270424 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08c85fa-4811-4e88-bcd1-ee0851a83475 None admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:11:50.275794 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 520/1028] 10.222.0.21 () {56 vars in 1251 bytes} [Wed May 4 07:11:50 2022] GET /identity/v3/endpoints?service_id=eb5c4a130b284bd6aac0641213427c4f&interface=public®ion_id=RegionOne => generated 194 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 07:11:50.282001 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08c85fa-4811-4e88-bcd1-ee0851a83475 None admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:11:50.367313 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af97a2b-a9ca-4a7a-999a-7402acc1959b None None] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:11:50.376031 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08c85fa-4811-4e88-bcd1-ee0851a83475 None admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:11:50.401651 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0148e874-87e5-4ad8-9024-f70947667bb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:11:50.402445 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0148e874-87e5-4ad8-9024-f70947667bb0 None admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:11:50.402722 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0148e874-87e5-4ad8-9024-f70947667bb0 None admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:11:50.402994 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0148e874-87e5-4ad8-9024-f70947667bb0 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:11:50.404195 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0148e874-87e5-4ad8-9024-f70947667bb0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:11:50.405609 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0148e874-87e5-4ad8-9024-f70947667bb0 None admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:11:50.407220 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 509/1029] 10.222.0.21 () {56 vars in 1108 bytes} [Wed May 4 07:11:50 2022] GET /identity/v3/domains/default => generated 199 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 07:11:50.409245 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf58861-e119-41a8-9cef-1dec1f967137 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:11:50.409905 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf58861-e119-41a8-9cef-1dec1f967137 None admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:11:50.410183 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf58861-e119-41a8-9cef-1dec1f967137 None admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:11:50.410456 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf58861-e119-41a8-9cef-1dec1f967137 None admin] PATH_INFO: `/v3/services` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:11:50.411131 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf58861-e119-41a8-9cef-1dec1f967137 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:11:50.412497 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf58861-e119-41a8-9cef-1dec1f967137 None admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:11:50.412676 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0148e874-87e5-4ad8-9024-f70947667bb0 None admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:11:50.431447 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 521/1030] 10.222.0.21 () {56 vars in 1087 bytes} [Wed May 4 07:11:50 2022] GET /identity/v3/services => generated 1957 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 04 07:11:50.523410 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0148e874-87e5-4ad8-9024-f70947667bb0 None admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:11:50.558235 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412ffb6e-4823-4c0f-bc7a-7867ac2d9258 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:11:50.558919 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412ffb6e-4823-4c0f-bc7a-7867ac2d9258 None admin] REQUEST_METHOD: `POST` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:11:50.559248 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412ffb6e-4823-4c0f-bc7a-7867ac2d9258 None admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:11:50.559483 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412ffb6e-4823-4c0f-bc7a-7867ac2d9258 None admin] PATH_INFO: `/v3/users` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:11:50.560204 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412ffb6e-4823-4c0f-bc7a-7867ac2d9258 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:11:50.561667 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412ffb6e-4823-4c0f-bc7a-7867ac2d9258 None admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:11:50.591175 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 510/1031] 10.222.0.21 () {60 vars in 1132 bytes} [Wed May 4 07:11:50 2022] POST /identity/v3/users => generated 285 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 07:11:51.030559 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291ce9dd-0f63-49e3-a053-c46def9eea83 None None] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:11:51.031112 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291ce9dd-0f63-49e3-a053-c46def9eea83 None None] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:11:51.031112 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291ce9dd-0f63-49e3-a053-c46def9eea83 None None] PATH_INFO: `/` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:11:51.032630 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 522/1032] 10.222.0.21 () {54 vars in 926 bytes} [Wed May 4 07:11:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 07:11:51.037611 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f548dc7-7b0d-4aee-b57a-1b5aebddc525 None None] REQUEST_METHOD: `POST` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:11:51.037906 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f548dc7-7b0d-4aee-b57a-1b5aebddc525 None None] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:11:51.038178 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f548dc7-7b0d-4aee-b57a-1b5aebddc525 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:11:51.055360 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.auth.core [None req-2f548dc7-7b0d-4aee-b57a-1b5aebddc525 None None] MFA Rules not processed for user `83c5e0dcb991496ea6dee38384514508`. Rule list: `[]` (Enabled: `True`). {{(pid=79745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:11:51.056524 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.fernet_utils [None req-2f548dc7-7b0d-4aee-b57a-1b5aebddc525 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:11:51.121381 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 511/1033] 10.222.0.21 () {58 vars in 1023 bytes} [Wed May 4 07:11:51 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 07:11:51.144539 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291ce9dd-0f63-49e3-a053-c46def9eea83 None None] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:11:51.243441 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291ce9dd-0f63-49e3-a053-c46def9eea83 None None] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:11:51.284662 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5476e81e-75c1-47f9-a271-74004a325544 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:11:51.285395 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5476e81e-75c1-47f9-a271-74004a325544 None admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:11:51.285673 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5476e81e-75c1-47f9-a271-74004a325544 None admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:11:51.285945 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5476e81e-75c1-47f9-a271-74004a325544 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:11:51.296214 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5476e81e-75c1-47f9-a271-74004a325544 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 07:11:51.304473 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application [None req-5476e81e-75c1-47f9-a271-74004a325544 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 04 07:11:51.304473 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 07:11:51.304473 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 07:11:51.304473 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 07:11:51.304473 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 07:11:51.304473 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 07:11:51.304473 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 07:11:51.304473 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 07:11:51.304473 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 07:11:51.304473 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 07:11:51.304473 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 07:11:51.304473 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 07:11:51.304473 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 07:11:51.304473 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 07:11:51.304473 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 07:11:51.304473 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 07:11:51.305473 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 07:11:51.305473 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 07:11:51.305473 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 07:11:51.305473 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 07:11:51.305473 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 07:11:51.305473 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 07:11:51.305473 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 07:11:51.305473 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 07:11:51.305473 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 07:11:51.305473 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.get_or_create( May 04 07:11:51.305473 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 07:11:51.305473 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application with Lock( May 04 07:11:51.305473 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 07:11:51.305473 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self._enter() May 04 07:11:51.305473 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 07:11:51.305473 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 07:11:51.306327 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 07:11:51.306327 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.creator() May 04 07:11:51.306327 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 07:11:51.306327 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application created_value = creator( May 04 07:11:51.306327 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 07:11:51.306327 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 07:11:51.306327 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 07:11:51.306327 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 07:11:51.306327 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 07:11:51.306327 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 07:11:51.306327 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 04 07:11:51.306327 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application May 04 07:11:51.306327 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 523/1034] 10.222.0.21 () {56 vars in 1120 bytes} [Wed May 4 07:11:51 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 07:11:51.312392 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f548dc7-7b0d-4aee-b57a-1b5aebddc525 None None] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:11:51.404914 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f548dc7-7b0d-4aee-b57a-1b5aebddc525 None None] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:11:51.437100 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44bcf757-78b8-4c41-afee-1d0557a5078a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:11:51.437768 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bcf757-78b8-4c41-afee-1d0557a5078a None admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:11:51.438042 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bcf757-78b8-4c41-afee-1d0557a5078a None admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:11:51.438311 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bcf757-78b8-4c41-afee-1d0557a5078a None admin] PATH_INFO: `/v3/roles` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:11:51.439053 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44bcf757-78b8-4c41-afee-1d0557a5078a None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 07:11:51.439405 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44bcf757-78b8-4c41-afee-1d0557a5078a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:11:51.440756 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44bcf757-78b8-4c41-afee-1d0557a5078a None admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:11:51.454467 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 512/1035] 10.222.0.21 () {56 vars in 1115 bytes} [Wed May 4 07:11:51 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 07:11:51.460076 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5476e81e-75c1-47f9-a271-74004a325544 None admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:11:51.555950 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5476e81e-75c1-47f9-a271-74004a325544 None admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:11:51.589482 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96465f9-983e-4bd5-8209-f9fab82f697a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:11:51.590627 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96465f9-983e-4bd5-8209-f9fab82f697a None admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:11:51.591083 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96465f9-983e-4bd5-8209-f9fab82f697a None admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:11:51.591563 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96465f9-983e-4bd5-8209-f9fab82f697a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:11:51.602280 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96465f9-983e-4bd5-8209-f9fab82f697a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:11:51.604662 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96465f9-983e-4bd5-8209-f9fab82f697a None admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:11:51.621525 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application [None req-e96465f9-983e-4bd5-8209-f9fab82f697a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 07:11:51.621525 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 07:11:51.621525 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 07:11:51.621525 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 07:11:51.621525 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 07:11:51.621525 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 07:11:51.621525 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 07:11:51.621525 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 07:11:51.621525 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 07:11:51.621525 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 07:11:51.621525 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 07:11:51.621525 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 07:11:51.621525 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 07:11:51.621525 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 07:11:51.621525 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 07:11:51.622459 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 07:11:51.622459 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 07:11:51.622459 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 07:11:51.622459 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 07:11:51.622459 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 07:11:51.622459 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 07:11:51.622459 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.get_or_create( May 04 07:11:51.622459 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 07:11:51.622459 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application with Lock( May 04 07:11:51.622459 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 07:11:51.622459 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self._enter() May 04 07:11:51.622459 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 07:11:51.622459 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 07:11:51.622459 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 07:11:51.622459 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.creator() May 04 07:11:51.622459 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 07:11:51.622459 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application created_value = creator( May 04 07:11:51.623419 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 07:11:51.623419 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 07:11:51.623419 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 07:11:51.623419 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application May 04 07:11:51.629156 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 524/1036] 10.222.0.21 () {56 vars in 1108 bytes} [Wed May 4 07:11:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 07:11:51.630351 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44bcf757-78b8-4c41-afee-1d0557a5078a None admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:11:51.728569 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44bcf757-78b8-4c41-afee-1d0557a5078a None admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:11:51.763889 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5b3c7a-8185-4125-8221-e15f8fe5fc8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:11:51.764862 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5b3c7a-8185-4125-8221-e15f8fe5fc8e None admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:11:51.765321 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5b3c7a-8185-4125-8221-e15f8fe5fc8e None admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:11:51.765785 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5b3c7a-8185-4125-8221-e15f8fe5fc8e None admin] PATH_INFO: `/v3/domains` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:11:51.766693 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5b3c7a-8185-4125-8221-e15f8fe5fc8e None admin] RBAC: Adding query filter params (name=Default) {{(pid=79745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 07:11:51.767194 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5b3c7a-8185-4125-8221-e15f8fe5fc8e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:11:51.768724 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5b3c7a-8185-4125-8221-e15f8fe5fc8e None admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:11:51.781293 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 513/1037] 10.222.0.21 () {56 vars in 1109 bytes} [Wed May 4 07:11:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 07:11:51.787170 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96465f9-983e-4bd5-8209-f9fab82f697a None admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:11:51.882553 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96465f9-983e-4bd5-8209-f9fab82f697a None admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:11:51.913930 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d76366-9922-4f39-91d8-73bb1d7c8ce8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:11:51.914716 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d76366-9922-4f39-91d8-73bb1d7c8ce8 None admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:11:51.914993 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d76366-9922-4f39-91d8-73bb1d7c8ce8 None admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:11:51.915294 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d76366-9922-4f39-91d8-73bb1d7c8ce8 None admin] PATH_INFO: `/v3/users/nova` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:11:51.924197 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d76366-9922-4f39-91d8-73bb1d7c8ce8 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:11:51.925634 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d76366-9922-4f39-91d8-73bb1d7c8ce8 None admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:11:51.940152 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application [None req-33d76366-9922-4f39-91d8-73bb1d7c8ce8 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 04 07:11:51.940152 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 07:11:51.940152 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 07:11:51.940152 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 07:11:51.940152 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 07:11:51.940152 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 07:11:51.940152 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 07:11:51.940152 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 07:11:51.940152 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 07:11:51.940152 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 07:11:51.940152 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 07:11:51.940152 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 07:11:51.940152 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 04 07:11:51.940152 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self._get_user(user_id) May 04 07:11:51.940152 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 04 07:11:51.940152 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 04 07:11:51.942354 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 07:11:51.942354 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 07:11:51.942354 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 04 07:11:51.942354 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 07:11:51.942354 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 04 07:11:51.942354 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 07:11:51.942354 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 07:11:51.942354 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 07:11:51.942354 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 07:11:51.942354 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.get_or_create( May 04 07:11:51.942354 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 07:11:51.942354 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application with Lock( May 04 07:11:51.942354 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 07:11:51.942354 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self._enter() May 04 07:11:51.942354 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 07:11:51.942354 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 07:11:51.942354 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 07:11:51.942354 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.creator() May 04 07:11:51.944655 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 07:11:51.944655 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application created_value = creator( May 04 07:11:51.944655 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 04 07:11:51.944655 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 04 07:11:51.944655 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 04 07:11:51.944655 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 04 07:11:51.944655 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 04 07:11:51.944655 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 04 07:11:51.944655 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 04 07:11:51.944655 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application May 04 07:11:51.946020 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 525/1038] 10.222.0.21 () {56 vars in 1093 bytes} [Wed May 4 07:11:51 2022] GET /identity/v3/users/nova => generated 82 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 07:11:51.947568 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5b3c7a-8185-4125-8221-e15f8fe5fc8e None admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:11:52.047852 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5b3c7a-8185-4125-8221-e15f8fe5fc8e None admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:11:52.082052 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c06f19e-3beb-4986-8cda-055bb4cd453d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:11:52.082713 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c06f19e-3beb-4986-8cda-055bb4cd453d None admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:11:52.082989 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c06f19e-3beb-4986-8cda-055bb4cd453d None admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:11:52.083291 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c06f19e-3beb-4986-8cda-055bb4cd453d None admin] PATH_INFO: `/v3/users` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:11:52.084122 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c06f19e-3beb-4986-8cda-055bb4cd453d None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 07:11:52.084427 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c06f19e-3beb-4986-8cda-055bb4cd453d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:11:52.085847 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c06f19e-3beb-4986-8cda-055bb4cd453d None admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:11:52.108354 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 514/1039] 10.222.0.21 () {56 vars in 1133 bytes} [Wed May 4 07:11:51 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 07:11:52.110044 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d76366-9922-4f39-91d8-73bb1d7c8ce8 None admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:11:52.206754 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d76366-9922-4f39-91d8-73bb1d7c8ce8 None admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:11:52.239132 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d454d0-f020-4bc9-ab33-726ef9154e6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:11:52.239798 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d454d0-f020-4bc9-ab33-726ef9154e6a None admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:11:52.240076 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d454d0-f020-4bc9-ab33-726ef9154e6a None admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:11:52.240347 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d454d0-f020-4bc9-ab33-726ef9154e6a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:11:52.306032 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d454d0-f020-4bc9-ab33-726ef9154e6a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:11:52.307941 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d454d0-f020-4bc9-ab33-726ef9154e6a None admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:11:52.408200 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 526/1040] 10.222.0.21 () {58 vars in 1282 bytes} [Wed May 4 07:11:52 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 04 07:11:52.409410 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c06f19e-3beb-4986-8cda-055bb4cd453d None admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:11:52.510871 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c06f19e-3beb-4986-8cda-055bb4cd453d None admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:11:52.549089 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69eb8772-e603-4578-a61b-99626f4e55bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:11:52.549896 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69eb8772-e603-4578-a61b-99626f4e55bb None admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:11:52.550227 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69eb8772-e603-4578-a61b-99626f4e55bb None admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:11:52.550504 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69eb8772-e603-4578-a61b-99626f4e55bb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:11:52.561482 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69eb8772-e603-4578-a61b-99626f4e55bb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:11:52.562937 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69eb8772-e603-4578-a61b-99626f4e55bb None admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:11:52.580814 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application [None req-69eb8772-e603-4578-a61b-99626f4e55bb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 07:11:52.580814 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 07:11:52.580814 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 07:11:52.580814 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 07:11:52.580814 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 07:11:52.580814 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 07:11:52.580814 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 07:11:52.580814 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 07:11:52.580814 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 07:11:52.580814 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 07:11:52.580814 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 07:11:52.580814 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 07:11:52.580814 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 07:11:52.580814 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 07:11:52.580814 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 07:11:52.581739 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 07:11:52.581739 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 07:11:52.581739 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 07:11:52.581739 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 07:11:52.581739 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 07:11:52.581739 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 07:11:52.581739 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self.get_or_create( May 04 07:11:52.581739 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 07:11:52.581739 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application with Lock( May 04 07:11:52.581739 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 07:11:52.581739 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self._enter() May 04 07:11:52.581739 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 07:11:52.581739 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 07:11:52.581739 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 07:11:52.581739 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self.creator() May 04 07:11:52.581739 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 07:11:52.581739 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application created_value = creator( May 04 07:11:52.587659 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 07:11:52.587659 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 07:11:52.587659 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 07:11:52.587659 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application May 04 07:11:52.587659 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 515/1041] 10.222.0.21 () {56 vars in 1108 bytes} [Wed May 4 07:11:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 07:11:52.587966 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d454d0-f020-4bc9-ab33-726ef9154e6a None admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:11:52.681323 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d454d0-f020-4bc9-ab33-726ef9154e6a None admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:11:52.714268 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7c4bda-1869-48ea-8691-5e16e53798e1 None None] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:11:52.714849 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7c4bda-1869-48ea-8691-5e16e53798e1 None None] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:11:52.714987 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7c4bda-1869-48ea-8691-5e16e53798e1 None None] PATH_INFO: `/` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:11:52.716690 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 516/1042] 10.222.0.21 () {54 vars in 926 bytes} [Wed May 4 07:11:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 04 07:11:52.718707 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5c9d14-f2a8-4446-b932-1a39964fc371 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:11:52.719423 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5c9d14-f2a8-4446-b932-1a39964fc371 None admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:11:52.719708 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5c9d14-f2a8-4446-b932-1a39964fc371 None admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:11:52.719983 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5c9d14-f2a8-4446-b932-1a39964fc371 None admin] PATH_INFO: `/v3/domains` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:11:52.720793 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5c9d14-f2a8-4446-b932-1a39964fc371 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79744) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 07:11:52.721061 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5c9d14-f2a8-4446-b932-1a39964fc371 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:11:52.722196 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7455e310-afdd-4407-9ebd-d908d537b460 None None] REQUEST_METHOD: `POST` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:11:52.722448 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5c9d14-f2a8-4446-b932-1a39964fc371 None admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:11:52.722554 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7455e310-afdd-4407-9ebd-d908d537b460 None None] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:11:52.722737 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7455e310-afdd-4407-9ebd-d908d537b460 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:11:52.739582 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 527/1043] 10.222.0.21 () {56 vars in 1109 bytes} [Wed May 4 07:11:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 07:11:52.739853 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.auth.core [None req-7455e310-afdd-4407-9ebd-d908d537b460 None None] MFA Rules not processed for user `83c5e0dcb991496ea6dee38384514508`. Rule list: `[]` (Enabled: `True`). {{(pid=79745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:11:52.740996 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.fernet_utils [None req-7455e310-afdd-4407-9ebd-d908d537b460 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:11:52.741460 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5c9d14-f2a8-4446-b932-1a39964fc371 None admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:11:52.811194 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 517/1044] 10.222.0.21 () {58 vars in 1023 bytes} [Wed May 4 07:11:52 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 04 07:11:52.829426 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7455e310-afdd-4407-9ebd-d908d537b460 None None] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:11:52.835973 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5c9d14-f2a8-4446-b932-1a39964fc371 None admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:11:52.869258 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd868e8d-99b1-4796-b763-c4c5eee67846 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:11:52.870592 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd868e8d-99b1-4796-b763-c4c5eee67846 None admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:11:52.870880 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd868e8d-99b1-4796-b763-c4c5eee67846 None admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:11:52.871172 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd868e8d-99b1-4796-b763-c4c5eee67846 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:11:52.877707 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd868e8d-99b1-4796-b763-c4c5eee67846 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:11:52.879168 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd868e8d-99b1-4796-b763-c4c5eee67846 None admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:11:52.893744 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application [None req-fd868e8d-99b1-4796-b763-c4c5eee67846 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 04 07:11:52.893744 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 07:11:52.893744 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 07:11:52.893744 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 07:11:52.893744 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 07:11:52.893744 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 07:11:52.893744 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 07:11:52.893744 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 07:11:52.893744 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 07:11:52.893744 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 07:11:52.893744 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 07:11:52.893744 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 07:11:52.893744 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 04 07:11:52.893744 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self._get_project(project_id) May 04 07:11:52.893744 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 04 07:11:52.894695 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 04 07:11:52.894695 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 07:11:52.894695 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 07:11:52.894695 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 07:11:52.894695 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 07:11:52.894695 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 07:11:52.894695 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.get_or_create( May 04 07:11:52.894695 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 07:11:52.894695 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application with Lock( May 04 07:11:52.894695 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 07:11:52.894695 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self._enter() May 04 07:11:52.894695 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 07:11:52.894695 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 07:11:52.894695 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 07:11:52.894695 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.creator() May 04 07:11:52.894695 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 07:11:52.894695 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application created_value = creator( May 04 07:11:52.895655 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 04 07:11:52.895655 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 04 07:11:52.895655 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 04 07:11:52.895655 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 04 07:11:52.895655 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 04 07:11:52.895655 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 04 07:11:52.895655 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 04 07:11:52.895655 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application May 04 07:11:52.895655 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 528/1045] 10.222.0.21 () {56 vars in 1111 bytes} [Wed May 4 07:11:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 07:11:52.896277 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c3a32c-8cd8-498b-839a-b1583682b357 None None] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:11:52.896645 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c3a32c-8cd8-498b-839a-b1583682b357 None None] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:11:52.896830 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c3a32c-8cd8-498b-839a-b1583682b357 None None] PATH_INFO: `/` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:11:52.898329 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 529/1046] 10.222.0.21 () {54 vars in 926 bytes} [Wed May 4 07:11:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 07:11:52.900293 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c3a32c-8cd8-498b-839a-b1583682b357 None None] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:11:52.930235 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7455e310-afdd-4407-9ebd-d908d537b460 None None] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:11:52.961690 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8a01d8-20db-4fd5-bd39-a7f2129f249b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:11:52.962467 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8a01d8-20db-4fd5-bd39-a7f2129f249b None admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:11:52.962739 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8a01d8-20db-4fd5-bd39-a7f2129f249b None admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:11:52.963003 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8a01d8-20db-4fd5-bd39-a7f2129f249b None admin] PATH_INFO: `/v3/services/image` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:11:52.964197 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8a01d8-20db-4fd5-bd39-a7f2129f249b None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:11:52.965549 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8a01d8-20db-4fd5-bd39-a7f2129f249b None admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:11:52.976709 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application [None req-de8a01d8-20db-4fd5-bd39-a7f2129f249b None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. May 04 07:11:52.976709 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 07:11:52.976709 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 04 07:11:52.976709 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 04 07:11:52.976709 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 04 07:11:52.976709 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 04 07:11:52.976709 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 04 07:11:52.976709 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 07:11:52.976709 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 04 07:11:52.976709 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application May 04 07:11:52.976709 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 04 07:11:52.976709 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application May 04 07:11:52.976709 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 07:11:52.976709 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 07:11:52.976709 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 07:11:52.976709 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 07:11:52.976709 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 07:11:52.977738 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 07:11:52.977738 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 07:11:52.977738 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 07:11:52.977738 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 07:11:52.977738 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 07:11:52.977738 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 07:11:52.977738 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 04 07:11:52.977738 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self._get_service(service_id) May 04 07:11:52.977738 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 04 07:11:52.977738 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 04 07:11:52.977738 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 07:11:52.977738 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 07:11:52.977738 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 07:11:52.977738 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 07:11:52.977738 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 07:11:52.977738 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self.get_or_create( May 04 07:11:52.978598 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 07:11:52.978598 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application with Lock( May 04 07:11:52.978598 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 07:11:52.978598 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self._enter() May 04 07:11:52.978598 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 07:11:52.978598 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 07:11:52.978598 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 07:11:52.978598 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self.creator() May 04 07:11:52.978598 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 07:11:52.978598 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application created_value = creator( May 04 07:11:52.978598 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 04 07:11:52.978598 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 07:11:52.978598 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 04 07:11:52.978598 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application May 04 07:11:52.978598 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 518/1047] 10.222.0.21 () {56 vars in 1105 bytes} [Wed May 4 07:11:52 2022] GET /identity/v3/services/image => generated 86 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 07:11:52.980538 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797b0e4b-354e-4c39-93f2-e02e389c9286 None None] REQUEST_METHOD: `POST` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:11:52.980782 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797b0e4b-354e-4c39-93f2-e02e389c9286 None None] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:11:52.981028 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797b0e4b-354e-4c39-93f2-e02e389c9286 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:11:52.996793 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.auth.core [None req-797b0e4b-354e-4c39-93f2-e02e389c9286 None None] MFA Rules not processed for user `83c5e0dcb991496ea6dee38384514508`. Rule list: `[]` (Enabled: `True`). {{(pid=79745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:11:52.997955 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.fernet_utils [None req-797b0e4b-354e-4c39-93f2-e02e389c9286 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:11:52.998063 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c3a32c-8cd8-498b-839a-b1583682b357 None None] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:11:53.031965 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0841e43e-a2c1-496b-b19f-432f109f66c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:11:53.032616 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0841e43e-a2c1-496b-b19f-432f109f66c2 None admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:11:53.032889 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0841e43e-a2c1-496b-b19f-432f109f66c2 None admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:11:53.033163 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0841e43e-a2c1-496b-b19f-432f109f66c2 None admin] PATH_INFO: `/v3/projects` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:11:53.033936 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0841e43e-a2c1-496b-b19f-432f109f66c2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79744) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 07:11:53.034240 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0841e43e-a2c1-496b-b19f-432f109f66c2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:11:53.035707 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0841e43e-a2c1-496b-b19f-432f109f66c2 None admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:11:53.046751 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 530/1048] 10.222.0.21 () {56 vars in 1148 bytes} [Wed May 4 07:11:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 07:11:53.047558 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0841e43e-a2c1-496b-b19f-432f109f66c2 None admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:11:53.061532 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 519/1049] 10.222.0.21 () {58 vars in 1023 bytes} [Wed May 4 07:11:52 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 07:11:53.062293 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797b0e4b-354e-4c39-93f2-e02e389c9286 None None] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:11:53.148641 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0841e43e-a2c1-496b-b19f-432f109f66c2 None admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:11:53.154197 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797b0e4b-354e-4c39-93f2-e02e389c9286 None None] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:11:53.180007 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0bdd891-2d5d-4ba7-9257-938db30c98b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:11:53.180658 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bdd891-2d5d-4ba7-9257-938db30c98b2 None admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:11:53.180939 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bdd891-2d5d-4ba7-9257-938db30c98b2 None admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:11:53.181208 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bdd891-2d5d-4ba7-9257-938db30c98b2 None admin] PATH_INFO: `/v3/services` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:11:53.181974 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0bdd891-2d5d-4ba7-9257-938db30c98b2 None admin] RBAC: Adding query filter params (name=image) {{(pid=79744) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 07:11:53.182277 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0bdd891-2d5d-4ba7-9257-938db30c98b2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:11:53.183647 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0bdd891-2d5d-4ba7-9257-938db30c98b2 None admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:11:53.186416 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa870d6d-1dc7-4b77-a672-cc0a8f409fa6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:11:53.187053 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa870d6d-1dc7-4b77-a672-cc0a8f409fa6 None admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:11:53.187359 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa870d6d-1dc7-4b77-a672-cc0a8f409fa6 None admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:11:53.187686 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa870d6d-1dc7-4b77-a672-cc0a8f409fa6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:11:53.188716 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 531/1050] 10.222.0.21 () {56 vars in 1108 bytes} [Wed May 4 07:11:53 2022] GET /identity/v3/services?name=image => generated 122 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 07:11:53.188976 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa870d6d-1dc7-4b77-a672-cc0a8f409fa6 None admin] RBAC: Adding query filter params (role.id=ad15e59c437846a4897f5821fc039560, scope.project.id=c9f9c44db4984653b8d4b5f6b3b949f5, user.id=1077289fedae43b6be47be7f716d573a) {{(pid=79745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 07:11:53.189503 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0bdd891-2d5d-4ba7-9257-938db30c98b2 None admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:11:53.189602 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa870d6d-1dc7-4b77-a672-cc0a8f409fa6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:11:53.192280 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa870d6d-1dc7-4b77-a672-cc0a8f409fa6 None admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:11:53.211241 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 520/1051] 10.222.0.21 () {56 vars in 1374 bytes} [Wed May 4 07:11:53 2022] GET /identity/v3/role_assignments?user.id=1077289fedae43b6be47be7f716d573a&scope.project.id=c9f9c44db4984653b8d4b5f6b3b949f5&role.id=ad15e59c437846a4897f5821fc039560 => generated 259 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 07:11:53.211241 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa870d6d-1dc7-4b77-a672-cc0a8f409fa6 None admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:11:53.294977 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0bdd891-2d5d-4ba7-9257-938db30c98b2 None admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:11:53.313690 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa870d6d-1dc7-4b77-a672-cc0a8f409fa6 None admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:11:53.329607 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81149c8b-0077-4648-a28c-c1df0a52b15f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:11:53.330409 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81149c8b-0077-4648-a28c-c1df0a52b15f None admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:11:53.330690 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81149c8b-0077-4648-a28c-c1df0a52b15f None admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:11:53.330962 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81149c8b-0077-4648-a28c-c1df0a52b15f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:11:53.342716 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81149c8b-0077-4648-a28c-c1df0a52b15f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 07:11:53.350454 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application [None req-81149c8b-0077-4648-a28c-c1df0a52b15f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 04 07:11:53.350454 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 07:11:53.350454 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 07:11:53.350454 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 07:11:53.350454 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 07:11:53.350454 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 07:11:53.350454 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 07:11:53.350454 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 07:11:53.350454 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 07:11:53.350454 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 07:11:53.350454 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 07:11:53.350454 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 07:11:53.350454 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 07:11:53.350454 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 07:11:53.350454 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 07:11:53.350454 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 07:11:53.351547 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 07:11:53.351547 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 07:11:53.351547 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 07:11:53.351547 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 07:11:53.351547 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 07:11:53.351547 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 07:11:53.351547 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 07:11:53.351547 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 07:11:53.351547 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 07:11:53.351547 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.get_or_create( May 04 07:11:53.351547 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 07:11:53.351547 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application with Lock( May 04 07:11:53.351547 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 07:11:53.351547 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self._enter() May 04 07:11:53.351547 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 07:11:53.351547 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 07:11:53.352413 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 07:11:53.352413 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.creator() May 04 07:11:53.352413 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 07:11:53.352413 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application created_value = creator( May 04 07:11:53.352413 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 07:11:53.352413 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 07:11:53.352413 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 07:11:53.352413 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 07:11:53.352413 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 07:11:53.352413 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 07:11:53.352413 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 04 07:11:53.352413 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application May 04 07:11:53.352413 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 532/1052] 10.222.0.21 () {56 vars in 1096 bytes} [Wed May 4 07:11:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 07:11:53.357892 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81149c8b-0077-4648-a28c-c1df0a52b15f None admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:11:53.360055 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7403573-e814-49e8-b6e7-84cf10f172f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:11:53.360933 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7403573-e814-49e8-b6e7-84cf10f172f5 None admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:11:53.361374 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7403573-e814-49e8-b6e7-84cf10f172f5 None admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:11:53.361648 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7403573-e814-49e8-b6e7-84cf10f172f5 None admin] PATH_INFO: `/v3/services` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:11:53.362366 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7403573-e814-49e8-b6e7-84cf10f172f5 None admin] RBAC: Adding query filter params (type=image) {{(pid=79745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 07:11:53.362676 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7403573-e814-49e8-b6e7-84cf10f172f5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:11:53.364101 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7403573-e814-49e8-b6e7-84cf10f172f5 None admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:11:53.374703 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 521/1053] 10.222.0.21 () {56 vars in 1108 bytes} [Wed May 4 07:11:53 2022] GET /identity/v3/services?type=image => generated 350 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 07:11:53.376257 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7403573-e814-49e8-b6e7-84cf10f172f5 None admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:11:53.462259 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81149c8b-0077-4648-a28c-c1df0a52b15f None admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:11:53.483854 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7403573-e814-49e8-b6e7-84cf10f172f5 None admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:11:53.496509 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328ab37a-d884-4c4b-83a2-c9fc82a8365f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:11:53.497175 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328ab37a-d884-4c4b-83a2-c9fc82a8365f None admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:11:53.497455 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328ab37a-d884-4c4b-83a2-c9fc82a8365f None admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:11:53.497730 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328ab37a-d884-4c4b-83a2-c9fc82a8365f None admin] PATH_INFO: `/v3/roles` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:11:53.498471 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328ab37a-d884-4c4b-83a2-c9fc82a8365f None admin] RBAC: Adding query filter params (name=admin) {{(pid=79744) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 07:11:53.498773 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328ab37a-d884-4c4b-83a2-c9fc82a8365f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:11:53.500161 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328ab37a-d884-4c4b-83a2-c9fc82a8365f None admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:11:53.508553 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 533/1054] 10.222.0.21 () {56 vars in 1099 bytes} [Wed May 4 07:11:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 07:11:53.514292 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328ab37a-d884-4c4b-83a2-c9fc82a8365f None admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:11:53.520249 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76acd733-4950-401e-b428-8d5ba30a4dea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:11:53.521080 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76acd733-4950-401e-b428-8d5ba30a4dea None admin] REQUEST_METHOD: `POST` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:11:53.521530 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76acd733-4950-401e-b428-8d5ba30a4dea None admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:11:53.521960 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76acd733-4950-401e-b428-8d5ba30a4dea None admin] PATH_INFO: `/v3/endpoints` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:11:53.523296 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76acd733-4950-401e-b428-8d5ba30a4dea None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:11:53.525167 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76acd733-4950-401e-b428-8d5ba30a4dea None admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:11:53.548387 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 522/1055] 10.222.0.21 () {60 vars in 1144 bytes} [Wed May 4 07:11:53 2022] POST /identity/v3/endpoints => generated 327 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 07:11:53.628183 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328ab37a-d884-4c4b-83a2-c9fc82a8365f None admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:11:53.668922 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da43a45c-7f9f-4b41-8de7-d3638d844ef0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:11:53.669802 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da43a45c-7f9f-4b41-8de7-d3638d844ef0 None admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:11:53.670078 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da43a45c-7f9f-4b41-8de7-d3638d844ef0 None admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:11:53.670347 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da43a45c-7f9f-4b41-8de7-d3638d844ef0 None admin] PATH_INFO: `/v3/users/2b470db170ae47b097a2602286b85c8c` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:11:53.685628 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da43a45c-7f9f-4b41-8de7-d3638d844ef0 None admin] RBAC: Authorizing `identity:get_user(user_id=2b470db170ae47b097a2602286b85c8c)` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:11:53.687091 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da43a45c-7f9f-4b41-8de7-d3638d844ef0 None admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:11:53.689130 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 534/1056] 10.222.0.21 () {56 vars in 1177 bytes} [Wed May 4 07:11:53 2022] GET /identity/v3/users/2b470db170ae47b097a2602286b85c8c => generated 285 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 07:11:53.694654 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76acd733-4950-401e-b428-8d5ba30a4dea None admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:11:53.793519 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76acd733-4950-401e-b428-8d5ba30a4dea None admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:11:53.825425 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e744498-3d30-455c-a68a-a136e8117361 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:11:53.826062 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e744498-3d30-455c-a68a-a136e8117361 None admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:11:53.826338 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e744498-3d30-455c-a68a-a136e8117361 None admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:11:53.826606 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e744498-3d30-455c-a68a-a136e8117361 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:11:53.892150 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e744498-3d30-455c-a68a-a136e8117361 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:11:53.893520 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e744498-3d30-455c-a68a-a136e8117361 None admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:11:53.988641 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 523/1057] 10.222.0.21 () {58 vars in 1282 bytes} [Wed May 4 07:11:53 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 04 07:11:53.993748 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da43a45c-7f9f-4b41-8de7-d3638d844ef0 None admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:11:54.086927 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da43a45c-7f9f-4b41-8de7-d3638d844ef0 None admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:11:54.118821 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a64007a-50d6-44c7-9f75-c41732c8881f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:11:54.121619 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a64007a-50d6-44c7-9f75-c41732c8881f None admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:11:54.121901 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a64007a-50d6-44c7-9f75-c41732c8881f None admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:11:54.122172 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a64007a-50d6-44c7-9f75-c41732c8881f None admin] PATH_INFO: `/v3/projects/6321bcb50618432f92223ac198d8e705` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:11:54.123357 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a64007a-50d6-44c7-9f75-c41732c8881f None admin] RBAC: Authorizing `identity:get_project(project_id=6321bcb50618432f92223ac198d8e705)` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:11:54.124760 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a64007a-50d6-44c7-9f75-c41732c8881f None admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:11:54.131449 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 535/1058] 10.222.0.21 () {56 vars in 1186 bytes} [Wed May 4 07:11:53 2022] GET /identity/v3/projects/6321bcb50618432f92223ac198d8e705 => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 07:11:54.133208 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e744498-3d30-455c-a68a-a136e8117361 None admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:11:54.226453 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e744498-3d30-455c-a68a-a136e8117361 None admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:11:54.260658 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9856a3d9-f719-4569-8982-4f94bc301a3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:11:54.261308 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9856a3d9-f719-4569-8982-4f94bc301a3a None admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:11:54.261584 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9856a3d9-f719-4569-8982-4f94bc301a3a None admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:11:54.261853 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9856a3d9-f719-4569-8982-4f94bc301a3a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:11:54.262668 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9856a3d9-f719-4569-8982-4f94bc301a3a None admin] RBAC: Adding query filter params (role.id=eb54c9cea2774a25b1fe8c79724408ee, scope.project.id=6321bcb50618432f92223ac198d8e705, user.id=2b470db170ae47b097a2602286b85c8c) {{(pid=79745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 07:11:54.262976 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9856a3d9-f719-4569-8982-4f94bc301a3a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:11:54.264438 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9856a3d9-f719-4569-8982-4f94bc301a3a None admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:11:54.275176 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 524/1059] 10.222.0.21 () {56 vars in 1374 bytes} [Wed May 4 07:11:54 2022] GET /identity/v3/role_assignments?user.id=2b470db170ae47b097a2602286b85c8c&scope.project.id=6321bcb50618432f92223ac198d8e705&role.id=eb54c9cea2774a25b1fe8c79724408ee => generated 259 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 07:11:55.456504 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512034e8-1127-4017-b069-51109b507fd7 None None] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:11:55.456902 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512034e8-1127-4017-b069-51109b507fd7 None None] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:11:55.457165 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512034e8-1127-4017-b069-51109b507fd7 None None] PATH_INFO: `/` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:11:55.458576 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 536/1060] 10.222.0.21 () {54 vars in 926 bytes} [Wed May 4 07:11:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 07:11:55.464372 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1b3a14-e8f6-4154-8d50-fecfbf92ceb3 None None] REQUEST_METHOD: `POST` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:11:55.464797 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1b3a14-e8f6-4154-8d50-fecfbf92ceb3 None None] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:11:55.464972 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1b3a14-e8f6-4154-8d50-fecfbf92ceb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:11:55.481732 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.auth.core [None req-5b1b3a14-e8f6-4154-8d50-fecfbf92ceb3 None None] MFA Rules not processed for user `83c5e0dcb991496ea6dee38384514508`. Rule list: `[]` (Enabled: `True`). {{(pid=79745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:11:55.482900 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.fernet_utils [None req-5b1b3a14-e8f6-4154-8d50-fecfbf92ceb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:11:55.545988 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 525/1061] 10.222.0.21 () {58 vars in 1023 bytes} [Wed May 4 07:11:55 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 07:11:55.568527 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512034e8-1127-4017-b069-51109b507fd7 None None] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:11:55.670048 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512034e8-1127-4017-b069-51109b507fd7 None None] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:11:55.704221 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f9298a-93a9-49be-9cc1-bd56b29b67b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:11:55.704946 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f9298a-93a9-49be-9cc1-bd56b29b67b0 None admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:11:55.705223 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f9298a-93a9-49be-9cc1-bd56b29b67b0 None admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:11:55.705493 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f9298a-93a9-49be-9cc1-bd56b29b67b0 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:11:55.715334 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f9298a-93a9-49be-9cc1-bd56b29b67b0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 07:11:55.723423 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application [None req-e1f9298a-93a9-49be-9cc1-bd56b29b67b0 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 04 07:11:55.723423 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 07:11:55.723423 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 07:11:55.723423 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 07:11:55.723423 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 07:11:55.723423 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 07:11:55.723423 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 07:11:55.723423 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 07:11:55.723423 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 07:11:55.723423 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 07:11:55.723423 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 07:11:55.723423 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 07:11:55.723423 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 07:11:55.723423 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 07:11:55.723423 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 07:11:55.723423 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 07:11:55.724346 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 07:11:55.724346 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 07:11:55.724346 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 07:11:55.724346 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 07:11:55.724346 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 07:11:55.724346 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 07:11:55.724346 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 07:11:55.724346 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 07:11:55.724346 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 07:11:55.724346 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.get_or_create( May 04 07:11:55.724346 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 07:11:55.724346 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application with Lock( May 04 07:11:55.724346 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 07:11:55.724346 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self._enter() May 04 07:11:55.724346 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 07:11:55.724346 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 07:11:55.725208 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 07:11:55.725208 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.creator() May 04 07:11:55.725208 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 07:11:55.725208 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application created_value = creator( May 04 07:11:55.725208 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 07:11:55.725208 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 07:11:55.725208 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 07:11:55.725208 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 07:11:55.725208 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 07:11:55.725208 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 07:11:55.725208 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 04 07:11:55.725208 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application May 04 07:11:55.725208 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 537/1062] 10.222.0.21 () {56 vars in 1120 bytes} [Wed May 4 07:11:55 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 07:11:55.732265 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1b3a14-e8f6-4154-8d50-fecfbf92ceb3 None None] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:11:55.826713 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1b3a14-e8f6-4154-8d50-fecfbf92ceb3 None None] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:11:55.834631 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf7a4bd-7b73-4f62-a43b-661de051272f None None] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:11:55.834915 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf7a4bd-7b73-4f62-a43b-661de051272f None None] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:11:55.835215 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf7a4bd-7b73-4f62-a43b-661de051272f None None] PATH_INFO: `/` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:11:55.836696 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 538/1063] 10.222.0.21 () {54 vars in 926 bytes} [Wed May 4 07:11:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 04 07:11:55.841488 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739472bd-504e-46e5-8fd9-efb546378880 None None] REQUEST_METHOD: `POST` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:11:55.841771 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739472bd-504e-46e5-8fd9-efb546378880 None None] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:11:55.842043 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739472bd-504e-46e5-8fd9-efb546378880 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:11:55.860124 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4624e515-c27a-434a-bf44-63b8cee4ff23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:11:55.860789 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4624e515-c27a-434a-bf44-63b8cee4ff23 None admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:11:55.861067 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4624e515-c27a-434a-bf44-63b8cee4ff23 None admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:11:55.861339 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4624e515-c27a-434a-bf44-63b8cee4ff23 None admin] PATH_INFO: `/v3/roles` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:11:55.861436 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.auth.core [None req-739472bd-504e-46e5-8fd9-efb546378880 None None] MFA Rules not processed for user `83c5e0dcb991496ea6dee38384514508`. Rule list: `[]` (Enabled: `True`). {{(pid=79744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:11:55.862076 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4624e515-c27a-434a-bf44-63b8cee4ff23 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 07:11:55.862380 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4624e515-c27a-434a-bf44-63b8cee4ff23 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:11:55.862532 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.fernet_utils [None req-739472bd-504e-46e5-8fd9-efb546378880 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:11:55.863788 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4624e515-c27a-434a-bf44-63b8cee4ff23 None admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:11:55.872564 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 526/1064] 10.222.0.21 () {56 vars in 1115 bytes} [Wed May 4 07:11:55 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 07:11:55.878282 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4624e515-c27a-434a-bf44-63b8cee4ff23 None admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:11:55.929784 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 539/1065] 10.222.0.21 () {58 vars in 1023 bytes} [Wed May 4 07:11:55 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 04 07:11:55.952817 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739472bd-504e-46e5-8fd9-efb546378880 None None] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:11:55.974372 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4624e515-c27a-434a-bf44-63b8cee4ff23 None admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:11:56.008946 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0cb1f51-dc0f-46f8-a9c4-3228ad591b99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:11:56.009729 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cb1f51-dc0f-46f8-a9c4-3228ad591b99 None admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:11:56.010546 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cb1f51-dc0f-46f8-a9c4-3228ad591b99 None admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:11:56.010810 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cb1f51-dc0f-46f8-a9c4-3228ad591b99 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:11:56.021187 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0cb1f51-dc0f-46f8-a9c4-3228ad591b99 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:11:56.022865 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0cb1f51-dc0f-46f8-a9c4-3228ad591b99 None admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:11:56.040026 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application [None req-e0cb1f51-dc0f-46f8-a9c4-3228ad591b99 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 07:11:56.040026 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 07:11:56.040026 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 07:11:56.040026 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 07:11:56.040026 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 07:11:56.040026 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 07:11:56.040026 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 07:11:56.040026 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 07:11:56.040026 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 07:11:56.040026 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 07:11:56.040026 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 07:11:56.040026 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 07:11:56.040026 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 07:11:56.040026 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 07:11:56.040026 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 07:11:56.040997 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 07:11:56.040997 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 07:11:56.040997 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 07:11:56.040997 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 07:11:56.040997 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 07:11:56.040997 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 07:11:56.040997 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self.get_or_create( May 04 07:11:56.040997 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 07:11:56.040997 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application with Lock( May 04 07:11:56.040997 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 07:11:56.040997 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self._enter() May 04 07:11:56.040997 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 07:11:56.040997 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 07:11:56.040997 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 07:11:56.040997 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self.creator() May 04 07:11:56.040997 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 07:11:56.040997 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application created_value = creator( May 04 07:11:56.042551 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 07:11:56.042551 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 07:11:56.042551 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 07:11:56.042551 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application May 04 07:11:56.046529 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 527/1066] 10.222.0.21 () {56 vars in 1108 bytes} [Wed May 4 07:11:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 07:11:56.047200 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0cb1f51-dc0f-46f8-a9c4-3228ad591b99 None admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:11:56.050280 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739472bd-504e-46e5-8fd9-efb546378880 None None] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:11:56.084628 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a7e18e-2f25-4dd6-bec0-177d84b829bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:11:56.085269 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a7e18e-2f25-4dd6-bec0-177d84b829bd None admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:11:56.085544 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a7e18e-2f25-4dd6-bec0-177d84b829bd None admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:11:56.085811 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a7e18e-2f25-4dd6-bec0-177d84b829bd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:11:56.145162 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0cb1f51-dc0f-46f8-a9c4-3228ad591b99 None admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:11:56.150644 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a7e18e-2f25-4dd6-bec0-177d84b829bd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:11:56.152141 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a7e18e-2f25-4dd6-bec0-177d84b829bd None admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:11:56.179506 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d7f104-7f45-4a10-b6c6-e6ed46fbd7c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:11:56.180170 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d7f104-7f45-4a10-b6c6-e6ed46fbd7c4 None admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:11:56.180529 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d7f104-7f45-4a10-b6c6-e6ed46fbd7c4 None admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:11:56.180807 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d7f104-7f45-4a10-b6c6-e6ed46fbd7c4 None admin] PATH_INFO: `/v3/domains` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:11:56.181521 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d7f104-7f45-4a10-b6c6-e6ed46fbd7c4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 07:11:56.182453 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d7f104-7f45-4a10-b6c6-e6ed46fbd7c4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:11:56.183853 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d7f104-7f45-4a10-b6c6-e6ed46fbd7c4 None admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:11:56.199183 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 528/1067] 10.222.0.21 () {56 vars in 1109 bytes} [Wed May 4 07:11:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 07:11:56.201088 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d7f104-7f45-4a10-b6c6-e6ed46fbd7c4 None admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:11:56.253679 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 540/1068] 10.222.0.21 () {58 vars in 1282 bytes} [Wed May 4 07:11:55 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 04 07:11:56.259477 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a7e18e-2f25-4dd6-bec0-177d84b829bd None admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:11:56.297656 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d7f104-7f45-4a10-b6c6-e6ed46fbd7c4 None admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:11:56.333186 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746e5d3c-65ae-4310-bfe8-a96f6eceefb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:11:56.333995 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746e5d3c-65ae-4310-bfe8-a96f6eceefb7 None admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:11:56.334273 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746e5d3c-65ae-4310-bfe8-a96f6eceefb7 None admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:11:56.334544 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746e5d3c-65ae-4310-bfe8-a96f6eceefb7 None admin] PATH_INFO: `/v3/users/nova` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:11:56.342637 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746e5d3c-65ae-4310-bfe8-a96f6eceefb7 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:11:56.344205 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746e5d3c-65ae-4310-bfe8-a96f6eceefb7 None admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:11:56.358106 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a7e18e-2f25-4dd6-bec0-177d84b829bd None admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:11:56.360096 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application [None req-746e5d3c-65ae-4310-bfe8-a96f6eceefb7 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 04 07:11:56.360096 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 07:11:56.360096 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 07:11:56.360096 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 07:11:56.360096 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 07:11:56.360096 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 07:11:56.360096 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 07:11:56.360096 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 07:11:56.360096 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 07:11:56.360096 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 07:11:56.360096 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 07:11:56.360096 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 07:11:56.360096 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 04 07:11:56.360096 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self._get_user(user_id) May 04 07:11:56.360096 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 04 07:11:56.360096 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 04 07:11:56.361061 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 07:11:56.361061 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 07:11:56.361061 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 04 07:11:56.361061 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 07:11:56.361061 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 04 07:11:56.361061 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 07:11:56.361061 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 07:11:56.361061 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 07:11:56.361061 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 07:11:56.361061 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self.get_or_create( May 04 07:11:56.361061 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 07:11:56.361061 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application with Lock( May 04 07:11:56.361061 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 07:11:56.361061 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self._enter() May 04 07:11:56.361061 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 07:11:56.361061 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 07:11:56.361061 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 07:11:56.361061 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self.creator() May 04 07:11:56.362043 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 07:11:56.362043 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application created_value = creator( May 04 07:11:56.362043 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 04 07:11:56.362043 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 04 07:11:56.362043 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 04 07:11:56.362043 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 04 07:11:56.362043 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 04 07:11:56.362043 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 04 07:11:56.362043 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 04 07:11:56.362043 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application May 04 07:11:56.366162 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 529/1069] 10.222.0.21 () {56 vars in 1093 bytes} [Wed May 4 07:11:56 2022] GET /identity/v3/users/nova => generated 82 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 07:11:56.366826 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746e5d3c-65ae-4310-bfe8-a96f6eceefb7 None admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:11:56.391371 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17bbcab0-4b6c-4c12-95d2-93e60ce54862 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:11:56.392147 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bbcab0-4b6c-4c12-95d2-93e60ce54862 None admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:11:56.392423 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bbcab0-4b6c-4c12-95d2-93e60ce54862 None admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:11:56.392687 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bbcab0-4b6c-4c12-95d2-93e60ce54862 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:11:56.404446 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17bbcab0-4b6c-4c12-95d2-93e60ce54862 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:11:56.405918 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17bbcab0-4b6c-4c12-95d2-93e60ce54862 None admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:11:56.423721 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application [None req-17bbcab0-4b6c-4c12-95d2-93e60ce54862 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 07:11:56.423721 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 07:11:56.423721 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 07:11:56.423721 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 07:11:56.423721 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 07:11:56.423721 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 07:11:56.423721 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 07:11:56.423721 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 07:11:56.423721 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 07:11:56.423721 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 07:11:56.423721 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 07:11:56.423721 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 07:11:56.423721 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 07:11:56.423721 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 07:11:56.423721 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 07:11:56.424663 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 07:11:56.424663 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 07:11:56.424663 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 07:11:56.424663 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 07:11:56.424663 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 07:11:56.424663 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 07:11:56.424663 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.get_or_create( May 04 07:11:56.424663 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 07:11:56.424663 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application with Lock( May 04 07:11:56.424663 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 07:11:56.424663 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self._enter() May 04 07:11:56.424663 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 07:11:56.424663 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 07:11:56.424663 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 07:11:56.424663 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.creator() May 04 07:11:56.424663 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 07:11:56.424663 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application created_value = creator( May 04 07:11:56.425582 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 07:11:56.425582 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 07:11:56.425582 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 07:11:56.425582 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application May 04 07:11:56.425582 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 541/1070] 10.222.0.21 () {56 vars in 1108 bytes} [Wed May 4 07:11:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 07:11:56.430663 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17bbcab0-4b6c-4c12-95d2-93e60ce54862 None admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:11:56.466361 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746e5d3c-65ae-4310-bfe8-a96f6eceefb7 None admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:11:56.499170 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d18539-62e5-41e9-bec3-e44c88b216e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:11:56.499845 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d18539-62e5-41e9-bec3-e44c88b216e5 None admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:11:56.500127 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d18539-62e5-41e9-bec3-e44c88b216e5 None admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:11:56.500400 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d18539-62e5-41e9-bec3-e44c88b216e5 None admin] PATH_INFO: `/v3/users` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:11:56.501233 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d18539-62e5-41e9-bec3-e44c88b216e5 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 07:11:56.501548 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d18539-62e5-41e9-bec3-e44c88b216e5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:11:56.502996 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d18539-62e5-41e9-bec3-e44c88b216e5 None admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:11:56.524521 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 530/1071] 10.222.0.21 () {56 vars in 1133 bytes} [Wed May 4 07:11:56 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 07:11:56.524521 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948f95a5-eacd-41f7-929f-7778665c00df None None] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:11:56.524521 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948f95a5-eacd-41f7-929f-7778665c00df None None] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:11:56.524521 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948f95a5-eacd-41f7-929f-7778665c00df None None] PATH_INFO: `/` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:11:56.524521 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 531/1072] 10.222.0.21 () {54 vars in 926 bytes} [Wed May 4 07:11:56 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 07:11:56.526675 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948f95a5-eacd-41f7-929f-7778665c00df None None] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:11:56.531431 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17bbcab0-4b6c-4c12-95d2-93e60ce54862 None admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:11:56.563404 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee83da0e-69c7-47c4-a802-70a5d3e39572 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:11:56.564050 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee83da0e-69c7-47c4-a802-70a5d3e39572 None admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:11:56.564320 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee83da0e-69c7-47c4-a802-70a5d3e39572 None admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:11:56.564586 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee83da0e-69c7-47c4-a802-70a5d3e39572 None admin] PATH_INFO: `/v3/domains` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:11:56.565284 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee83da0e-69c7-47c4-a802-70a5d3e39572 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79744) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 07:11:56.565581 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee83da0e-69c7-47c4-a802-70a5d3e39572 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:11:56.566928 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee83da0e-69c7-47c4-a802-70a5d3e39572 None admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:11:56.577452 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 542/1073] 10.222.0.21 () {56 vars in 1109 bytes} [Wed May 4 07:11:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 07:11:56.578612 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffde6cce-06f1-400e-be51-05735e5487d8 None None] REQUEST_METHOD: `POST` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:11:56.578888 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffde6cce-06f1-400e-be51-05735e5487d8 None None] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:11:56.579167 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffde6cce-06f1-400e-be51-05735e5487d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:11:56.597021 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.auth.core [None req-ffde6cce-06f1-400e-be51-05735e5487d8 None None] MFA Rules not processed for user `83c5e0dcb991496ea6dee38384514508`. Rule list: `[]` (Enabled: `True`). {{(pid=79744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:11:56.598235 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.fernet_utils [None req-ffde6cce-06f1-400e-be51-05735e5487d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:11:56.628011 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948f95a5-eacd-41f7-929f-7778665c00df None None] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:11:56.665043 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47061a76-0b3c-4eed-8830-01915364b462 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:11:56.665836 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47061a76-0b3c-4eed-8830-01915364b462 None admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:11:56.666118 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47061a76-0b3c-4eed-8830-01915364b462 None admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:11:56.666425 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47061a76-0b3c-4eed-8830-01915364b462 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:11:56.672861 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 543/1074] 10.222.0.21 () {58 vars in 1023 bytes} [Wed May 4 07:11:56 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 07:11:56.678393 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47061a76-0b3c-4eed-8830-01915364b462 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:11:56.679897 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47061a76-0b3c-4eed-8830-01915364b462 None admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:11:56.695846 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffde6cce-06f1-400e-be51-05735e5487d8 None None] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:11:56.698954 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application [None req-47061a76-0b3c-4eed-8830-01915364b462 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 07:11:56.698954 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 07:11:56.698954 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 07:11:56.698954 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 07:11:56.698954 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 07:11:56.698954 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 07:11:56.698954 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 07:11:56.698954 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 07:11:56.698954 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 07:11:56.698954 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 07:11:56.698954 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 07:11:56.698954 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 07:11:56.698954 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 07:11:56.698954 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 07:11:56.698954 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 07:11:56.700071 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 07:11:56.700071 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 07:11:56.700071 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 07:11:56.700071 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 07:11:56.700071 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 07:11:56.700071 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 07:11:56.700071 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self.get_or_create( May 04 07:11:56.700071 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 07:11:56.700071 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application with Lock( May 04 07:11:56.700071 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 07:11:56.700071 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self._enter() May 04 07:11:56.700071 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 07:11:56.700071 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 07:11:56.700071 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 07:11:56.700071 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self.creator() May 04 07:11:56.700071 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 07:11:56.700071 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application created_value = creator( May 04 07:11:56.701119 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 07:11:56.701119 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 07:11:56.701119 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 07:11:56.701119 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application May 04 07:11:56.701119 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 532/1075] 10.222.0.21 () {56 vars in 1108 bytes} [Wed May 4 07:11:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 07:11:56.706237 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47061a76-0b3c-4eed-8830-01915364b462 None admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:11:56.802477 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffde6cce-06f1-400e-be51-05735e5487d8 None None] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:11:56.807881 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47061a76-0b3c-4eed-8830-01915364b462 None admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:11:56.839796 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c27c6ed-9652-4f23-aa01-8a40986d76f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:11:56.840709 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c27c6ed-9652-4f23-aa01-8a40986d76f6 None admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:11:56.840904 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c27c6ed-9652-4f23-aa01-8a40986d76f6 None admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:11:56.841118 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c27c6ed-9652-4f23-aa01-8a40986d76f6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:11:56.845548 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411f778b-44af-469e-af0d-813130b132fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:11:56.846217 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411f778b-44af-469e-af0d-813130b132fc None admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:11:56.846497 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411f778b-44af-469e-af0d-813130b132fc None admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:11:56.846767 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411f778b-44af-469e-af0d-813130b132fc None admin] PATH_INFO: `/v3/domains` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:11:56.847512 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411f778b-44af-469e-af0d-813130b132fc None admin] RBAC: Adding query filter params (name=Default) {{(pid=79745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 07:11:56.847817 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411f778b-44af-469e-af0d-813130b132fc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:11:56.849169 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411f778b-44af-469e-af0d-813130b132fc None admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:11:56.851584 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c27c6ed-9652-4f23-aa01-8a40986d76f6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 07:11:56.859833 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application [None req-6c27c6ed-9652-4f23-aa01-8a40986d76f6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 04 07:11:56.859833 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 07:11:56.859833 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 07:11:56.859833 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 07:11:56.859833 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 07:11:56.859833 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 07:11:56.859833 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 07:11:56.859833 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 07:11:56.859833 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 07:11:56.859833 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 07:11:56.859833 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 07:11:56.859833 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 07:11:56.859833 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 07:11:56.859833 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 07:11:56.859833 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 07:11:56.859833 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 07:11:56.860801 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 07:11:56.860801 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 07:11:56.860801 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 07:11:56.860801 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 07:11:56.860801 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 07:11:56.860801 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 07:11:56.860801 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 07:11:56.860801 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 07:11:56.860801 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 07:11:56.860801 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.get_or_create( May 04 07:11:56.860801 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 07:11:56.860801 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application with Lock( May 04 07:11:56.860801 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 07:11:56.860801 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self._enter() May 04 07:11:56.860801 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 07:11:56.860801 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 07:11:56.861692 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 07:11:56.861692 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.creator() May 04 07:11:56.861692 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 07:11:56.861692 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application created_value = creator( May 04 07:11:56.861692 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 07:11:56.861692 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 07:11:56.861692 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 07:11:56.861692 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 07:11:56.861692 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 07:11:56.861692 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 07:11:56.861692 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 04 07:11:56.861692 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application May 04 07:11:56.862343 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 533/1077] 10.222.0.21 () {56 vars in 1109 bytes} [Wed May 4 07:11:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 07:11:56.866560 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 544/1077] 10.222.0.21 () {56 vars in 1096 bytes} [Wed May 4 07:11:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 07:11:56.868597 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411f778b-44af-469e-af0d-813130b132fc None admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:11:56.872095 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c27c6ed-9652-4f23-aa01-8a40986d76f6 None admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:11:56.965118 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411f778b-44af-469e-af0d-813130b132fc None admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:11:56.965333 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c27c6ed-9652-4f23-aa01-8a40986d76f6 None admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:11:56.997260 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391101df-a6e6-4eb0-a71c-45a942bcacb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:11:56.998041 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0db2569-d15c-4415-a95f-36dc2df73335 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:11:56.998155 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391101df-a6e6-4eb0-a71c-45a942bcacb2 None admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:11:56.998311 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391101df-a6e6-4eb0-a71c-45a942bcacb2 None admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:11:56.998576 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391101df-a6e6-4eb0-a71c-45a942bcacb2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:11:56.998698 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0db2569-d15c-4415-a95f-36dc2df73335 None admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:11:56.998977 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0db2569-d15c-4415-a95f-36dc2df73335 None admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:11:56.999284 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0db2569-d15c-4415-a95f-36dc2df73335 None admin] PATH_INFO: `/v3/roles` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:11:57.000023 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0db2569-d15c-4415-a95f-36dc2df73335 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79744) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 07:11:57.000327 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0db2569-d15c-4415-a95f-36dc2df73335 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:11:57.001679 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0db2569-d15c-4415-a95f-36dc2df73335 None admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:11:57.004981 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391101df-a6e6-4eb0-a71c-45a942bcacb2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:11:57.006404 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391101df-a6e6-4eb0-a71c-45a942bcacb2 None admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:11:57.014663 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 545/1078] 10.222.0.21 () {56 vars in 1099 bytes} [Wed May 4 07:11:56 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 07:11:57.015637 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0db2569-d15c-4415-a95f-36dc2df73335 None admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:11:57.020595 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application [None req-391101df-a6e6-4eb0-a71c-45a942bcacb2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 04 07:11:57.020595 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 07:11:57.020595 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 07:11:57.020595 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 07:11:57.020595 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 07:11:57.020595 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 07:11:57.020595 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 07:11:57.020595 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 07:11:57.020595 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 07:11:57.020595 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 07:11:57.020595 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 07:11:57.020595 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 07:11:57.020595 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 04 07:11:57.020595 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self._get_project(project_id) May 04 07:11:57.020595 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 04 07:11:57.021663 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 04 07:11:57.021663 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 07:11:57.021663 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 07:11:57.021663 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 07:11:57.021663 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 07:11:57.021663 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 07:11:57.021663 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self.get_or_create( May 04 07:11:57.021663 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 07:11:57.021663 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application with Lock( May 04 07:11:57.021663 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 07:11:57.021663 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self._enter() May 04 07:11:57.021663 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 07:11:57.021663 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 07:11:57.021663 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 07:11:57.021663 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self.creator() May 04 07:11:57.021663 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 07:11:57.021663 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application created_value = creator( May 04 07:11:57.022599 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 04 07:11:57.022599 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 04 07:11:57.022599 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 04 07:11:57.022599 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 04 07:11:57.022599 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 04 07:11:57.022599 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 04 07:11:57.022599 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 04 07:11:57.022599 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application May 04 07:11:57.022599 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 534/1079] 10.222.0.21 () {56 vars in 1111 bytes} [Wed May 4 07:11:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 07:11:57.027423 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391101df-a6e6-4eb0-a71c-45a942bcacb2 None admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:11:57.108628 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0db2569-d15c-4415-a95f-36dc2df73335 None admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:11:57.121199 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391101df-a6e6-4eb0-a71c-45a942bcacb2 None admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:11:57.140516 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49e9c8d-eabd-471b-b8fb-b7a94451b02b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:11:57.141455 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49e9c8d-eabd-471b-b8fb-b7a94451b02b None admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:11:57.141726 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49e9c8d-eabd-471b-b8fb-b7a94451b02b None admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:11:57.141990 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49e9c8d-eabd-471b-b8fb-b7a94451b02b None admin] PATH_INFO: `/v3/users/2b470db170ae47b097a2602286b85c8c` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:11:57.143169 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49e9c8d-eabd-471b-b8fb-b7a94451b02b None admin] RBAC: Authorizing `identity:get_user(user_id=2b470db170ae47b097a2602286b85c8c)` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:11:57.144578 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49e9c8d-eabd-471b-b8fb-b7a94451b02b None admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:11:57.146180 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 546/1080] 10.222.0.21 () {56 vars in 1177 bytes} [Wed May 4 07:11:57 2022] GET /identity/v3/users/2b470db170ae47b097a2602286b85c8c => generated 285 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 07:11:57.152275 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49e9c8d-eabd-471b-b8fb-b7a94451b02b None admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:11:57.153634 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a7cda7-d616-430d-9e6f-6fc0e1ce053a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:11:57.154278 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a7cda7-d616-430d-9e6f-6fc0e1ce053a None admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:11:57.154548 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a7cda7-d616-430d-9e6f-6fc0e1ce053a None admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:11:57.154816 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a7cda7-d616-430d-9e6f-6fc0e1ce053a None admin] PATH_INFO: `/v3/projects` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:11:57.155618 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a7cda7-d616-430d-9e6f-6fc0e1ce053a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 07:11:57.155920 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a7cda7-d616-430d-9e6f-6fc0e1ce053a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:11:57.157328 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a7cda7-d616-430d-9e6f-6fc0e1ce053a None admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:11:57.168253 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 535/1081] 10.222.0.21 () {56 vars in 1148 bytes} [Wed May 4 07:11:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 07:11:57.174158 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a7cda7-d616-430d-9e6f-6fc0e1ce053a None admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:11:57.248243 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49e9c8d-eabd-471b-b8fb-b7a94451b02b None admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:11:57.270411 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a7cda7-d616-430d-9e6f-6fc0e1ce053a None admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:11:57.280340 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5facc26-deec-40c6-b1bf-099787b108ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:11:57.281180 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5facc26-deec-40c6-b1bf-099787b108ef None admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:11:57.281460 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5facc26-deec-40c6-b1bf-099787b108ef None admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:11:57.281728 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5facc26-deec-40c6-b1bf-099787b108ef None admin] PATH_INFO: `/v3/projects/6321bcb50618432f92223ac198d8e705` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:11:57.282876 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5facc26-deec-40c6-b1bf-099787b108ef None admin] RBAC: Authorizing `identity:get_project(project_id=6321bcb50618432f92223ac198d8e705)` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:11:57.284326 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5facc26-deec-40c6-b1bf-099787b108ef None admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:11:57.286002 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 547/1082] 10.222.0.21 () {56 vars in 1186 bytes} [Wed May 4 07:11:57 2022] GET /identity/v3/projects/6321bcb50618432f92223ac198d8e705 => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 07:11:57.291958 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5facc26-deec-40c6-b1bf-099787b108ef None admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:11:57.302546 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7958bd7-8e71-46a7-84f5-625545d01a67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:11:57.303452 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7958bd7-8e71-46a7-84f5-625545d01a67 None admin] REQUEST_METHOD: `PUT` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:11:57.303728 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7958bd7-8e71-46a7-84f5-625545d01a67 None admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:11:57.303995 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7958bd7-8e71-46a7-84f5-625545d01a67 None admin] PATH_INFO: `/v3/projects/c9f9c44db4984653b8d4b5f6b3b949f5/users/1077289fedae43b6be47be7f716d573a/roles/ad15e59c437846a4897f5821fc039560` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:11:57.306160 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7958bd7-8e71-46a7-84f5-625545d01a67 None admin] RBAC: Authorizing `identity:create_grant(project_id=c9f9c44db4984653b8d4b5f6b3b949f5, user_id=1077289fedae43b6be47be7f716d573a, role_id=ad15e59c437846a4897f5821fc039560)` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:11:57.308256 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7958bd7-8e71-46a7-84f5-625545d01a67 None admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:11:57.320538 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 536/1083] 10.222.0.21 () {58 vars in 1439 bytes} [Wed May 4 07:11:57 2022] PUT /identity/v3/projects/c9f9c44db4984653b8d4b5f6b3b949f5/users/1077289fedae43b6be47be7f716d573a/roles/ad15e59c437846a4897f5821fc039560 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 07:11:57.394816 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5facc26-deec-40c6-b1bf-099787b108ef None admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:11:57.428625 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a8efd5-8c87-46c0-ba68-f86d12df789e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:11:57.429519 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a8efd5-8c87-46c0-ba68-f86d12df789e None admin] REQUEST_METHOD: `PUT` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:11:57.429787 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a8efd5-8c87-46c0-ba68-f86d12df789e None admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:11:57.430052 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a8efd5-8c87-46c0-ba68-f86d12df789e None admin] PATH_INFO: `/v3/projects/6321bcb50618432f92223ac198d8e705/users/2b470db170ae47b097a2602286b85c8c/roles/eb54c9cea2774a25b1fe8c79724408ee` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:11:57.432816 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a8efd5-8c87-46c0-ba68-f86d12df789e None admin] RBAC: Authorizing `identity:create_grant(project_id=6321bcb50618432f92223ac198d8e705, user_id=2b470db170ae47b097a2602286b85c8c, role_id=eb54c9cea2774a25b1fe8c79724408ee)` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:11:57.434257 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a8efd5-8c87-46c0-ba68-f86d12df789e None admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:11:57.448982 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 548/1084] 10.222.0.21 () {58 vars in 1439 bytes} [Wed May 4 07:11:57 2022] PUT /identity/v3/projects/6321bcb50618432f92223ac198d8e705/users/2b470db170ae47b097a2602286b85c8c/roles/eb54c9cea2774a25b1fe8c79724408ee => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 07:11:59.575142 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915bfdbe-bd51-459b-8c47-ac0c87ac71dd None None] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:11:59.575680 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915bfdbe-bd51-459b-8c47-ac0c87ac71dd None None] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:11:59.575806 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915bfdbe-bd51-459b-8c47-ac0c87ac71dd None None] PATH_INFO: `/` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:11:59.577061 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 537/1085] 10.222.0.21 () {54 vars in 926 bytes} [Wed May 4 07:11:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 07:11:59.582316 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde94ef3-bbaf-43a0-a4cb-6fc84ab027eb None None] REQUEST_METHOD: `POST` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:11:59.582760 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde94ef3-bbaf-43a0-a4cb-6fc84ab027eb None None] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:11:59.582934 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde94ef3-bbaf-43a0-a4cb-6fc84ab027eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:11:59.599702 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.auth.core [None req-dde94ef3-bbaf-43a0-a4cb-6fc84ab027eb None None] MFA Rules not processed for user `83c5e0dcb991496ea6dee38384514508`. Rule list: `[]` (Enabled: `True`). {{(pid=79744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:11:59.600873 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.fernet_utils [None req-dde94ef3-bbaf-43a0-a4cb-6fc84ab027eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:11:59.664952 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 549/1086] 10.222.0.21 () {58 vars in 1023 bytes} [Wed May 4 07:11:59 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 07:11:59.673867 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1692dd8-f981-4935-b848-eed0845d347f None None] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:11:59.674148 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1692dd8-f981-4935-b848-eed0845d347f None None] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:11:59.674417 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1692dd8-f981-4935-b848-eed0845d347f None None] PATH_INFO: `/` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:11:59.675858 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 538/1087] 10.222.0.21 () {54 vars in 926 bytes} [Wed May 4 07:11:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 07:11:59.680878 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34da0de-a69b-4950-9f5a-f05d9c18241c None None] REQUEST_METHOD: `POST` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:11:59.681167 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34da0de-a69b-4950-9f5a-f05d9c18241c None None] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:11:59.681444 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34da0de-a69b-4950-9f5a-f05d9c18241c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:11:59.689216 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1692dd8-f981-4935-b848-eed0845d347f None None] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:11:59.698216 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.auth.core [None req-d34da0de-a69b-4950-9f5a-f05d9c18241c None None] MFA Rules not processed for user `83c5e0dcb991496ea6dee38384514508`. Rule list: `[]` (Enabled: `True`). {{(pid=79744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:11:59.699414 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.fernet_utils [None req-d34da0de-a69b-4950-9f5a-f05d9c18241c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:11:59.762213 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 550/1088] 10.222.0.21 () {58 vars in 1023 bytes} [Wed May 4 07:11:59 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 07:11:59.785089 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1692dd8-f981-4935-b848-eed0845d347f None None] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:11:59.785491 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34da0de-a69b-4950-9f5a-f05d9c18241c None None] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:11:59.816467 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557aa2bb-adfa-4e35-a209-75901e6d43c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:11:59.817256 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557aa2bb-adfa-4e35-a209-75901e6d43c3 None admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:11:59.817530 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557aa2bb-adfa-4e35-a209-75901e6d43c3 None admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:11:59.817799 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557aa2bb-adfa-4e35-a209-75901e6d43c3 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:11:59.827972 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557aa2bb-adfa-4e35-a209-75901e6d43c3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 07:11:59.835928 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application [None req-557aa2bb-adfa-4e35-a209-75901e6d43c3 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 04 07:11:59.835928 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 07:11:59.835928 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 07:11:59.835928 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 07:11:59.835928 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 07:11:59.835928 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 07:11:59.835928 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 07:11:59.835928 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 07:11:59.835928 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 07:11:59.835928 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 07:11:59.835928 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 07:11:59.835928 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 07:11:59.835928 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 07:11:59.835928 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 07:11:59.835928 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 07:11:59.835928 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 07:11:59.836863 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 07:11:59.836863 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 07:11:59.836863 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 07:11:59.836863 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 07:11:59.836863 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 07:11:59.836863 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 07:11:59.836863 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 07:11:59.836863 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 07:11:59.836863 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 07:11:59.836863 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self.get_or_create( May 04 07:11:59.836863 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 07:11:59.836863 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application with Lock( May 04 07:11:59.836863 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 07:11:59.836863 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self._enter() May 04 07:11:59.836863 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 07:11:59.836863 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 07:11:59.843398 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 07:11:59.843398 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self.creator() May 04 07:11:59.843398 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 07:11:59.843398 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application created_value = creator( May 04 07:11:59.843398 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 07:11:59.843398 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 07:11:59.843398 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 07:11:59.843398 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 07:11:59.843398 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 07:11:59.843398 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 07:11:59.843398 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 04 07:11:59.843398 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application May 04 07:11:59.843398 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 539/1089] 10.222.0.21 () {56 vars in 1120 bytes} [Wed May 4 07:11:59 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 07:11:59.844139 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557aa2bb-adfa-4e35-a209-75901e6d43c3 None admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:11:59.876978 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34da0de-a69b-4950-9f5a-f05d9c18241c None None] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:11:59.908950 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94716a9-ce0d-4db2-ab1e-aa90fdc8c614 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:11:59.909738 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94716a9-ce0d-4db2-ab1e-aa90fdc8c614 None admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:11:59.910015 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94716a9-ce0d-4db2-ab1e-aa90fdc8c614 None admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:11:59.910286 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94716a9-ce0d-4db2-ab1e-aa90fdc8c614 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:11:59.920635 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94716a9-ce0d-4db2-ab1e-aa90fdc8c614 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 07:11:59.928171 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application [None req-e94716a9-ce0d-4db2-ab1e-aa90fdc8c614 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 04 07:11:59.928171 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 07:11:59.928171 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 07:11:59.928171 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 07:11:59.928171 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 07:11:59.928171 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 07:11:59.928171 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 07:11:59.928171 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 07:11:59.928171 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 07:11:59.928171 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 07:11:59.928171 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 07:11:59.928171 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 07:11:59.928171 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 07:11:59.928171 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 07:11:59.928171 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 07:11:59.928171 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 07:11:59.929266 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 07:11:59.929266 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 07:11:59.929266 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 07:11:59.929266 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 07:11:59.929266 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 07:11:59.929266 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 07:11:59.929266 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 07:11:59.929266 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 07:11:59.929266 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 07:11:59.929266 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.get_or_create( May 04 07:11:59.929266 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 07:11:59.929266 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application with Lock( May 04 07:11:59.929266 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 07:11:59.929266 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self._enter() May 04 07:11:59.929266 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 07:11:59.929266 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 07:11:59.930152 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 07:11:59.930152 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.creator() May 04 07:11:59.930152 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 07:11:59.930152 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application created_value = creator( May 04 07:11:59.930152 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 07:11:59.930152 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 07:11:59.930152 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 07:11:59.930152 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 07:11:59.930152 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 07:11:59.930152 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 07:11:59.930152 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 04 07:11:59.930152 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application May 04 07:11:59.930152 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 551/1090] 10.222.0.21 () {56 vars in 1096 bytes} [Wed May 4 07:11:59 2022] GET /identity/v3/roles/admin => generated 83 bytes in 144 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 07:11:59.936019 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94716a9-ce0d-4db2-ab1e-aa90fdc8c614 None admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:11:59.939376 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557aa2bb-adfa-4e35-a209-75901e6d43c3 None admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:11:59.970452 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7b3cf2-1c6f-4a39-b928-a00c37708fe9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:11:59.971100 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7b3cf2-1c6f-4a39-b928-a00c37708fe9 None admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:11:59.971396 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7b3cf2-1c6f-4a39-b928-a00c37708fe9 None admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:11:59.971662 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7b3cf2-1c6f-4a39-b928-a00c37708fe9 None admin] PATH_INFO: `/v3/roles` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:11:59.972420 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7b3cf2-1c6f-4a39-b928-a00c37708fe9 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 07:11:59.972720 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7b3cf2-1c6f-4a39-b928-a00c37708fe9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:11:59.974128 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7b3cf2-1c6f-4a39-b928-a00c37708fe9 None admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:11:59.982381 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 540/1091] 10.222.0.21 () {56 vars in 1115 bytes} [Wed May 4 07:11:59 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 07:11:59.987931 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7b3cf2-1c6f-4a39-b928-a00c37708fe9 None admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:12:00.038469 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94716a9-ce0d-4db2-ab1e-aa90fdc8c614 None admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:12:00.072332 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f49738-3b02-48f7-b691-d545fc6453fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:12:00.072988 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f49738-3b02-48f7-b691-d545fc6453fc None admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:12:00.073262 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f49738-3b02-48f7-b691-d545fc6453fc None admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:12:00.073525 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f49738-3b02-48f7-b691-d545fc6453fc None admin] PATH_INFO: `/v3/roles` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:12:00.074249 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f49738-3b02-48f7-b691-d545fc6453fc None admin] RBAC: Adding query filter params (name=admin) {{(pid=79744) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 07:12:00.074546 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f49738-3b02-48f7-b691-d545fc6453fc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:12:00.075916 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f49738-3b02-48f7-b691-d545fc6453fc None admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:12:00.081151 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7b3cf2-1c6f-4a39-b928-a00c37708fe9 None admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:12:00.083526 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 552/1092] 10.222.0.21 () {56 vars in 1099 bytes} [Wed May 4 07:11:59 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 07:12:00.089724 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f49738-3b02-48f7-b691-d545fc6453fc None admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:12:00.112748 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b55a323-3a1b-4153-973d-2e0a2f879fa2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:12:00.113523 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b55a323-3a1b-4153-973d-2e0a2f879fa2 None admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:12:00.113799 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b55a323-3a1b-4153-973d-2e0a2f879fa2 None admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:12:00.114065 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b55a323-3a1b-4153-973d-2e0a2f879fa2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:12:00.124540 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b55a323-3a1b-4153-973d-2e0a2f879fa2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:12:00.125955 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b55a323-3a1b-4153-973d-2e0a2f879fa2 None admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:12:00.142959 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application [None req-7b55a323-3a1b-4153-973d-2e0a2f879fa2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 07:12:00.142959 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 07:12:00.142959 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 07:12:00.142959 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 07:12:00.142959 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 07:12:00.142959 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 07:12:00.142959 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 07:12:00.142959 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 07:12:00.142959 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 07:12:00.142959 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 07:12:00.142959 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 07:12:00.142959 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 07:12:00.142959 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 07:12:00.142959 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 07:12:00.142959 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 07:12:00.144094 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 07:12:00.144094 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 07:12:00.144094 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 07:12:00.144094 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 07:12:00.144094 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 07:12:00.144094 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 07:12:00.144094 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self.get_or_create( May 04 07:12:00.144094 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 07:12:00.144094 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application with Lock( May 04 07:12:00.144094 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 07:12:00.144094 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self._enter() May 04 07:12:00.144094 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 07:12:00.144094 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 07:12:00.144094 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 07:12:00.144094 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self.creator() May 04 07:12:00.144094 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 07:12:00.144094 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application created_value = creator( May 04 07:12:00.145216 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 07:12:00.145216 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 07:12:00.145216 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 07:12:00.145216 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application May 04 07:12:00.145216 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 541/1093] 10.222.0.21 () {56 vars in 1108 bytes} [Wed May 4 07:11:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 07:12:00.149756 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b55a323-3a1b-4153-973d-2e0a2f879fa2 None admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:12:00.186023 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f49738-3b02-48f7-b691-d545fc6453fc None admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:12:00.217527 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd077869-cc5c-4349-b1fd-3ea0a6ff4c6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:12:00.218381 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd077869-cc5c-4349-b1fd-3ea0a6ff4c6b None admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:12:00.218660 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd077869-cc5c-4349-b1fd-3ea0a6ff4c6b None admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:12:00.218930 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd077869-cc5c-4349-b1fd-3ea0a6ff4c6b None admin] PATH_INFO: `/v3/users/2b470db170ae47b097a2602286b85c8c` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:12:00.220140 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd077869-cc5c-4349-b1fd-3ea0a6ff4c6b None admin] RBAC: Authorizing `identity:get_user(user_id=2b470db170ae47b097a2602286b85c8c)` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:12:00.221557 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd077869-cc5c-4349-b1fd-3ea0a6ff4c6b None admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:12:00.223168 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 553/1094] 10.222.0.21 () {56 vars in 1177 bytes} [Wed May 4 07:12:00 2022] GET /identity/v3/users/2b470db170ae47b097a2602286b85c8c => generated 285 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 07:12:00.228748 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd077869-cc5c-4349-b1fd-3ea0a6ff4c6b None admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:12:00.243713 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b55a323-3a1b-4153-973d-2e0a2f879fa2 None admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:12:00.277876 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeaf9880-bd34-4081-9ade-65d8b84a2547 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:12:00.278537 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeaf9880-bd34-4081-9ade-65d8b84a2547 None admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:12:00.278815 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeaf9880-bd34-4081-9ade-65d8b84a2547 None admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:12:00.279089 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeaf9880-bd34-4081-9ade-65d8b84a2547 None admin] PATH_INFO: `/v3/domains` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:12:00.279862 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeaf9880-bd34-4081-9ade-65d8b84a2547 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 07:12:00.280169 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeaf9880-bd34-4081-9ade-65d8b84a2547 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:12:00.281528 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeaf9880-bd34-4081-9ade-65d8b84a2547 None admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:12:00.292908 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 542/1095] 10.222.0.21 () {56 vars in 1109 bytes} [Wed May 4 07:12:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 07:12:00.298358 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeaf9880-bd34-4081-9ade-65d8b84a2547 None admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:12:00.325923 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd077869-cc5c-4349-b1fd-3ea0a6ff4c6b None admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:12:00.357287 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2880279c-75a6-44d1-9ca5-7652d242a602 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:12:00.357925 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2880279c-75a6-44d1-9ca5-7652d242a602 None admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:12:00.358203 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2880279c-75a6-44d1-9ca5-7652d242a602 None admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:12:00.358473 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2880279c-75a6-44d1-9ca5-7652d242a602 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:12:00.391589 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeaf9880-bd34-4081-9ade-65d8b84a2547 None admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:12:00.421500 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2880279c-75a6-44d1-9ca5-7652d242a602 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:12:00.422941 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2880279c-75a6-44d1-9ca5-7652d242a602 None admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:12:00.423066 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc804e5-c600-423d-ac8e-5df0d460add6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:12:00.423754 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc804e5-c600-423d-ac8e-5df0d460add6 None admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:12:00.424037 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc804e5-c600-423d-ac8e-5df0d460add6 None admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:12:00.424312 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc804e5-c600-423d-ac8e-5df0d460add6 None admin] PATH_INFO: `/v3/users/nova` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:12:00.431279 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc804e5-c600-423d-ac8e-5df0d460add6 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:12:00.433433 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc804e5-c600-423d-ac8e-5df0d460add6 None admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:12:00.448043 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application [None req-2fc804e5-c600-423d-ac8e-5df0d460add6 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 04 07:12:00.448043 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 07:12:00.448043 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 07:12:00.448043 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 07:12:00.448043 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 07:12:00.448043 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 07:12:00.448043 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 07:12:00.448043 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 07:12:00.448043 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 07:12:00.448043 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 07:12:00.448043 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 07:12:00.448043 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 07:12:00.448043 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 04 07:12:00.448043 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self._get_user(user_id) May 04 07:12:00.448043 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 04 07:12:00.448043 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 04 07:12:00.449279 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 07:12:00.449279 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 07:12:00.449279 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 04 07:12:00.449279 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 07:12:00.449279 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 04 07:12:00.449279 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 07:12:00.449279 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 07:12:00.449279 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 07:12:00.449279 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 07:12:00.449279 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self.get_or_create( May 04 07:12:00.449279 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 07:12:00.449279 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application with Lock( May 04 07:12:00.449279 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 07:12:00.449279 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self._enter() May 04 07:12:00.449279 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 07:12:00.449279 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 07:12:00.449279 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 07:12:00.449279 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self.creator() May 04 07:12:00.450731 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 07:12:00.450731 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application created_value = creator( May 04 07:12:00.450731 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 04 07:12:00.450731 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 04 07:12:00.450731 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 04 07:12:00.450731 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 04 07:12:00.450731 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 04 07:12:00.450731 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 04 07:12:00.450731 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 04 07:12:00.450731 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application May 04 07:12:00.453902 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 543/1096] 10.222.0.21 () {56 vars in 1093 bytes} [Wed May 4 07:12:00 2022] GET /identity/v3/users/nova => generated 82 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 07:12:00.454782 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc804e5-c600-423d-ac8e-5df0d460add6 None admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:12:00.518146 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 554/1097] 10.222.0.21 () {58 vars in 1282 bytes} [Wed May 4 07:12:00 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 04 07:12:00.523862 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2880279c-75a6-44d1-9ca5-7652d242a602 None admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:12:00.548061 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc804e5-c600-423d-ac8e-5df0d460add6 None admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:12:00.580017 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df32277-8c23-40fd-9467-7608763b34bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:12:00.580674 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df32277-8c23-40fd-9467-7608763b34bd None admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:12:00.580952 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df32277-8c23-40fd-9467-7608763b34bd None admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:12:00.581226 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df32277-8c23-40fd-9467-7608763b34bd None admin] PATH_INFO: `/v3/users` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:12:00.582047 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df32277-8c23-40fd-9467-7608763b34bd None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 07:12:00.582353 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df32277-8c23-40fd-9467-7608763b34bd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:12:00.583813 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df32277-8c23-40fd-9467-7608763b34bd None admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:12:00.600534 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 544/1098] 10.222.0.21 () {56 vars in 1133 bytes} [Wed May 4 07:12:00 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 07:12:00.606488 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df32277-8c23-40fd-9467-7608763b34bd None admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:12:00.615276 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2880279c-75a6-44d1-9ca5-7652d242a602 None admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:12:00.647668 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73bf71d4-d6c7-4ad4-a207-54b0a456dc70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:12:00.648509 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bf71d4-d6c7-4ad4-a207-54b0a456dc70 None admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:12:00.648783 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bf71d4-d6c7-4ad4-a207-54b0a456dc70 None admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:12:00.649049 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bf71d4-d6c7-4ad4-a207-54b0a456dc70 None admin] PATH_INFO: `/v3/projects/6321bcb50618432f92223ac198d8e705` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:12:00.650202 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73bf71d4-d6c7-4ad4-a207-54b0a456dc70 None admin] RBAC: Authorizing `identity:get_project(project_id=6321bcb50618432f92223ac198d8e705)` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:12:00.651710 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73bf71d4-d6c7-4ad4-a207-54b0a456dc70 None admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:12:00.653411 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 555/1099] 10.222.0.21 () {56 vars in 1186 bytes} [Wed May 4 07:12:00 2022] GET /identity/v3/projects/6321bcb50618432f92223ac198d8e705 => generated 311 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 07:12:00.659612 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73bf71d4-d6c7-4ad4-a207-54b0a456dc70 None admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:12:00.701264 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df32277-8c23-40fd-9467-7608763b34bd None admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:12:00.732761 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45b7ca7-0fce-41fe-ad7b-01f8b148bbaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:12:00.733394 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45b7ca7-0fce-41fe-ad7b-01f8b148bbaa None admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:12:00.733672 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45b7ca7-0fce-41fe-ad7b-01f8b148bbaa None admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:12:00.733944 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45b7ca7-0fce-41fe-ad7b-01f8b148bbaa None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:12:00.752093 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73bf71d4-d6c7-4ad4-a207-54b0a456dc70 None admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:12:00.783119 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94d2e45-2be3-4171-8e00-3145e7105718 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:12:00.783776 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94d2e45-2be3-4171-8e00-3145e7105718 None admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:12:00.784057 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94d2e45-2be3-4171-8e00-3145e7105718 None admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:12:00.784320 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94d2e45-2be3-4171-8e00-3145e7105718 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:12:00.785127 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94d2e45-2be3-4171-8e00-3145e7105718 None admin] RBAC: Adding query filter params (role.id=eb54c9cea2774a25b1fe8c79724408ee, scope.project.id=6321bcb50618432f92223ac198d8e705, user.id=2b470db170ae47b097a2602286b85c8c) {{(pid=79744) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 07:12:00.785430 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94d2e45-2be3-4171-8e00-3145e7105718 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:12:00.786842 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94d2e45-2be3-4171-8e00-3145e7105718 None admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:12:00.792890 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 556/1100] 10.222.0.21 () {56 vars in 1374 bytes} [Wed May 4 07:12:00 2022] GET /identity/v3/role_assignments?user.id=2b470db170ae47b097a2602286b85c8c&scope.project.id=6321bcb50618432f92223ac198d8e705&role.id=eb54c9cea2774a25b1fe8c79724408ee => generated 608 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 07:12:00.796826 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45b7ca7-0fce-41fe-ad7b-01f8b148bbaa None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:12:00.798363 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45b7ca7-0fce-41fe-ad7b-01f8b148bbaa None admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:12:00.900277 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 545/1101] 10.222.0.21 () {58 vars in 1282 bytes} [Wed May 4 07:12:00 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 04 07:12:00.906667 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94d2e45-2be3-4171-8e00-3145e7105718 None admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:12:01.005660 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94d2e45-2be3-4171-8e00-3145e7105718 None admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:12:01.038895 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feff1aa5-0e39-4749-8e44-0a98eda3f817 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:12:01.039704 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feff1aa5-0e39-4749-8e44-0a98eda3f817 None admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:12:01.039982 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feff1aa5-0e39-4749-8e44-0a98eda3f817 None admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:12:01.040250 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feff1aa5-0e39-4749-8e44-0a98eda3f817 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:12:01.050762 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feff1aa5-0e39-4749-8e44-0a98eda3f817 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:12:01.052223 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feff1aa5-0e39-4749-8e44-0a98eda3f817 None admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:12:01.072992 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application [None req-feff1aa5-0e39-4749-8e44-0a98eda3f817 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 07:12:01.072992 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 07:12:01.072992 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 07:12:01.072992 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 07:12:01.072992 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 07:12:01.072992 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 07:12:01.072992 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 07:12:01.072992 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 07:12:01.072992 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 07:12:01.072992 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 07:12:01.072992 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 07:12:01.072992 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 07:12:01.072992 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 07:12:01.072992 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 07:12:01.072992 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 07:12:01.074328 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 07:12:01.074328 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 07:12:01.074328 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 07:12:01.074328 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 07:12:01.074328 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 07:12:01.074328 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 07:12:01.074328 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.get_or_create( May 04 07:12:01.074328 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 07:12:01.074328 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application with Lock( May 04 07:12:01.074328 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 07:12:01.074328 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self._enter() May 04 07:12:01.074328 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 07:12:01.074328 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 07:12:01.074328 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 07:12:01.074328 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.creator() May 04 07:12:01.074328 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 07:12:01.074328 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application created_value = creator( May 04 07:12:01.075365 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 07:12:01.075365 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 07:12:01.075365 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 07:12:01.075365 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application May 04 07:12:01.075365 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 557/1102] 10.222.0.21 () {56 vars in 1108 bytes} [Wed May 4 07:12:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 07:12:01.079986 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45b7ca7-0fce-41fe-ad7b-01f8b148bbaa None admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:12:01.172921 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45b7ca7-0fce-41fe-ad7b-01f8b148bbaa None admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:12:01.205545 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6e95e2-028f-47fc-8f73-d1bb6bf69a13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:12:01.206200 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6e95e2-028f-47fc-8f73-d1bb6bf69a13 None admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:12:01.206479 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6e95e2-028f-47fc-8f73-d1bb6bf69a13 None admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:12:01.206753 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6e95e2-028f-47fc-8f73-d1bb6bf69a13 None admin] PATH_INFO: `/v3/domains` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:12:01.207492 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6e95e2-028f-47fc-8f73-d1bb6bf69a13 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 07:12:01.207797 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6e95e2-028f-47fc-8f73-d1bb6bf69a13 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:12:01.209163 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6e95e2-028f-47fc-8f73-d1bb6bf69a13 None admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:12:01.220505 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 546/1103] 10.222.0.21 () {56 vars in 1109 bytes} [Wed May 4 07:12:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 07:12:01.226188 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feff1aa5-0e39-4749-8e44-0a98eda3f817 None admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:12:01.321011 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feff1aa5-0e39-4749-8e44-0a98eda3f817 None admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:12:01.354053 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456fbb35-9116-478f-b588-efd9c7cd64e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:12:01.355007 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456fbb35-9116-478f-b588-efd9c7cd64e2 None admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:12:01.355328 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456fbb35-9116-478f-b588-efd9c7cd64e2 None admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:12:01.355602 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456fbb35-9116-478f-b588-efd9c7cd64e2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:12:01.362049 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456fbb35-9116-478f-b588-efd9c7cd64e2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:12:01.363519 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456fbb35-9116-478f-b588-efd9c7cd64e2 None admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:12:01.377445 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application [None req-456fbb35-9116-478f-b588-efd9c7cd64e2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 04 07:12:01.377445 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 07:12:01.377445 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 07:12:01.377445 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 07:12:01.377445 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 07:12:01.377445 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 07:12:01.377445 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 07:12:01.377445 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 07:12:01.377445 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 07:12:01.377445 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 07:12:01.377445 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 07:12:01.377445 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 07:12:01.377445 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 04 07:12:01.377445 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self._get_project(project_id) May 04 07:12:01.377445 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 04 07:12:01.378550 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 04 07:12:01.378550 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 07:12:01.378550 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 07:12:01.378550 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 07:12:01.378550 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 07:12:01.378550 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 07:12:01.378550 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.get_or_create( May 04 07:12:01.378550 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 07:12:01.378550 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application with Lock( May 04 07:12:01.378550 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 07:12:01.378550 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self._enter() May 04 07:12:01.378550 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 07:12:01.378550 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 07:12:01.378550 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 07:12:01.378550 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.creator() May 04 07:12:01.378550 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 07:12:01.378550 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application created_value = creator( May 04 07:12:01.379897 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 04 07:12:01.379897 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 04 07:12:01.379897 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 04 07:12:01.379897 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 04 07:12:01.379897 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 04 07:12:01.379897 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 04 07:12:01.379897 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 04 07:12:01.379897 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application May 04 07:12:01.379897 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 558/1104] 10.222.0.21 () {56 vars in 1111 bytes} [Wed May 4 07:12:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 07:12:01.384710 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6e95e2-028f-47fc-8f73-d1bb6bf69a13 None admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:12:01.479523 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6e95e2-028f-47fc-8f73-d1bb6bf69a13 None admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:12:01.511501 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7b63af-797b-4525-a6ba-b14782f4b265 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:12:01.512156 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7b63af-797b-4525-a6ba-b14782f4b265 None admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:12:01.512434 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7b63af-797b-4525-a6ba-b14782f4b265 None admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:12:01.512705 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7b63af-797b-4525-a6ba-b14782f4b265 None admin] PATH_INFO: `/v3/projects` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:12:01.513479 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7b63af-797b-4525-a6ba-b14782f4b265 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 07:12:01.513784 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7b63af-797b-4525-a6ba-b14782f4b265 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:12:01.515221 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7b63af-797b-4525-a6ba-b14782f4b265 None admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:12:01.527584 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 547/1105] 10.222.0.21 () {56 vars in 1148 bytes} [Wed May 4 07:12:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 07:12:01.533529 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456fbb35-9116-478f-b588-efd9c7cd64e2 None admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:12:01.627465 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456fbb35-9116-478f-b588-efd9c7cd64e2 None admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:12:01.662497 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11cf47a6-9699-4aa8-a7ab-039f9498bc09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:12:01.663167 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cf47a6-9699-4aa8-a7ab-039f9498bc09 None admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:12:01.663454 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cf47a6-9699-4aa8-a7ab-039f9498bc09 None admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:12:01.663722 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cf47a6-9699-4aa8-a7ab-039f9498bc09 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:12:01.664546 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11cf47a6-9699-4aa8-a7ab-039f9498bc09 None admin] RBAC: Adding query filter params (role.id=ad15e59c437846a4897f5821fc039560, scope.project.id=c9f9c44db4984653b8d4b5f6b3b949f5, user.id=1077289fedae43b6be47be7f716d573a) {{(pid=79744) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 07:12:01.664853 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11cf47a6-9699-4aa8-a7ab-039f9498bc09 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:12:01.666330 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11cf47a6-9699-4aa8-a7ab-039f9498bc09 None admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:12:01.673931 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 559/1106] 10.222.0.21 () {56 vars in 1374 bytes} [Wed May 4 07:12:01 2022] GET /identity/v3/role_assignments?user.id=1077289fedae43b6be47be7f716d573a&scope.project.id=c9f9c44db4984653b8d4b5f6b3b949f5&role.id=ad15e59c437846a4897f5821fc039560 => generated 608 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 07:12:03.076003 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26aea88b-90ee-41f1-9736-d4e818e99f6b None None] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:12:03.076555 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26aea88b-90ee-41f1-9736-d4e818e99f6b None None] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:12:03.076555 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26aea88b-90ee-41f1-9736-d4e818e99f6b None None] PATH_INFO: `/` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:12:03.077888 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 548/1107] 10.222.0.21 () {54 vars in 926 bytes} [Wed May 4 07:12:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 07:12:03.083011 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a849c4e7-0005-4431-85b7-a4300c03968c None None] REQUEST_METHOD: `POST` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:12:03.083441 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a849c4e7-0005-4431-85b7-a4300c03968c None None] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:12:03.083581 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a849c4e7-0005-4431-85b7-a4300c03968c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:12:03.100049 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.auth.core [None req-a849c4e7-0005-4431-85b7-a4300c03968c None None] MFA Rules not processed for user `83c5e0dcb991496ea6dee38384514508`. Rule list: `[]` (Enabled: `True`). {{(pid=79744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:12:03.101203 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.fernet_utils [None req-a849c4e7-0005-4431-85b7-a4300c03968c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:12:03.162368 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 560/1108] 10.222.0.21 () {58 vars in 1023 bytes} [Wed May 4 07:12:03 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 07:12:03.186708 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26aea88b-90ee-41f1-9736-d4e818e99f6b None None] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:12:03.284773 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26aea88b-90ee-41f1-9736-d4e818e99f6b None None] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:12:03.316776 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684c7f52-b2e2-4cc8-843a-e781c9a59ad9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:12:03.317540 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684c7f52-b2e2-4cc8-843a-e781c9a59ad9 None admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:12:03.317814 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684c7f52-b2e2-4cc8-843a-e781c9a59ad9 None admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:12:03.318081 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684c7f52-b2e2-4cc8-843a-e781c9a59ad9 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:12:03.319250 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684c7f52-b2e2-4cc8-843a-e781c9a59ad9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:12:03.320667 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684c7f52-b2e2-4cc8-843a-e781c9a59ad9 None admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:12:03.322285 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 549/1109] 10.222.0.21 () {56 vars in 1108 bytes} [Wed May 4 07:12:03 2022] GET /identity/v3/domains/default => generated 199 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 07:12:03.328208 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a849c4e7-0005-4431-85b7-a4300c03968c None None] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:12:03.419753 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a849c4e7-0005-4431-85b7-a4300c03968c None None] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:12:03.450673 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec7c649-eb29-4f2f-9cd1-d1fe9da04a7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:12:03.451366 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec7c649-eb29-4f2f-9cd1-d1fe9da04a7a None admin] REQUEST_METHOD: `POST` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:12:03.451644 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec7c649-eb29-4f2f-9cd1-d1fe9da04a7a None admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:12:03.451915 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec7c649-eb29-4f2f-9cd1-d1fe9da04a7a None admin] PATH_INFO: `/v3/users` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:12:03.452627 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec7c649-eb29-4f2f-9cd1-d1fe9da04a7a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:12:03.454029 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec7c649-eb29-4f2f-9cd1-d1fe9da04a7a None admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:12:03.473677 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 561/1110] 10.222.0.21 () {60 vars in 1132 bytes} [Wed May 4 07:12:03 2022] POST /identity/v3/users => generated 286 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 07:12:05.747878 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd15b1d-341a-45b4-8d0c-c13f3a1265ff None None] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:12:05.748397 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd15b1d-341a-45b4-8d0c-c13f3a1265ff None None] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:12:05.748397 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd15b1d-341a-45b4-8d0c-c13f3a1265ff None None] PATH_INFO: `/` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:12:05.749676 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 550/1111] 10.222.0.21 () {54 vars in 926 bytes} [Wed May 4 07:12:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 07:12:05.754643 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3199493-a2c4-4410-ac5b-68de86676017 None None] REQUEST_METHOD: `POST` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:12:05.755062 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3199493-a2c4-4410-ac5b-68de86676017 None None] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:12:05.755190 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3199493-a2c4-4410-ac5b-68de86676017 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:12:05.772019 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.auth.core [None req-a3199493-a2c4-4410-ac5b-68de86676017 None None] MFA Rules not processed for user `83c5e0dcb991496ea6dee38384514508`. Rule list: `[]` (Enabled: `True`). {{(pid=79744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:12:05.773179 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.fernet_utils [None req-a3199493-a2c4-4410-ac5b-68de86676017 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:12:05.835229 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 562/1112] 10.222.0.21 () {58 vars in 1023 bytes} [Wed May 4 07:12:05 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 07:12:05.858834 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd15b1d-341a-45b4-8d0c-c13f3a1265ff None None] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:12:05.952022 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd15b1d-341a-45b4-8d0c-c13f3a1265ff None None] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:12:05.983257 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a2d41a-0b86-4343-91cd-1a0de2a47c5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:12:05.984080 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a2d41a-0b86-4343-91cd-1a0de2a47c5e None admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:12:05.984352 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a2d41a-0b86-4343-91cd-1a0de2a47c5e None admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:12:05.984618 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a2d41a-0b86-4343-91cd-1a0de2a47c5e None admin] PATH_INFO: `/v3/roles/91b8526a43a4426a883870ad97362652` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:12:05.986050 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a2d41a-0b86-4343-91cd-1a0de2a47c5e None admin] RBAC: Authorizing `identity:get_role(role_id=91b8526a43a4426a883870ad97362652)` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:12:05.987418 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a2d41a-0b86-4343-91cd-1a0de2a47c5e None admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:12:05.988732 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 551/1113] 10.222.0.21 () {56 vars in 1177 bytes} [Wed May 4 07:12:05 2022] GET /identity/v3/roles/91b8526a43a4426a883870ad97362652 => generated 223 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 07:12:05.994349 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3199493-a2c4-4410-ac5b-68de86676017 None None] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:12:06.085876 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3199493-a2c4-4410-ac5b-68de86676017 None None] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:12:06.116941 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15d4aba-3277-4925-b8b1-46962f0d9519 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:12:06.117796 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15d4aba-3277-4925-b8b1-46962f0d9519 None admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:12:06.118069 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15d4aba-3277-4925-b8b1-46962f0d9519 None admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:12:06.118335 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15d4aba-3277-4925-b8b1-46962f0d9519 None admin] PATH_INFO: `/v3/users/bab8383bb50446ae847f67502a9618e8` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:12:06.133281 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15d4aba-3277-4925-b8b1-46962f0d9519 None admin] RBAC: Authorizing `identity:get_user(user_id=bab8383bb50446ae847f67502a9618e8)` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:12:06.135523 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15d4aba-3277-4925-b8b1-46962f0d9519 None admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:12:06.137130 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 563/1114] 10.222.0.21 () {56 vars in 1177 bytes} [Wed May 4 07:12:05 2022] GET /identity/v3/users/bab8383bb50446ae847f67502a9618e8 => generated 286 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 07:12:06.142859 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a2d41a-0b86-4343-91cd-1a0de2a47c5e None admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:12:06.235616 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a2d41a-0b86-4343-91cd-1a0de2a47c5e None admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:12:06.266715 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d321e4fa-7ffa-437f-9438-d3313c1c6861 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:12:06.267440 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d321e4fa-7ffa-437f-9438-d3313c1c6861 None admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:12:06.267718 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d321e4fa-7ffa-437f-9438-d3313c1c6861 None admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:12:06.267987 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d321e4fa-7ffa-437f-9438-d3313c1c6861 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:12:06.330097 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d321e4fa-7ffa-437f-9438-d3313c1c6861 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:12:06.331557 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d321e4fa-7ffa-437f-9438-d3313c1c6861 None admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:12:06.421878 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 552/1115] 10.222.0.21 () {58 vars in 1282 bytes} [Wed May 4 07:12:06 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 279 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 04 07:12:06.427799 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15d4aba-3277-4925-b8b1-46962f0d9519 None admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:12:06.522064 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15d4aba-3277-4925-b8b1-46962f0d9519 None admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:12:06.553916 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9090a908-7916-48fa-8725-e900edcd4d25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:12:06.554755 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9090a908-7916-48fa-8725-e900edcd4d25 None admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:12:06.555035 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9090a908-7916-48fa-8725-e900edcd4d25 None admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:12:06.555336 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9090a908-7916-48fa-8725-e900edcd4d25 None admin] PATH_INFO: `/v3/projects/6321bcb50618432f92223ac198d8e705` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:12:06.557098 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9090a908-7916-48fa-8725-e900edcd4d25 None admin] RBAC: Authorizing `identity:get_project(project_id=6321bcb50618432f92223ac198d8e705)` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:12:06.558807 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9090a908-7916-48fa-8725-e900edcd4d25 None admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:12:06.560528 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 564/1116] 10.222.0.21 () {56 vars in 1186 bytes} [Wed May 4 07:12:06 2022] GET /identity/v3/projects/6321bcb50618432f92223ac198d8e705 => generated 311 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 07:12:06.566665 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d321e4fa-7ffa-437f-9438-d3313c1c6861 None admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:12:06.658667 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d321e4fa-7ffa-437f-9438-d3313c1c6861 None admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:12:06.690459 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9824331-ae5a-4c3a-ad7b-3c469eca5663 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:12:06.691035 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9824331-ae5a-4c3a-ad7b-3c469eca5663 None admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:12:06.691347 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9824331-ae5a-4c3a-ad7b-3c469eca5663 None admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:12:06.691617 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9824331-ae5a-4c3a-ad7b-3c469eca5663 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:12:06.692420 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9824331-ae5a-4c3a-ad7b-3c469eca5663 None admin] RBAC: Adding query filter params (role.id=91b8526a43a4426a883870ad97362652, scope.project.id=6321bcb50618432f92223ac198d8e705, user.id=bab8383bb50446ae847f67502a9618e8) {{(pid=79745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 07:12:06.692724 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9824331-ae5a-4c3a-ad7b-3c469eca5663 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:12:06.694122 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9824331-ae5a-4c3a-ad7b-3c469eca5663 None admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:12:06.699453 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 553/1117] 10.222.0.21 () {56 vars in 1374 bytes} [Wed May 4 07:12:06 2022] GET /identity/v3/role_assignments?user.id=bab8383bb50446ae847f67502a9618e8&scope.project.id=6321bcb50618432f92223ac198d8e705&role.id=91b8526a43a4426a883870ad97362652 => generated 259 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 07:12:08.873899 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b765ed7f-37c3-4795-958d-027682f9ce05 None None] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:12:08.874444 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b765ed7f-37c3-4795-958d-027682f9ce05 None None] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:12:08.874444 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b765ed7f-37c3-4795-958d-027682f9ce05 None None] PATH_INFO: `/` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:12:08.875816 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 565/1118] 10.222.0.21 () {54 vars in 926 bytes} [Wed May 4 07:12:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 07:12:08.881056 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6fb474-0582-4fef-89ea-cfefc7777c64 None None] REQUEST_METHOD: `POST` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:12:08.881478 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6fb474-0582-4fef-89ea-cfefc7777c64 None None] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:12:08.881584 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6fb474-0582-4fef-89ea-cfefc7777c64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:12:08.898464 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.auth.core [None req-9b6fb474-0582-4fef-89ea-cfefc7777c64 None None] MFA Rules not processed for user `83c5e0dcb991496ea6dee38384514508`. Rule list: `[]` (Enabled: `True`). {{(pid=79745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:12:08.899706 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.fernet_utils [None req-9b6fb474-0582-4fef-89ea-cfefc7777c64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:12:08.961923 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 554/1119] 10.222.0.21 () {58 vars in 1023 bytes} [Wed May 4 07:12:08 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 07:12:08.984790 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b765ed7f-37c3-4795-958d-027682f9ce05 None None] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:12:09.079490 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b765ed7f-37c3-4795-958d-027682f9ce05 None None] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:12:09.110010 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3118975-beae-479d-8094-7c3875979397 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:12:09.110838 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3118975-beae-479d-8094-7c3875979397 None admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:12:09.111111 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3118975-beae-479d-8094-7c3875979397 None admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:12:09.111406 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3118975-beae-479d-8094-7c3875979397 None admin] PATH_INFO: `/v3/roles/91b8526a43a4426a883870ad97362652` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:12:09.112826 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3118975-beae-479d-8094-7c3875979397 None admin] RBAC: Authorizing `identity:get_role(role_id=91b8526a43a4426a883870ad97362652)` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:12:09.114164 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3118975-beae-479d-8094-7c3875979397 None admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:12:09.115629 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 566/1120] 10.222.0.21 () {56 vars in 1177 bytes} [Wed May 4 07:12:08 2022] GET /identity/v3/roles/91b8526a43a4426a883870ad97362652 => generated 223 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 07:12:09.121999 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6fb474-0582-4fef-89ea-cfefc7777c64 None None] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:12:09.212642 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6fb474-0582-4fef-89ea-cfefc7777c64 None None] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:12:09.242845 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6b61a1-2b76-4f0c-8983-2341b68b0fdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:12:09.243712 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6b61a1-2b76-4f0c-8983-2341b68b0fdf None admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:12:09.244500 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6b61a1-2b76-4f0c-8983-2341b68b0fdf None admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:12:09.244766 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6b61a1-2b76-4f0c-8983-2341b68b0fdf None admin] PATH_INFO: `/v3/users/bab8383bb50446ae847f67502a9618e8` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:12:09.245920 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6b61a1-2b76-4f0c-8983-2341b68b0fdf None admin] RBAC: Authorizing `identity:get_user(user_id=bab8383bb50446ae847f67502a9618e8)` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:12:09.247342 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6b61a1-2b76-4f0c-8983-2341b68b0fdf None admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:12:09.248897 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 555/1121] 10.222.0.21 () {56 vars in 1177 bytes} [Wed May 4 07:12:09 2022] GET /identity/v3/users/bab8383bb50446ae847f67502a9618e8 => generated 286 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 07:12:09.254734 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3118975-beae-479d-8094-7c3875979397 None admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:12:09.348535 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3118975-beae-479d-8094-7c3875979397 None admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:12:09.380336 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9c2a00-62af-44f5-b905-1bb64eff76e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:12:09.381175 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9c2a00-62af-44f5-b905-1bb64eff76e9 None admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:12:09.381452 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9c2a00-62af-44f5-b905-1bb64eff76e9 None admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:12:09.381723 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9c2a00-62af-44f5-b905-1bb64eff76e9 None admin] PATH_INFO: `/v3/projects/6321bcb50618432f92223ac198d8e705` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:12:09.383131 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9c2a00-62af-44f5-b905-1bb64eff76e9 None admin] RBAC: Authorizing `identity:get_project(project_id=6321bcb50618432f92223ac198d8e705)` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:12:09.384613 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9c2a00-62af-44f5-b905-1bb64eff76e9 None admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:12:09.386404 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 567/1122] 10.222.0.21 () {56 vars in 1186 bytes} [Wed May 4 07:12:09 2022] GET /identity/v3/projects/6321bcb50618432f92223ac198d8e705 => generated 311 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 07:12:09.392602 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6b61a1-2b76-4f0c-8983-2341b68b0fdf None admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:12:09.486990 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6b61a1-2b76-4f0c-8983-2341b68b0fdf None admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:12:09.518160 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69465567-d6ac-4ec2-aba6-130ea2de9e20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:12:09.519025 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69465567-d6ac-4ec2-aba6-130ea2de9e20 None admin] REQUEST_METHOD: `PUT` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:12:09.519329 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69465567-d6ac-4ec2-aba6-130ea2de9e20 None admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:12:09.519598 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69465567-d6ac-4ec2-aba6-130ea2de9e20 None admin] PATH_INFO: `/v3/projects/6321bcb50618432f92223ac198d8e705/users/bab8383bb50446ae847f67502a9618e8/roles/91b8526a43a4426a883870ad97362652` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:12:09.521736 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69465567-d6ac-4ec2-aba6-130ea2de9e20 None admin] RBAC: Authorizing `identity:create_grant(project_id=6321bcb50618432f92223ac198d8e705, user_id=bab8383bb50446ae847f67502a9618e8, role_id=91b8526a43a4426a883870ad97362652)` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:12:09.523139 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69465567-d6ac-4ec2-aba6-130ea2de9e20 None admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:12:09.535715 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 556/1123] 10.222.0.21 () {58 vars in 1439 bytes} [Wed May 4 07:12:09 2022] PUT /identity/v3/projects/6321bcb50618432f92223ac198d8e705/users/bab8383bb50446ae847f67502a9618e8/roles/91b8526a43a4426a883870ad97362652 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 07:12:11.717919 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e91f85-2c46-4eb8-bdff-469ba39457a4 None None] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:12:11.718440 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e91f85-2c46-4eb8-bdff-469ba39457a4 None None] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:12:11.718440 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e91f85-2c46-4eb8-bdff-469ba39457a4 None None] PATH_INFO: `/` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:12:11.719783 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 568/1124] 10.222.0.21 () {54 vars in 926 bytes} [Wed May 4 07:12:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 07:12:11.724857 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06e8d82-3be5-4861-8626-5867fd99fdc1 None None] REQUEST_METHOD: `POST` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:12:11.725279 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06e8d82-3be5-4861-8626-5867fd99fdc1 None None] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:12:11.725388 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06e8d82-3be5-4861-8626-5867fd99fdc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:12:11.742764 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.auth.core [None req-d06e8d82-3be5-4861-8626-5867fd99fdc1 None None] MFA Rules not processed for user `83c5e0dcb991496ea6dee38384514508`. Rule list: `[]` (Enabled: `True`). {{(pid=79745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:12:11.744736 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.fernet_utils [None req-d06e8d82-3be5-4861-8626-5867fd99fdc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:12:11.805641 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 557/1125] 10.222.0.21 () {58 vars in 1023 bytes} [Wed May 4 07:12:11 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 07:12:11.828896 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e91f85-2c46-4eb8-bdff-469ba39457a4 None None] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:12:11.922842 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e91f85-2c46-4eb8-bdff-469ba39457a4 None None] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:12:11.954107 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da714d40-3125-4bf7-8b1d-ffbb8de8f16c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:12:11.954932 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da714d40-3125-4bf7-8b1d-ffbb8de8f16c None admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:12:11.955232 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da714d40-3125-4bf7-8b1d-ffbb8de8f16c None admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:12:11.955497 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da714d40-3125-4bf7-8b1d-ffbb8de8f16c None admin] PATH_INFO: `/v3/roles/91b8526a43a4426a883870ad97362652` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:12:11.956929 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da714d40-3125-4bf7-8b1d-ffbb8de8f16c None admin] RBAC: Authorizing `identity:get_role(role_id=91b8526a43a4426a883870ad97362652)` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:12:11.958263 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da714d40-3125-4bf7-8b1d-ffbb8de8f16c None admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:12:11.959613 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 569/1126] 10.222.0.21 () {56 vars in 1177 bytes} [Wed May 4 07:12:11 2022] GET /identity/v3/roles/91b8526a43a4426a883870ad97362652 => generated 223 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 07:12:11.965928 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06e8d82-3be5-4861-8626-5867fd99fdc1 None None] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:12:12.056919 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06e8d82-3be5-4861-8626-5867fd99fdc1 None None] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:12:12.088319 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed5c115-1fd5-4d3d-b36d-4886a9696d60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:12:12.089159 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed5c115-1fd5-4d3d-b36d-4886a9696d60 None admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:12:12.089435 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed5c115-1fd5-4d3d-b36d-4886a9696d60 None admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:12:12.089701 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed5c115-1fd5-4d3d-b36d-4886a9696d60 None admin] PATH_INFO: `/v3/users/bab8383bb50446ae847f67502a9618e8` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:12:12.090852 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed5c115-1fd5-4d3d-b36d-4886a9696d60 None admin] RBAC: Authorizing `identity:get_user(user_id=bab8383bb50446ae847f67502a9618e8)` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:12:12.092293 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed5c115-1fd5-4d3d-b36d-4886a9696d60 None admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:12:12.093876 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 558/1127] 10.222.0.21 () {56 vars in 1177 bytes} [Wed May 4 07:12:11 2022] GET /identity/v3/users/bab8383bb50446ae847f67502a9618e8 => generated 286 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 07:12:12.099533 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da714d40-3125-4bf7-8b1d-ffbb8de8f16c None admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:12:12.191327 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da714d40-3125-4bf7-8b1d-ffbb8de8f16c None admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:12:12.222535 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd9f894-db56-4693-8de0-fcd3b60a6797 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:12:12.223175 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd9f894-db56-4693-8de0-fcd3b60a6797 None admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:12:12.223455 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd9f894-db56-4693-8de0-fcd3b60a6797 None admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:12:12.223721 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd9f894-db56-4693-8de0-fcd3b60a6797 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:12:12.285783 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd9f894-db56-4693-8de0-fcd3b60a6797 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:12:12.287240 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd9f894-db56-4693-8de0-fcd3b60a6797 None admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:12:12.378782 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 570/1128] 10.222.0.21 () {58 vars in 1282 bytes} [Wed May 4 07:12:12 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 280 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 04 07:12:12.385088 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed5c115-1fd5-4d3d-b36d-4886a9696d60 None admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:12:12.477855 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed5c115-1fd5-4d3d-b36d-4886a9696d60 None admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:12:12.509242 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d88c5aa-0487-4575-867d-09e3765c5d64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:12:12.510612 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d88c5aa-0487-4575-867d-09e3765c5d64 None admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:12:12.510880 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d88c5aa-0487-4575-867d-09e3765c5d64 None admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:12:12.511166 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d88c5aa-0487-4575-867d-09e3765c5d64 None admin] PATH_INFO: `/v3/projects/6321bcb50618432f92223ac198d8e705` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:12:12.512317 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d88c5aa-0487-4575-867d-09e3765c5d64 None admin] RBAC: Authorizing `identity:get_project(project_id=6321bcb50618432f92223ac198d8e705)` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:12:12.513720 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d88c5aa-0487-4575-867d-09e3765c5d64 None admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:12:12.515406 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 559/1129] 10.222.0.21 () {56 vars in 1186 bytes} [Wed May 4 07:12:12 2022] GET /identity/v3/projects/6321bcb50618432f92223ac198d8e705 => generated 311 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 07:12:12.521406 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd9f894-db56-4693-8de0-fcd3b60a6797 None admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:12:12.612940 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd9f894-db56-4693-8de0-fcd3b60a6797 None admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:12:12.644508 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adfd2ac6-bf73-46e8-bc4d-af8fdc510035 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:12:12.645078 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfd2ac6-bf73-46e8-bc4d-af8fdc510035 None admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:12:12.645349 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfd2ac6-bf73-46e8-bc4d-af8fdc510035 None admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:12:12.645613 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfd2ac6-bf73-46e8-bc4d-af8fdc510035 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:12:12.646425 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adfd2ac6-bf73-46e8-bc4d-af8fdc510035 None admin] RBAC: Adding query filter params (role.id=91b8526a43a4426a883870ad97362652, scope.project.id=6321bcb50618432f92223ac198d8e705, user.id=bab8383bb50446ae847f67502a9618e8) {{(pid=79744) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 07:12:12.646725 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adfd2ac6-bf73-46e8-bc4d-af8fdc510035 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:12:12.648235 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adfd2ac6-bf73-46e8-bc4d-af8fdc510035 None admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:12:12.654438 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 571/1130] 10.222.0.21 () {56 vars in 1374 bytes} [Wed May 4 07:12:12 2022] GET /identity/v3/role_assignments?user.id=bab8383bb50446ae847f67502a9618e8&scope.project.id=6321bcb50618432f92223ac198d8e705&role.id=91b8526a43a4426a883870ad97362652 => generated 608 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 07:12:14.882972 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bf992b-e838-4a95-87ec-66ffec3808e2 None None] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:12:14.883560 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bf992b-e838-4a95-87ec-66ffec3808e2 None None] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:12:14.883560 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bf992b-e838-4a95-87ec-66ffec3808e2 None None] PATH_INFO: `/` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:12:14.884972 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 560/1131] 10.222.0.21 () {54 vars in 926 bytes} [Wed May 4 07:12:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 07:12:14.890076 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8ead74-73b2-4d6b-a58f-3f5f7330747e None None] REQUEST_METHOD: `POST` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:12:14.890498 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8ead74-73b2-4d6b-a58f-3f5f7330747e None None] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:12:14.890615 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8ead74-73b2-4d6b-a58f-3f5f7330747e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:12:14.907882 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.auth.core [None req-1d8ead74-73b2-4d6b-a58f-3f5f7330747e None None] MFA Rules not processed for user `83c5e0dcb991496ea6dee38384514508`. Rule list: `[]` (Enabled: `True`). {{(pid=79744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:12:14.909476 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.fernet_utils [None req-1d8ead74-73b2-4d6b-a58f-3f5f7330747e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:12:14.971005 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 572/1132] 10.222.0.21 () {58 vars in 1023 bytes} [Wed May 4 07:12:14 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 07:12:14.995406 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bf992b-e838-4a95-87ec-66ffec3808e2 None None] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:12:15.090041 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bf992b-e838-4a95-87ec-66ffec3808e2 None None] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:12:15.121384 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a02f6a-503b-4556-b297-6ef8ed34c6d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:12:15.122146 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a02f6a-503b-4556-b297-6ef8ed34c6d9 None admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:12:15.122417 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a02f6a-503b-4556-b297-6ef8ed34c6d9 None admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:12:15.122684 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a02f6a-503b-4556-b297-6ef8ed34c6d9 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:12:15.123850 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a02f6a-503b-4556-b297-6ef8ed34c6d9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:12:15.125249 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a02f6a-503b-4556-b297-6ef8ed34c6d9 None admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:12:15.126799 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 561/1133] 10.222.0.21 () {56 vars in 1108 bytes} [Wed May 4 07:12:14 2022] GET /identity/v3/domains/default => generated 199 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 07:12:15.132763 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8ead74-73b2-4d6b-a58f-3f5f7330747e None None] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:12:15.231797 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8ead74-73b2-4d6b-a58f-3f5f7330747e None None] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:12:15.262988 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09dfa25c-1e2c-42b3-96db-2ddcdeafa564 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:12:15.263658 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09dfa25c-1e2c-42b3-96db-2ddcdeafa564 None admin] REQUEST_METHOD: `POST` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:12:15.263934 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09dfa25c-1e2c-42b3-96db-2ddcdeafa564 None admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:12:15.264201 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09dfa25c-1e2c-42b3-96db-2ddcdeafa564 None admin] PATH_INFO: `/v3/projects` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:12:15.264880 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09dfa25c-1e2c-42b3-96db-2ddcdeafa564 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:12:15.266281 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09dfa25c-1e2c-42b3-96db-2ddcdeafa564 None admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:12:15.290181 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 573/1134] 10.222.0.21 () {60 vars in 1141 bytes} [Wed May 4 07:12:15 2022] POST /identity/v3/projects => generated 311 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 07:12:17.550542 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06795135-5189-4626-8be6-99aad878e21f None None] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:12:17.551077 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06795135-5189-4626-8be6-99aad878e21f None None] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:12:17.551077 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06795135-5189-4626-8be6-99aad878e21f None None] PATH_INFO: `/` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:12:17.552444 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 562/1135] 10.222.0.21 () {54 vars in 926 bytes} [Wed May 4 07:12:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 07:12:17.557778 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b24e89a-91ae-4377-b1d5-204c272aba22 None None] REQUEST_METHOD: `POST` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:12:17.558204 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b24e89a-91ae-4377-b1d5-204c272aba22 None None] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:12:17.558320 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b24e89a-91ae-4377-b1d5-204c272aba22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:12:17.574417 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.auth.core [None req-2b24e89a-91ae-4377-b1d5-204c272aba22 None None] MFA Rules not processed for user `83c5e0dcb991496ea6dee38384514508`. Rule list: `[]` (Enabled: `True`). {{(pid=79744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:12:17.575598 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.fernet_utils [None req-2b24e89a-91ae-4377-b1d5-204c272aba22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:12:17.637122 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 574/1136] 10.222.0.21 () {58 vars in 1023 bytes} [Wed May 4 07:12:17 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 04 07:12:17.662426 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06795135-5189-4626-8be6-99aad878e21f None None] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:12:17.756485 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06795135-5189-4626-8be6-99aad878e21f None None] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:12:17.787684 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b023413-83d9-453e-86e7-8a06acfaf2de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:12:17.788441 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b023413-83d9-453e-86e7-8a06acfaf2de None admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:12:17.788721 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b023413-83d9-453e-86e7-8a06acfaf2de None admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:12:17.788984 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b023413-83d9-453e-86e7-8a06acfaf2de None admin] PATH_INFO: `/v3/domains/default` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:12:17.790120 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b023413-83d9-453e-86e7-8a06acfaf2de None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:12:17.792088 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b023413-83d9-453e-86e7-8a06acfaf2de None admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:12:17.793629 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 563/1137] 10.222.0.21 () {56 vars in 1108 bytes} [Wed May 4 07:12:17 2022] GET /identity/v3/domains/default => generated 199 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 07:12:17.799244 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b24e89a-91ae-4377-b1d5-204c272aba22 None None] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:12:17.891809 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b24e89a-91ae-4377-b1d5-204c272aba22 None None] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:12:17.923496 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03025b3f-5760-4827-8378-1a01df17a12b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:12:17.924148 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03025b3f-5760-4827-8378-1a01df17a12b None admin] REQUEST_METHOD: `POST` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:12:17.924427 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03025b3f-5760-4827-8378-1a01df17a12b None admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:12:17.924699 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03025b3f-5760-4827-8378-1a01df17a12b None admin] PATH_INFO: `/v3/users` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:12:17.925393 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03025b3f-5760-4827-8378-1a01df17a12b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:12:17.926806 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03025b3f-5760-4827-8378-1a01df17a12b None admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:12:17.945874 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 575/1138] 10.222.0.21 () {60 vars in 1132 bytes} [Wed May 4 07:12:17 2022] POST /identity/v3/users => generated 286 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 07:12:20.212197 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea13b6b-4e5f-4ed0-9ee5-6f9eaac1ec2d None None] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:12:20.212792 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea13b6b-4e5f-4ed0-9ee5-6f9eaac1ec2d None None] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:12:20.212792 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea13b6b-4e5f-4ed0-9ee5-6f9eaac1ec2d None None] PATH_INFO: `/` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:12:20.214159 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 564/1139] 10.222.0.21 () {54 vars in 926 bytes} [Wed May 4 07:12:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 07:12:20.219652 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7f46e7-bde1-463f-a908-cb0d868c73f8 None None] REQUEST_METHOD: `POST` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:12:20.220105 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7f46e7-bde1-463f-a908-cb0d868c73f8 None None] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:12:20.220201 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7f46e7-bde1-463f-a908-cb0d868c73f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:12:20.236932 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.auth.core [None req-bd7f46e7-bde1-463f-a908-cb0d868c73f8 None None] MFA Rules not processed for user `83c5e0dcb991496ea6dee38384514508`. Rule list: `[]` (Enabled: `True`). {{(pid=79744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:12:20.238089 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.fernet_utils [None req-bd7f46e7-bde1-463f-a908-cb0d868c73f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:12:20.300376 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 576/1140] 10.222.0.21 () {58 vars in 1023 bytes} [Wed May 4 07:12:20 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 07:12:20.323288 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea13b6b-4e5f-4ed0-9ee5-6f9eaac1ec2d None None] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:12:20.417266 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea13b6b-4e5f-4ed0-9ee5-6f9eaac1ec2d None None] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:12:20.448753 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c675a098-2ec3-4ca3-9d3b-4b293fe34c7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:12:20.449540 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c675a098-2ec3-4ca3-9d3b-4b293fe34c7d None admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:12:20.449819 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c675a098-2ec3-4ca3-9d3b-4b293fe34c7d None admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:12:20.450088 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c675a098-2ec3-4ca3-9d3b-4b293fe34c7d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:12:20.459816 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c675a098-2ec3-4ca3-9d3b-4b293fe34c7d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 07:12:20.468306 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application [None req-c675a098-2ec3-4ca3-9d3b-4b293fe34c7d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 04 07:12:20.468306 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 07:12:20.468306 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 07:12:20.468306 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 07:12:20.468306 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 07:12:20.468306 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 07:12:20.468306 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 07:12:20.468306 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 07:12:20.468306 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 07:12:20.468306 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 07:12:20.468306 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 07:12:20.468306 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 07:12:20.468306 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 07:12:20.468306 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 07:12:20.468306 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 07:12:20.468306 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 07:12:20.469406 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 07:12:20.469406 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 07:12:20.469406 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 07:12:20.469406 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 07:12:20.469406 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 07:12:20.469406 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 07:12:20.469406 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 07:12:20.469406 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 07:12:20.469406 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 07:12:20.469406 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self.get_or_create( May 04 07:12:20.469406 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 07:12:20.469406 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application with Lock( May 04 07:12:20.469406 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 07:12:20.469406 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self._enter() May 04 07:12:20.469406 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 07:12:20.469406 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 07:12:20.470458 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 07:12:20.470458 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self.creator() May 04 07:12:20.470458 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 07:12:20.470458 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application created_value = creator( May 04 07:12:20.470458 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 07:12:20.470458 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 07:12:20.470458 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 07:12:20.470458 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 07:12:20.470458 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 07:12:20.470458 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 07:12:20.470458 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 04 07:12:20.470458 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application May 04 07:12:20.470458 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 565/1141] 10.222.0.21 () {56 vars in 1096 bytes} [Wed May 4 07:12:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 07:12:20.475364 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7f46e7-bde1-463f-a908-cb0d868c73f8 None None] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:12:20.566291 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7f46e7-bde1-463f-a908-cb0d868c73f8 None None] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:12:20.597682 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a461d7-4ed8-497e-b2a4-cfa83d08c43f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:12:20.598328 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a461d7-4ed8-497e-b2a4-cfa83d08c43f None admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:12:20.598604 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a461d7-4ed8-497e-b2a4-cfa83d08c43f None admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:12:20.598873 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a461d7-4ed8-497e-b2a4-cfa83d08c43f None admin] PATH_INFO: `/v3/roles` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:12:20.599636 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a461d7-4ed8-497e-b2a4-cfa83d08c43f None admin] RBAC: Adding query filter params (name=admin) {{(pid=79744) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 07:12:20.599938 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a461d7-4ed8-497e-b2a4-cfa83d08c43f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:12:20.601279 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a461d7-4ed8-497e-b2a4-cfa83d08c43f None admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:12:20.608882 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 577/1142] 10.222.0.21 () {56 vars in 1099 bytes} [Wed May 4 07:12:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 07:12:20.614518 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c675a098-2ec3-4ca3-9d3b-4b293fe34c7d None admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:12:20.708990 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c675a098-2ec3-4ca3-9d3b-4b293fe34c7d None admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:12:20.739760 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b940323f-0e51-40f3-a312-2289190386f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:12:20.740532 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b940323f-0e51-40f3-a312-2289190386f5 None admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:12:20.740803 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b940323f-0e51-40f3-a312-2289190386f5 None admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:12:20.741065 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b940323f-0e51-40f3-a312-2289190386f5 None admin] PATH_INFO: `/v3/users/28145f1e037649249ae73ee4523d4aaf` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:12:20.753801 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b940323f-0e51-40f3-a312-2289190386f5 None admin] RBAC: Authorizing `identity:get_user(user_id=28145f1e037649249ae73ee4523d4aaf)` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:12:20.755245 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b940323f-0e51-40f3-a312-2289190386f5 None admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:12:20.756824 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 566/1143] 10.222.0.21 () {56 vars in 1177 bytes} [Wed May 4 07:12:20 2022] GET /identity/v3/users/28145f1e037649249ae73ee4523d4aaf => generated 286 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 07:12:20.762730 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a461d7-4ed8-497e-b2a4-cfa83d08c43f None admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:12:20.855342 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a461d7-4ed8-497e-b2a4-cfa83d08c43f None admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:12:20.887271 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a919e82-f942-472e-8171-9e546dea86b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:12:20.887892 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a919e82-f942-472e-8171-9e546dea86b0 None admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:12:20.888170 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a919e82-f942-472e-8171-9e546dea86b0 None admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:12:20.888440 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a919e82-f942-472e-8171-9e546dea86b0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:12:20.950524 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a919e82-f942-472e-8171-9e546dea86b0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:12:20.951958 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a919e82-f942-472e-8171-9e546dea86b0 None admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:12:21.045572 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 578/1144] 10.222.0.21 () {58 vars in 1282 bytes} [Wed May 4 07:12:20 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 283 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 04 07:12:21.051560 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b940323f-0e51-40f3-a312-2289190386f5 None admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:12:21.146900 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b940323f-0e51-40f3-a312-2289190386f5 None admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:12:21.194118 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322e094c-6589-47ed-ae2a-ac7b117313a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:12:21.194974 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322e094c-6589-47ed-ae2a-ac7b117313a6 None admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:12:21.195276 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322e094c-6589-47ed-ae2a-ac7b117313a6 None admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:12:21.195547 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322e094c-6589-47ed-ae2a-ac7b117313a6 None admin] PATH_INFO: `/v3/projects/ccf26e412fd94549b83373865a854c58` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:12:21.196731 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322e094c-6589-47ed-ae2a-ac7b117313a6 None admin] RBAC: Authorizing `identity:get_project(project_id=ccf26e412fd94549b83373865a854c58)` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:12:21.198346 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322e094c-6589-47ed-ae2a-ac7b117313a6 None admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:12:21.200057 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 567/1145] 10.222.0.21 () {56 vars in 1186 bytes} [Wed May 4 07:12:21 2022] GET /identity/v3/projects/ccf26e412fd94549b83373865a854c58 => generated 311 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 07:12:21.206589 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a919e82-f942-472e-8171-9e546dea86b0 None admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:12:21.307521 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a919e82-f942-472e-8171-9e546dea86b0 None admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:12:21.342939 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5adf5d1f-05f4-4ec1-9231-260a424b457c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:12:21.343613 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adf5d1f-05f4-4ec1-9231-260a424b457c None admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:12:21.343894 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adf5d1f-05f4-4ec1-9231-260a424b457c None admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:12:21.344169 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adf5d1f-05f4-4ec1-9231-260a424b457c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:12:21.344990 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5adf5d1f-05f4-4ec1-9231-260a424b457c None admin] RBAC: Adding query filter params (role.id=eb54c9cea2774a25b1fe8c79724408ee, scope.project.id=ccf26e412fd94549b83373865a854c58, user.id=28145f1e037649249ae73ee4523d4aaf) {{(pid=79744) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 07:12:21.345300 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5adf5d1f-05f4-4ec1-9231-260a424b457c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:12:21.346844 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5adf5d1f-05f4-4ec1-9231-260a424b457c None admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:12:21.352938 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 579/1146] 10.222.0.21 () {56 vars in 1374 bytes} [Wed May 4 07:12:21 2022] GET /identity/v3/role_assignments?user.id=28145f1e037649249ae73ee4523d4aaf&scope.project.id=ccf26e412fd94549b83373865a854c58&role.id=eb54c9cea2774a25b1fe8c79724408ee => generated 259 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 07:12:23.592366 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159e29b2-c97b-44bf-bebc-5639f5f64647 None None] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:12:23.592913 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159e29b2-c97b-44bf-bebc-5639f5f64647 None None] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:12:23.592913 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159e29b2-c97b-44bf-bebc-5639f5f64647 None None] PATH_INFO: `/` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:12:23.594252 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 568/1147] 10.222.0.21 () {54 vars in 926 bytes} [Wed May 4 07:12:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 07:12:23.599568 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d97de8e-73ef-400a-b82b-09bffa94f9cc None None] REQUEST_METHOD: `POST` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:12:23.599950 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d97de8e-73ef-400a-b82b-09bffa94f9cc None None] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:12:23.600117 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d97de8e-73ef-400a-b82b-09bffa94f9cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:12:23.616832 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.auth.core [None req-3d97de8e-73ef-400a-b82b-09bffa94f9cc None None] MFA Rules not processed for user `83c5e0dcb991496ea6dee38384514508`. Rule list: `[]` (Enabled: `True`). {{(pid=79744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:12:23.617999 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.fernet_utils [None req-3d97de8e-73ef-400a-b82b-09bffa94f9cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:12:23.681864 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 580/1148] 10.222.0.21 () {58 vars in 1023 bytes} [Wed May 4 07:12:23 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 07:12:23.703699 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159e29b2-c97b-44bf-bebc-5639f5f64647 None None] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:12:23.799960 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159e29b2-c97b-44bf-bebc-5639f5f64647 None None] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:12:23.831877 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843b2361-8624-43e6-93ee-9fafcc87c7b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:12:23.832645 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843b2361-8624-43e6-93ee-9fafcc87c7b1 None admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:12:23.832924 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843b2361-8624-43e6-93ee-9fafcc87c7b1 None admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:12:23.833199 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843b2361-8624-43e6-93ee-9fafcc87c7b1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:12:23.842883 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843b2361-8624-43e6-93ee-9fafcc87c7b1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 07:12:23.850435 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application [None req-843b2361-8624-43e6-93ee-9fafcc87c7b1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 04 07:12:23.850435 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 07:12:23.850435 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 07:12:23.850435 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 07:12:23.850435 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 07:12:23.850435 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 07:12:23.850435 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 07:12:23.850435 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 07:12:23.850435 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 07:12:23.850435 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 07:12:23.850435 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 07:12:23.850435 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 07:12:23.850435 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 07:12:23.850435 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 07:12:23.850435 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 07:12:23.850435 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 07:12:23.851560 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 07:12:23.851560 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 07:12:23.851560 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 07:12:23.851560 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 07:12:23.851560 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 07:12:23.851560 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 07:12:23.851560 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 07:12:23.851560 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 07:12:23.851560 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 07:12:23.851560 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self.get_or_create( May 04 07:12:23.851560 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 07:12:23.851560 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application with Lock( May 04 07:12:23.851560 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 07:12:23.851560 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self._enter() May 04 07:12:23.851560 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 07:12:23.851560 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 07:12:23.852649 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 07:12:23.852649 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self.creator() May 04 07:12:23.852649 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 07:12:23.852649 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application created_value = creator( May 04 07:12:23.852649 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 07:12:23.852649 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 07:12:23.852649 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 07:12:23.852649 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 07:12:23.852649 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 07:12:23.852649 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 07:12:23.852649 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 04 07:12:23.852649 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application May 04 07:12:23.852649 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 569/1149] 10.222.0.21 () {56 vars in 1096 bytes} [Wed May 4 07:12:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 07:12:23.858233 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d97de8e-73ef-400a-b82b-09bffa94f9cc None None] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:12:23.950767 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d97de8e-73ef-400a-b82b-09bffa94f9cc None None] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:12:23.982286 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45edcb81-ec5e-4bd8-8d69-9d7253b8a630 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:12:23.982866 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45edcb81-ec5e-4bd8-8d69-9d7253b8a630 None admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:12:23.983171 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45edcb81-ec5e-4bd8-8d69-9d7253b8a630 None admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:12:23.983459 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45edcb81-ec5e-4bd8-8d69-9d7253b8a630 None admin] PATH_INFO: `/v3/roles` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:12:23.984193 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45edcb81-ec5e-4bd8-8d69-9d7253b8a630 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79744) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 07:12:23.984496 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45edcb81-ec5e-4bd8-8d69-9d7253b8a630 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:12:23.985853 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45edcb81-ec5e-4bd8-8d69-9d7253b8a630 None admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:12:23.993462 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 581/1150] 10.222.0.21 () {56 vars in 1099 bytes} [Wed May 4 07:12:23 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 07:12:24.000487 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843b2361-8624-43e6-93ee-9fafcc87c7b1 None admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:12:24.093136 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843b2361-8624-43e6-93ee-9fafcc87c7b1 None admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:12:24.124155 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d69300-8df8-4d18-8942-fce81f313987 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:12:24.124999 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d69300-8df8-4d18-8942-fce81f313987 None admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:12:24.125277 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d69300-8df8-4d18-8942-fce81f313987 None admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:12:24.125549 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d69300-8df8-4d18-8942-fce81f313987 None admin] PATH_INFO: `/v3/users/28145f1e037649249ae73ee4523d4aaf` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:12:24.126702 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d69300-8df8-4d18-8942-fce81f313987 None admin] RBAC: Authorizing `identity:get_user(user_id=28145f1e037649249ae73ee4523d4aaf)` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:12:24.128150 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d69300-8df8-4d18-8942-fce81f313987 None admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:12:24.129729 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 570/1151] 10.222.0.21 () {56 vars in 1177 bytes} [Wed May 4 07:12:23 2022] GET /identity/v3/users/28145f1e037649249ae73ee4523d4aaf => generated 286 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 07:12:24.135952 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45edcb81-ec5e-4bd8-8d69-9d7253b8a630 None admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:12:24.229568 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45edcb81-ec5e-4bd8-8d69-9d7253b8a630 None admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:12:24.260593 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09751fef-f757-46db-845c-147167ce9246 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:12:24.261377 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09751fef-f757-46db-845c-147167ce9246 None admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:12:24.261652 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09751fef-f757-46db-845c-147167ce9246 None admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:12:24.261921 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09751fef-f757-46db-845c-147167ce9246 None admin] PATH_INFO: `/v3/projects/ccf26e412fd94549b83373865a854c58` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:12:24.263088 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09751fef-f757-46db-845c-147167ce9246 None admin] RBAC: Authorizing `identity:get_project(project_id=ccf26e412fd94549b83373865a854c58)` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:12:24.264526 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09751fef-f757-46db-845c-147167ce9246 None admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:12:24.266183 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 582/1152] 10.222.0.21 () {56 vars in 1186 bytes} [Wed May 4 07:12:24 2022] GET /identity/v3/projects/ccf26e412fd94549b83373865a854c58 => generated 311 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 07:12:24.271974 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d69300-8df8-4d18-8942-fce81f313987 None admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:12:24.365822 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d69300-8df8-4d18-8942-fce81f313987 None admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:12:24.396690 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cfe459-d19d-49d0-a1c1-ef7dc4d8c4f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:12:24.397556 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cfe459-d19d-49d0-a1c1-ef7dc4d8c4f3 None admin] REQUEST_METHOD: `PUT` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:12:24.397834 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cfe459-d19d-49d0-a1c1-ef7dc4d8c4f3 None admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:12:24.398108 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cfe459-d19d-49d0-a1c1-ef7dc4d8c4f3 None admin] PATH_INFO: `/v3/projects/ccf26e412fd94549b83373865a854c58/users/28145f1e037649249ae73ee4523d4aaf/roles/eb54c9cea2774a25b1fe8c79724408ee` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:12:24.400572 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6cfe459-d19d-49d0-a1c1-ef7dc4d8c4f3 None admin] RBAC: Authorizing `identity:create_grant(project_id=ccf26e412fd94549b83373865a854c58, user_id=28145f1e037649249ae73ee4523d4aaf, role_id=eb54c9cea2774a25b1fe8c79724408ee)` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:12:24.401974 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6cfe459-d19d-49d0-a1c1-ef7dc4d8c4f3 None admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:12:24.414266 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 571/1153] 10.222.0.21 () {58 vars in 1439 bytes} [Wed May 4 07:12:24 2022] PUT /identity/v3/projects/ccf26e412fd94549b83373865a854c58/users/28145f1e037649249ae73ee4523d4aaf/roles/eb54c9cea2774a25b1fe8c79724408ee => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 07:12:26.645417 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e248b4cf-687c-434f-90b1-9d29b805e66a None None] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:12:26.645958 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e248b4cf-687c-434f-90b1-9d29b805e66a None None] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:12:26.645958 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e248b4cf-687c-434f-90b1-9d29b805e66a None None] PATH_INFO: `/` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:12:26.647362 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 583/1154] 10.222.0.21 () {54 vars in 926 bytes} [Wed May 4 07:12:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 07:12:26.653208 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0514ecba-e6a8-49d1-8640-c8f7cce7c2e4 None None] REQUEST_METHOD: `POST` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:12:26.653629 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0514ecba-e6a8-49d1-8640-c8f7cce7c2e4 None None] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:12:26.653764 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0514ecba-e6a8-49d1-8640-c8f7cce7c2e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:12:26.670571 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.auth.core [None req-0514ecba-e6a8-49d1-8640-c8f7cce7c2e4 None None] MFA Rules not processed for user `83c5e0dcb991496ea6dee38384514508`. Rule list: `[]` (Enabled: `True`). {{(pid=79745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:12:26.671781 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.fernet_utils [None req-0514ecba-e6a8-49d1-8640-c8f7cce7c2e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:12:26.734700 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 572/1155] 10.222.0.21 () {58 vars in 1023 bytes} [Wed May 4 07:12:26 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 07:12:26.758251 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e248b4cf-687c-434f-90b1-9d29b805e66a None None] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:12:26.853045 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e248b4cf-687c-434f-90b1-9d29b805e66a None None] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:12:26.884889 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0240fd-026d-48bd-8d98-6a3af24184b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:12:26.885692 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0240fd-026d-48bd-8d98-6a3af24184b5 None admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:12:26.885971 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0240fd-026d-48bd-8d98-6a3af24184b5 None admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:12:26.886244 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0240fd-026d-48bd-8d98-6a3af24184b5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:12:26.896197 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0240fd-026d-48bd-8d98-6a3af24184b5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 07:12:26.903750 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application [None req-3a0240fd-026d-48bd-8d98-6a3af24184b5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 04 07:12:26.903750 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 07:12:26.903750 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 07:12:26.903750 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 07:12:26.903750 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 07:12:26.903750 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 07:12:26.903750 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 07:12:26.903750 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 07:12:26.903750 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 07:12:26.903750 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 07:12:26.903750 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 07:12:26.903750 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 07:12:26.903750 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 07:12:26.903750 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 07:12:26.903750 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 07:12:26.903750 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 07:12:26.904863 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 07:12:26.904863 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 07:12:26.904863 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 07:12:26.904863 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 07:12:26.904863 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 07:12:26.904863 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 07:12:26.904863 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 07:12:26.904863 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 07:12:26.904863 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 07:12:26.904863 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.get_or_create( May 04 07:12:26.904863 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 07:12:26.904863 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application with Lock( May 04 07:12:26.904863 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 07:12:26.904863 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self._enter() May 04 07:12:26.904863 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 07:12:26.904863 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 07:12:26.906109 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 07:12:26.906109 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.creator() May 04 07:12:26.906109 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 07:12:26.906109 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application created_value = creator( May 04 07:12:26.906109 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 07:12:26.906109 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 07:12:26.906109 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 07:12:26.906109 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 07:12:26.906109 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 07:12:26.906109 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 07:12:26.906109 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 04 07:12:26.906109 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application May 04 07:12:26.906109 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 584/1156] 10.222.0.21 () {56 vars in 1096 bytes} [Wed May 4 07:12:26 2022] GET /identity/v3/roles/admin => generated 83 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 07:12:26.910731 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0514ecba-e6a8-49d1-8640-c8f7cce7c2e4 None None] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:12:27.002511 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0514ecba-e6a8-49d1-8640-c8f7cce7c2e4 None None] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:12:27.035056 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1dc29c-6ba6-4fbb-a5ee-764b755e5fa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:12:27.035731 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1dc29c-6ba6-4fbb-a5ee-764b755e5fa7 None admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:12:27.036009 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1dc29c-6ba6-4fbb-a5ee-764b755e5fa7 None admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:12:27.036279 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1dc29c-6ba6-4fbb-a5ee-764b755e5fa7 None admin] PATH_INFO: `/v3/roles` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:12:27.037016 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1dc29c-6ba6-4fbb-a5ee-764b755e5fa7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 07:12:27.037316 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1dc29c-6ba6-4fbb-a5ee-764b755e5fa7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:12:27.038661 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1dc29c-6ba6-4fbb-a5ee-764b755e5fa7 None admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:12:27.046421 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 573/1157] 10.222.0.21 () {56 vars in 1099 bytes} [Wed May 4 07:12:26 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 07:12:27.052097 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0240fd-026d-48bd-8d98-6a3af24184b5 None admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:12:27.144442 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0240fd-026d-48bd-8d98-6a3af24184b5 None admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:12:27.176489 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0caa5ae-5b2f-461c-950d-f3d521d1cae8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:12:27.177321 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0caa5ae-5b2f-461c-950d-f3d521d1cae8 None admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:12:27.177594 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0caa5ae-5b2f-461c-950d-f3d521d1cae8 None admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:12:27.177858 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0caa5ae-5b2f-461c-950d-f3d521d1cae8 None admin] PATH_INFO: `/v3/users/28145f1e037649249ae73ee4523d4aaf` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:12:27.179004 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0caa5ae-5b2f-461c-950d-f3d521d1cae8 None admin] RBAC: Authorizing `identity:get_user(user_id=28145f1e037649249ae73ee4523d4aaf)` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:12:27.180419 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0caa5ae-5b2f-461c-950d-f3d521d1cae8 None admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:12:27.182169 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 585/1158] 10.222.0.21 () {56 vars in 1177 bytes} [Wed May 4 07:12:27 2022] GET /identity/v3/users/28145f1e037649249ae73ee4523d4aaf => generated 286 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 07:12:27.187711 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1dc29c-6ba6-4fbb-a5ee-764b755e5fa7 None admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:12:27.282269 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1dc29c-6ba6-4fbb-a5ee-764b755e5fa7 None admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:12:27.313541 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0840dc1b-9365-4de2-bb3b-be3cd5cd8ae3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:12:27.314169 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0840dc1b-9365-4de2-bb3b-be3cd5cd8ae3 None admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:12:27.314448 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0840dc1b-9365-4de2-bb3b-be3cd5cd8ae3 None admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:12:27.314721 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0840dc1b-9365-4de2-bb3b-be3cd5cd8ae3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:12:27.379756 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0840dc1b-9365-4de2-bb3b-be3cd5cd8ae3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:12:27.381181 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0840dc1b-9365-4de2-bb3b-be3cd5cd8ae3 None admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:12:27.473346 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 574/1159] 10.222.0.21 () {58 vars in 1282 bytes} [Wed May 4 07:12:27 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 286 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 04 07:12:27.479911 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0caa5ae-5b2f-461c-950d-f3d521d1cae8 None admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:12:27.570916 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0caa5ae-5b2f-461c-950d-f3d521d1cae8 None admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:12:27.602356 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234cb283-7183-42af-9432-2eb8a261201c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:12:27.603320 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234cb283-7183-42af-9432-2eb8a261201c None admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:12:27.603591 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234cb283-7183-42af-9432-2eb8a261201c None admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:12:27.603859 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234cb283-7183-42af-9432-2eb8a261201c None admin] PATH_INFO: `/v3/projects/ccf26e412fd94549b83373865a854c58` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:12:27.604998 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234cb283-7183-42af-9432-2eb8a261201c None admin] RBAC: Authorizing `identity:get_project(project_id=ccf26e412fd94549b83373865a854c58)` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:12:27.606420 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234cb283-7183-42af-9432-2eb8a261201c None admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:12:27.608099 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 586/1160] 10.222.0.21 () {56 vars in 1186 bytes} [Wed May 4 07:12:27 2022] GET /identity/v3/projects/ccf26e412fd94549b83373865a854c58 => generated 311 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 07:12:27.614162 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0840dc1b-9365-4de2-bb3b-be3cd5cd8ae3 None admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:12:27.707848 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0840dc1b-9365-4de2-bb3b-be3cd5cd8ae3 None admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:12:27.740735 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b3321c-3d6f-44d6-8169-adeef414f060 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:12:27.741365 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b3321c-3d6f-44d6-8169-adeef414f060 None admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:12:27.741641 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b3321c-3d6f-44d6-8169-adeef414f060 None admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:12:27.741909 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b3321c-3d6f-44d6-8169-adeef414f060 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:12:27.742716 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b3321c-3d6f-44d6-8169-adeef414f060 None admin] RBAC: Adding query filter params (role.id=eb54c9cea2774a25b1fe8c79724408ee, scope.project.id=ccf26e412fd94549b83373865a854c58, user.id=28145f1e037649249ae73ee4523d4aaf) {{(pid=79745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 07:12:27.743018 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b3321c-3d6f-44d6-8169-adeef414f060 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:12:27.744585 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b3321c-3d6f-44d6-8169-adeef414f060 None admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:12:27.750025 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 575/1161] 10.222.0.21 () {56 vars in 1374 bytes} [Wed May 4 07:12:27 2022] GET /identity/v3/role_assignments?user.id=28145f1e037649249ae73ee4523d4aaf&scope.project.id=ccf26e412fd94549b83373865a854c58&role.id=eb54c9cea2774a25b1fe8c79724408ee => generated 608 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 07:12:30.027419 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ab56c6-154b-41d7-8df3-b2bc0dbb9ad0 None None] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:12:30.027958 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ab56c6-154b-41d7-8df3-b2bc0dbb9ad0 None None] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:12:30.027958 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ab56c6-154b-41d7-8df3-b2bc0dbb9ad0 None None] PATH_INFO: `/` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:12:30.029656 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 587/1162] 10.222.0.21 () {54 vars in 926 bytes} [Wed May 4 07:12:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 07:12:30.036160 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05193c2a-a219-4131-a6c8-31696497087e None None] REQUEST_METHOD: `POST` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:12:30.036658 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05193c2a-a219-4131-a6c8-31696497087e None None] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:12:30.036784 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05193c2a-a219-4131-a6c8-31696497087e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:12:30.055407 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.auth.core [None req-05193c2a-a219-4131-a6c8-31696497087e None None] MFA Rules not processed for user `83c5e0dcb991496ea6dee38384514508`. Rule list: `[]` (Enabled: `True`). {{(pid=79745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:12:30.056766 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.fernet_utils [None req-05193c2a-a219-4131-a6c8-31696497087e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:12:30.122695 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 576/1163] 10.222.0.21 () {58 vars in 1023 bytes} [Wed May 4 07:12:30 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 07:12:30.145511 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ab56c6-154b-41d7-8df3-b2bc0dbb9ad0 None None] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:12:30.239899 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ab56c6-154b-41d7-8df3-b2bc0dbb9ad0 None None] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:12:30.272572 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7da52e-3658-4c52-b800-9b54598ce341 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:12:30.273193 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7da52e-3658-4c52-b800-9b54598ce341 None admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:12:30.273467 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7da52e-3658-4c52-b800-9b54598ce341 None admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:12:30.273734 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7da52e-3658-4c52-b800-9b54598ce341 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:12:30.346247 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7da52e-3658-4c52-b800-9b54598ce341 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:12:30.347639 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7da52e-3658-4c52-b800-9b54598ce341 None admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:12:30.438939 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 588/1164] 10.222.0.21 () {58 vars in 1282 bytes} [Wed May 4 07:12:30 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 04 07:12:30.445068 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05193c2a-a219-4131-a6c8-31696497087e None None] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:12:30.537635 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05193c2a-a219-4131-a6c8-31696497087e None None] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:12:30.568427 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96d503f-946f-4cb7-8414-fe7bd913381d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:12:30.569204 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96d503f-946f-4cb7-8414-fe7bd913381d None admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:12:30.569478 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96d503f-946f-4cb7-8414-fe7bd913381d None admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:12:30.569743 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96d503f-946f-4cb7-8414-fe7bd913381d None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:12:30.576826 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96d503f-946f-4cb7-8414-fe7bd913381d None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:12:30.578261 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96d503f-946f-4cb7-8414-fe7bd913381d None admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:12:30.593804 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application [None req-b96d503f-946f-4cb7-8414-fe7bd913381d None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. May 04 07:12:30.593804 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 07:12:30.593804 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain May 04 07:12:30.593804 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) May 04 07:12:30.593804 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 04 07:12:30.593804 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 04 07:12:30.593804 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 04 07:12:30.593804 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 04 07:12:30.593804 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. May 04 07:12:30.593804 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application May 04 07:12:30.593804 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 04 07:12:30.593804 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application May 04 07:12:30.593804 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 07:12:30.593804 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 07:12:30.593804 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 07:12:30.593804 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 07:12:30.593804 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 07:12:30.595028 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 07:12:30.595028 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 07:12:30.595028 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 07:12:30.595028 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 07:12:30.595028 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 07:12:30.595028 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 07:12:30.595028 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 07:12:30.595028 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 07:12:30.595028 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 07:12:30.595028 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 07:12:30.595028 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 07:12:30.595028 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 07:12:30.595028 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 07:12:30.595028 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 07:12:30.595028 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 07:12:30.595028 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self.get_or_create( May 04 07:12:30.595943 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 07:12:30.595943 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application with Lock( May 04 07:12:30.595943 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 07:12:30.595943 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self._enter() May 04 07:12:30.595943 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 07:12:30.595943 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 07:12:30.595943 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 07:12:30.595943 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self.creator() May 04 07:12:30.595943 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 07:12:30.595943 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application created_value = creator( May 04 07:12:30.595943 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain May 04 07:12:30.595943 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 07:12:30.595943 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. May 04 07:12:30.595943 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application May 04 07:12:30.595943 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 577/1165] 10.222.0.21 () {56 vars in 1117 bytes} [Wed May 4 07:12:30 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 07:12:30.602353 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7da52e-3658-4c52-b800-9b54598ce341 None admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:12:30.704632 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7da52e-3658-4c52-b800-9b54598ce341 None admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:12:30.736561 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd819a35-d156-41e9-a49d-914d7a120e6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:12:30.737205 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd819a35-d156-41e9-a49d-914d7a120e6f None admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:12:30.737483 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd819a35-d156-41e9-a49d-914d7a120e6f None admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:12:30.737754 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd819a35-d156-41e9-a49d-914d7a120e6f None admin] PATH_INFO: `/v3/domains` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:12:30.738460 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd819a35-d156-41e9-a49d-914d7a120e6f None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=79744) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 07:12:30.738767 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd819a35-d156-41e9-a49d-914d7a120e6f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:12:30.740136 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd819a35-d156-41e9-a49d-914d7a120e6f None admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:12:30.747637 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 589/1166] 10.222.0.21 () {56 vars in 1115 bytes} [Wed May 4 07:12:30 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 07:12:32.978119 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331c7927-ff64-4683-8b43-8b4d64ce39d1 None None] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:12:32.978706 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331c7927-ff64-4683-8b43-8b4d64ce39d1 None None] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:12:32.978706 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331c7927-ff64-4683-8b43-8b4d64ce39d1 None None] PATH_INFO: `/` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:12:32.980084 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 578/1167] 10.222.0.21 () {54 vars in 926 bytes} [Wed May 4 07:12:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 07:12:32.985096 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2492849a-2811-43e2-8180-7a41ac71cee7 None None] REQUEST_METHOD: `POST` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:12:32.985570 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2492849a-2811-43e2-8180-7a41ac71cee7 None None] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:12:32.985671 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2492849a-2811-43e2-8180-7a41ac71cee7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:12:33.002311 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.auth.core [None req-2492849a-2811-43e2-8180-7a41ac71cee7 None None] MFA Rules not processed for user `83c5e0dcb991496ea6dee38384514508`. Rule list: `[]` (Enabled: `True`). {{(pid=79744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:12:33.003521 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.fernet_utils [None req-2492849a-2811-43e2-8180-7a41ac71cee7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:12:33.065417 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 590/1168] 10.222.0.21 () {58 vars in 1023 bytes} [Wed May 4 07:12:32 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 07:12:33.089218 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331c7927-ff64-4683-8b43-8b4d64ce39d1 None None] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:12:33.183519 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331c7927-ff64-4683-8b43-8b4d64ce39d1 None None] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:12:33.214399 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2fd934-b0a1-49f9-954a-9ff75990a66b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:12:33.215024 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2fd934-b0a1-49f9-954a-9ff75990a66b None admin] REQUEST_METHOD: `POST` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:12:33.215329 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2fd934-b0a1-49f9-954a-9ff75990a66b None admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:12:33.215597 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2fd934-b0a1-49f9-954a-9ff75990a66b None admin] PATH_INFO: `/v3/domains` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:12:33.216310 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2fd934-b0a1-49f9-954a-9ff75990a66b None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:12:33.217642 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2fd934-b0a1-49f9-954a-9ff75990a66b None admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:12:33.231715 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 579/1169] 10.222.0.21 () {60 vars in 1138 bytes} [Wed May 4 07:12:33 2022] POST /identity/v3/domains => generated 267 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 07:12:35.473251 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573c0259-4f08-4843-b382-49eaddb9154b None None] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:12:35.473753 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573c0259-4f08-4843-b382-49eaddb9154b None None] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:12:35.473853 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573c0259-4f08-4843-b382-49eaddb9154b None None] PATH_INFO: `/` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:12:35.475162 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 591/1170] 10.222.0.21 () {54 vars in 926 bytes} [Wed May 4 07:12:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 07:12:35.480448 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c1a7b1-fcea-4f8d-800b-73c38be5244a None None] REQUEST_METHOD: `POST` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:12:35.480860 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c1a7b1-fcea-4f8d-800b-73c38be5244a None None] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:12:35.480990 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c1a7b1-fcea-4f8d-800b-73c38be5244a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:12:35.497915 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.auth.core [None req-f3c1a7b1-fcea-4f8d-800b-73c38be5244a None None] MFA Rules not processed for user `83c5e0dcb991496ea6dee38384514508`. Rule list: `[]` (Enabled: `True`). {{(pid=79745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:12:35.499094 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.fernet_utils [None req-f3c1a7b1-fcea-4f8d-800b-73c38be5244a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:12:35.565951 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 580/1171] 10.222.0.21 () {58 vars in 1023 bytes} [Wed May 4 07:12:35 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 07:12:35.590089 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573c0259-4f08-4843-b382-49eaddb9154b None None] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:12:35.685007 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573c0259-4f08-4843-b382-49eaddb9154b None None] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:12:35.716887 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f033dbd-44b8-4950-b83f-bcd370b48caf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:12:35.717668 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f033dbd-44b8-4950-b83f-bcd370b48caf None admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:12:35.717942 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f033dbd-44b8-4950-b83f-bcd370b48caf None admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:12:35.718209 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f033dbd-44b8-4950-b83f-bcd370b48caf None admin] PATH_INFO: `/v3/domains/7d70866b0c3348a080d539d1f69e4741` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:12:35.728540 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f033dbd-44b8-4950-b83f-bcd370b48caf None admin] RBAC: Authorizing `identity:get_domain(domain_id=7d70866b0c3348a080d539d1f69e4741)` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:12:35.729951 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f033dbd-44b8-4950-b83f-bcd370b48caf None admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:12:35.731575 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 592/1172] 10.222.0.21 () {56 vars in 1183 bytes} [Wed May 4 07:12:35 2022] GET /identity/v3/domains/7d70866b0c3348a080d539d1f69e4741 => generated 267 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 07:12:35.737329 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c1a7b1-fcea-4f8d-800b-73c38be5244a None None] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:12:35.830059 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c1a7b1-fcea-4f8d-800b-73c38be5244a None None] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:12:35.861698 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf8be4e-8a20-40c9-8833-a057766e587c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:12:35.862334 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf8be4e-8a20-40c9-8833-a057766e587c None admin] REQUEST_METHOD: `POST` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:12:35.862608 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf8be4e-8a20-40c9-8833-a057766e587c None admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:12:35.862876 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf8be4e-8a20-40c9-8833-a057766e587c None admin] PATH_INFO: `/v3/projects` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:12:35.863593 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf8be4e-8a20-40c9-8833-a057766e587c None admin] RBAC: Authorizing `identity:create_project()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:12:35.864999 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf8be4e-8a20-40c9-8833-a057766e587c None admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:12:35.888644 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 581/1173] 10.222.0.21 () {60 vars in 1141 bytes} [Wed May 4 07:12:35 2022] POST /identity/v3/projects => generated 361 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 07:12:38.179865 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bef8f47-1e8d-42c8-8aae-261d3276e00a None None] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:12:38.180423 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bef8f47-1e8d-42c8-8aae-261d3276e00a None None] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:12:38.180423 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bef8f47-1e8d-42c8-8aae-261d3276e00a None None] PATH_INFO: `/` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:12:38.181835 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 593/1174] 10.222.0.21 () {54 vars in 926 bytes} [Wed May 4 07:12:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 07:12:38.186915 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a240cc-2538-4d2c-8c5b-d67432a83b09 None None] REQUEST_METHOD: `POST` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:12:38.187349 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a240cc-2538-4d2c-8c5b-d67432a83b09 None None] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:12:38.187511 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a240cc-2538-4d2c-8c5b-d67432a83b09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:12:38.204137 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.auth.core [None req-96a240cc-2538-4d2c-8c5b-d67432a83b09 None None] MFA Rules not processed for user `83c5e0dcb991496ea6dee38384514508`. Rule list: `[]` (Enabled: `True`). {{(pid=79745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:12:38.205296 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.fernet_utils [None req-96a240cc-2538-4d2c-8c5b-d67432a83b09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:12:38.267644 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 582/1175] 10.222.0.21 () {58 vars in 1023 bytes} [Wed May 4 07:12:38 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 07:12:38.297645 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bef8f47-1e8d-42c8-8aae-261d3276e00a None None] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:12:38.396291 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bef8f47-1e8d-42c8-8aae-261d3276e00a None None] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:12:38.427927 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff562cef-3bf6-4033-8c05-b06875f8f4c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:12:38.428770 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff562cef-3bf6-4033-8c05-b06875f8f4c2 None admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:12:38.429040 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff562cef-3bf6-4033-8c05-b06875f8f4c2 None admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:12:38.429306 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff562cef-3bf6-4033-8c05-b06875f8f4c2 None admin] PATH_INFO: `/v3/domains/7d70866b0c3348a080d539d1f69e4741` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:12:38.430503 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff562cef-3bf6-4033-8c05-b06875f8f4c2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=7d70866b0c3348a080d539d1f69e4741)` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:12:38.432085 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff562cef-3bf6-4033-8c05-b06875f8f4c2 None admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:12:38.433664 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 594/1176] 10.222.0.21 () {56 vars in 1183 bytes} [Wed May 4 07:12:38 2022] GET /identity/v3/domains/7d70866b0c3348a080d539d1f69e4741 => generated 267 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 07:12:38.439444 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a240cc-2538-4d2c-8c5b-d67432a83b09 None None] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:12:38.536242 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a240cc-2538-4d2c-8c5b-d67432a83b09 None None] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:12:38.568570 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a3068e-9693-49ac-a8ec-1c10b2319f29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:12:38.569222 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a3068e-9693-49ac-a8ec-1c10b2319f29 None admin] REQUEST_METHOD: `POST` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:12:38.569499 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a3068e-9693-49ac-a8ec-1c10b2319f29 None admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:12:38.569768 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a3068e-9693-49ac-a8ec-1c10b2319f29 None admin] PATH_INFO: `/v3/users` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:12:38.570473 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a3068e-9693-49ac-a8ec-1c10b2319f29 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:12:38.572178 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a3068e-9693-49ac-a8ec-1c10b2319f29 None admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:12:38.591416 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 583/1177] 10.222.0.21 () {60 vars in 1132 bytes} [Wed May 4 07:12:38 2022] POST /identity/v3/users => generated 311 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 07:12:41.120972 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c19c5b-16d1-49c4-b669-949512f41f6b None None] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:12:41.121522 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c19c5b-16d1-49c4-b669-949512f41f6b None None] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:12:41.121522 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c19c5b-16d1-49c4-b669-949512f41f6b None None] PATH_INFO: `/` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:12:41.122857 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 595/1178] 10.222.0.21 () {54 vars in 926 bytes} [Wed May 4 07:12:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 04 07:12:41.127896 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a4c788-d400-4445-b538-8cbef7a58fd3 None None] REQUEST_METHOD: `POST` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:12:41.128278 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a4c788-d400-4445-b538-8cbef7a58fd3 None None] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:12:41.128446 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a4c788-d400-4445-b538-8cbef7a58fd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:12:41.144812 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.auth.core [None req-33a4c788-d400-4445-b538-8cbef7a58fd3 None None] MFA Rules not processed for user `83c5e0dcb991496ea6dee38384514508`. Rule list: `[]` (Enabled: `True`). {{(pid=79745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:12:41.145974 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.fernet_utils [None req-33a4c788-d400-4445-b538-8cbef7a58fd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:12:41.208260 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 584/1179] 10.222.0.21 () {58 vars in 1023 bytes} [Wed May 4 07:12:41 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 07:12:41.231755 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c19c5b-16d1-49c4-b669-949512f41f6b None None] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:12:41.335107 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c19c5b-16d1-49c4-b669-949512f41f6b None None] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:12:41.367442 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c4f422-4e22-4c47-acd1-d2318c7efc43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:12:41.368251 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c4f422-4e22-4c47-acd1-d2318c7efc43 None admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:12:41.368663 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c4f422-4e22-4c47-acd1-d2318c7efc43 None admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:12:41.368937 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c4f422-4e22-4c47-acd1-d2318c7efc43 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:12:41.378718 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c4f422-4e22-4c47-acd1-d2318c7efc43 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 07:12:41.386652 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application [None req-37c4f422-4e22-4c47-acd1-d2318c7efc43 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 04 07:12:41.386652 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 07:12:41.386652 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 07:12:41.386652 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 07:12:41.386652 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 07:12:41.386652 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 07:12:41.386652 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 07:12:41.386652 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 07:12:41.386652 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 07:12:41.386652 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 07:12:41.386652 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 07:12:41.386652 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 07:12:41.386652 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 07:12:41.386652 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 07:12:41.386652 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 07:12:41.386652 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 07:12:41.387859 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 07:12:41.387859 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 07:12:41.387859 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 07:12:41.387859 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 07:12:41.387859 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 07:12:41.387859 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 07:12:41.387859 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 07:12:41.387859 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 07:12:41.387859 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 07:12:41.387859 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.get_or_create( May 04 07:12:41.387859 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 07:12:41.387859 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application with Lock( May 04 07:12:41.387859 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 07:12:41.387859 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self._enter() May 04 07:12:41.387859 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 07:12:41.387859 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 07:12:41.388982 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 07:12:41.388982 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.creator() May 04 07:12:41.388982 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 07:12:41.388982 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application created_value = creator( May 04 07:12:41.388982 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 07:12:41.388982 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 07:12:41.388982 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 07:12:41.388982 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 07:12:41.388982 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 07:12:41.388982 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 07:12:41.388982 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 04 07:12:41.388982 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application May 04 07:12:41.388982 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 596/1180] 10.222.0.21 () {56 vars in 1096 bytes} [Wed May 4 07:12:41 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 07:12:41.397424 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a4c788-d400-4445-b538-8cbef7a58fd3 None None] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:12:41.492300 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a4c788-d400-4445-b538-8cbef7a58fd3 None None] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:12:41.523273 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2aff15-05ed-436e-add5-25a1456e8fe2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:12:41.523924 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2aff15-05ed-436e-add5-25a1456e8fe2 None admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:12:41.524775 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2aff15-05ed-436e-add5-25a1456e8fe2 None admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:12:41.525084 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2aff15-05ed-436e-add5-25a1456e8fe2 None admin] PATH_INFO: `/v3/roles` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:12:41.525821 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2aff15-05ed-436e-add5-25a1456e8fe2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 07:12:41.526120 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2aff15-05ed-436e-add5-25a1456e8fe2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:12:41.527494 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2aff15-05ed-436e-add5-25a1456e8fe2 None admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:12:41.534944 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 585/1181] 10.222.0.21 () {56 vars in 1099 bytes} [Wed May 4 07:12:41 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 07:12:41.541287 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c4f422-4e22-4c47-acd1-d2318c7efc43 None admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:12:41.633788 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c4f422-4e22-4c47-acd1-d2318c7efc43 None admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:12:41.665690 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274ce0af-f08b-4e1e-881b-3e6de4edff2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:12:41.666528 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274ce0af-f08b-4e1e-881b-3e6de4edff2f None admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:12:41.666800 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274ce0af-f08b-4e1e-881b-3e6de4edff2f None admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:12:41.667063 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274ce0af-f08b-4e1e-881b-3e6de4edff2f None admin] PATH_INFO: `/v3/users/0973bf7fd6a544a4a3aa3264df5932a8` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:12:41.679191 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274ce0af-f08b-4e1e-881b-3e6de4edff2f None admin] RBAC: Authorizing `identity:get_user(user_id=0973bf7fd6a544a4a3aa3264df5932a8)` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:12:41.681152 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274ce0af-f08b-4e1e-881b-3e6de4edff2f None admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:12:41.682747 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 597/1182] 10.222.0.21 () {56 vars in 1177 bytes} [Wed May 4 07:12:41 2022] GET /identity/v3/users/0973bf7fd6a544a4a3aa3264df5932a8 => generated 311 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 07:12:41.688501 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2aff15-05ed-436e-add5-25a1456e8fe2 None admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:12:41.781234 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2aff15-05ed-436e-add5-25a1456e8fe2 None admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:12:41.812669 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65a30d5-ad59-4b6d-af77-703254f53c37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:12:41.813293 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65a30d5-ad59-4b6d-af77-703254f53c37 None admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:12:41.813571 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65a30d5-ad59-4b6d-af77-703254f53c37 None admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:12:41.813843 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65a30d5-ad59-4b6d-af77-703254f53c37 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:12:41.875936 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65a30d5-ad59-4b6d-af77-703254f53c37 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:12:41.877357 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65a30d5-ad59-4b6d-af77-703254f53c37 None admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:12:41.968537 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 586/1183] 10.222.0.21 () {58 vars in 1282 bytes} [Wed May 4 07:12:41 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 280 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 04 07:12:41.974427 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274ce0af-f08b-4e1e-881b-3e6de4edff2f None admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:12:42.067376 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274ce0af-f08b-4e1e-881b-3e6de4edff2f None admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:12:42.099219 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75d2ab0-d8fa-45a9-b858-585f967654f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:12:42.100051 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75d2ab0-d8fa-45a9-b858-585f967654f4 None admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:12:42.100323 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75d2ab0-d8fa-45a9-b858-585f967654f4 None admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:12:42.100588 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75d2ab0-d8fa-45a9-b858-585f967654f4 None admin] PATH_INFO: `/v3/projects/d1fff8754d7e4ec2a89527bae766e63d` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:12:42.101725 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75d2ab0-d8fa-45a9-b858-585f967654f4 None admin] RBAC: Authorizing `identity:get_project(project_id=d1fff8754d7e4ec2a89527bae766e63d)` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:12:42.103183 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75d2ab0-d8fa-45a9-b858-585f967654f4 None admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:12:42.104810 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 598/1184] 10.222.0.21 () {56 vars in 1186 bytes} [Wed May 4 07:12:41 2022] GET /identity/v3/projects/d1fff8754d7e4ec2a89527bae766e63d => generated 361 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 07:12:42.110769 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65a30d5-ad59-4b6d-af77-703254f53c37 None admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:12:42.203193 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65a30d5-ad59-4b6d-af77-703254f53c37 None admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:12:42.234282 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b736db3d-1ab9-4709-887d-e40877cf04b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:12:42.234847 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b736db3d-1ab9-4709-887d-e40877cf04b5 None admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:12:42.235122 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b736db3d-1ab9-4709-887d-e40877cf04b5 None admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:12:42.235423 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b736db3d-1ab9-4709-887d-e40877cf04b5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:12:42.236232 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b736db3d-1ab9-4709-887d-e40877cf04b5 None admin] RBAC: Adding query filter params (role.id=eb54c9cea2774a25b1fe8c79724408ee, scope.project.id=d1fff8754d7e4ec2a89527bae766e63d, user.id=0973bf7fd6a544a4a3aa3264df5932a8) {{(pid=79745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 07:12:42.236540 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b736db3d-1ab9-4709-887d-e40877cf04b5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:12:42.237959 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b736db3d-1ab9-4709-887d-e40877cf04b5 None admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:12:42.243590 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 587/1185] 10.222.0.21 () {56 vars in 1374 bytes} [Wed May 4 07:12:42 2022] GET /identity/v3/role_assignments?user.id=0973bf7fd6a544a4a3aa3264df5932a8&scope.project.id=d1fff8754d7e4ec2a89527bae766e63d&role.id=eb54c9cea2774a25b1fe8c79724408ee => generated 259 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 07:12:44.497383 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabc0b75-2d84-4ac3-bff0-fd14caf1fcc0 None None] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:12:44.497864 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabc0b75-2d84-4ac3-bff0-fd14caf1fcc0 None None] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:12:44.497979 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabc0b75-2d84-4ac3-bff0-fd14caf1fcc0 None None] PATH_INFO: `/` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:12:44.499349 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 599/1186] 10.222.0.21 () {54 vars in 926 bytes} [Wed May 4 07:12:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 07:12:44.504412 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0de3065-196f-487d-a98b-8d2f16a30f86 None None] REQUEST_METHOD: `POST` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:12:44.504805 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0de3065-196f-487d-a98b-8d2f16a30f86 None None] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:12:44.504957 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0de3065-196f-487d-a98b-8d2f16a30f86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:12:44.522642 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.auth.core [None req-d0de3065-196f-487d-a98b-8d2f16a30f86 None None] MFA Rules not processed for user `83c5e0dcb991496ea6dee38384514508`. Rule list: `[]` (Enabled: `True`). {{(pid=79745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:12:44.523824 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.fernet_utils [None req-d0de3065-196f-487d-a98b-8d2f16a30f86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:12:44.584794 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 588/1187] 10.222.0.21 () {58 vars in 1023 bytes} [Wed May 4 07:12:44 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 07:12:44.609161 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabc0b75-2d84-4ac3-bff0-fd14caf1fcc0 None None] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:12:44.703399 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabc0b75-2d84-4ac3-bff0-fd14caf1fcc0 None None] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:12:44.734701 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907d1515-9c84-4c8e-bf52-519984bd1a2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:12:44.735504 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907d1515-9c84-4c8e-bf52-519984bd1a2f None admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:12:44.735781 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907d1515-9c84-4c8e-bf52-519984bd1a2f None admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:12:44.736051 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907d1515-9c84-4c8e-bf52-519984bd1a2f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:12:44.746167 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907d1515-9c84-4c8e-bf52-519984bd1a2f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 07:12:44.753645 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application [None req-907d1515-9c84-4c8e-bf52-519984bd1a2f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 04 07:12:44.753645 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 07:12:44.753645 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 07:12:44.753645 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 07:12:44.753645 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 07:12:44.753645 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 07:12:44.753645 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 07:12:44.753645 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 07:12:44.753645 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 07:12:44.753645 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 07:12:44.753645 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 07:12:44.753645 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 07:12:44.753645 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 07:12:44.753645 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 07:12:44.753645 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 07:12:44.753645 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 07:12:44.754751 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 07:12:44.754751 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 07:12:44.754751 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 07:12:44.754751 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 07:12:44.754751 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 07:12:44.754751 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 07:12:44.754751 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 07:12:44.754751 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 07:12:44.754751 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 07:12:44.754751 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.get_or_create( May 04 07:12:44.754751 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 07:12:44.754751 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application with Lock( May 04 07:12:44.754751 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 07:12:44.754751 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self._enter() May 04 07:12:44.754751 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 07:12:44.754751 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 07:12:44.755843 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 07:12:44.755843 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.creator() May 04 07:12:44.755843 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 07:12:44.755843 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application created_value = creator( May 04 07:12:44.755843 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 07:12:44.755843 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 07:12:44.755843 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 07:12:44.755843 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 07:12:44.755843 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 07:12:44.755843 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 07:12:44.755843 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 04 07:12:44.755843 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application May 04 07:12:44.755843 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 600/1188] 10.222.0.21 () {56 vars in 1096 bytes} [Wed May 4 07:12:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 146 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 07:12:44.761073 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0de3065-196f-487d-a98b-8d2f16a30f86 None None] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:12:44.851114 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0de3065-196f-487d-a98b-8d2f16a30f86 None None] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:12:44.881434 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581b1152-5ba1-4ef2-8201-9b72e1ac2775 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:12:44.882317 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581b1152-5ba1-4ef2-8201-9b72e1ac2775 None admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:12:44.882599 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581b1152-5ba1-4ef2-8201-9b72e1ac2775 None admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:12:44.882868 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581b1152-5ba1-4ef2-8201-9b72e1ac2775 None admin] PATH_INFO: `/v3/roles` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:12:44.884186 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581b1152-5ba1-4ef2-8201-9b72e1ac2775 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 07:12:44.884458 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581b1152-5ba1-4ef2-8201-9b72e1ac2775 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:12:44.885819 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581b1152-5ba1-4ef2-8201-9b72e1ac2775 None admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:12:44.893264 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 589/1189] 10.222.0.21 () {56 vars in 1099 bytes} [Wed May 4 07:12:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 07:12:44.899718 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907d1515-9c84-4c8e-bf52-519984bd1a2f None admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:12:44.992769 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907d1515-9c84-4c8e-bf52-519984bd1a2f None admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:12:45.024511 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8eb6513-79c1-4210-b248-c2c057853641 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:12:45.025355 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8eb6513-79c1-4210-b248-c2c057853641 None admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:12:45.025628 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8eb6513-79c1-4210-b248-c2c057853641 None admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:12:45.025891 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8eb6513-79c1-4210-b248-c2c057853641 None admin] PATH_INFO: `/v3/users/0973bf7fd6a544a4a3aa3264df5932a8` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:12:45.027038 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8eb6513-79c1-4210-b248-c2c057853641 None admin] RBAC: Authorizing `identity:get_user(user_id=0973bf7fd6a544a4a3aa3264df5932a8)` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:12:45.028489 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8eb6513-79c1-4210-b248-c2c057853641 None admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:12:45.030064 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 601/1190] 10.222.0.21 () {56 vars in 1177 bytes} [Wed May 4 07:12:44 2022] GET /identity/v3/users/0973bf7fd6a544a4a3aa3264df5932a8 => generated 311 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 07:12:45.036259 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581b1152-5ba1-4ef2-8201-9b72e1ac2775 None admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:12:45.127763 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581b1152-5ba1-4ef2-8201-9b72e1ac2775 None admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:12:45.159210 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e1bf8e-68d3-4bfe-856c-a03f554bec21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:12:45.160054 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e1bf8e-68d3-4bfe-856c-a03f554bec21 None admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:12:45.160328 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e1bf8e-68d3-4bfe-856c-a03f554bec21 None admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:12:45.160591 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e1bf8e-68d3-4bfe-856c-a03f554bec21 None admin] PATH_INFO: `/v3/projects/d1fff8754d7e4ec2a89527bae766e63d` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:12:45.161733 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e1bf8e-68d3-4bfe-856c-a03f554bec21 None admin] RBAC: Authorizing `identity:get_project(project_id=d1fff8754d7e4ec2a89527bae766e63d)` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:12:45.163134 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e1bf8e-68d3-4bfe-856c-a03f554bec21 None admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:12:45.165482 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 590/1191] 10.222.0.21 () {56 vars in 1186 bytes} [Wed May 4 07:12:45 2022] GET /identity/v3/projects/d1fff8754d7e4ec2a89527bae766e63d => generated 361 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 07:12:45.170942 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8eb6513-79c1-4210-b248-c2c057853641 None admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:12:45.261804 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8eb6513-79c1-4210-b248-c2c057853641 None admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:12:45.292559 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26cc77fb-05bd-4c14-84fd-c2d43f9f6782 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:12:45.293418 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cc77fb-05bd-4c14-84fd-c2d43f9f6782 None admin] REQUEST_METHOD: `PUT` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:12:45.293691 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cc77fb-05bd-4c14-84fd-c2d43f9f6782 None admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:12:45.293956 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cc77fb-05bd-4c14-84fd-c2d43f9f6782 None admin] PATH_INFO: `/v3/projects/d1fff8754d7e4ec2a89527bae766e63d/users/0973bf7fd6a544a4a3aa3264df5932a8/roles/eb54c9cea2774a25b1fe8c79724408ee` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:12:45.295992 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26cc77fb-05bd-4c14-84fd-c2d43f9f6782 None admin] RBAC: Authorizing `identity:create_grant(project_id=d1fff8754d7e4ec2a89527bae766e63d, user_id=0973bf7fd6a544a4a3aa3264df5932a8, role_id=eb54c9cea2774a25b1fe8c79724408ee)` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:12:45.297440 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26cc77fb-05bd-4c14-84fd-c2d43f9f6782 None admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:12:45.310607 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 602/1192] 10.222.0.21 () {58 vars in 1439 bytes} [Wed May 4 07:12:45 2022] PUT /identity/v3/projects/d1fff8754d7e4ec2a89527bae766e63d/users/0973bf7fd6a544a4a3aa3264df5932a8/roles/eb54c9cea2774a25b1fe8c79724408ee => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 07:12:47.619381 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3554af10-e384-4453-ae1d-11363a0d1723 None None] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:12:47.619903 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3554af10-e384-4453-ae1d-11363a0d1723 None None] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:12:47.619903 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3554af10-e384-4453-ae1d-11363a0d1723 None None] PATH_INFO: `/` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:12:47.621256 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 591/1193] 10.222.0.21 () {54 vars in 926 bytes} [Wed May 4 07:12:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 07:12:47.626317 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f36db94-3223-41ab-bb9f-7217eed9c15a None None] REQUEST_METHOD: `POST` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:12:47.626728 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f36db94-3223-41ab-bb9f-7217eed9c15a None None] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:12:47.626836 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f36db94-3223-41ab-bb9f-7217eed9c15a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:12:47.644071 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.auth.core [None req-9f36db94-3223-41ab-bb9f-7217eed9c15a None None] MFA Rules not processed for user `83c5e0dcb991496ea6dee38384514508`. Rule list: `[]` (Enabled: `True`). {{(pid=79744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:12:47.645234 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.fernet_utils [None req-9f36db94-3223-41ab-bb9f-7217eed9c15a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:12:47.707271 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 603/1194] 10.222.0.21 () {58 vars in 1023 bytes} [Wed May 4 07:12:47 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 07:12:47.732804 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3554af10-e384-4453-ae1d-11363a0d1723 None None] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:12:47.831632 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3554af10-e384-4453-ae1d-11363a0d1723 None None] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:12:47.862722 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe55a3a-9fb1-4ce4-94cc-8dbdc7a1c614 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:12:47.863514 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe55a3a-9fb1-4ce4-94cc-8dbdc7a1c614 None admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:12:47.863787 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe55a3a-9fb1-4ce4-94cc-8dbdc7a1c614 None admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:12:47.864053 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe55a3a-9fb1-4ce4-94cc-8dbdc7a1c614 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:12:47.873960 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe55a3a-9fb1-4ce4-94cc-8dbdc7a1c614 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 07:12:47.881559 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application [None req-4fe55a3a-9fb1-4ce4-94cc-8dbdc7a1c614 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 04 07:12:47.881559 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 07:12:47.881559 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 07:12:47.881559 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 07:12:47.881559 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 07:12:47.881559 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 07:12:47.881559 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 07:12:47.881559 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 07:12:47.881559 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 07:12:47.881559 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 07:12:47.881559 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 07:12:47.881559 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 07:12:47.881559 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 07:12:47.881559 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 07:12:47.881559 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 07:12:47.881559 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 07:12:47.882913 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 07:12:47.882913 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 07:12:47.882913 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 07:12:47.882913 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 07:12:47.882913 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 07:12:47.882913 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 07:12:47.882913 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 07:12:47.882913 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 07:12:47.882913 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 07:12:47.882913 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self.get_or_create( May 04 07:12:47.882913 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 07:12:47.882913 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application with Lock( May 04 07:12:47.882913 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 07:12:47.882913 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self._enter() May 04 07:12:47.882913 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 07:12:47.882913 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 07:12:47.884096 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 07:12:47.884096 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self.creator() May 04 07:12:47.884096 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 07:12:47.884096 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application created_value = creator( May 04 07:12:47.884096 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 07:12:47.884096 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 07:12:47.884096 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 07:12:47.884096 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 07:12:47.884096 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 07:12:47.884096 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 07:12:47.884096 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 04 07:12:47.884096 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application May 04 07:12:47.884096 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 592/1195] 10.222.0.21 () {56 vars in 1096 bytes} [Wed May 4 07:12:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 07:12:47.889121 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f36db94-3223-41ab-bb9f-7217eed9c15a None None] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:12:47.980840 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f36db94-3223-41ab-bb9f-7217eed9c15a None None] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:12:48.012413 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c47bd4-a4d3-4b9c-90d5-6aaa4ff2096f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:12:48.013061 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c47bd4-a4d3-4b9c-90d5-6aaa4ff2096f None admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:12:48.013338 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c47bd4-a4d3-4b9c-90d5-6aaa4ff2096f None admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:12:48.013605 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c47bd4-a4d3-4b9c-90d5-6aaa4ff2096f None admin] PATH_INFO: `/v3/roles` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:12:48.014328 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c47bd4-a4d3-4b9c-90d5-6aaa4ff2096f None admin] RBAC: Adding query filter params (name=admin) {{(pid=79744) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 07:12:48.014629 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c47bd4-a4d3-4b9c-90d5-6aaa4ff2096f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:12:48.015990 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c47bd4-a4d3-4b9c-90d5-6aaa4ff2096f None admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:12:48.023587 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 604/1196] 10.222.0.21 () {56 vars in 1099 bytes} [Wed May 4 07:12:47 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 07:12:48.029284 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe55a3a-9fb1-4ce4-94cc-8dbdc7a1c614 None admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:12:48.124257 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe55a3a-9fb1-4ce4-94cc-8dbdc7a1c614 None admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:12:48.155459 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee602355-e7b3-47b6-848c-119609c6c0b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:12:48.156299 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee602355-e7b3-47b6-848c-119609c6c0b1 None admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:12:48.156570 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee602355-e7b3-47b6-848c-119609c6c0b1 None admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:12:48.156834 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee602355-e7b3-47b6-848c-119609c6c0b1 None admin] PATH_INFO: `/v3/users/0973bf7fd6a544a4a3aa3264df5932a8` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:12:48.157984 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee602355-e7b3-47b6-848c-119609c6c0b1 None admin] RBAC: Authorizing `identity:get_user(user_id=0973bf7fd6a544a4a3aa3264df5932a8)` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:12:48.159415 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee602355-e7b3-47b6-848c-119609c6c0b1 None admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:12:48.160989 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 593/1197] 10.222.0.21 () {56 vars in 1177 bytes} [Wed May 4 07:12:48 2022] GET /identity/v3/users/0973bf7fd6a544a4a3aa3264df5932a8 => generated 311 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 07:12:48.167402 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c47bd4-a4d3-4b9c-90d5-6aaa4ff2096f None admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:12:48.258877 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c47bd4-a4d3-4b9c-90d5-6aaa4ff2096f None admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:12:48.289720 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3cc5b9b-3110-47bc-b340-d732a1266e1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:12:48.290783 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cc5b9b-3110-47bc-b340-d732a1266e1b None admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:12:48.291111 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cc5b9b-3110-47bc-b340-d732a1266e1b None admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:12:48.291433 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cc5b9b-3110-47bc-b340-d732a1266e1b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:12:48.354595 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3cc5b9b-3110-47bc-b340-d732a1266e1b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:12:48.356062 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3cc5b9b-3110-47bc-b340-d732a1266e1b None admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:12:48.452964 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 605/1198] 10.222.0.21 () {58 vars in 1282 bytes} [Wed May 4 07:12:48 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 286 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 04 07:12:48.458820 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee602355-e7b3-47b6-848c-119609c6c0b1 None admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:12:48.552310 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee602355-e7b3-47b6-848c-119609c6c0b1 None admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:12:48.583065 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4e0986-6b61-44d6-88f0-ccbffce8d4e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:12:48.583927 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4e0986-6b61-44d6-88f0-ccbffce8d4e7 None admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:12:48.584202 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4e0986-6b61-44d6-88f0-ccbffce8d4e7 None admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:12:48.584466 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4e0986-6b61-44d6-88f0-ccbffce8d4e7 None admin] PATH_INFO: `/v3/projects/d1fff8754d7e4ec2a89527bae766e63d` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:12:48.585617 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4e0986-6b61-44d6-88f0-ccbffce8d4e7 None admin] RBAC: Authorizing `identity:get_project(project_id=d1fff8754d7e4ec2a89527bae766e63d)` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:12:48.587135 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4e0986-6b61-44d6-88f0-ccbffce8d4e7 None admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:12:48.588788 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 594/1199] 10.222.0.21 () {56 vars in 1186 bytes} [Wed May 4 07:12:48 2022] GET /identity/v3/projects/d1fff8754d7e4ec2a89527bae766e63d => generated 361 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 07:12:48.594715 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3cc5b9b-3110-47bc-b340-d732a1266e1b None admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:12:48.686975 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3cc5b9b-3110-47bc-b340-d732a1266e1b None admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:12:48.717534 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9973785b-14f1-46e9-8af0-03dce006052f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:12:48.718157 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9973785b-14f1-46e9-8af0-03dce006052f None admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:12:48.718431 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9973785b-14f1-46e9-8af0-03dce006052f None admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:12:48.718696 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9973785b-14f1-46e9-8af0-03dce006052f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:12:48.719527 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9973785b-14f1-46e9-8af0-03dce006052f None admin] RBAC: Adding query filter params (role.id=eb54c9cea2774a25b1fe8c79724408ee, scope.project.id=d1fff8754d7e4ec2a89527bae766e63d, user.id=0973bf7fd6a544a4a3aa3264df5932a8) {{(pid=79744) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 07:12:48.719829 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9973785b-14f1-46e9-8af0-03dce006052f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:12:48.721231 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9973785b-14f1-46e9-8af0-03dce006052f None admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:12:48.726681 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 606/1200] 10.222.0.21 () {56 vars in 1374 bytes} [Wed May 4 07:12:48 2022] GET /identity/v3/role_assignments?user.id=0973bf7fd6a544a4a3aa3264df5932a8&scope.project.id=d1fff8754d7e4ec2a89527bae766e63d&role.id=eb54c9cea2774a25b1fe8c79724408ee => generated 608 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 07:13:50.564845 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b8e650-80e7-402b-881d-1a6406016ac5 None None] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:13:50.564845 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b8e650-80e7-402b-881d-1a6406016ac5 None None] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:13:50.564845 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b8e650-80e7-402b-881d-1a6406016ac5 None None] PATH_INFO: `/` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:13:50.564845 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 595/1201] 10.222.0.21 () {54 vars in 926 bytes} [Wed May 4 07:13:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 07:13:50.572752 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a4846b-9026-4c0d-9f8f-3a89c04ecd8a None None] REQUEST_METHOD: `POST` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:13:50.573284 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a4846b-9026-4c0d-9f8f-3a89c04ecd8a None None] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:13:50.573284 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a4846b-9026-4c0d-9f8f-3a89c04ecd8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:13:50.593958 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.auth.core [None req-68a4846b-9026-4c0d-9f8f-3a89c04ecd8a None None] MFA Rules not processed for user `83c5e0dcb991496ea6dee38384514508`. Rule list: `[]` (Enabled: `True`). {{(pid=79744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:13:50.595175 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.fernet_utils [None req-68a4846b-9026-4c0d-9f8f-3a89c04ecd8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:13:50.679861 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 607/1202] 10.222.0.21 () {58 vars in 1023 bytes} [Wed May 4 07:13:50 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 04 07:13:50.706615 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b8e650-80e7-402b-881d-1a6406016ac5 None None] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:13:50.828183 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b8e650-80e7-402b-881d-1a6406016ac5 None None] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:13:50.870035 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4565755-b85b-4a43-8c5b-e555faa1b536 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:13:50.871134 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4565755-b85b-4a43-8c5b-e555faa1b536 None admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:13:50.871547 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4565755-b85b-4a43-8c5b-e555faa1b536 None admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:13:50.871938 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4565755-b85b-4a43-8c5b-e555faa1b536 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:13:50.885131 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4565755-b85b-4a43-8c5b-e555faa1b536 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:13:50.886857 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4565755-b85b-4a43-8c5b-e555faa1b536 None admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:13:50.908260 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application [None req-c4565755-b85b-4a43-8c5b-e555faa1b536 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 07:13:50.908260 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 07:13:50.908260 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 07:13:50.908260 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 07:13:50.908260 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 07:13:50.908260 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 07:13:50.908260 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 07:13:50.908260 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 07:13:50.908260 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 07:13:50.908260 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 07:13:50.908260 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 07:13:50.908260 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 07:13:50.908260 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 07:13:50.908260 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 07:13:50.908260 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 07:13:50.914877 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 07:13:50.914877 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 07:13:50.914877 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 07:13:50.914877 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 07:13:50.914877 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 07:13:50.914877 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 07:13:50.914877 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self.get_or_create( May 04 07:13:50.914877 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 07:13:50.914877 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application with Lock( May 04 07:13:50.914877 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 07:13:50.914877 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self._enter() May 04 07:13:50.914877 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 07:13:50.914877 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 07:13:50.914877 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 07:13:50.914877 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self.creator() May 04 07:13:50.914877 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 07:13:50.914877 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application created_value = creator( May 04 07:13:50.916196 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 07:13:50.916196 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 07:13:50.916196 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 07:13:50.916196 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application May 04 07:13:50.916196 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 596/1203] 10.222.0.21 () {56 vars in 1108 bytes} [Wed May 4 07:13:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 07:13:50.916514 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a4846b-9026-4c0d-9f8f-3a89c04ecd8a None None] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:13:51.060826 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a4846b-9026-4c0d-9f8f-3a89c04ecd8a None None] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:13:51.105046 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b838d23e-4043-40b1-a76d-f56b3840305b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:13:51.106487 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b838d23e-4043-40b1-a76d-f56b3840305b None admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:13:51.107044 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b838d23e-4043-40b1-a76d-f56b3840305b None admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:13:51.107518 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b838d23e-4043-40b1-a76d-f56b3840305b None admin] PATH_INFO: `/v3/domains` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:13:51.108745 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b838d23e-4043-40b1-a76d-f56b3840305b None admin] RBAC: Adding query filter params (name=Default) {{(pid=79744) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 07:13:51.109498 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b838d23e-4043-40b1-a76d-f56b3840305b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:13:51.111962 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b838d23e-4043-40b1-a76d-f56b3840305b None admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:13:51.129200 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 608/1204] 10.222.0.21 () {56 vars in 1109 bytes} [Wed May 4 07:13:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 07:13:51.137299 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4565755-b85b-4a43-8c5b-e555faa1b536 None admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:13:51.255650 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4565755-b85b-4a43-8c5b-e555faa1b536 None admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:13:51.305179 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298e98dc-04b7-4951-88bf-e45e1402456e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:13:51.305910 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298e98dc-04b7-4951-88bf-e45e1402456e None admin] REQUEST_METHOD: `POST` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:13:51.306188 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298e98dc-04b7-4951-88bf-e45e1402456e None admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:13:51.306604 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298e98dc-04b7-4951-88bf-e45e1402456e None admin] PATH_INFO: `/v3/users` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:13:51.307403 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298e98dc-04b7-4951-88bf-e45e1402456e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:13:51.309458 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298e98dc-04b7-4951-88bf-e45e1402456e None admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:13:51.331905 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 597/1205] 10.222.0.21 () {60 vars in 1132 bytes} [Wed May 4 07:13:51 2022] POST /identity/v3/users => generated 251 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 07:13:53.876856 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2342ba01-b738-4ac7-9218-60baeaae8898 None None] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:13:53.877418 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2342ba01-b738-4ac7-9218-60baeaae8898 None None] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:13:53.877418 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2342ba01-b738-4ac7-9218-60baeaae8898 None None] PATH_INFO: `/` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:13:53.878946 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 609/1206] 10.222.0.21 () {54 vars in 926 bytes} [Wed May 4 07:13:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 07:13:53.885328 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be69f3f-5901-4f36-80c2-06fc49809575 None None] REQUEST_METHOD: `POST` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:13:53.885787 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be69f3f-5901-4f36-80c2-06fc49809575 None None] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:13:53.885884 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be69f3f-5901-4f36-80c2-06fc49809575 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:13:53.904109 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.auth.core [None req-4be69f3f-5901-4f36-80c2-06fc49809575 None None] MFA Rules not processed for user `83c5e0dcb991496ea6dee38384514508`. Rule list: `[]` (Enabled: `True`). {{(pid=79745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:13:53.905287 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.fernet_utils [None req-4be69f3f-5901-4f36-80c2-06fc49809575 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:13:53.977299 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 598/1207] 10.222.0.21 () {58 vars in 1023 bytes} [Wed May 4 07:13:53 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 07:13:54.001657 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2342ba01-b738-4ac7-9218-60baeaae8898 None None] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:13:54.108084 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2342ba01-b738-4ac7-9218-60baeaae8898 None None] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:13:54.143031 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ab0846-ece8-46db-ae49-0c01050d62ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:13:54.143783 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ab0846-ece8-46db-ae49-0c01050d62ca None admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:13:54.144062 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ab0846-ece8-46db-ae49-0c01050d62ca None admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:13:54.144332 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ab0846-ece8-46db-ae49-0c01050d62ca None admin] PATH_INFO: `/v3/roles/service` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:13:54.157575 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ab0846-ece8-46db-ae49-0c01050d62ca None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 07:13:54.164024 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application [None req-e0ab0846-ece8-46db-ae49-0c01050d62ca None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 04 07:13:54.164024 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 07:13:54.164024 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 07:13:54.164024 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 07:13:54.164024 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 07:13:54.164024 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 07:13:54.164024 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 07:13:54.164024 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 07:13:54.164024 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 07:13:54.164024 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 07:13:54.164024 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 07:13:54.164024 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 07:13:54.164024 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 07:13:54.164024 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 07:13:54.164024 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 07:13:54.164024 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 07:13:54.164979 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 07:13:54.164979 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 07:13:54.164979 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 07:13:54.164979 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 07:13:54.164979 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 07:13:54.164979 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 07:13:54.164979 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 07:13:54.164979 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 07:13:54.164979 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 07:13:54.164979 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.get_or_create( May 04 07:13:54.164979 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 07:13:54.164979 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application with Lock( May 04 07:13:54.164979 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 07:13:54.164979 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self._enter() May 04 07:13:54.164979 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 07:13:54.164979 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 07:13:54.165844 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 07:13:54.165844 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.creator() May 04 07:13:54.165844 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 07:13:54.165844 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application created_value = creator( May 04 07:13:54.165844 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 07:13:54.165844 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 07:13:54.165844 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 07:13:54.165844 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 07:13:54.165844 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 07:13:54.165844 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 07:13:54.165844 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 04 07:13:54.165844 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application May 04 07:13:54.165844 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 610/1208] 10.222.0.21 () {56 vars in 1102 bytes} [Wed May 4 07:13:54 2022] GET /identity/v3/roles/service => generated 85 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 07:13:54.172081 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be69f3f-5901-4f36-80c2-06fc49809575 None None] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:13:54.294620 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be69f3f-5901-4f36-80c2-06fc49809575 None None] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:13:54.331291 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83063ecf-f129-4a09-a4f0-0bda34114c7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:13:54.331979 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83063ecf-f129-4a09-a4f0-0bda34114c7f None admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:13:54.332247 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83063ecf-f129-4a09-a4f0-0bda34114c7f None admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:13:54.332515 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83063ecf-f129-4a09-a4f0-0bda34114c7f None admin] PATH_INFO: `/v3/roles` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:13:54.333255 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83063ecf-f129-4a09-a4f0-0bda34114c7f None admin] RBAC: Adding query filter params (name=service) {{(pid=79745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 07:13:54.333533 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83063ecf-f129-4a09-a4f0-0bda34114c7f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:13:54.335394 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83063ecf-f129-4a09-a4f0-0bda34114c7f None admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:13:54.343346 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 599/1209] 10.222.0.21 () {56 vars in 1103 bytes} [Wed May 4 07:13:54 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 07:13:54.349219 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ab0846-ece8-46db-ae49-0c01050d62ca None admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:13:54.464083 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ab0846-ece8-46db-ae49-0c01050d62ca None admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:13:54.504460 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6525a8-3daf-4563-afd4-9f79588266af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:13:54.505438 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6525a8-3daf-4563-afd4-9f79588266af None admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:13:54.505706 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6525a8-3daf-4563-afd4-9f79588266af None admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:13:54.506034 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6525a8-3daf-4563-afd4-9f79588266af None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:13:54.518235 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6525a8-3daf-4563-afd4-9f79588266af None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:13:54.521369 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6525a8-3daf-4563-afd4-9f79588266af None admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:13:54.550297 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application [None req-be6525a8-3daf-4563-afd4-9f79588266af None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 07:13:54.550297 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 07:13:54.550297 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 07:13:54.550297 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 07:13:54.550297 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 07:13:54.550297 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 07:13:54.550297 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 07:13:54.550297 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 07:13:54.550297 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 07:13:54.550297 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 07:13:54.550297 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 07:13:54.550297 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 07:13:54.550297 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 07:13:54.550297 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 07:13:54.550297 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 07:13:54.557326 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 07:13:54.557326 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 07:13:54.557326 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 07:13:54.557326 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 07:13:54.557326 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 07:13:54.557326 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 07:13:54.557326 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.get_or_create( May 04 07:13:54.557326 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 07:13:54.557326 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application with Lock( May 04 07:13:54.557326 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 07:13:54.557326 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self._enter() May 04 07:13:54.557326 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 07:13:54.557326 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 07:13:54.557326 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 07:13:54.557326 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.creator() May 04 07:13:54.557326 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 07:13:54.557326 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application created_value = creator( May 04 07:13:54.558246 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 07:13:54.558246 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 07:13:54.558246 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 07:13:54.558246 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application May 04 07:13:54.558246 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 611/1210] 10.222.0.21 () {56 vars in 1108 bytes} [Wed May 4 07:13:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 07:13:54.558551 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83063ecf-f129-4a09-a4f0-0bda34114c7f None admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:13:54.675855 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83063ecf-f129-4a09-a4f0-0bda34114c7f None admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:13:54.713304 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b18915-897d-486f-bf0f-28f212cdee17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:13:54.714052 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b18915-897d-486f-bf0f-28f212cdee17 None admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:13:54.714423 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b18915-897d-486f-bf0f-28f212cdee17 None admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:13:54.714785 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b18915-897d-486f-bf0f-28f212cdee17 None admin] PATH_INFO: `/v3/domains` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:13:54.715699 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b18915-897d-486f-bf0f-28f212cdee17 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 07:13:54.716104 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b18915-897d-486f-bf0f-28f212cdee17 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:13:54.717563 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b18915-897d-486f-bf0f-28f212cdee17 None admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:13:54.730030 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 600/1211] 10.222.0.21 () {56 vars in 1109 bytes} [Wed May 4 07:13:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 07:13:54.736007 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6525a8-3daf-4563-afd4-9f79588266af None admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:13:54.841971 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6525a8-3daf-4563-afd4-9f79588266af None admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:13:54.876620 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a756a792-baec-4bc0-a99c-383502c04a49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:13:54.877582 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a756a792-baec-4bc0-a99c-383502c04a49 None admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:13:54.878165 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a756a792-baec-4bc0-a99c-383502c04a49 None admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:13:54.878165 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a756a792-baec-4bc0-a99c-383502c04a49 None admin] PATH_INFO: `/v3/users/placement` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:13:54.886947 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a756a792-baec-4bc0-a99c-383502c04a49 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:13:54.888602 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a756a792-baec-4bc0-a99c-383502c04a49 None admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:13:54.903181 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application [None req-a756a792-baec-4bc0-a99c-383502c04a49 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 04 07:13:54.903181 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 07:13:54.903181 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 07:13:54.903181 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 07:13:54.903181 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 07:13:54.903181 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 07:13:54.903181 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 07:13:54.903181 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 07:13:54.903181 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 07:13:54.903181 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 07:13:54.903181 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 07:13:54.903181 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 07:13:54.903181 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 04 07:13:54.903181 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self._get_user(user_id) May 04 07:13:54.903181 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 04 07:13:54.903181 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 04 07:13:54.904220 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 07:13:54.904220 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 07:13:54.904220 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 04 07:13:54.904220 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 07:13:54.904220 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 04 07:13:54.904220 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 07:13:54.904220 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 07:13:54.904220 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 07:13:54.904220 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 07:13:54.904220 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.get_or_create( May 04 07:13:54.904220 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 07:13:54.904220 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application with Lock( May 04 07:13:54.904220 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 07:13:54.904220 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self._enter() May 04 07:13:54.904220 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 07:13:54.904220 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 07:13:54.904220 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 07:13:54.904220 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.creator() May 04 07:13:54.910302 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 07:13:54.910302 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application created_value = creator( May 04 07:13:54.910302 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 04 07:13:54.910302 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 04 07:13:54.910302 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 04 07:13:54.910302 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 04 07:13:54.910302 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 04 07:13:54.910302 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 04 07:13:54.910302 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 04 07:13:54.910302 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application May 04 07:13:54.910302 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 612/1212] 10.222.0.21 () {56 vars in 1108 bytes} [Wed May 4 07:13:54 2022] GET /identity/v3/users/placement => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 07:13:54.910932 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b18915-897d-486f-bf0f-28f212cdee17 None admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:13:55.018211 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b18915-897d-486f-bf0f-28f212cdee17 None admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:13:55.057691 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca9ff37-3ccc-4a46-a2c5-d83aec109f65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:13:55.058538 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca9ff37-3ccc-4a46-a2c5-d83aec109f65 None admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:13:55.058838 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca9ff37-3ccc-4a46-a2c5-d83aec109f65 None admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:13:55.059206 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca9ff37-3ccc-4a46-a2c5-d83aec109f65 None admin] PATH_INFO: `/v3/users` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:13:55.060051 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca9ff37-3ccc-4a46-a2c5-d83aec109f65 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 07:13:55.060390 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca9ff37-3ccc-4a46-a2c5-d83aec109f65 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:13:55.062160 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca9ff37-3ccc-4a46-a2c5-d83aec109f65 None admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:13:55.084818 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 601/1213] 10.222.0.21 () {56 vars in 1143 bytes} [Wed May 4 07:13:54 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 07:13:55.090502 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a756a792-baec-4bc0-a99c-383502c04a49 None admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:13:55.199108 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a756a792-baec-4bc0-a99c-383502c04a49 None admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:13:55.235693 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b71af8-b982-486f-b44d-149f5d5bbe28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:13:55.236466 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b71af8-b982-486f-b44d-149f5d5bbe28 None admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:13:55.236794 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b71af8-b982-486f-b44d-149f5d5bbe28 None admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:13:55.237079 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b71af8-b982-486f-b44d-149f5d5bbe28 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:13:55.309306 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b71af8-b982-486f-b44d-149f5d5bbe28 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:13:55.310757 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b71af8-b982-486f-b44d-149f5d5bbe28 None admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:13:55.418460 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 613/1214] 10.222.0.21 () {58 vars in 1282 bytes} [Wed May 4 07:13:55 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 04 07:13:55.424083 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca9ff37-3ccc-4a46-a2c5-d83aec109f65 None admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:13:55.533600 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca9ff37-3ccc-4a46-a2c5-d83aec109f65 None admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:13:55.573699 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbdfc4a-64c5-4b46-9dc0-14af9191762a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:13:55.574777 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbdfc4a-64c5-4b46-9dc0-14af9191762a None admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:13:55.575245 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbdfc4a-64c5-4b46-9dc0-14af9191762a None admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:13:55.575683 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbdfc4a-64c5-4b46-9dc0-14af9191762a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:13:55.588039 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bbdfc4a-64c5-4b46-9dc0-14af9191762a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:13:55.589467 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bbdfc4a-64c5-4b46-9dc0-14af9191762a None admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:13:55.608594 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application [None req-1bbdfc4a-64c5-4b46-9dc0-14af9191762a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 07:13:55.608594 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 07:13:55.608594 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 07:13:55.608594 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 07:13:55.608594 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 07:13:55.608594 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 07:13:55.608594 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 07:13:55.608594 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 07:13:55.608594 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 07:13:55.608594 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 07:13:55.608594 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 07:13:55.608594 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 07:13:55.608594 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 07:13:55.608594 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 07:13:55.608594 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 07:13:55.609739 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 07:13:55.609739 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 07:13:55.609739 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 07:13:55.609739 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 07:13:55.609739 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 07:13:55.609739 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 07:13:55.609739 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self.get_or_create( May 04 07:13:55.609739 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 07:13:55.609739 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application with Lock( May 04 07:13:55.609739 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 07:13:55.609739 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self._enter() May 04 07:13:55.609739 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 07:13:55.609739 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 07:13:55.609739 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 07:13:55.609739 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self.creator() May 04 07:13:55.609739 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 07:13:55.609739 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application created_value = creator( May 04 07:13:55.610669 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 07:13:55.610669 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 07:13:55.610669 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 07:13:55.610669 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application May 04 07:13:55.610669 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 602/1215] 10.222.0.21 () {56 vars in 1108 bytes} [Wed May 4 07:13:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 07:13:55.616897 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b71af8-b982-486f-b44d-149f5d5bbe28 None admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:13:55.723335 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b71af8-b982-486f-b44d-149f5d5bbe28 None admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:13:55.762697 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca7249d-b581-475a-85b6-8be9c64b7be7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:13:55.763403 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca7249d-b581-475a-85b6-8be9c64b7be7 None admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:13:55.763675 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca7249d-b581-475a-85b6-8be9c64b7be7 None admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:13:55.763944 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca7249d-b581-475a-85b6-8be9c64b7be7 None admin] PATH_INFO: `/v3/domains` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:13:55.764753 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca7249d-b581-475a-85b6-8be9c64b7be7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79744) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 07:13:55.764966 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca7249d-b581-475a-85b6-8be9c64b7be7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:13:55.766519 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca7249d-b581-475a-85b6-8be9c64b7be7 None admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:13:55.779851 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 614/1216] 10.222.0.21 () {56 vars in 1109 bytes} [Wed May 4 07:13:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 07:13:55.785520 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbdfc4a-64c5-4b46-9dc0-14af9191762a None admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:13:55.902537 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbdfc4a-64c5-4b46-9dc0-14af9191762a None admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:13:55.942227 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d888e832-3c44-4bf1-80ab-e18ea49f600d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:13:55.943112 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d888e832-3c44-4bf1-80ab-e18ea49f600d None admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:13:55.944647 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d888e832-3c44-4bf1-80ab-e18ea49f600d None admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:13:55.944647 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d888e832-3c44-4bf1-80ab-e18ea49f600d None admin] PATH_INFO: `/v3/projects/service` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:13:55.950932 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d888e832-3c44-4bf1-80ab-e18ea49f600d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:13:55.952579 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d888e832-3c44-4bf1-80ab-e18ea49f600d None admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:13:55.967685 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application [None req-d888e832-3c44-4bf1-80ab-e18ea49f600d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 04 07:13:55.967685 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 07:13:55.967685 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 07:13:55.967685 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 07:13:55.967685 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 07:13:55.967685 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 07:13:55.967685 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 07:13:55.967685 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 07:13:55.967685 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 07:13:55.967685 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 07:13:55.967685 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 07:13:55.967685 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 07:13:55.967685 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 04 07:13:55.967685 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self._get_project(project_id) May 04 07:13:55.967685 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 04 07:13:55.968757 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 04 07:13:55.968757 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 07:13:55.968757 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 07:13:55.968757 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 07:13:55.968757 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 07:13:55.968757 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 07:13:55.968757 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self.get_or_create( May 04 07:13:55.968757 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 07:13:55.968757 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application with Lock( May 04 07:13:55.968757 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 07:13:55.968757 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self._enter() May 04 07:13:55.968757 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 07:13:55.968757 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 07:13:55.968757 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 07:13:55.968757 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self.creator() May 04 07:13:55.968757 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 07:13:55.968757 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application created_value = creator( May 04 07:13:55.969927 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 04 07:13:55.969927 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 04 07:13:55.969927 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 04 07:13:55.969927 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 04 07:13:55.969927 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 04 07:13:55.969927 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 04 07:13:55.969927 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 04 07:13:55.969927 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application May 04 07:13:55.969927 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 603/1217] 10.222.0.21 () {56 vars in 1111 bytes} [Wed May 4 07:13:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 07:13:55.975628 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca7249d-b581-475a-85b6-8be9c64b7be7 None admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:13:56.087203 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca7249d-b581-475a-85b6-8be9c64b7be7 None admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:13:56.123452 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc72e01-f5ba-431f-b720-ffd6f5e6e795 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:13:56.124405 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc72e01-f5ba-431f-b720-ffd6f5e6e795 None admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:13:56.124802 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc72e01-f5ba-431f-b720-ffd6f5e6e795 None admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:13:56.125165 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc72e01-f5ba-431f-b720-ffd6f5e6e795 None admin] PATH_INFO: `/v3/projects` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:13:56.126043 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc72e01-f5ba-431f-b720-ffd6f5e6e795 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79744) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 07:13:56.129016 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc72e01-f5ba-431f-b720-ffd6f5e6e795 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:13:56.130560 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc72e01-f5ba-431f-b720-ffd6f5e6e795 None admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:13:56.144533 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 615/1218] 10.222.0.21 () {56 vars in 1148 bytes} [Wed May 4 07:13:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 07:13:56.151655 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d888e832-3c44-4bf1-80ab-e18ea49f600d None admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:13:56.256236 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d888e832-3c44-4bf1-80ab-e18ea49f600d None admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:13:56.294366 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f79ab2b-fc62-435d-9786-54077dad57d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:13:56.295368 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f79ab2b-fc62-435d-9786-54077dad57d4 None admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:13:56.295823 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f79ab2b-fc62-435d-9786-54077dad57d4 None admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:13:56.296301 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f79ab2b-fc62-435d-9786-54077dad57d4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:13:56.297156 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f79ab2b-fc62-435d-9786-54077dad57d4 None admin] RBAC: Adding query filter params (role.id=14041215d0f7476a8e90241a49338706, scope.project.id=c9f9c44db4984653b8d4b5f6b3b949f5, user.id=ef28e980e8664d3eba4304e4589ea2df) {{(pid=79745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 07:13:56.297492 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f79ab2b-fc62-435d-9786-54077dad57d4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:13:56.298978 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f79ab2b-fc62-435d-9786-54077dad57d4 None admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:13:56.305225 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 604/1219] 10.222.0.21 () {56 vars in 1374 bytes} [Wed May 4 07:13:56 2022] GET /identity/v3/role_assignments?user.id=ef28e980e8664d3eba4304e4589ea2df&scope.project.id=c9f9c44db4984653b8d4b5f6b3b949f5&role.id=14041215d0f7476a8e90241a49338706 => generated 259 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 07:13:58.649521 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f85aecd-6696-4499-a12a-7148cc59cf03 None None] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:13:58.650068 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f85aecd-6696-4499-a12a-7148cc59cf03 None None] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:13:58.650068 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f85aecd-6696-4499-a12a-7148cc59cf03 None None] PATH_INFO: `/` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:13:58.651743 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 616/1220] 10.222.0.21 () {54 vars in 926 bytes} [Wed May 4 07:13:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 07:13:58.657732 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e8a7d0-9eeb-4b90-ac3d-88bfa995c8a4 None None] REQUEST_METHOD: `POST` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:13:58.658201 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e8a7d0-9eeb-4b90-ac3d-88bfa995c8a4 None None] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:13:58.658301 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e8a7d0-9eeb-4b90-ac3d-88bfa995c8a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:13:58.677936 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.auth.core [None req-62e8a7d0-9eeb-4b90-ac3d-88bfa995c8a4 None None] MFA Rules not processed for user `83c5e0dcb991496ea6dee38384514508`. Rule list: `[]` (Enabled: `True`). {{(pid=79745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:13:58.679796 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.fernet_utils [None req-62e8a7d0-9eeb-4b90-ac3d-88bfa995c8a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:13:58.750103 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 605/1221] 10.222.0.21 () {58 vars in 1023 bytes} [Wed May 4 07:13:58 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 07:13:58.774838 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f85aecd-6696-4499-a12a-7148cc59cf03 None None] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:13:58.883194 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f85aecd-6696-4499-a12a-7148cc59cf03 None None] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:13:58.920255 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9bee2d-3e52-4523-a132-6fa3b58ef199 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:13:58.921119 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9bee2d-3e52-4523-a132-6fa3b58ef199 None admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:13:58.921469 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9bee2d-3e52-4523-a132-6fa3b58ef199 None admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:13:58.921753 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9bee2d-3e52-4523-a132-6fa3b58ef199 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:13:58.932962 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9bee2d-3e52-4523-a132-6fa3b58ef199 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 07:13:58.941603 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application [None req-1a9bee2d-3e52-4523-a132-6fa3b58ef199 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 04 07:13:58.941603 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 07:13:58.941603 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 07:13:58.941603 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 07:13:58.941603 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 07:13:58.941603 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 07:13:58.941603 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 07:13:58.941603 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 07:13:58.941603 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 07:13:58.941603 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 07:13:58.941603 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 07:13:58.941603 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 07:13:58.941603 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 07:13:58.941603 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 07:13:58.941603 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 07:13:58.941603 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 07:13:58.942706 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 07:13:58.942706 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 07:13:58.942706 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 07:13:58.942706 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 07:13:58.942706 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 07:13:58.942706 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 07:13:58.942706 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 07:13:58.942706 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 07:13:58.942706 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 07:13:58.942706 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.get_or_create( May 04 07:13:58.942706 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 07:13:58.942706 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application with Lock( May 04 07:13:58.942706 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 07:13:58.942706 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self._enter() May 04 07:13:58.942706 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 07:13:58.942706 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 07:13:58.944248 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 07:13:58.944248 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.creator() May 04 07:13:58.944248 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 07:13:58.944248 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application created_value = creator( May 04 07:13:58.944248 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 07:13:58.944248 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 07:13:58.944248 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 07:13:58.944248 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 07:13:58.944248 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 07:13:58.944248 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 07:13:58.944248 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 04 07:13:58.944248 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application May 04 07:13:58.948855 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 617/1222] 10.222.0.21 () {56 vars in 1102 bytes} [Wed May 4 07:13:58 2022] GET /identity/v3/roles/service => generated 85 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 07:13:58.949830 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e8a7d0-9eeb-4b90-ac3d-88bfa995c8a4 None None] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:13:59.056614 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e8a7d0-9eeb-4b90-ac3d-88bfa995c8a4 None None] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:13:59.097941 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65648f8d-9777-402f-8591-b134e6d766c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:13:59.098639 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65648f8d-9777-402f-8591-b134e6d766c1 None admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:13:59.098998 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65648f8d-9777-402f-8591-b134e6d766c1 None admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:13:59.099453 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65648f8d-9777-402f-8591-b134e6d766c1 None admin] PATH_INFO: `/v3/roles` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:13:59.100229 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65648f8d-9777-402f-8591-b134e6d766c1 None admin] RBAC: Adding query filter params (name=service) {{(pid=79745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 07:13:59.100612 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65648f8d-9777-402f-8591-b134e6d766c1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:13:59.102339 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65648f8d-9777-402f-8591-b134e6d766c1 None admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:13:59.110924 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 606/1223] 10.222.0.21 () {56 vars in 1103 bytes} [Wed May 4 07:13:58 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 07:13:59.118273 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9bee2d-3e52-4523-a132-6fa3b58ef199 None admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:13:59.221330 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9bee2d-3e52-4523-a132-6fa3b58ef199 None admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:13:59.258573 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2f231b-a858-41be-a959-3117f273cba7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:13:59.259455 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2f231b-a858-41be-a959-3117f273cba7 None admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:13:59.259770 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2f231b-a858-41be-a959-3117f273cba7 None admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:13:59.260025 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2f231b-a858-41be-a959-3117f273cba7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:13:59.271191 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2f231b-a858-41be-a959-3117f273cba7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:13:59.272796 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2f231b-a858-41be-a959-3117f273cba7 None admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:13:59.291079 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application [None req-4a2f231b-a858-41be-a959-3117f273cba7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 07:13:59.291079 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 07:13:59.291079 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 07:13:59.291079 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 07:13:59.291079 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 07:13:59.291079 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 07:13:59.291079 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 07:13:59.291079 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 07:13:59.291079 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 07:13:59.291079 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 07:13:59.291079 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 07:13:59.291079 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 07:13:59.291079 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 07:13:59.291079 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 07:13:59.291079 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 07:13:59.292272 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 07:13:59.292272 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 07:13:59.292272 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 07:13:59.292272 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 07:13:59.292272 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 07:13:59.292272 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 07:13:59.292272 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.get_or_create( May 04 07:13:59.292272 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 07:13:59.292272 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application with Lock( May 04 07:13:59.292272 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 07:13:59.292272 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self._enter() May 04 07:13:59.292272 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 07:13:59.292272 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 07:13:59.292272 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 07:13:59.292272 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.creator() May 04 07:13:59.292272 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 07:13:59.292272 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application created_value = creator( May 04 07:13:59.293352 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 07:13:59.293352 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 07:13:59.293352 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 07:13:59.293352 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application May 04 07:13:59.293352 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 618/1224] 10.222.0.21 () {56 vars in 1108 bytes} [Wed May 4 07:13:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 07:13:59.301021 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65648f8d-9777-402f-8591-b134e6d766c1 None admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:13:59.408985 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65648f8d-9777-402f-8591-b134e6d766c1 None admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:13:59.442367 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd5a638-dedc-4023-91d7-638a72788d8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:13:59.443021 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd5a638-dedc-4023-91d7-638a72788d8b None admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:13:59.443346 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd5a638-dedc-4023-91d7-638a72788d8b None admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:13:59.447120 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd5a638-dedc-4023-91d7-638a72788d8b None admin] PATH_INFO: `/v3/domains` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:13:59.447120 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd5a638-dedc-4023-91d7-638a72788d8b None admin] RBAC: Adding query filter params (name=Default) {{(pid=79745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 07:13:59.447120 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd5a638-dedc-4023-91d7-638a72788d8b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:13:59.447120 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd5a638-dedc-4023-91d7-638a72788d8b None admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:13:59.458512 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 607/1225] 10.222.0.21 () {56 vars in 1109 bytes} [Wed May 4 07:13:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 07:13:59.465134 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2f231b-a858-41be-a959-3117f273cba7 None admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:13:59.575142 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2f231b-a858-41be-a959-3117f273cba7 None admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:13:59.610040 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c869401-7f19-4967-bffc-9a22ffe09b54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:13:59.610839 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c869401-7f19-4967-bffc-9a22ffe09b54 None admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:13:59.611122 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c869401-7f19-4967-bffc-9a22ffe09b54 None admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:13:59.611492 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c869401-7f19-4967-bffc-9a22ffe09b54 None admin] PATH_INFO: `/v3/users/placement` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:13:59.619854 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c869401-7f19-4967-bffc-9a22ffe09b54 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:13:59.621289 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c869401-7f19-4967-bffc-9a22ffe09b54 None admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:13:59.636564 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application [None req-9c869401-7f19-4967-bffc-9a22ffe09b54 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 04 07:13:59.636564 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 07:13:59.636564 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 07:13:59.636564 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 07:13:59.636564 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 07:13:59.636564 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 07:13:59.636564 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 07:13:59.636564 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 07:13:59.636564 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 07:13:59.636564 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 07:13:59.636564 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 07:13:59.636564 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 07:13:59.636564 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 04 07:13:59.636564 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self._get_user(user_id) May 04 07:13:59.636564 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 04 07:13:59.636564 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 04 07:13:59.642705 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 07:13:59.642705 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 07:13:59.642705 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 04 07:13:59.642705 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 07:13:59.642705 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 04 07:13:59.642705 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 07:13:59.642705 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 07:13:59.642705 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 07:13:59.642705 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 07:13:59.642705 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.get_or_create( May 04 07:13:59.642705 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 07:13:59.642705 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application with Lock( May 04 07:13:59.642705 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 07:13:59.642705 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self._enter() May 04 07:13:59.642705 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 07:13:59.642705 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 07:13:59.642705 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 07:13:59.642705 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.creator() May 04 07:13:59.644100 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 07:13:59.644100 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application created_value = creator( May 04 07:13:59.644100 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 04 07:13:59.644100 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 04 07:13:59.644100 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 04 07:13:59.644100 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 04 07:13:59.644100 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 04 07:13:59.644100 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 04 07:13:59.644100 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 04 07:13:59.644100 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application May 04 07:13:59.644100 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 619/1226] 10.222.0.21 () {56 vars in 1108 bytes} [Wed May 4 07:13:59 2022] GET /identity/v3/users/placement => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 07:13:59.644815 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd5a638-dedc-4023-91d7-638a72788d8b None admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:13:59.754622 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd5a638-dedc-4023-91d7-638a72788d8b None admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:13:59.791029 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be92d0f4-399f-43ca-923d-50c857bab01b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:13:59.791803 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be92d0f4-399f-43ca-923d-50c857bab01b None admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:13:59.792143 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be92d0f4-399f-43ca-923d-50c857bab01b None admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:13:59.792442 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be92d0f4-399f-43ca-923d-50c857bab01b None admin] PATH_INFO: `/v3/users` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:13:59.793345 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be92d0f4-399f-43ca-923d-50c857bab01b None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 07:13:59.793620 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be92d0f4-399f-43ca-923d-50c857bab01b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:13:59.795029 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be92d0f4-399f-43ca-923d-50c857bab01b None admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:13:59.815984 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 608/1227] 10.222.0.21 () {56 vars in 1143 bytes} [Wed May 4 07:13:59 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 07:13:59.823155 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c869401-7f19-4967-bffc-9a22ffe09b54 None admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:13:59.937091 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c869401-7f19-4967-bffc-9a22ffe09b54 None admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:13:59.974395 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48a1b2f-5cbb-4212-953e-6b6f1626f51e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:13:59.975454 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48a1b2f-5cbb-4212-953e-6b6f1626f51e None admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:13:59.975741 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48a1b2f-5cbb-4212-953e-6b6f1626f51e None admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:13:59.976017 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48a1b2f-5cbb-4212-953e-6b6f1626f51e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:13:59.987815 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48a1b2f-5cbb-4212-953e-6b6f1626f51e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:13:59.989539 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48a1b2f-5cbb-4212-953e-6b6f1626f51e None admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:14:00.009887 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application [None req-a48a1b2f-5cbb-4212-953e-6b6f1626f51e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 07:14:00.009887 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 07:14:00.009887 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 07:14:00.009887 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 07:14:00.009887 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 07:14:00.009887 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 07:14:00.009887 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 07:14:00.009887 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 07:14:00.009887 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 07:14:00.009887 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 07:14:00.009887 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 07:14:00.009887 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 07:14:00.009887 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 07:14:00.009887 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 07:14:00.009887 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 07:14:00.011011 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 07:14:00.011011 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 07:14:00.011011 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 07:14:00.011011 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 07:14:00.011011 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 07:14:00.011011 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 07:14:00.011011 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.get_or_create( May 04 07:14:00.011011 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 07:14:00.011011 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application with Lock( May 04 07:14:00.011011 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 07:14:00.011011 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self._enter() May 04 07:14:00.011011 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 07:14:00.011011 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 07:14:00.011011 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 07:14:00.011011 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.creator() May 04 07:14:00.011011 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 07:14:00.011011 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application created_value = creator( May 04 07:14:00.012140 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 07:14:00.012140 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 07:14:00.012140 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 07:14:00.012140 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application May 04 07:14:00.016511 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 620/1228] 10.222.0.21 () {56 vars in 1108 bytes} [Wed May 4 07:13:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 07:14:00.017526 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be92d0f4-399f-43ca-923d-50c857bab01b None admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:14:00.126448 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be92d0f4-399f-43ca-923d-50c857bab01b None admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:14:00.160580 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d34097-9a46-486b-af37-01a30aa15288 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:14:00.161346 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d34097-9a46-486b-af37-01a30aa15288 None admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:14:00.161681 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d34097-9a46-486b-af37-01a30aa15288 None admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:14:00.162016 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d34097-9a46-486b-af37-01a30aa15288 None admin] PATH_INFO: `/v3/domains` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:14:00.163493 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d34097-9a46-486b-af37-01a30aa15288 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 07:14:00.163835 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d34097-9a46-486b-af37-01a30aa15288 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:14:00.165385 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d34097-9a46-486b-af37-01a30aa15288 None admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:14:00.177358 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 609/1229] 10.222.0.21 () {56 vars in 1109 bytes} [Wed May 4 07:14:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 07:14:00.184267 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48a1b2f-5cbb-4212-953e-6b6f1626f51e None admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:14:00.293385 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48a1b2f-5cbb-4212-953e-6b6f1626f51e None admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:14:00.328643 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7308c9ba-b36c-4b17-a8b9-b605e2ab8221 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:14:00.329432 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7308c9ba-b36c-4b17-a8b9-b605e2ab8221 None admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:14:00.329710 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7308c9ba-b36c-4b17-a8b9-b605e2ab8221 None admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:14:00.329976 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7308c9ba-b36c-4b17-a8b9-b605e2ab8221 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:14:00.336739 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7308c9ba-b36c-4b17-a8b9-b605e2ab8221 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:14:00.338187 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7308c9ba-b36c-4b17-a8b9-b605e2ab8221 None admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:14:00.352817 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application [None req-7308c9ba-b36c-4b17-a8b9-b605e2ab8221 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 04 07:14:00.352817 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 07:14:00.352817 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 07:14:00.352817 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 07:14:00.352817 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 07:14:00.352817 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 07:14:00.352817 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 07:14:00.352817 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 07:14:00.352817 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 07:14:00.352817 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 07:14:00.352817 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 07:14:00.352817 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 07:14:00.352817 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 04 07:14:00.352817 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self._get_project(project_id) May 04 07:14:00.352817 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 04 07:14:00.358984 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 04 07:14:00.358984 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 07:14:00.358984 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 07:14:00.358984 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 07:14:00.358984 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 07:14:00.358984 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 07:14:00.358984 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.get_or_create( May 04 07:14:00.358984 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 07:14:00.358984 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application with Lock( May 04 07:14:00.358984 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 07:14:00.358984 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self._enter() May 04 07:14:00.358984 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 07:14:00.358984 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 07:14:00.358984 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 07:14:00.358984 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.creator() May 04 07:14:00.358984 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 07:14:00.358984 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application created_value = creator( May 04 07:14:00.360152 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 04 07:14:00.360152 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 04 07:14:00.360152 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 04 07:14:00.360152 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 04 07:14:00.360152 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 04 07:14:00.360152 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 04 07:14:00.360152 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 04 07:14:00.360152 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application May 04 07:14:00.360152 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 621/1230] 10.222.0.21 () {56 vars in 1111 bytes} [Wed May 4 07:14:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 07:14:00.360771 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d34097-9a46-486b-af37-01a30aa15288 None admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:14:00.474091 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d34097-9a46-486b-af37-01a30aa15288 None admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:14:00.510219 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711bcefb-a8d2-4d7c-afc2-cdf845644ba7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:14:00.510869 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711bcefb-a8d2-4d7c-afc2-cdf845644ba7 None admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:14:00.511175 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711bcefb-a8d2-4d7c-afc2-cdf845644ba7 None admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:14:00.511441 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711bcefb-a8d2-4d7c-afc2-cdf845644ba7 None admin] PATH_INFO: `/v3/projects` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:14:00.512273 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711bcefb-a8d2-4d7c-afc2-cdf845644ba7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 07:14:00.512533 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711bcefb-a8d2-4d7c-afc2-cdf845644ba7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:14:00.513957 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711bcefb-a8d2-4d7c-afc2-cdf845644ba7 None admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:14:00.526446 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 610/1231] 10.222.0.21 () {56 vars in 1148 bytes} [Wed May 4 07:14:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 07:14:00.532662 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7308c9ba-b36c-4b17-a8b9-b605e2ab8221 None admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:14:00.632828 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7308c9ba-b36c-4b17-a8b9-b605e2ab8221 None admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:14:00.666485 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9671ecd-6a0a-4bd1-9e98-beea2cf32b54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:14:00.667430 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9671ecd-6a0a-4bd1-9e98-beea2cf32b54 None admin] REQUEST_METHOD: `PUT` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:14:00.667704 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9671ecd-6a0a-4bd1-9e98-beea2cf32b54 None admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:14:00.667974 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9671ecd-6a0a-4bd1-9e98-beea2cf32b54 None admin] PATH_INFO: `/v3/projects/c9f9c44db4984653b8d4b5f6b3b949f5/users/ef28e980e8664d3eba4304e4589ea2df/roles/14041215d0f7476a8e90241a49338706` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:14:00.683382 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9671ecd-6a0a-4bd1-9e98-beea2cf32b54 None admin] RBAC: Authorizing `identity:create_grant(project_id=c9f9c44db4984653b8d4b5f6b3b949f5, user_id=ef28e980e8664d3eba4304e4589ea2df, role_id=14041215d0f7476a8e90241a49338706)` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:14:00.684835 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9671ecd-6a0a-4bd1-9e98-beea2cf32b54 None admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:14:00.698517 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 622/1232] 10.222.0.21 () {58 vars in 1439 bytes} [Wed May 4 07:14:00 2022] PUT /identity/v3/projects/c9f9c44db4984653b8d4b5f6b3b949f5/users/ef28e980e8664d3eba4304e4589ea2df/roles/14041215d0f7476a8e90241a49338706 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 07:14:03.055440 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506edcad-a02e-4057-8c84-6c3baaed18c7 None None] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:14:03.056108 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506edcad-a02e-4057-8c84-6c3baaed18c7 None None] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:14:03.056243 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506edcad-a02e-4057-8c84-6c3baaed18c7 None None] PATH_INFO: `/` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:14:03.057779 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 611/1233] 10.222.0.21 () {54 vars in 926 bytes} [Wed May 4 07:14:03 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 07:14:03.063906 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc0f490-0e93-41ff-bed5-9426cb0d9a5d None None] REQUEST_METHOD: `POST` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:14:03.064379 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc0f490-0e93-41ff-bed5-9426cb0d9a5d None None] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:14:03.064544 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc0f490-0e93-41ff-bed5-9426cb0d9a5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:14:03.082737 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.auth.core [None req-fdc0f490-0e93-41ff-bed5-9426cb0d9a5d None None] MFA Rules not processed for user `83c5e0dcb991496ea6dee38384514508`. Rule list: `[]` (Enabled: `True`). {{(pid=79744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:14:03.084048 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.fernet_utils [None req-fdc0f490-0e93-41ff-bed5-9426cb0d9a5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:14:03.158084 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 623/1234] 10.222.0.21 () {58 vars in 1023 bytes} [Wed May 4 07:14:03 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 07:14:03.183906 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506edcad-a02e-4057-8c84-6c3baaed18c7 None None] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:14:03.294235 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506edcad-a02e-4057-8c84-6c3baaed18c7 None None] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:14:03.328175 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e2fdb3-8081-47a5-af1e-2fcd0ed1fde0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:14:03.329000 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e2fdb3-8081-47a5-af1e-2fcd0ed1fde0 None admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:14:03.329714 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e2fdb3-8081-47a5-af1e-2fcd0ed1fde0 None admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:14:03.329714 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e2fdb3-8081-47a5-af1e-2fcd0ed1fde0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:14:03.340982 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e2fdb3-8081-47a5-af1e-2fcd0ed1fde0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 07:14:03.349859 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application [None req-20e2fdb3-8081-47a5-af1e-2fcd0ed1fde0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 04 07:14:03.349859 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 07:14:03.349859 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 07:14:03.349859 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 07:14:03.349859 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 07:14:03.349859 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 07:14:03.349859 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 07:14:03.349859 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 07:14:03.349859 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 07:14:03.349859 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 07:14:03.349859 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 07:14:03.349859 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 07:14:03.349859 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 07:14:03.349859 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 07:14:03.349859 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 07:14:03.349859 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 07:14:03.351862 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 07:14:03.351862 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 07:14:03.351862 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 07:14:03.351862 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 07:14:03.351862 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 07:14:03.351862 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 07:14:03.351862 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 07:14:03.351862 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 07:14:03.351862 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 07:14:03.351862 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self.get_or_create( May 04 07:14:03.351862 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 07:14:03.351862 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application with Lock( May 04 07:14:03.351862 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 07:14:03.351862 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self._enter() May 04 07:14:03.351862 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 07:14:03.351862 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 07:14:03.352945 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 07:14:03.352945 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self.creator() May 04 07:14:03.352945 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 07:14:03.352945 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application created_value = creator( May 04 07:14:03.352945 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 07:14:03.352945 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 07:14:03.352945 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 07:14:03.352945 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 07:14:03.352945 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 07:14:03.352945 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 07:14:03.352945 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 04 07:14:03.352945 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application May 04 07:14:03.352945 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 612/1235] 10.222.0.21 () {56 vars in 1102 bytes} [Wed May 4 07:14:03 2022] GET /identity/v3/roles/service => generated 85 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 07:14:03.358248 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc0f490-0e93-41ff-bed5-9426cb0d9a5d None None] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:14:03.467094 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc0f490-0e93-41ff-bed5-9426cb0d9a5d None None] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:14:03.508038 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d04cfb-b46b-4d97-afd0-f49269ab7b60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:14:03.509003 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d04cfb-b46b-4d97-afd0-f49269ab7b60 None admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:14:03.509291 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d04cfb-b46b-4d97-afd0-f49269ab7b60 None admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:14:03.509558 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d04cfb-b46b-4d97-afd0-f49269ab7b60 None admin] PATH_INFO: `/v3/roles` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:14:03.510357 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d04cfb-b46b-4d97-afd0-f49269ab7b60 None admin] RBAC: Adding query filter params (name=service) {{(pid=79744) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 07:14:03.510666 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d04cfb-b46b-4d97-afd0-f49269ab7b60 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:14:03.512170 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d04cfb-b46b-4d97-afd0-f49269ab7b60 None admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:14:03.523051 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 624/1236] 10.222.0.21 () {56 vars in 1103 bytes} [Wed May 4 07:14:03 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 07:14:03.528774 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e2fdb3-8081-47a5-af1e-2fcd0ed1fde0 None admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:14:03.642869 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e2fdb3-8081-47a5-af1e-2fcd0ed1fde0 None admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:14:03.678808 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40668fe6-caec-4875-9a34-1fd0094648da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:14:03.679654 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40668fe6-caec-4875-9a34-1fd0094648da None admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:14:03.679953 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40668fe6-caec-4875-9a34-1fd0094648da None admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:14:03.680283 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40668fe6-caec-4875-9a34-1fd0094648da None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:14:03.691996 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40668fe6-caec-4875-9a34-1fd0094648da None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:14:03.694193 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40668fe6-caec-4875-9a34-1fd0094648da None admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:14:03.714726 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application [None req-40668fe6-caec-4875-9a34-1fd0094648da None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 07:14:03.714726 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 07:14:03.714726 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 07:14:03.714726 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 07:14:03.714726 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 07:14:03.714726 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 07:14:03.714726 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 07:14:03.714726 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 07:14:03.714726 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 07:14:03.714726 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 07:14:03.714726 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 07:14:03.714726 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 07:14:03.714726 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 07:14:03.714726 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 07:14:03.714726 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 07:14:03.716052 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 07:14:03.716052 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 07:14:03.716052 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 07:14:03.716052 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 07:14:03.716052 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 07:14:03.716052 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 07:14:03.716052 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self.get_or_create( May 04 07:14:03.716052 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 07:14:03.716052 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application with Lock( May 04 07:14:03.716052 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 07:14:03.716052 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self._enter() May 04 07:14:03.716052 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 07:14:03.716052 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 07:14:03.716052 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 07:14:03.716052 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self.creator() May 04 07:14:03.716052 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 07:14:03.716052 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application created_value = creator( May 04 07:14:03.717150 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 07:14:03.717150 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 07:14:03.717150 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 07:14:03.717150 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application May 04 07:14:03.717150 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 613/1237] 10.222.0.21 () {56 vars in 1108 bytes} [Wed May 4 07:14:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 07:14:03.722230 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d04cfb-b46b-4d97-afd0-f49269ab7b60 None admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:14:03.828086 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d04cfb-b46b-4d97-afd0-f49269ab7b60 None admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:14:03.862968 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ce2dc8-1898-4e4b-99b4-2dae66520ef1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:14:03.863662 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ce2dc8-1898-4e4b-99b4-2dae66520ef1 None admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:14:03.863944 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ce2dc8-1898-4e4b-99b4-2dae66520ef1 None admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:14:03.864227 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ce2dc8-1898-4e4b-99b4-2dae66520ef1 None admin] PATH_INFO: `/v3/domains` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:14:03.864941 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ce2dc8-1898-4e4b-99b4-2dae66520ef1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79744) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 07:14:03.865288 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ce2dc8-1898-4e4b-99b4-2dae66520ef1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:14:03.867254 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ce2dc8-1898-4e4b-99b4-2dae66520ef1 None admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:14:03.879275 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 625/1238] 10.222.0.21 () {56 vars in 1109 bytes} [Wed May 4 07:14:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 07:14:03.886917 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40668fe6-caec-4875-9a34-1fd0094648da None admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:14:03.993788 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40668fe6-caec-4875-9a34-1fd0094648da None admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:14:04.027896 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35fd8ea-8ef3-4043-97ca-bbf65fc92f1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:14:04.028801 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35fd8ea-8ef3-4043-97ca-bbf65fc92f1a None admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:14:04.029158 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35fd8ea-8ef3-4043-97ca-bbf65fc92f1a None admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:14:04.029564 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35fd8ea-8ef3-4043-97ca-bbf65fc92f1a None admin] PATH_INFO: `/v3/users/placement` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:14:04.037504 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35fd8ea-8ef3-4043-97ca-bbf65fc92f1a None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:14:04.039481 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35fd8ea-8ef3-4043-97ca-bbf65fc92f1a None admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:14:04.058363 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application [None req-b35fd8ea-8ef3-4043-97ca-bbf65fc92f1a None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 04 07:14:04.058363 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 07:14:04.058363 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 07:14:04.058363 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 07:14:04.058363 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 07:14:04.058363 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 07:14:04.058363 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 07:14:04.058363 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 07:14:04.058363 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 07:14:04.058363 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 07:14:04.058363 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 07:14:04.058363 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 07:14:04.058363 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 04 07:14:04.058363 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self._get_user(user_id) May 04 07:14:04.058363 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 04 07:14:04.058363 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 04 07:14:04.060089 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 07:14:04.060089 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 07:14:04.060089 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 04 07:14:04.060089 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 07:14:04.060089 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 04 07:14:04.060089 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 07:14:04.060089 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 07:14:04.060089 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 07:14:04.060089 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 07:14:04.060089 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self.get_or_create( May 04 07:14:04.060089 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 07:14:04.060089 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application with Lock( May 04 07:14:04.060089 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 07:14:04.060089 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self._enter() May 04 07:14:04.060089 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 07:14:04.060089 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 07:14:04.060089 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 07:14:04.060089 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self.creator() May 04 07:14:04.061170 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 07:14:04.061170 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application created_value = creator( May 04 07:14:04.061170 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 04 07:14:04.061170 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 04 07:14:04.061170 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 04 07:14:04.061170 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 04 07:14:04.061170 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 04 07:14:04.061170 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 04 07:14:04.061170 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 04 07:14:04.061170 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application May 04 07:14:04.061170 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 614/1239] 10.222.0.21 () {56 vars in 1108 bytes} [Wed May 4 07:14:03 2022] GET /identity/v3/users/placement => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 07:14:04.065921 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ce2dc8-1898-4e4b-99b4-2dae66520ef1 None admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:14:04.179195 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ce2dc8-1898-4e4b-99b4-2dae66520ef1 None admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:14:04.214648 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb821c1-ec7c-43fb-999c-3e3f3c95cff1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:14:04.215332 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb821c1-ec7c-43fb-999c-3e3f3c95cff1 None admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:14:04.215607 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb821c1-ec7c-43fb-999c-3e3f3c95cff1 None admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:14:04.215877 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb821c1-ec7c-43fb-999c-3e3f3c95cff1 None admin] PATH_INFO: `/v3/users` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:14:04.216726 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb821c1-ec7c-43fb-999c-3e3f3c95cff1 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79744) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 07:14:04.217007 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb821c1-ec7c-43fb-999c-3e3f3c95cff1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:14:04.218425 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb821c1-ec7c-43fb-999c-3e3f3c95cff1 None admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:14:04.236343 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 626/1240] 10.222.0.21 () {56 vars in 1143 bytes} [Wed May 4 07:14:04 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 07:14:04.242178 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35fd8ea-8ef3-4043-97ca-bbf65fc92f1a None admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:14:04.352446 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35fd8ea-8ef3-4043-97ca-bbf65fc92f1a None admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:14:04.393465 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ff2143-e4ff-4c1e-8049-97315cecb570 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:14:04.393465 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ff2143-e4ff-4c1e-8049-97315cecb570 None admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:14:04.393465 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ff2143-e4ff-4c1e-8049-97315cecb570 None admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:14:04.393465 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ff2143-e4ff-4c1e-8049-97315cecb570 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:14:04.465922 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ff2143-e4ff-4c1e-8049-97315cecb570 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:14:04.467657 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ff2143-e4ff-4c1e-8049-97315cecb570 None admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:14:04.575466 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 615/1241] 10.222.0.21 () {58 vars in 1282 bytes} [Wed May 4 07:14:04 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 04 07:14:04.582315 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb821c1-ec7c-43fb-999c-3e3f3c95cff1 None admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:14:04.693680 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb821c1-ec7c-43fb-999c-3e3f3c95cff1 None admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:14:04.731264 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c744b5ba-6f84-469b-adcf-aaa3de08138e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:14:04.732046 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c744b5ba-6f84-469b-adcf-aaa3de08138e None admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:14:04.732331 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c744b5ba-6f84-469b-adcf-aaa3de08138e None admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:14:04.732600 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c744b5ba-6f84-469b-adcf-aaa3de08138e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:14:04.743127 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c744b5ba-6f84-469b-adcf-aaa3de08138e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:14:04.744671 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c744b5ba-6f84-469b-adcf-aaa3de08138e None admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:14:04.762767 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application [None req-c744b5ba-6f84-469b-adcf-aaa3de08138e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 07:14:04.762767 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 07:14:04.762767 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 07:14:04.762767 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 07:14:04.762767 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 07:14:04.762767 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 07:14:04.762767 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 07:14:04.762767 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 07:14:04.762767 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 07:14:04.762767 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 07:14:04.762767 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 07:14:04.762767 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 07:14:04.762767 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 07:14:04.762767 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 07:14:04.762767 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 07:14:04.764026 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 07:14:04.764026 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 07:14:04.764026 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 07:14:04.764026 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 07:14:04.764026 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 07:14:04.764026 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 07:14:04.764026 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.get_or_create( May 04 07:14:04.764026 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 07:14:04.764026 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application with Lock( May 04 07:14:04.764026 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 07:14:04.764026 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self._enter() May 04 07:14:04.764026 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 07:14:04.764026 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 07:14:04.764026 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 07:14:04.764026 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.creator() May 04 07:14:04.764026 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 07:14:04.764026 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application created_value = creator( May 04 07:14:04.765107 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 07:14:04.765107 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 07:14:04.765107 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 07:14:04.765107 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application May 04 07:14:04.765107 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 627/1242] 10.222.0.21 () {56 vars in 1108 bytes} [Wed May 4 07:14:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 07:14:04.769772 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ff2143-e4ff-4c1e-8049-97315cecb570 None admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:14:04.870411 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ff2143-e4ff-4c1e-8049-97315cecb570 None admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:14:04.907273 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d5e613-456d-446d-9aab-fdefcf03a6fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:14:04.908096 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d5e613-456d-446d-9aab-fdefcf03a6fd None admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:14:04.908335 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d5e613-456d-446d-9aab-fdefcf03a6fd None admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:14:04.908739 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d5e613-456d-446d-9aab-fdefcf03a6fd None admin] PATH_INFO: `/v3/domains` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:14:04.909579 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d5e613-456d-446d-9aab-fdefcf03a6fd None admin] RBAC: Adding query filter params (name=Default) {{(pid=79745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 07:14:04.909884 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d5e613-456d-446d-9aab-fdefcf03a6fd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:14:04.911353 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d5e613-456d-446d-9aab-fdefcf03a6fd None admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:14:04.930234 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 616/1243] 10.222.0.21 () {56 vars in 1109 bytes} [Wed May 4 07:14:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 07:14:04.931808 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c744b5ba-6f84-469b-adcf-aaa3de08138e None admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:14:05.054747 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c744b5ba-6f84-469b-adcf-aaa3de08138e None admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:14:05.094748 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ff3cef-bd31-4f27-97af-fd234993efea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:14:05.095772 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ff3cef-bd31-4f27-97af-fd234993efea None admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:14:05.096019 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ff3cef-bd31-4f27-97af-fd234993efea None admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:14:05.096294 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ff3cef-bd31-4f27-97af-fd234993efea None admin] PATH_INFO: `/v3/projects/service` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:14:05.105697 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ff3cef-bd31-4f27-97af-fd234993efea None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:14:05.107577 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ff3cef-bd31-4f27-97af-fd234993efea None admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:14:05.123681 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application [None req-50ff3cef-bd31-4f27-97af-fd234993efea None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 04 07:14:05.123681 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 07:14:05.123681 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 07:14:05.123681 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 07:14:05.123681 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 07:14:05.123681 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 07:14:05.123681 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 07:14:05.123681 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 07:14:05.123681 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 07:14:05.123681 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 07:14:05.123681 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 07:14:05.123681 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 07:14:05.123681 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 04 07:14:05.123681 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self._get_project(project_id) May 04 07:14:05.123681 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 04 07:14:05.124812 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 04 07:14:05.124812 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 07:14:05.124812 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 07:14:05.124812 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 07:14:05.124812 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 07:14:05.124812 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 07:14:05.124812 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.get_or_create( May 04 07:14:05.124812 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 07:14:05.124812 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application with Lock( May 04 07:14:05.124812 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 07:14:05.124812 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self._enter() May 04 07:14:05.124812 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 07:14:05.124812 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 07:14:05.124812 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 07:14:05.124812 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.creator() May 04 07:14:05.124812 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 07:14:05.124812 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application created_value = creator( May 04 07:14:05.125963 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 04 07:14:05.125963 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 04 07:14:05.125963 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 04 07:14:05.125963 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 04 07:14:05.125963 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 04 07:14:05.125963 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 04 07:14:05.125963 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 04 07:14:05.125963 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application May 04 07:14:05.125963 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 628/1244] 10.222.0.21 () {56 vars in 1111 bytes} [Wed May 4 07:14:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 07:14:05.132688 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d5e613-456d-446d-9aab-fdefcf03a6fd None admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:14:05.237700 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d5e613-456d-446d-9aab-fdefcf03a6fd None admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:14:05.275002 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca36fd0e-c0c9-46b4-9ddf-75f7084573ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:14:05.275684 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca36fd0e-c0c9-46b4-9ddf-75f7084573ca None admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:14:05.275959 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca36fd0e-c0c9-46b4-9ddf-75f7084573ca None admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:14:05.276218 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca36fd0e-c0c9-46b4-9ddf-75f7084573ca None admin] PATH_INFO: `/v3/projects` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:14:05.277110 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca36fd0e-c0c9-46b4-9ddf-75f7084573ca None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 07:14:05.277410 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca36fd0e-c0c9-46b4-9ddf-75f7084573ca None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:14:05.279036 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca36fd0e-c0c9-46b4-9ddf-75f7084573ca None admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:14:05.294057 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 617/1245] 10.222.0.21 () {56 vars in 1148 bytes} [Wed May 4 07:14:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 07:14:05.301433 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ff3cef-bd31-4f27-97af-fd234993efea None admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:14:05.407724 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ff3cef-bd31-4f27-97af-fd234993efea None admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:14:05.444268 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857a80aa-94cf-4091-9035-5bc1c78b22a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:14:05.445357 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857a80aa-94cf-4091-9035-5bc1c78b22a3 None admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:14:05.445636 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857a80aa-94cf-4091-9035-5bc1c78b22a3 None admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:14:05.445904 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857a80aa-94cf-4091-9035-5bc1c78b22a3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:14:05.446774 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857a80aa-94cf-4091-9035-5bc1c78b22a3 None admin] RBAC: Adding query filter params (role.id=14041215d0f7476a8e90241a49338706, scope.project.id=c9f9c44db4984653b8d4b5f6b3b949f5, user.id=ef28e980e8664d3eba4304e4589ea2df) {{(pid=79744) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 07:14:05.447050 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857a80aa-94cf-4091-9035-5bc1c78b22a3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:14:05.448518 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857a80aa-94cf-4091-9035-5bc1c78b22a3 None admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:14:05.455758 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 629/1246] 10.222.0.21 () {56 vars in 1374 bytes} [Wed May 4 07:14:05 2022] GET /identity/v3/role_assignments?user.id=ef28e980e8664d3eba4304e4589ea2df&scope.project.id=c9f9c44db4984653b8d4b5f6b3b949f5&role.id=14041215d0f7476a8e90241a49338706 => generated 608 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 07:14:07.919511 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febc76a3-47f4-4916-8402-a1581a4e84c0 None None] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:14:07.920175 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febc76a3-47f4-4916-8402-a1581a4e84c0 None None] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:14:07.920175 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febc76a3-47f4-4916-8402-a1581a4e84c0 None None] PATH_INFO: `/` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:14:07.921391 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 618/1247] 10.222.0.21 () {54 vars in 926 bytes} [Wed May 4 07:14:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 07:14:07.927106 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9056fa48-41f9-462c-b6a9-c2f2350cb95e None None] REQUEST_METHOD: `POST` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:14:07.927655 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9056fa48-41f9-462c-b6a9-c2f2350cb95e None None] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:14:07.927994 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9056fa48-41f9-462c-b6a9-c2f2350cb95e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:14:07.945822 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.auth.core [None req-9056fa48-41f9-462c-b6a9-c2f2350cb95e None None] MFA Rules not processed for user `83c5e0dcb991496ea6dee38384514508`. Rule list: `[]` (Enabled: `True`). {{(pid=79744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:14:07.947175 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.fernet_utils [None req-9056fa48-41f9-462c-b6a9-c2f2350cb95e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:14:08.034351 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 630/1248] 10.222.0.21 () {58 vars in 1023 bytes} [Wed May 4 07:14:07 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 07:14:08.059406 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febc76a3-47f4-4916-8402-a1581a4e84c0 None None] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:14:08.187211 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febc76a3-47f4-4916-8402-a1581a4e84c0 None None] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:14:08.221867 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f737501c-79a2-481a-ab92-6827c2b6b716 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:14:08.222685 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f737501c-79a2-481a-ab92-6827c2b6b716 None admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:14:08.222961 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f737501c-79a2-481a-ab92-6827c2b6b716 None admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:14:08.223261 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f737501c-79a2-481a-ab92-6827c2b6b716 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:14:08.234651 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f737501c-79a2-481a-ab92-6827c2b6b716 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 07:14:08.243169 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application [None req-f737501c-79a2-481a-ab92-6827c2b6b716 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 04 07:14:08.243169 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 07:14:08.243169 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 07:14:08.243169 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 07:14:08.243169 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 07:14:08.243169 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 07:14:08.243169 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 07:14:08.243169 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 07:14:08.243169 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 07:14:08.243169 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 07:14:08.243169 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 07:14:08.243169 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 07:14:08.243169 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 07:14:08.243169 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 07:14:08.243169 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 07:14:08.243169 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 07:14:08.244324 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 07:14:08.244324 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 07:14:08.244324 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 07:14:08.244324 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 07:14:08.244324 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 07:14:08.244324 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 07:14:08.244324 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 07:14:08.244324 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 07:14:08.244324 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 07:14:08.244324 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self.get_or_create( May 04 07:14:08.244324 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 07:14:08.244324 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application with Lock( May 04 07:14:08.244324 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 07:14:08.244324 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self._enter() May 04 07:14:08.244324 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 07:14:08.244324 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 07:14:08.245366 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 07:14:08.245366 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self.creator() May 04 07:14:08.245366 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 07:14:08.245366 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application created_value = creator( May 04 07:14:08.245366 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 07:14:08.245366 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 07:14:08.245366 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 07:14:08.245366 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 07:14:08.245366 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 07:14:08.245366 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 07:14:08.245366 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 04 07:14:08.245366 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application May 04 07:14:08.245366 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 619/1249] 10.222.0.21 () {56 vars in 1096 bytes} [Wed May 4 07:14:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 07:14:08.250792 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9056fa48-41f9-462c-b6a9-c2f2350cb95e None None] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:14:08.357504 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9056fa48-41f9-462c-b6a9-c2f2350cb95e None None] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:14:08.392210 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3313847-6db1-42f7-b1fb-c5595e86add9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:14:08.392860 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3313847-6db1-42f7-b1fb-c5595e86add9 None admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:14:08.393136 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3313847-6db1-42f7-b1fb-c5595e86add9 None admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:14:08.393406 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3313847-6db1-42f7-b1fb-c5595e86add9 None admin] PATH_INFO: `/v3/roles` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:14:08.394139 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3313847-6db1-42f7-b1fb-c5595e86add9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79744) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 07:14:08.394440 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3313847-6db1-42f7-b1fb-c5595e86add9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:14:08.395854 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3313847-6db1-42f7-b1fb-c5595e86add9 None admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:14:08.404438 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 631/1250] 10.222.0.21 () {56 vars in 1099 bytes} [Wed May 4 07:14:08 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 07:14:08.411323 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f737501c-79a2-481a-ab92-6827c2b6b716 None admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:14:08.518738 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f737501c-79a2-481a-ab92-6827c2b6b716 None admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:14:08.556187 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66fc48c9-cc8c-4464-a391-f58596e6e2ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:14:08.556967 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fc48c9-cc8c-4464-a391-f58596e6e2ff None admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:14:08.558725 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fc48c9-cc8c-4464-a391-f58596e6e2ff None admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:14:08.558725 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fc48c9-cc8c-4464-a391-f58596e6e2ff None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:14:08.567793 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66fc48c9-cc8c-4464-a391-f58596e6e2ff None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:14:08.569420 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66fc48c9-cc8c-4464-a391-f58596e6e2ff None admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:14:08.590307 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application [None req-66fc48c9-cc8c-4464-a391-f58596e6e2ff None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 07:14:08.590307 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 07:14:08.590307 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 07:14:08.590307 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 07:14:08.590307 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 07:14:08.590307 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 07:14:08.590307 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 07:14:08.590307 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 07:14:08.590307 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 07:14:08.590307 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 07:14:08.590307 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 07:14:08.590307 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 07:14:08.590307 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 07:14:08.590307 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 07:14:08.590307 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 07:14:08.591302 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 07:14:08.591302 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 07:14:08.591302 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 07:14:08.591302 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 07:14:08.591302 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 07:14:08.591302 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 07:14:08.591302 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self.get_or_create( May 04 07:14:08.591302 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 07:14:08.591302 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application with Lock( May 04 07:14:08.591302 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 07:14:08.591302 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self._enter() May 04 07:14:08.591302 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 07:14:08.591302 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 07:14:08.591302 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 07:14:08.591302 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self.creator() May 04 07:14:08.591302 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 07:14:08.591302 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application created_value = creator( May 04 07:14:08.592513 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 07:14:08.592513 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 07:14:08.592513 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 07:14:08.592513 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application May 04 07:14:08.592513 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 620/1251] 10.222.0.21 () {56 vars in 1108 bytes} [Wed May 4 07:14:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 07:14:08.598893 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3313847-6db1-42f7-b1fb-c5595e86add9 None admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:14:08.709599 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3313847-6db1-42f7-b1fb-c5595e86add9 None admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:14:08.748660 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d5ebe4-ce70-4f6a-ae61-3d3109fdb933 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:14:08.749587 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d5ebe4-ce70-4f6a-ae61-3d3109fdb933 None admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:14:08.749917 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d5ebe4-ce70-4f6a-ae61-3d3109fdb933 None admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:14:08.750312 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d5ebe4-ce70-4f6a-ae61-3d3109fdb933 None admin] PATH_INFO: `/v3/domains` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:14:08.751352 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d5ebe4-ce70-4f6a-ae61-3d3109fdb933 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79744) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 07:14:08.751654 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d5ebe4-ce70-4f6a-ae61-3d3109fdb933 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:14:08.753753 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d5ebe4-ce70-4f6a-ae61-3d3109fdb933 None admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:14:08.768245 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 632/1252] 10.222.0.21 () {56 vars in 1109 bytes} [Wed May 4 07:14:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 07:14:08.774448 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66fc48c9-cc8c-4464-a391-f58596e6e2ff None admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:14:08.877561 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66fc48c9-cc8c-4464-a391-f58596e6e2ff None admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:14:08.913853 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879fc8eb-c7b6-471c-80ba-60bdbeb5c171 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:14:08.914665 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879fc8eb-c7b6-471c-80ba-60bdbeb5c171 None admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:14:08.914945 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879fc8eb-c7b6-471c-80ba-60bdbeb5c171 None admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:14:08.915242 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879fc8eb-c7b6-471c-80ba-60bdbeb5c171 None admin] PATH_INFO: `/v3/users/placement` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:14:08.923004 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879fc8eb-c7b6-471c-80ba-60bdbeb5c171 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:14:08.924499 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879fc8eb-c7b6-471c-80ba-60bdbeb5c171 None admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:14:08.939984 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application [None req-879fc8eb-c7b6-471c-80ba-60bdbeb5c171 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 04 07:14:08.939984 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 07:14:08.939984 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 07:14:08.939984 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 07:14:08.939984 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 07:14:08.939984 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 07:14:08.939984 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 07:14:08.939984 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 07:14:08.939984 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 07:14:08.939984 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 07:14:08.939984 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 07:14:08.939984 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 07:14:08.939984 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 04 07:14:08.939984 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self._get_user(user_id) May 04 07:14:08.939984 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 04 07:14:08.939984 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 04 07:14:08.941234 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 07:14:08.941234 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 07:14:08.941234 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 04 07:14:08.941234 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 07:14:08.941234 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 04 07:14:08.941234 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 07:14:08.941234 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 07:14:08.941234 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 07:14:08.941234 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 07:14:08.941234 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self.get_or_create( May 04 07:14:08.941234 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 07:14:08.941234 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application with Lock( May 04 07:14:08.941234 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 07:14:08.941234 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self._enter() May 04 07:14:08.941234 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 07:14:08.941234 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 07:14:08.941234 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 07:14:08.941234 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self.creator() May 04 07:14:08.942218 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 07:14:08.942218 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application created_value = creator( May 04 07:14:08.942218 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 04 07:14:08.942218 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 04 07:14:08.942218 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 04 07:14:08.942218 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 04 07:14:08.942218 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 04 07:14:08.942218 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 04 07:14:08.942218 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 04 07:14:08.942218 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application May 04 07:14:08.942218 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 621/1253] 10.222.0.21 () {56 vars in 1108 bytes} [Wed May 4 07:14:08 2022] GET /identity/v3/users/placement => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 07:14:08.948207 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d5ebe4-ce70-4f6a-ae61-3d3109fdb933 None admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:14:09.049743 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d5ebe4-ce70-4f6a-ae61-3d3109fdb933 None admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:14:09.093342 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aecd734b-87dd-4d8d-bee7-e0191c8b680c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:14:09.094103 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecd734b-87dd-4d8d-bee7-e0191c8b680c None admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:14:09.094383 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecd734b-87dd-4d8d-bee7-e0191c8b680c None admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:14:09.094730 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecd734b-87dd-4d8d-bee7-e0191c8b680c None admin] PATH_INFO: `/v3/users` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:14:09.095820 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aecd734b-87dd-4d8d-bee7-e0191c8b680c None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79744) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 07:14:09.096157 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aecd734b-87dd-4d8d-bee7-e0191c8b680c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:14:09.097985 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aecd734b-87dd-4d8d-bee7-e0191c8b680c None admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:14:09.119819 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 633/1254] 10.222.0.21 () {56 vars in 1143 bytes} [Wed May 4 07:14:08 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 07:14:09.125617 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879fc8eb-c7b6-471c-80ba-60bdbeb5c171 None admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:14:09.221614 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879fc8eb-c7b6-471c-80ba-60bdbeb5c171 None admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:14:09.255700 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ff9369-21f1-4ac1-9019-6df6c0492031 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:14:09.256468 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ff9369-21f1-4ac1-9019-6df6c0492031 None admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:14:09.256744 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ff9369-21f1-4ac1-9019-6df6c0492031 None admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:14:09.257374 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ff9369-21f1-4ac1-9019-6df6c0492031 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:14:09.322635 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ff9369-21f1-4ac1-9019-6df6c0492031 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:14:09.324034 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ff9369-21f1-4ac1-9019-6df6c0492031 None admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:14:09.419470 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 622/1255] 10.222.0.21 () {58 vars in 1282 bytes} [Wed May 4 07:14:09 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 04 07:14:09.425216 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aecd734b-87dd-4d8d-bee7-e0191c8b680c None admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:14:09.519547 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aecd734b-87dd-4d8d-bee7-e0191c8b680c None admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:14:09.551387 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1bf843-265f-4369-9fec-cdf92e002b58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:14:09.552153 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1bf843-265f-4369-9fec-cdf92e002b58 None admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:14:09.552426 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1bf843-265f-4369-9fec-cdf92e002b58 None admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:14:09.552690 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1bf843-265f-4369-9fec-cdf92e002b58 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:14:09.562017 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1bf843-265f-4369-9fec-cdf92e002b58 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:14:09.563455 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1bf843-265f-4369-9fec-cdf92e002b58 None admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:14:09.580225 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application [None req-9d1bf843-265f-4369-9fec-cdf92e002b58 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 07:14:09.580225 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 07:14:09.580225 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 07:14:09.580225 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 07:14:09.580225 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 07:14:09.580225 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 07:14:09.580225 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 07:14:09.580225 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 07:14:09.580225 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 07:14:09.580225 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 07:14:09.580225 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 07:14:09.580225 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 07:14:09.580225 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 07:14:09.580225 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 07:14:09.580225 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 07:14:09.581259 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 07:14:09.581259 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 07:14:09.581259 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 07:14:09.581259 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 07:14:09.581259 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 07:14:09.581259 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 07:14:09.581259 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.get_or_create( May 04 07:14:09.581259 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 07:14:09.581259 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application with Lock( May 04 07:14:09.581259 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 07:14:09.581259 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self._enter() May 04 07:14:09.581259 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 07:14:09.581259 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 07:14:09.581259 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 07:14:09.581259 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.creator() May 04 07:14:09.581259 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 07:14:09.581259 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application created_value = creator( May 04 07:14:09.582340 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 07:14:09.582340 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 07:14:09.582340 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 07:14:09.582340 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application May 04 07:14:09.582340 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 634/1256] 10.222.0.21 () {56 vars in 1108 bytes} [Wed May 4 07:14:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 07:14:09.587563 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ff9369-21f1-4ac1-9019-6df6c0492031 None admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:14:09.678828 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ff9369-21f1-4ac1-9019-6df6c0492031 None admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:14:09.712087 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edf6518-2cd7-4fec-ab2b-8ba3e6817e60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:14:09.712734 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edf6518-2cd7-4fec-ab2b-8ba3e6817e60 None admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:14:09.713011 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edf6518-2cd7-4fec-ab2b-8ba3e6817e60 None admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:14:09.713280 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edf6518-2cd7-4fec-ab2b-8ba3e6817e60 None admin] PATH_INFO: `/v3/domains` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:14:09.713984 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1edf6518-2cd7-4fec-ab2b-8ba3e6817e60 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 07:14:09.714282 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1edf6518-2cd7-4fec-ab2b-8ba3e6817e60 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:14:09.715678 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1edf6518-2cd7-4fec-ab2b-8ba3e6817e60 None admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:14:09.726466 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 623/1257] 10.222.0.21 () {56 vars in 1109 bytes} [Wed May 4 07:14:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 07:14:09.732167 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1bf843-265f-4369-9fec-cdf92e002b58 None admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:14:09.825533 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1bf843-265f-4369-9fec-cdf92e002b58 None admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:14:09.866886 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8c1341-e3a2-47b0-abc9-4213cfe6d79b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:14:09.867616 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8c1341-e3a2-47b0-abc9-4213cfe6d79b None admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:14:09.867890 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8c1341-e3a2-47b0-abc9-4213cfe6d79b None admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:14:09.868155 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8c1341-e3a2-47b0-abc9-4213cfe6d79b None admin] PATH_INFO: `/v3/projects/service` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:14:09.874424 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8c1341-e3a2-47b0-abc9-4213cfe6d79b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:14:09.875889 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8c1341-e3a2-47b0-abc9-4213cfe6d79b None admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:14:09.889800 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application [None req-7f8c1341-e3a2-47b0-abc9-4213cfe6d79b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 04 07:14:09.889800 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 07:14:09.889800 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 07:14:09.889800 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 07:14:09.889800 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 07:14:09.889800 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 07:14:09.889800 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 07:14:09.889800 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 07:14:09.889800 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 07:14:09.889800 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 07:14:09.889800 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 07:14:09.889800 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 07:14:09.889800 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 04 07:14:09.889800 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self._get_project(project_id) May 04 07:14:09.889800 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 04 07:14:09.890841 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 04 07:14:09.890841 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 07:14:09.890841 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 07:14:09.890841 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 07:14:09.890841 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 07:14:09.890841 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 07:14:09.890841 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.get_or_create( May 04 07:14:09.890841 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 07:14:09.890841 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application with Lock( May 04 07:14:09.890841 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 07:14:09.890841 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self._enter() May 04 07:14:09.890841 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 07:14:09.890841 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 07:14:09.890841 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 07:14:09.890841 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.creator() May 04 07:14:09.890841 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 07:14:09.890841 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application created_value = creator( May 04 07:14:09.891988 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 04 07:14:09.891988 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 04 07:14:09.891988 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 04 07:14:09.891988 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 04 07:14:09.891988 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 04 07:14:09.891988 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 04 07:14:09.891988 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 04 07:14:09.891988 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application May 04 07:14:09.891988 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 635/1258] 10.222.0.21 () {56 vars in 1111 bytes} [Wed May 4 07:14:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 07:14:09.897528 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edf6518-2cd7-4fec-ab2b-8ba3e6817e60 None admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:14:09.989741 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edf6518-2cd7-4fec-ab2b-8ba3e6817e60 None admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:14:10.030824 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f45737-4277-40ca-bab1-99fd6aaf7615 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:14:10.031511 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f45737-4277-40ca-bab1-99fd6aaf7615 None admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:14:10.031792 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f45737-4277-40ca-bab1-99fd6aaf7615 None admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:14:10.032066 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f45737-4277-40ca-bab1-99fd6aaf7615 None admin] PATH_INFO: `/v3/projects` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:14:10.032850 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f45737-4277-40ca-bab1-99fd6aaf7615 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 07:14:10.033156 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f45737-4277-40ca-bab1-99fd6aaf7615 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:14:10.034589 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f45737-4277-40ca-bab1-99fd6aaf7615 None admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:14:10.046962 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 624/1259] 10.222.0.21 () {56 vars in 1148 bytes} [Wed May 4 07:14:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 07:14:10.054292 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8c1341-e3a2-47b0-abc9-4213cfe6d79b None admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:14:10.151856 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8c1341-e3a2-47b0-abc9-4213cfe6d79b None admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:14:10.182453 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd091c89-1cd5-486e-b41e-3af4078ddb0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:14:10.183083 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd091c89-1cd5-486e-b41e-3af4078ddb0f None admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:14:10.183384 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd091c89-1cd5-486e-b41e-3af4078ddb0f None admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:14:10.183653 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd091c89-1cd5-486e-b41e-3af4078ddb0f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:14:10.184460 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd091c89-1cd5-486e-b41e-3af4078ddb0f None admin] RBAC: Adding query filter params (role.id=eb54c9cea2774a25b1fe8c79724408ee, scope.project.id=c9f9c44db4984653b8d4b5f6b3b949f5, user.id=ef28e980e8664d3eba4304e4589ea2df) {{(pid=79744) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 07:14:10.184764 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd091c89-1cd5-486e-b41e-3af4078ddb0f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:14:10.186163 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd091c89-1cd5-486e-b41e-3af4078ddb0f None admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:14:10.191307 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 636/1260] 10.222.0.21 () {56 vars in 1374 bytes} [Wed May 4 07:14:10 2022] GET /identity/v3/role_assignments?user.id=ef28e980e8664d3eba4304e4589ea2df&scope.project.id=c9f9c44db4984653b8d4b5f6b3b949f5&role.id=eb54c9cea2774a25b1fe8c79724408ee => generated 259 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 07:14:12.401330 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8686f98a-5d44-4c79-aa10-8b1dcf7f2028 None None] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:14:12.401899 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8686f98a-5d44-4c79-aa10-8b1dcf7f2028 None None] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:14:12.401899 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8686f98a-5d44-4c79-aa10-8b1dcf7f2028 None None] PATH_INFO: `/` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:14:12.403227 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 625/1261] 10.222.0.21 () {54 vars in 926 bytes} [Wed May 4 07:14:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 07:14:12.408324 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530d946d-ce09-486c-9790-31dcc09d4ade None None] REQUEST_METHOD: `POST` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:14:12.408735 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530d946d-ce09-486c-9790-31dcc09d4ade None None] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:14:12.408854 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530d946d-ce09-486c-9790-31dcc09d4ade None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:14:12.424790 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.auth.core [None req-530d946d-ce09-486c-9790-31dcc09d4ade None None] MFA Rules not processed for user `83c5e0dcb991496ea6dee38384514508`. Rule list: `[]` (Enabled: `True`). {{(pid=79744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:14:12.425946 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.fernet_utils [None req-530d946d-ce09-486c-9790-31dcc09d4ade None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:14:12.489722 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 637/1262] 10.222.0.21 () {58 vars in 1023 bytes} [Wed May 4 07:14:12 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 04 07:14:12.513453 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8686f98a-5d44-4c79-aa10-8b1dcf7f2028 None None] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:14:12.609241 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8686f98a-5d44-4c79-aa10-8b1dcf7f2028 None None] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:14:12.641667 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6559a055-5a53-4712-a3ab-cf3aa23a3ced None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:14:12.642440 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6559a055-5a53-4712-a3ab-cf3aa23a3ced None admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:14:12.642723 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6559a055-5a53-4712-a3ab-cf3aa23a3ced None admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:14:12.642994 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6559a055-5a53-4712-a3ab-cf3aa23a3ced None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:14:12.652881 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6559a055-5a53-4712-a3ab-cf3aa23a3ced None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 07:14:12.660350 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application [None req-6559a055-5a53-4712-a3ab-cf3aa23a3ced None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 04 07:14:12.660350 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 07:14:12.660350 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 07:14:12.660350 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 07:14:12.660350 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 07:14:12.660350 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 07:14:12.660350 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 07:14:12.660350 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 07:14:12.660350 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 07:14:12.660350 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 07:14:12.660350 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 07:14:12.660350 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 07:14:12.660350 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 07:14:12.660350 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 07:14:12.660350 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 07:14:12.660350 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 07:14:12.661495 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 07:14:12.661495 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 07:14:12.661495 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 07:14:12.661495 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 07:14:12.661495 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 07:14:12.661495 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 07:14:12.661495 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 07:14:12.661495 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 07:14:12.661495 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 07:14:12.661495 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self.get_or_create( May 04 07:14:12.661495 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 07:14:12.661495 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application with Lock( May 04 07:14:12.661495 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 07:14:12.661495 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self._enter() May 04 07:14:12.661495 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 07:14:12.661495 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 07:14:12.663425 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 07:14:12.663425 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self.creator() May 04 07:14:12.663425 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 07:14:12.663425 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application created_value = creator( May 04 07:14:12.663425 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 07:14:12.663425 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 07:14:12.663425 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 07:14:12.663425 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 07:14:12.663425 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 07:14:12.663425 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 07:14:12.663425 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 04 07:14:12.663425 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application May 04 07:14:12.663425 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 626/1263] 10.222.0.21 () {56 vars in 1096 bytes} [Wed May 4 07:14:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 07:14:12.668323 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530d946d-ce09-486c-9790-31dcc09d4ade None None] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:14:12.761563 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530d946d-ce09-486c-9790-31dcc09d4ade None None] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:14:12.793493 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c276ed75-b8d7-41d1-be5d-0750de9a7d13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:14:12.794147 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c276ed75-b8d7-41d1-be5d-0750de9a7d13 None admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:14:12.794427 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c276ed75-b8d7-41d1-be5d-0750de9a7d13 None admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:14:12.794699 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c276ed75-b8d7-41d1-be5d-0750de9a7d13 None admin] PATH_INFO: `/v3/roles` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:14:12.795468 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c276ed75-b8d7-41d1-be5d-0750de9a7d13 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79744) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 07:14:12.795775 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c276ed75-b8d7-41d1-be5d-0750de9a7d13 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:14:12.797128 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c276ed75-b8d7-41d1-be5d-0750de9a7d13 None admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:14:12.805474 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 638/1264] 10.222.0.21 () {56 vars in 1099 bytes} [Wed May 4 07:14:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 07:14:12.811625 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6559a055-5a53-4712-a3ab-cf3aa23a3ced None admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:14:12.904654 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6559a055-5a53-4712-a3ab-cf3aa23a3ced None admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:14:12.935435 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ac4d42-e9c5-49cb-b3be-fde4b6e2e80e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:14:12.936201 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ac4d42-e9c5-49cb-b3be-fde4b6e2e80e None admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:14:12.936476 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ac4d42-e9c5-49cb-b3be-fde4b6e2e80e None admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:14:12.936748 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ac4d42-e9c5-49cb-b3be-fde4b6e2e80e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:14:12.947245 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ac4d42-e9c5-49cb-b3be-fde4b6e2e80e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:14:12.948676 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ac4d42-e9c5-49cb-b3be-fde4b6e2e80e None admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:14:12.965569 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application [None req-e1ac4d42-e9c5-49cb-b3be-fde4b6e2e80e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 07:14:12.965569 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 07:14:12.965569 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 07:14:12.965569 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 07:14:12.965569 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 07:14:12.965569 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 07:14:12.965569 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 07:14:12.965569 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 07:14:12.965569 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 07:14:12.965569 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 07:14:12.965569 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 07:14:12.965569 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 07:14:12.965569 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 07:14:12.965569 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 07:14:12.965569 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 07:14:12.966625 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 07:14:12.966625 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 07:14:12.966625 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 07:14:12.966625 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 07:14:12.966625 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 07:14:12.966625 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 07:14:12.966625 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self.get_or_create( May 04 07:14:12.966625 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 07:14:12.966625 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application with Lock( May 04 07:14:12.966625 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 07:14:12.966625 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self._enter() May 04 07:14:12.966625 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 07:14:12.966625 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 07:14:12.966625 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 07:14:12.966625 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self.creator() May 04 07:14:12.966625 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 07:14:12.966625 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application created_value = creator( May 04 07:14:12.968291 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 07:14:12.968291 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 07:14:12.968291 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 07:14:12.968291 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application May 04 07:14:12.968291 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 627/1265] 10.222.0.21 () {56 vars in 1108 bytes} [Wed May 4 07:14:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 07:14:12.972824 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c276ed75-b8d7-41d1-be5d-0750de9a7d13 None admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:14:13.075884 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c276ed75-b8d7-41d1-be5d-0750de9a7d13 None admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:14:13.114891 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa10163-62ad-4de3-8c9c-a4cec4c33466 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:14:13.115665 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa10163-62ad-4de3-8c9c-a4cec4c33466 None admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:14:13.116197 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa10163-62ad-4de3-8c9c-a4cec4c33466 None admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:14:13.116463 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa10163-62ad-4de3-8c9c-a4cec4c33466 None admin] PATH_INFO: `/v3/domains` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:14:13.117266 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa10163-62ad-4de3-8c9c-a4cec4c33466 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79744) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 07:14:13.117639 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa10163-62ad-4de3-8c9c-a4cec4c33466 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:14:13.119204 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa10163-62ad-4de3-8c9c-a4cec4c33466 None admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:14:13.133233 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 639/1266] 10.222.0.21 () {56 vars in 1109 bytes} [Wed May 4 07:14:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 07:14:13.139070 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ac4d42-e9c5-49cb-b3be-fde4b6e2e80e None admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:14:13.233940 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ac4d42-e9c5-49cb-b3be-fde4b6e2e80e None admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:14:13.264536 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48286e95-6c77-4831-a16d-2caac5612c7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:14:13.265309 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48286e95-6c77-4831-a16d-2caac5612c7a None admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:14:13.265584 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48286e95-6c77-4831-a16d-2caac5612c7a None admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:14:13.265853 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48286e95-6c77-4831-a16d-2caac5612c7a None admin] PATH_INFO: `/v3/users/placement` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:14:13.273352 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48286e95-6c77-4831-a16d-2caac5612c7a None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:14:13.274750 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48286e95-6c77-4831-a16d-2caac5612c7a None admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:14:13.288381 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application [None req-48286e95-6c77-4831-a16d-2caac5612c7a None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 04 07:14:13.288381 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 07:14:13.288381 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 07:14:13.288381 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 07:14:13.288381 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 07:14:13.288381 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 07:14:13.288381 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 07:14:13.288381 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 07:14:13.288381 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 07:14:13.288381 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 07:14:13.288381 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 07:14:13.288381 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 07:14:13.288381 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 04 07:14:13.288381 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self._get_user(user_id) May 04 07:14:13.288381 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 04 07:14:13.288381 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 04 07:14:13.289489 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 07:14:13.289489 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 07:14:13.289489 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 04 07:14:13.289489 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 07:14:13.289489 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 04 07:14:13.289489 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 07:14:13.289489 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 07:14:13.289489 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 07:14:13.289489 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 07:14:13.289489 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self.get_or_create( May 04 07:14:13.289489 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 07:14:13.289489 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application with Lock( May 04 07:14:13.289489 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 07:14:13.289489 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self._enter() May 04 07:14:13.289489 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 07:14:13.289489 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 07:14:13.289489 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 07:14:13.289489 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self.creator() May 04 07:14:13.290495 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 07:14:13.290495 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application created_value = creator( May 04 07:14:13.290495 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 04 07:14:13.290495 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 04 07:14:13.290495 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 04 07:14:13.290495 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 04 07:14:13.290495 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 04 07:14:13.290495 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 04 07:14:13.290495 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 04 07:14:13.290495 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application May 04 07:14:13.290495 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 628/1267] 10.222.0.21 () {56 vars in 1108 bytes} [Wed May 4 07:14:13 2022] GET /identity/v3/users/placement => generated 87 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 07:14:13.295197 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa10163-62ad-4de3-8c9c-a4cec4c33466 None admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:14:13.386756 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa10163-62ad-4de3-8c9c-a4cec4c33466 None admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:14:13.417993 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9fdffb-9ebe-4429-a888-0e56aa831259 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:14:13.418641 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9fdffb-9ebe-4429-a888-0e56aa831259 None admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:14:13.418914 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9fdffb-9ebe-4429-a888-0e56aa831259 None admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:14:13.419203 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9fdffb-9ebe-4429-a888-0e56aa831259 None admin] PATH_INFO: `/v3/users` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:14:13.420019 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9fdffb-9ebe-4429-a888-0e56aa831259 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79744) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 07:14:13.420319 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9fdffb-9ebe-4429-a888-0e56aa831259 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:14:13.421713 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9fdffb-9ebe-4429-a888-0e56aa831259 None admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:14:13.438407 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 640/1268] 10.222.0.21 () {56 vars in 1143 bytes} [Wed May 4 07:14:13 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 07:14:13.444637 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48286e95-6c77-4831-a16d-2caac5612c7a None admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:14:13.538054 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48286e95-6c77-4831-a16d-2caac5612c7a None admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:14:13.576544 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5b30dd-9d94-4812-8ef8-8337de80ba0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:14:13.577307 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5b30dd-9d94-4812-8ef8-8337de80ba0c None admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:14:13.577578 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5b30dd-9d94-4812-8ef8-8337de80ba0c None admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:14:13.577841 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5b30dd-9d94-4812-8ef8-8337de80ba0c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:14:13.593252 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5b30dd-9d94-4812-8ef8-8337de80ba0c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:14:13.594685 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5b30dd-9d94-4812-8ef8-8337de80ba0c None admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:14:13.610818 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application [None req-8c5b30dd-9d94-4812-8ef8-8337de80ba0c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 07:14:13.610818 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 07:14:13.610818 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 07:14:13.610818 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 07:14:13.610818 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 07:14:13.610818 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 07:14:13.610818 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 07:14:13.610818 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 07:14:13.610818 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 07:14:13.610818 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 07:14:13.610818 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 07:14:13.610818 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 07:14:13.610818 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 07:14:13.610818 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 07:14:13.610818 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 07:14:13.611784 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 07:14:13.611784 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 07:14:13.611784 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 07:14:13.611784 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 07:14:13.611784 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 07:14:13.611784 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 07:14:13.611784 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self.get_or_create( May 04 07:14:13.611784 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 07:14:13.611784 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application with Lock( May 04 07:14:13.611784 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 07:14:13.611784 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self._enter() May 04 07:14:13.611784 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 07:14:13.611784 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 07:14:13.611784 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 07:14:13.611784 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self.creator() May 04 07:14:13.611784 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 07:14:13.611784 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application created_value = creator( May 04 07:14:13.612739 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 07:14:13.612739 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 07:14:13.612739 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 07:14:13.612739 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application May 04 07:14:13.612739 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 629/1269] 10.222.0.21 () {56 vars in 1108 bytes} [Wed May 4 07:14:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 07:14:13.617784 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9fdffb-9ebe-4429-a888-0e56aa831259 None admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:14:13.711498 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9fdffb-9ebe-4429-a888-0e56aa831259 None admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:14:13.742895 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c407ed8-20ea-499c-b053-10a3d13d6fcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:14:13.743561 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c407ed8-20ea-499c-b053-10a3d13d6fcc None admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:14:13.743838 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c407ed8-20ea-499c-b053-10a3d13d6fcc None admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:14:13.744107 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c407ed8-20ea-499c-b053-10a3d13d6fcc None admin] PATH_INFO: `/v3/domains` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:14:13.744809 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c407ed8-20ea-499c-b053-10a3d13d6fcc None admin] RBAC: Adding query filter params (name=Default) {{(pid=79744) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 07:14:13.745111 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c407ed8-20ea-499c-b053-10a3d13d6fcc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:14:13.746446 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c407ed8-20ea-499c-b053-10a3d13d6fcc None admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:14:13.758008 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 641/1270] 10.222.0.21 () {56 vars in 1109 bytes} [Wed May 4 07:14:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 07:14:13.763459 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5b30dd-9d94-4812-8ef8-8337de80ba0c None admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:14:13.856059 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5b30dd-9d94-4812-8ef8-8337de80ba0c None admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:14:13.888854 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50d31e3-7929-496c-9e6e-5399e883b298 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:14:13.889640 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50d31e3-7929-496c-9e6e-5399e883b298 None admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:14:13.889921 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50d31e3-7929-496c-9e6e-5399e883b298 None admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:14:13.890194 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50d31e3-7929-496c-9e6e-5399e883b298 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:14:13.896545 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50d31e3-7929-496c-9e6e-5399e883b298 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:14:13.897960 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50d31e3-7929-496c-9e6e-5399e883b298 None admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:14:13.911622 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application [None req-e50d31e3-7929-496c-9e6e-5399e883b298 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 04 07:14:13.911622 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 07:14:13.911622 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 07:14:13.911622 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 07:14:13.911622 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 07:14:13.911622 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 07:14:13.911622 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 07:14:13.911622 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 07:14:13.911622 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 07:14:13.911622 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 07:14:13.911622 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 07:14:13.911622 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 07:14:13.911622 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 04 07:14:13.911622 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self._get_project(project_id) May 04 07:14:13.911622 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 04 07:14:13.912647 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 04 07:14:13.912647 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 07:14:13.912647 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 07:14:13.912647 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 07:14:13.912647 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 07:14:13.912647 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 07:14:13.912647 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self.get_or_create( May 04 07:14:13.912647 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 07:14:13.912647 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application with Lock( May 04 07:14:13.912647 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 07:14:13.912647 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self._enter() May 04 07:14:13.912647 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 07:14:13.912647 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 07:14:13.912647 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 07:14:13.912647 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self.creator() May 04 07:14:13.912647 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 07:14:13.912647 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application created_value = creator( May 04 07:14:13.913927 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 04 07:14:13.913927 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 04 07:14:13.913927 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 04 07:14:13.913927 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 04 07:14:13.913927 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 04 07:14:13.913927 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 04 07:14:13.913927 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 04 07:14:13.913927 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application May 04 07:14:13.913927 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 630/1271] 10.222.0.21 () {56 vars in 1111 bytes} [Wed May 4 07:14:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 07:14:13.918642 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c407ed8-20ea-499c-b053-10a3d13d6fcc None admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:14:14.012448 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c407ed8-20ea-499c-b053-10a3d13d6fcc None admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:14:14.043027 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52089697-4352-47c0-b186-dc4da2b1eccf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:14:14.043694 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52089697-4352-47c0-b186-dc4da2b1eccf None admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:14:14.043974 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52089697-4352-47c0-b186-dc4da2b1eccf None admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:14:14.044245 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52089697-4352-47c0-b186-dc4da2b1eccf None admin] PATH_INFO: `/v3/projects` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:14:14.045012 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52089697-4352-47c0-b186-dc4da2b1eccf None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79744) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 07:14:14.045319 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52089697-4352-47c0-b186-dc4da2b1eccf None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:14:14.046726 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52089697-4352-47c0-b186-dc4da2b1eccf None admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:14:14.058859 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 642/1272] 10.222.0.21 () {56 vars in 1148 bytes} [Wed May 4 07:14:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 07:14:14.065404 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50d31e3-7929-496c-9e6e-5399e883b298 None admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:14:14.161540 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50d31e3-7929-496c-9e6e-5399e883b298 None admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:14:14.193168 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9c5c8a-da1c-4bf2-945d-9a2868a4e3a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:14:14.194208 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9c5c8a-da1c-4bf2-945d-9a2868a4e3a8 None admin] REQUEST_METHOD: `PUT` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:14:14.194477 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9c5c8a-da1c-4bf2-945d-9a2868a4e3a8 None admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:14:14.194740 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9c5c8a-da1c-4bf2-945d-9a2868a4e3a8 None admin] PATH_INFO: `/v3/projects/c9f9c44db4984653b8d4b5f6b3b949f5/users/ef28e980e8664d3eba4304e4589ea2df/roles/eb54c9cea2774a25b1fe8c79724408ee` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:14:14.196668 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9c5c8a-da1c-4bf2-945d-9a2868a4e3a8 None admin] RBAC: Authorizing `identity:create_grant(project_id=c9f9c44db4984653b8d4b5f6b3b949f5, user_id=ef28e980e8664d3eba4304e4589ea2df, role_id=eb54c9cea2774a25b1fe8c79724408ee)` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:14:14.198108 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9c5c8a-da1c-4bf2-945d-9a2868a4e3a8 None admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:14:14.210188 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 631/1273] 10.222.0.21 () {58 vars in 1439 bytes} [Wed May 4 07:14:14 2022] PUT /identity/v3/projects/c9f9c44db4984653b8d4b5f6b3b949f5/users/ef28e980e8664d3eba4304e4589ea2df/roles/eb54c9cea2774a25b1fe8c79724408ee => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 07:14:16.405569 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918d61bc-ee42-4a1f-984d-302260156084 None None] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:14:16.406123 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918d61bc-ee42-4a1f-984d-302260156084 None None] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:14:16.406123 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918d61bc-ee42-4a1f-984d-302260156084 None None] PATH_INFO: `/` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:14:16.407500 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 643/1274] 10.222.0.21 () {54 vars in 926 bytes} [Wed May 4 07:14:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 07:14:16.413099 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9a2b5d-2042-4bae-a679-fafbd9e19b6b None None] REQUEST_METHOD: `POST` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:14:16.413515 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9a2b5d-2042-4bae-a679-fafbd9e19b6b None None] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:14:16.413633 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9a2b5d-2042-4bae-a679-fafbd9e19b6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:14:16.430300 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.auth.core [None req-0e9a2b5d-2042-4bae-a679-fafbd9e19b6b None None] MFA Rules not processed for user `83c5e0dcb991496ea6dee38384514508`. Rule list: `[]` (Enabled: `True`). {{(pid=79745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:14:16.431481 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.fernet_utils [None req-0e9a2b5d-2042-4bae-a679-fafbd9e19b6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:14:16.493470 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 632/1275] 10.222.0.21 () {58 vars in 1023 bytes} [Wed May 4 07:14:16 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 07:14:16.516332 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918d61bc-ee42-4a1f-984d-302260156084 None None] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:14:16.611225 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918d61bc-ee42-4a1f-984d-302260156084 None None] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:14:16.643062 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc93f0b5-8531-401f-a7f0-a6b6c09e8433 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:14:16.643856 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc93f0b5-8531-401f-a7f0-a6b6c09e8433 None admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:14:16.644135 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc93f0b5-8531-401f-a7f0-a6b6c09e8433 None admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:14:16.644408 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc93f0b5-8531-401f-a7f0-a6b6c09e8433 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:14:16.653946 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc93f0b5-8531-401f-a7f0-a6b6c09e8433 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 07:14:16.661563 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application [None req-fc93f0b5-8531-401f-a7f0-a6b6c09e8433 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 04 07:14:16.661563 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 07:14:16.661563 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 07:14:16.661563 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 07:14:16.661563 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 07:14:16.661563 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 07:14:16.661563 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 07:14:16.661563 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 07:14:16.661563 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 07:14:16.661563 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 07:14:16.661563 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 07:14:16.661563 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 07:14:16.661563 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 07:14:16.661563 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 07:14:16.661563 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 07:14:16.661563 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 07:14:16.663427 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 07:14:16.663427 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 07:14:16.663427 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 07:14:16.663427 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 07:14:16.663427 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 07:14:16.663427 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 07:14:16.663427 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 07:14:16.663427 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 07:14:16.663427 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 07:14:16.663427 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.get_or_create( May 04 07:14:16.663427 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 07:14:16.663427 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application with Lock( May 04 07:14:16.663427 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 07:14:16.663427 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self._enter() May 04 07:14:16.663427 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 07:14:16.663427 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 07:14:16.664645 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 07:14:16.664645 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.creator() May 04 07:14:16.664645 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 07:14:16.664645 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application created_value = creator( May 04 07:14:16.664645 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 07:14:16.664645 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 07:14:16.664645 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 07:14:16.664645 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 07:14:16.664645 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 07:14:16.664645 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 07:14:16.664645 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 04 07:14:16.664645 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application May 04 07:14:16.664645 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 644/1276] 10.222.0.21 () {56 vars in 1096 bytes} [Wed May 4 07:14:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 07:14:16.668998 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9a2b5d-2042-4bae-a679-fafbd9e19b6b None None] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:14:16.759952 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9a2b5d-2042-4bae-a679-fafbd9e19b6b None None] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:14:16.791607 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1dbb86e-dafc-4b61-af6d-4f22a93d6054 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:14:16.792247 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1dbb86e-dafc-4b61-af6d-4f22a93d6054 None admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:14:16.792522 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1dbb86e-dafc-4b61-af6d-4f22a93d6054 None admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:14:16.792787 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1dbb86e-dafc-4b61-af6d-4f22a93d6054 None admin] PATH_INFO: `/v3/roles` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:14:16.793508 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1dbb86e-dafc-4b61-af6d-4f22a93d6054 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 07:14:16.793807 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1dbb86e-dafc-4b61-af6d-4f22a93d6054 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:14:16.795193 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1dbb86e-dafc-4b61-af6d-4f22a93d6054 None admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:14:16.802636 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 633/1277] 10.222.0.21 () {56 vars in 1099 bytes} [Wed May 4 07:14:16 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 07:14:16.808251 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc93f0b5-8531-401f-a7f0-a6b6c09e8433 None admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:14:16.902431 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc93f0b5-8531-401f-a7f0-a6b6c09e8433 None admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:14:16.934318 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303ca997-3e66-47bc-8fe6-b1f7a0040d11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:14:16.935026 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303ca997-3e66-47bc-8fe6-b1f7a0040d11 None admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:14:16.935331 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303ca997-3e66-47bc-8fe6-b1f7a0040d11 None admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:14:16.935608 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303ca997-3e66-47bc-8fe6-b1f7a0040d11 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:14:16.945775 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303ca997-3e66-47bc-8fe6-b1f7a0040d11 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:14:16.947219 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303ca997-3e66-47bc-8fe6-b1f7a0040d11 None admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:14:16.964083 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application [None req-303ca997-3e66-47bc-8fe6-b1f7a0040d11 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 07:14:16.964083 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 07:14:16.964083 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 07:14:16.964083 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 07:14:16.964083 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 07:14:16.964083 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 07:14:16.964083 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 07:14:16.964083 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 07:14:16.964083 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 07:14:16.964083 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 07:14:16.964083 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 07:14:16.964083 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 07:14:16.964083 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 07:14:16.964083 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 07:14:16.964083 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 07:14:16.965126 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 07:14:16.965126 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 07:14:16.965126 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 07:14:16.965126 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 07:14:16.965126 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 07:14:16.965126 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 07:14:16.965126 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.get_or_create( May 04 07:14:16.965126 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 07:14:16.965126 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application with Lock( May 04 07:14:16.965126 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 07:14:16.965126 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self._enter() May 04 07:14:16.965126 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 07:14:16.965126 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 07:14:16.965126 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 07:14:16.965126 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.creator() May 04 07:14:16.965126 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 07:14:16.965126 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application created_value = creator( May 04 07:14:16.966231 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 07:14:16.966231 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 07:14:16.966231 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 07:14:16.966231 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application May 04 07:14:16.966231 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 645/1278] 10.222.0.21 () {56 vars in 1108 bytes} [Wed May 4 07:14:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 07:14:16.970832 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1dbb86e-dafc-4b61-af6d-4f22a93d6054 None admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:14:17.072530 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1dbb86e-dafc-4b61-af6d-4f22a93d6054 None admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:14:17.110274 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76564e85-7faf-4098-8168-a5e7e18f6fed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:14:17.110991 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76564e85-7faf-4098-8168-a5e7e18f6fed None admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:14:17.111330 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76564e85-7faf-4098-8168-a5e7e18f6fed None admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:14:17.111626 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76564e85-7faf-4098-8168-a5e7e18f6fed None admin] PATH_INFO: `/v3/domains` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:14:17.112431 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76564e85-7faf-4098-8168-a5e7e18f6fed None admin] RBAC: Adding query filter params (name=Default) {{(pid=79745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 07:14:17.112770 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76564e85-7faf-4098-8168-a5e7e18f6fed None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:14:17.114309 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76564e85-7faf-4098-8168-a5e7e18f6fed None admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:14:17.127565 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 634/1279] 10.222.0.21 () {56 vars in 1109 bytes} [Wed May 4 07:14:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 07:14:17.134608 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303ca997-3e66-47bc-8fe6-b1f7a0040d11 None admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:14:17.228325 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303ca997-3e66-47bc-8fe6-b1f7a0040d11 None admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:14:17.260480 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e938748b-840a-4908-bfd5-f70a0e09151e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:14:17.261255 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e938748b-840a-4908-bfd5-f70a0e09151e None admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:14:17.261529 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e938748b-840a-4908-bfd5-f70a0e09151e None admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:14:17.261795 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e938748b-840a-4908-bfd5-f70a0e09151e None admin] PATH_INFO: `/v3/users/placement` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:14:17.268824 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e938748b-840a-4908-bfd5-f70a0e09151e None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:14:17.270245 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e938748b-840a-4908-bfd5-f70a0e09151e None admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:14:17.284045 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application [None req-e938748b-840a-4908-bfd5-f70a0e09151e None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 04 07:14:17.284045 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 07:14:17.284045 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 07:14:17.284045 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 07:14:17.284045 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 07:14:17.284045 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 07:14:17.284045 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 07:14:17.284045 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 07:14:17.284045 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 07:14:17.284045 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 07:14:17.284045 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 07:14:17.284045 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 07:14:17.284045 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 04 07:14:17.284045 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self._get_user(user_id) May 04 07:14:17.284045 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 04 07:14:17.284045 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 04 07:14:17.285133 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 07:14:17.285133 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 07:14:17.285133 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 04 07:14:17.285133 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 07:14:17.285133 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 04 07:14:17.285133 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 07:14:17.285133 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 07:14:17.285133 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 07:14:17.285133 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 07:14:17.285133 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.get_or_create( May 04 07:14:17.285133 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 07:14:17.285133 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application with Lock( May 04 07:14:17.285133 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 07:14:17.285133 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self._enter() May 04 07:14:17.285133 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 07:14:17.285133 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 07:14:17.285133 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 07:14:17.285133 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.creator() May 04 07:14:17.286422 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 07:14:17.286422 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application created_value = creator( May 04 07:14:17.286422 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 04 07:14:17.286422 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 04 07:14:17.286422 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 04 07:14:17.286422 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 04 07:14:17.286422 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 04 07:14:17.286422 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 04 07:14:17.286422 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 04 07:14:17.286422 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application May 04 07:14:17.286422 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 646/1280] 10.222.0.21 () {56 vars in 1108 bytes} [Wed May 4 07:14:17 2022] GET /identity/v3/users/placement => generated 87 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 07:14:17.291411 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76564e85-7faf-4098-8168-a5e7e18f6fed None admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:14:17.384182 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76564e85-7faf-4098-8168-a5e7e18f6fed None admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:14:17.415830 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14996e72-21e2-43b6-a928-a83a1f071a51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:14:17.416471 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14996e72-21e2-43b6-a928-a83a1f071a51 None admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:14:17.416750 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14996e72-21e2-43b6-a928-a83a1f071a51 None admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:14:17.417022 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14996e72-21e2-43b6-a928-a83a1f071a51 None admin] PATH_INFO: `/v3/users` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:14:17.417881 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14996e72-21e2-43b6-a928-a83a1f071a51 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 07:14:17.418186 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14996e72-21e2-43b6-a928-a83a1f071a51 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:14:17.419645 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14996e72-21e2-43b6-a928-a83a1f071a51 None admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:14:17.437034 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 635/1281] 10.222.0.21 () {56 vars in 1143 bytes} [Wed May 4 07:14:17 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 07:14:17.442719 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e938748b-840a-4908-bfd5-f70a0e09151e None admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:14:17.537711 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e938748b-840a-4908-bfd5-f70a0e09151e None admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:14:17.569384 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee264c6-1250-49bd-a773-aa55d1a29c65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:14:17.570019 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee264c6-1250-49bd-a773-aa55d1a29c65 None admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:14:17.570297 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee264c6-1250-49bd-a773-aa55d1a29c65 None admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:14:17.570565 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee264c6-1250-49bd-a773-aa55d1a29c65 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:14:17.633601 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee264c6-1250-49bd-a773-aa55d1a29c65 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:14:17.635018 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee264c6-1250-49bd-a773-aa55d1a29c65 None admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:14:17.725318 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 647/1282] 10.222.0.21 () {58 vars in 1282 bytes} [Wed May 4 07:14:17 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 283 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 04 07:14:17.731042 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14996e72-21e2-43b6-a928-a83a1f071a51 None admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:14:17.822695 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14996e72-21e2-43b6-a928-a83a1f071a51 None admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:14:17.853594 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c01773e-72ce-404f-a437-9a1ea6a57373 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:14:17.854359 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c01773e-72ce-404f-a437-9a1ea6a57373 None admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:14:17.854631 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c01773e-72ce-404f-a437-9a1ea6a57373 None admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:14:17.854896 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c01773e-72ce-404f-a437-9a1ea6a57373 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:14:17.864122 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c01773e-72ce-404f-a437-9a1ea6a57373 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:14:17.865540 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c01773e-72ce-404f-a437-9a1ea6a57373 None admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:14:17.883641 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application [None req-3c01773e-72ce-404f-a437-9a1ea6a57373 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 07:14:17.883641 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 07:14:17.883641 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 07:14:17.883641 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 07:14:17.883641 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 07:14:17.883641 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 07:14:17.883641 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 07:14:17.883641 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 07:14:17.883641 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 07:14:17.883641 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 07:14:17.883641 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 07:14:17.883641 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 07:14:17.883641 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 07:14:17.883641 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 07:14:17.883641 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 07:14:17.884774 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 07:14:17.884774 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 07:14:17.884774 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 07:14:17.884774 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 07:14:17.884774 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 07:14:17.884774 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 07:14:17.884774 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self.get_or_create( May 04 07:14:17.884774 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 07:14:17.884774 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application with Lock( May 04 07:14:17.884774 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 07:14:17.884774 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self._enter() May 04 07:14:17.884774 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 07:14:17.884774 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 07:14:17.884774 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 07:14:17.884774 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self.creator() May 04 07:14:17.884774 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 07:14:17.884774 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application created_value = creator( May 04 07:14:17.885904 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 07:14:17.885904 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 07:14:17.885904 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 07:14:17.885904 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application May 04 07:14:17.885904 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 636/1283] 10.222.0.21 () {56 vars in 1108 bytes} [Wed May 4 07:14:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 07:14:17.890385 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee264c6-1250-49bd-a773-aa55d1a29c65 None admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:14:17.982046 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee264c6-1250-49bd-a773-aa55d1a29c65 None admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:14:18.013560 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec9848c-984a-4330-a5f2-d1d809c937b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:14:18.014195 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec9848c-984a-4330-a5f2-d1d809c937b8 None admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:14:18.014470 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec9848c-984a-4330-a5f2-d1d809c937b8 None admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:14:18.014736 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec9848c-984a-4330-a5f2-d1d809c937b8 None admin] PATH_INFO: `/v3/domains` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:14:18.015462 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec9848c-984a-4330-a5f2-d1d809c937b8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79744) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 07:14:18.015762 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec9848c-984a-4330-a5f2-d1d809c937b8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:14:18.017102 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec9848c-984a-4330-a5f2-d1d809c937b8 None admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:14:18.027571 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 648/1284] 10.222.0.21 () {56 vars in 1109 bytes} [Wed May 4 07:14:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 07:14:18.033023 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c01773e-72ce-404f-a437-9a1ea6a57373 None admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:14:18.125719 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c01773e-72ce-404f-a437-9a1ea6a57373 None admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:14:18.158588 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ca630a-4586-4356-981f-621b1d7a5f2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:14:18.158588 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ca630a-4586-4356-981f-621b1d7a5f2e None admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:14:18.158588 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ca630a-4586-4356-981f-621b1d7a5f2e None admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:14:18.158588 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ca630a-4586-4356-981f-621b1d7a5f2e None admin] PATH_INFO: `/v3/projects/service` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:14:18.166022 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ca630a-4586-4356-981f-621b1d7a5f2e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:14:18.167483 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ca630a-4586-4356-981f-621b1d7a5f2e None admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:14:18.181036 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application [None req-e3ca630a-4586-4356-981f-621b1d7a5f2e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 04 07:14:18.181036 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 07:14:18.181036 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 07:14:18.181036 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 07:14:18.181036 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 07:14:18.181036 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 07:14:18.181036 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 07:14:18.181036 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 07:14:18.181036 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 07:14:18.181036 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 07:14:18.181036 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 07:14:18.181036 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 07:14:18.181036 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 04 07:14:18.181036 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self._get_project(project_id) May 04 07:14:18.181036 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 04 07:14:18.182124 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 04 07:14:18.182124 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 07:14:18.182124 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 07:14:18.182124 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 07:14:18.182124 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 07:14:18.182124 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 07:14:18.182124 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self.get_or_create( May 04 07:14:18.182124 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 07:14:18.182124 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application with Lock( May 04 07:14:18.182124 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 07:14:18.182124 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self._enter() May 04 07:14:18.182124 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 07:14:18.182124 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 07:14:18.182124 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 07:14:18.182124 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self.creator() May 04 07:14:18.182124 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 07:14:18.182124 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application created_value = creator( May 04 07:14:18.183274 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 04 07:14:18.183274 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 04 07:14:18.183274 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 04 07:14:18.183274 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 04 07:14:18.183274 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 04 07:14:18.183274 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 04 07:14:18.183274 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 04 07:14:18.183274 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: ERROR keystone.server.flask.application May 04 07:14:18.183274 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 637/1285] 10.222.0.21 () {56 vars in 1111 bytes} [Wed May 4 07:14:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 07:14:18.188022 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec9848c-984a-4330-a5f2-d1d809c937b8 None admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:14:18.280633 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec9848c-984a-4330-a5f2-d1d809c937b8 None admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:14:18.312078 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22e2781-74e4-4186-b46f-6351447677a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:14:18.312727 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22e2781-74e4-4186-b46f-6351447677a1 None admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:14:18.313008 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22e2781-74e4-4186-b46f-6351447677a1 None admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:14:18.313282 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22e2781-74e4-4186-b46f-6351447677a1 None admin] PATH_INFO: `/v3/projects` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:14:18.314057 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22e2781-74e4-4186-b46f-6351447677a1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79744) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 07:14:18.314365 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22e2781-74e4-4186-b46f-6351447677a1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:14:18.315812 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22e2781-74e4-4186-b46f-6351447677a1 None admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:14:18.327216 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 649/1286] 10.222.0.21 () {56 vars in 1148 bytes} [Wed May 4 07:14:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 07:14:18.333025 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ca630a-4586-4356-981f-621b1d7a5f2e None admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:14:18.426892 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ca630a-4586-4356-981f-621b1d7a5f2e None admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:14:18.462050 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93fd419a-2969-4405-a00a-2bc106b5a437 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:14:18.462692 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fd419a-2969-4405-a00a-2bc106b5a437 None admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:14:18.462971 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fd419a-2969-4405-a00a-2bc106b5a437 None admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:14:18.463269 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fd419a-2969-4405-a00a-2bc106b5a437 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:14:18.464080 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93fd419a-2969-4405-a00a-2bc106b5a437 None admin] RBAC: Adding query filter params (role.id=eb54c9cea2774a25b1fe8c79724408ee, scope.project.id=c9f9c44db4984653b8d4b5f6b3b949f5, user.id=ef28e980e8664d3eba4304e4589ea2df) {{(pid=79745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 07:14:18.464386 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93fd419a-2969-4405-a00a-2bc106b5a437 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:14:18.465805 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93fd419a-2969-4405-a00a-2bc106b5a437 None admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:14:18.471330 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 638/1287] 10.222.0.21 () {56 vars in 1374 bytes} [Wed May 4 07:14:18 2022] GET /identity/v3/role_assignments?user.id=ef28e980e8664d3eba4304e4589ea2df&scope.project.id=c9f9c44db4984653b8d4b5f6b3b949f5&role.id=eb54c9cea2774a25b1fe8c79724408ee => generated 608 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 07:14:20.705029 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c32a4a-fc3a-4d19-bf6b-78ee92c0a444 None None] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:14:20.705558 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c32a4a-fc3a-4d19-bf6b-78ee92c0a444 None None] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:14:20.705558 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c32a4a-fc3a-4d19-bf6b-78ee92c0a444 None None] PATH_INFO: `/` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:14:20.706837 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 650/1288] 10.222.0.21 () {54 vars in 926 bytes} [Wed May 4 07:14:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 07:14:20.712485 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a86e041-f0e5-4884-aa53-a297dc501448 None None] REQUEST_METHOD: `POST` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:14:20.712921 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a86e041-f0e5-4884-aa53-a297dc501448 None None] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:14:20.713026 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a86e041-f0e5-4884-aa53-a297dc501448 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:14:20.729837 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.auth.core [None req-3a86e041-f0e5-4884-aa53-a297dc501448 None None] MFA Rules not processed for user `83c5e0dcb991496ea6dee38384514508`. Rule list: `[]` (Enabled: `True`). {{(pid=79745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:14:20.731005 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.fernet_utils [None req-3a86e041-f0e5-4884-aa53-a297dc501448 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:14:20.793852 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 639/1289] 10.222.0.21 () {58 vars in 1023 bytes} [Wed May 4 07:14:20 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 07:14:20.815360 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c32a4a-fc3a-4d19-bf6b-78ee92c0a444 None None] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:14:20.910818 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c32a4a-fc3a-4d19-bf6b-78ee92c0a444 None None] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:14:20.941430 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d964bf5-3bfa-4162-b659-1fe337a30c59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:14:20.942196 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d964bf5-3bfa-4162-b659-1fe337a30c59 None admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:14:20.942467 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d964bf5-3bfa-4162-b659-1fe337a30c59 None admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:14:20.942735 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d964bf5-3bfa-4162-b659-1fe337a30c59 None admin] PATH_INFO: `/v3/services/placement` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:14:20.943389 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d964bf5-3bfa-4162-b659-1fe337a30c59 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:14:20.945251 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d964bf5-3bfa-4162-b659-1fe337a30c59 None admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:14:20.956588 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application [None req-4d964bf5-3bfa-4162-b659-1fe337a30c59 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. May 04 07:14:20.956588 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 07:14:20.956588 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 04 07:14:20.956588 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 04 07:14:20.956588 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 04 07:14:20.956588 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 04 07:14:20.956588 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 04 07:14:20.956588 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 07:14:20.956588 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 04 07:14:20.956588 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application May 04 07:14:20.956588 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 04 07:14:20.956588 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application May 04 07:14:20.956588 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 07:14:20.956588 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 07:14:20.956588 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 07:14:20.956588 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 07:14:20.956588 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 07:14:20.957773 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 07:14:20.957773 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 07:14:20.957773 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 07:14:20.957773 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 07:14:20.957773 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 07:14:20.957773 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 07:14:20.957773 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 04 07:14:20.957773 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self._get_service(service_id) May 04 07:14:20.957773 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 04 07:14:20.957773 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 04 07:14:20.957773 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 07:14:20.957773 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 07:14:20.957773 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 07:14:20.957773 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 07:14:20.957773 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 07:14:20.957773 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.get_or_create( May 04 07:14:20.958651 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 07:14:20.958651 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application with Lock( May 04 07:14:20.958651 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 07:14:20.958651 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self._enter() May 04 07:14:20.958651 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 07:14:20.958651 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 07:14:20.958651 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 07:14:20.958651 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.creator() May 04 07:14:20.958651 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 07:14:20.958651 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application created_value = creator( May 04 07:14:20.958651 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 04 07:14:20.958651 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 07:14:20.958651 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 04 07:14:20.958651 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application May 04 07:14:20.958651 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 651/1290] 10.222.0.21 () {56 vars in 1117 bytes} [Wed May 4 07:14:20 2022] GET /identity/v3/services/placement => generated 90 bytes in 143 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 07:14:20.964455 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a86e041-f0e5-4884-aa53-a297dc501448 None None] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:14:21.059407 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a86e041-f0e5-4884-aa53-a297dc501448 None None] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:14:21.101687 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b8bb64-9c01-4826-a194-f676133c9fc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:14:21.102415 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b8bb64-9c01-4826-a194-f676133c9fc5 None admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:14:21.102892 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b8bb64-9c01-4826-a194-f676133c9fc5 None admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:14:21.103047 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b8bb64-9c01-4826-a194-f676133c9fc5 None admin] PATH_INFO: `/v3/services` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:14:21.103807 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b8bb64-9c01-4826-a194-f676133c9fc5 None admin] RBAC: Adding query filter params (name=placement) {{(pid=79745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 07:14:21.104154 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b8bb64-9c01-4826-a194-f676133c9fc5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:14:21.105684 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b8bb64-9c01-4826-a194-f676133c9fc5 None admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:14:21.111872 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 640/1291] 10.222.0.21 () {56 vars in 1116 bytes} [Wed May 4 07:14:20 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 07:14:21.118316 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d964bf5-3bfa-4162-b659-1fe337a30c59 None admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:14:21.213621 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d964bf5-3bfa-4162-b659-1fe337a30c59 None admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:14:21.244744 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e613054-195b-428a-9ccc-50ab7856ca9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:14:21.245382 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e613054-195b-428a-9ccc-50ab7856ca9c None admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:14:21.245657 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e613054-195b-428a-9ccc-50ab7856ca9c None admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:14:21.245923 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e613054-195b-428a-9ccc-50ab7856ca9c None admin] PATH_INFO: `/v3/services` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:14:21.246610 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e613054-195b-428a-9ccc-50ab7856ca9c None admin] RBAC: Adding query filter params (type=placement) {{(pid=79744) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 07:14:21.246909 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e613054-195b-428a-9ccc-50ab7856ca9c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:14:21.248283 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e613054-195b-428a-9ccc-50ab7856ca9c None admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:14:21.252499 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 652/1292] 10.222.0.21 () {56 vars in 1116 bytes} [Wed May 4 07:14:21 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 07:14:23.522431 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c59b80c-9b2e-48d4-9061-ad5667d5f4f6 None None] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:14:23.523532 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c59b80c-9b2e-48d4-9061-ad5667d5f4f6 None None] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:14:23.523532 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c59b80c-9b2e-48d4-9061-ad5667d5f4f6 None None] PATH_INFO: `/` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:14:23.525439 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 641/1293] 10.222.0.21 () {54 vars in 926 bytes} [Wed May 4 07:14:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 07:14:23.530447 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c601e9-2f3e-4aae-8333-f6db9850a56d None None] REQUEST_METHOD: `POST` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:14:23.530847 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c601e9-2f3e-4aae-8333-f6db9850a56d None None] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:14:23.531000 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c601e9-2f3e-4aae-8333-f6db9850a56d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:14:23.548691 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.auth.core [None req-b2c601e9-2f3e-4aae-8333-f6db9850a56d None None] MFA Rules not processed for user `83c5e0dcb991496ea6dee38384514508`. Rule list: `[]` (Enabled: `True`). {{(pid=79744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:14:23.549868 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.fernet_utils [None req-b2c601e9-2f3e-4aae-8333-f6db9850a56d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:14:23.616422 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 653/1294] 10.222.0.21 () {58 vars in 1023 bytes} [Wed May 4 07:14:23 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 07:14:23.642912 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c59b80c-9b2e-48d4-9061-ad5667d5f4f6 None None] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:14:23.746663 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c59b80c-9b2e-48d4-9061-ad5667d5f4f6 None None] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:14:23.780500 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3259a39e-f526-4a14-9053-93040388f51c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:14:23.781512 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3259a39e-f526-4a14-9053-93040388f51c None admin] REQUEST_METHOD: `POST` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:14:23.781792 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3259a39e-f526-4a14-9053-93040388f51c None admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:14:23.782174 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3259a39e-f526-4a14-9053-93040388f51c None admin] PATH_INFO: `/v3/services` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:14:23.782891 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3259a39e-f526-4a14-9053-93040388f51c None admin] RBAC: Authorizing `identity:create_service()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:14:23.784281 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3259a39e-f526-4a14-9053-93040388f51c None admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:14:23.798043 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 642/1295] 10.222.0.21 () {60 vars in 1141 bytes} [Wed May 4 07:14:23 2022] POST /identity/v3/services => generated 246 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 07:14:26.025322 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c229e8-d915-4240-9370-9c0ddd1a58b9 None None] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:14:26.025869 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c229e8-d915-4240-9370-9c0ddd1a58b9 None None] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:14:26.025869 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c229e8-d915-4240-9370-9c0ddd1a58b9 None None] PATH_INFO: `/` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:14:26.027232 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 654/1296] 10.222.0.21 () {54 vars in 926 bytes} [Wed May 4 07:14:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 07:14:26.032189 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb983e47-bcf3-4966-b706-52ac4f2a8aa5 None None] REQUEST_METHOD: `POST` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:14:26.032620 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb983e47-bcf3-4966-b706-52ac4f2a8aa5 None None] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:14:26.032714 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb983e47-bcf3-4966-b706-52ac4f2a8aa5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:14:26.049385 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.auth.core [None req-fb983e47-bcf3-4966-b706-52ac4f2a8aa5 None None] MFA Rules not processed for user `83c5e0dcb991496ea6dee38384514508`. Rule list: `[]` (Enabled: `True`). {{(pid=79745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:14:26.050690 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.fernet_utils [None req-fb983e47-bcf3-4966-b706-52ac4f2a8aa5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:14:26.127761 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 643/1297] 10.222.0.21 () {58 vars in 1023 bytes} [Wed May 4 07:14:26 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 04 07:14:26.150218 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c229e8-d915-4240-9370-9c0ddd1a58b9 None None] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:14:26.244918 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c229e8-d915-4240-9370-9c0ddd1a58b9 None None] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:14:26.276427 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2779182-a2ca-4dc6-864d-20918ae1c5fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:14:26.277138 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2779182-a2ca-4dc6-864d-20918ae1c5fc None admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:14:26.277416 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2779182-a2ca-4dc6-864d-20918ae1c5fc None admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:14:26.277688 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2779182-a2ca-4dc6-864d-20918ae1c5fc None admin] PATH_INFO: `/v3/services/placement` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:14:26.278321 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2779182-a2ca-4dc6-864d-20918ae1c5fc None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:14:26.279693 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2779182-a2ca-4dc6-864d-20918ae1c5fc None admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:14:26.291619 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application [None req-b2779182-a2ca-4dc6-864d-20918ae1c5fc None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. May 04 07:14:26.291619 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 07:14:26.291619 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 04 07:14:26.291619 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 04 07:14:26.291619 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 04 07:14:26.291619 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 04 07:14:26.291619 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 04 07:14:26.291619 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 07:14:26.291619 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 04 07:14:26.291619 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application May 04 07:14:26.291619 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 04 07:14:26.291619 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application May 04 07:14:26.291619 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 07:14:26.291619 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 07:14:26.291619 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 07:14:26.291619 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 07:14:26.291619 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 07:14:26.292736 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 07:14:26.292736 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 07:14:26.292736 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 07:14:26.292736 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 07:14:26.292736 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 07:14:26.292736 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 07:14:26.292736 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 04 07:14:26.292736 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self._get_service(service_id) May 04 07:14:26.292736 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 04 07:14:26.292736 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 04 07:14:26.292736 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 07:14:26.292736 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 07:14:26.292736 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 07:14:26.292736 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 07:14:26.292736 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 07:14:26.292736 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.get_or_create( May 04 07:14:26.293683 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 07:14:26.293683 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application with Lock( May 04 07:14:26.293683 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 07:14:26.293683 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self._enter() May 04 07:14:26.293683 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 07:14:26.293683 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 07:14:26.293683 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 07:14:26.293683 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.creator() May 04 07:14:26.293683 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 07:14:26.293683 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application created_value = creator( May 04 07:14:26.293683 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 04 07:14:26.293683 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 07:14:26.293683 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 04 07:14:26.293683 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application May 04 07:14:26.293683 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 655/1298] 10.222.0.21 () {56 vars in 1117 bytes} [Wed May 4 07:14:26 2022] GET /identity/v3/services/placement => generated 90 bytes in 143 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 07:14:26.298636 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb983e47-bcf3-4966-b706-52ac4f2a8aa5 None None] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:14:26.389969 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb983e47-bcf3-4966-b706-52ac4f2a8aa5 None None] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:14:26.421419 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99cef27-e4e6-4a53-af59-9956f3581f3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:14:26.422054 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99cef27-e4e6-4a53-af59-9956f3581f3f None admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:14:26.422328 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99cef27-e4e6-4a53-af59-9956f3581f3f None admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:14:26.422593 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99cef27-e4e6-4a53-af59-9956f3581f3f None admin] PATH_INFO: `/v3/services` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:14:26.423318 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99cef27-e4e6-4a53-af59-9956f3581f3f None admin] RBAC: Adding query filter params (name=placement) {{(pid=79745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 07:14:26.423617 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99cef27-e4e6-4a53-af59-9956f3581f3f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:14:26.424961 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99cef27-e4e6-4a53-af59-9956f3581f3f None admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:14:26.430467 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 644/1299] 10.222.0.21 () {56 vars in 1116 bytes} [Wed May 4 07:14:26 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 07:14:26.436240 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2779182-a2ca-4dc6-864d-20918ae1c5fc None admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:14:26.529962 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2779182-a2ca-4dc6-864d-20918ae1c5fc None admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:14:26.561042 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290c0a62-1fde-442f-b987-481dc7dd38cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:14:26.561681 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290c0a62-1fde-442f-b987-481dc7dd38cc None admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:14:26.561956 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290c0a62-1fde-442f-b987-481dc7dd38cc None admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:14:26.562221 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290c0a62-1fde-442f-b987-481dc7dd38cc None admin] PATH_INFO: `/v3/endpoints` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:14:26.562990 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290c0a62-1fde-442f-b987-481dc7dd38cc None admin] RBAC: Adding query filter params (interface=public, service_id=eea6708148c64a6dbc1366034c1a40df, region_id=RegionOne) {{(pid=79744) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 07:14:26.563325 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290c0a62-1fde-442f-b987-481dc7dd38cc None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:14:26.564656 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290c0a62-1fde-442f-b987-481dc7dd38cc None admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:14:26.569431 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 656/1300] 10.222.0.21 () {56 vars in 1251 bytes} [Wed May 4 07:14:26 2022] GET /identity/v3/endpoints?service_id=eea6708148c64a6dbc1366034c1a40df&interface=public®ion_id=RegionOne => generated 194 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 07:14:26.575059 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99cef27-e4e6-4a53-af59-9956f3581f3f None admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:14:26.668125 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99cef27-e4e6-4a53-af59-9956f3581f3f None admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:14:26.699690 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60177f9-4ee2-4dfa-8822-bc4f54f3c25e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:14:26.700321 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60177f9-4ee2-4dfa-8822-bc4f54f3c25e None admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:14:26.700595 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60177f9-4ee2-4dfa-8822-bc4f54f3c25e None admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:14:26.700863 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60177f9-4ee2-4dfa-8822-bc4f54f3c25e None admin] PATH_INFO: `/v3/services` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:14:26.701530 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60177f9-4ee2-4dfa-8822-bc4f54f3c25e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:14:26.702872 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60177f9-4ee2-4dfa-8822-bc4f54f3c25e None admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:14:26.709280 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 645/1301] 10.222.0.21 () {56 vars in 1087 bytes} [Wed May 4 07:14:26 2022] GET /identity/v3/services => generated 2191 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 07:14:28.928320 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b053a4-756a-408c-957f-2d4a71dd4956 None None] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:14:28.928878 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b053a4-756a-408c-957f-2d4a71dd4956 None None] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:14:28.928878 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b053a4-756a-408c-957f-2d4a71dd4956 None None] PATH_INFO: `/` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:14:28.930233 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 657/1302] 10.222.0.21 () {54 vars in 926 bytes} [Wed May 4 07:14:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 07:14:28.935340 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8c6a32-ccb8-4fcb-a500-ede1ba648791 None None] REQUEST_METHOD: `POST` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:14:28.935733 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8c6a32-ccb8-4fcb-a500-ede1ba648791 None None] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:14:28.935916 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8c6a32-ccb8-4fcb-a500-ede1ba648791 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:14:28.952002 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.auth.core [None req-8a8c6a32-ccb8-4fcb-a500-ede1ba648791 None None] MFA Rules not processed for user `83c5e0dcb991496ea6dee38384514508`. Rule list: `[]` (Enabled: `True`). {{(pid=79745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:14:28.953182 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.fernet_utils [None req-8a8c6a32-ccb8-4fcb-a500-ede1ba648791 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:14:29.015227 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 646/1303] 10.222.0.21 () {58 vars in 1023 bytes} [Wed May 4 07:14:28 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 07:14:29.037686 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b053a4-756a-408c-957f-2d4a71dd4956 None None] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:14:29.132784 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b053a4-756a-408c-957f-2d4a71dd4956 None None] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:14:29.163974 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a295d3da-b8e9-4b81-b94a-ec2f85b330b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:14:29.164741 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a295d3da-b8e9-4b81-b94a-ec2f85b330b2 None admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:14:29.165016 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a295d3da-b8e9-4b81-b94a-ec2f85b330b2 None admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:14:29.165282 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a295d3da-b8e9-4b81-b94a-ec2f85b330b2 None admin] PATH_INFO: `/v3/services/placement` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:14:29.165914 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a295d3da-b8e9-4b81-b94a-ec2f85b330b2 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:14:29.167288 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a295d3da-b8e9-4b81-b94a-ec2f85b330b2 None admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:14:29.178709 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application [None req-a295d3da-b8e9-4b81-b94a-ec2f85b330b2 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. May 04 07:14:29.178709 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 07:14:29.178709 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 04 07:14:29.178709 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 04 07:14:29.178709 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 04 07:14:29.178709 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 04 07:14:29.178709 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 04 07:14:29.178709 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 07:14:29.178709 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 04 07:14:29.178709 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application May 04 07:14:29.178709 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 04 07:14:29.178709 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application May 04 07:14:29.178709 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 07:14:29.178709 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 07:14:29.178709 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 07:14:29.178709 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 07:14:29.178709 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 07:14:29.180372 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 07:14:29.180372 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 07:14:29.180372 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 07:14:29.180372 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 07:14:29.180372 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 07:14:29.180372 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 07:14:29.180372 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 04 07:14:29.180372 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self._get_service(service_id) May 04 07:14:29.180372 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 04 07:14:29.180372 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 04 07:14:29.180372 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 07:14:29.180372 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 07:14:29.180372 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 07:14:29.180372 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 07:14:29.180372 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 07:14:29.180372 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.get_or_create( May 04 07:14:29.181397 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 07:14:29.181397 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application with Lock( May 04 07:14:29.181397 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 07:14:29.181397 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self._enter() May 04 07:14:29.181397 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 07:14:29.181397 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 07:14:29.181397 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 07:14:29.181397 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application return self.creator() May 04 07:14:29.181397 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 07:14:29.181397 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application created_value = creator( May 04 07:14:29.181397 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 04 07:14:29.181397 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 07:14:29.181397 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 04 07:14:29.181397 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: ERROR keystone.server.flask.application May 04 07:14:29.181397 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 658/1304] 10.222.0.21 () {56 vars in 1117 bytes} [Wed May 4 07:14:29 2022] GET /identity/v3/services/placement => generated 90 bytes in 143 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 07:14:29.186244 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8c6a32-ccb8-4fcb-a500-ede1ba648791 None None] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:14:29.277804 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8c6a32-ccb8-4fcb-a500-ede1ba648791 None None] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:14:29.309771 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b61dde-b014-4189-b858-495eb1d9044c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:14:29.310405 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b61dde-b014-4189-b858-495eb1d9044c None admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:14:29.310678 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b61dde-b014-4189-b858-495eb1d9044c None admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:14:29.310945 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b61dde-b014-4189-b858-495eb1d9044c None admin] PATH_INFO: `/v3/services` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:14:29.311659 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b61dde-b014-4189-b858-495eb1d9044c None admin] RBAC: Adding query filter params (name=placement) {{(pid=79745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 07:14:29.311957 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b61dde-b014-4189-b858-495eb1d9044c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:14:29.313294 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b61dde-b014-4189-b858-495eb1d9044c None admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:14:29.318084 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 647/1305] 10.222.0.21 () {56 vars in 1116 bytes} [Wed May 4 07:14:29 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 07:14:29.323847 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a295d3da-b8e9-4b81-b94a-ec2f85b330b2 None admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:14:29.418414 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a295d3da-b8e9-4b81-b94a-ec2f85b330b2 None admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:14:29.449993 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6551f516-ad17-4519-9903-f0b9d389c87a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:14:29.450589 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6551f516-ad17-4519-9903-f0b9d389c87a None admin] REQUEST_METHOD: `POST` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:14:29.450923 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6551f516-ad17-4519-9903-f0b9d389c87a None admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:14:29.451123 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6551f516-ad17-4519-9903-f0b9d389c87a None admin] PATH_INFO: `/v3/endpoints` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:14:29.451880 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6551f516-ad17-4519-9903-f0b9d389c87a None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:14:29.453230 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6551f516-ad17-4519-9903-f0b9d389c87a None admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:14:29.470909 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 659/1306] 10.222.0.21 () {60 vars in 1144 bytes} [Wed May 4 07:14:29 2022] POST /identity/v3/endpoints => generated 331 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 07:15:32.898499 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef9f89e-20f9-446f-ae26-6e478f24700d None None] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:15:32.899086 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef9f89e-20f9-446f-ae26-6e478f24700d None None] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:15:32.899086 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef9f89e-20f9-446f-ae26-6e478f24700d None None] PATH_INFO: `/` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:15:32.900575 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 648/1307] 10.222.0.21 () {54 vars in 926 bytes} [Wed May 4 07:15:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 07:15:32.905786 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822da623-166b-4948-9fa8-bab5a405d08c None None] REQUEST_METHOD: `POST` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:15:32.906223 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822da623-166b-4948-9fa8-bab5a405d08c None None] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:15:32.906400 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822da623-166b-4948-9fa8-bab5a405d08c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:15:32.989108 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.auth.core [None req-822da623-166b-4948-9fa8-bab5a405d08c None None] MFA Rules not processed for user `83c5e0dcb991496ea6dee38384514508`. Rule list: `[]` (Enabled: `True`). {{(pid=79744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:15:32.990360 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.fernet_utils [None req-822da623-166b-4948-9fa8-bab5a405d08c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:15:33.101122 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 660/1308] 10.222.0.21 () {58 vars in 1023 bytes} [Wed May 4 07:15:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 07:15:33.154255 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068ea22e-d0b9-4d17-a1b1-2536840cfbf1 None None] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:15:33.154435 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068ea22e-d0b9-4d17-a1b1-2536840cfbf1 None None] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:15:33.154696 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068ea22e-d0b9-4d17-a1b1-2536840cfbf1 None None] PATH_INFO: `/` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:15:33.156473 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 649/1309] 10.222.0.21 () {54 vars in 964 bytes} [Wed May 4 07:15:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 07:15:33.163165 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4476d1-473f-4397-b7db-56f1766259a6 None None] REQUEST_METHOD: `POST` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:15:33.163465 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4476d1-473f-4397-b7db-56f1766259a6 None None] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:15:33.163790 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4476d1-473f-4397-b7db-56f1766259a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:15:33.238303 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.auth.core [None req-8f4476d1-473f-4397-b7db-56f1766259a6 None None] MFA Rules not processed for user `91cb92d00273402b837cb29b37325101`. Rule list: `[]` (Enabled: `True`). {{(pid=79744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:15:33.240116 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.fernet_utils [None req-8f4476d1-473f-4397-b7db-56f1766259a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:15:33.345147 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068ea22e-d0b9-4d17-a1b1-2536840cfbf1 None None] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:15:33.346924 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.fernet_utils [None req-068ea22e-d0b9-4d17-a1b1-2536840cfbf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:15:33.351762 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 661/1310] 10.222.0.21 () {58 vars in 1061 bytes} [Wed May 4 07:15:33 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 07:15:33.486023 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068ea22e-d0b9-4d17-a1b1-2536840cfbf1 None None] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:15:33.561441 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e23f00-2fac-4aea-8482-4624dbd7341f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91cb92d00273402b837cb29b37325101', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9f9c44db4984653b8d4b5f6b3b949f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:15:33.562200 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e23f00-2fac-4aea-8482-4624dbd7341f service neutron] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:15:33.562480 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e23f00-2fac-4aea-8482-4624dbd7341f service neutron] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:15:33.562749 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e23f00-2fac-4aea-8482-4624dbd7341f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:15:33.564415 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.fernet_utils [None req-f9e23f00-2fac-4aea-8482-4624dbd7341f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:15:33.675537 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e23f00-2fac-4aea-8482-4624dbd7341f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:15:33.677821 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e23f00-2fac-4aea-8482-4624dbd7341f service neutron] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:15:33.698228 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 650/1311] 10.222.0.21 () {60 vars in 1365 bytes} [Wed May 4 07:15:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 07:15:36.252342 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b600902b-4dd2-4a69-a844-0a7924bb9b7e None None] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:15:36.252859 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b600902b-4dd2-4a69-a844-0a7924bb9b7e None None] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:15:36.252950 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b600902b-4dd2-4a69-a844-0a7924bb9b7e None None] PATH_INFO: `/` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:15:36.254260 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 662/1312] 10.222.0.21 () {54 vars in 926 bytes} [Wed May 4 07:15:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 07:15:36.260161 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36989181-2478-4433-b5e4-b500046b6980 None None] REQUEST_METHOD: `POST` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:15:36.260628 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36989181-2478-4433-b5e4-b500046b6980 None None] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:15:36.260738 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36989181-2478-4433-b5e4-b500046b6980 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:15:36.353692 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.auth.core [None req-36989181-2478-4433-b5e4-b500046b6980 None None] MFA Rules not processed for user `83c5e0dcb991496ea6dee38384514508`. Rule list: `[]` (Enabled: `True`). {{(pid=79745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:15:36.355013 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.fernet_utils [None req-36989181-2478-4433-b5e4-b500046b6980 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:15:36.452210 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 651/1313] 10.222.0.21 () {58 vars in 1023 bytes} [Wed May 4 07:15:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 07:15:36.491198 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b600902b-4dd2-4a69-a844-0a7924bb9b7e None None] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:15:36.493039 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.fernet_utils [None req-b600902b-4dd2-4a69-a844-0a7924bb9b7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:15:36.596351 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b600902b-4dd2-4a69-a844-0a7924bb9b7e None None] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:15:36.669337 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1865a65d-7770-43ac-87d5-351641ed005a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91cb92d00273402b837cb29b37325101', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9f9c44db4984653b8d4b5f6b3b949f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:15:36.669980 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1865a65d-7770-43ac-87d5-351641ed005a service neutron] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:15:36.670257 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1865a65d-7770-43ac-87d5-351641ed005a service neutron] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:15:36.670527 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1865a65d-7770-43ac-87d5-351641ed005a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:15:36.672195 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.fernet_utils [None req-1865a65d-7770-43ac-87d5-351641ed005a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:15:36.779600 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1865a65d-7770-43ac-87d5-351641ed005a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:15:36.781034 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1865a65d-7770-43ac-87d5-351641ed005a service neutron] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:15:36.800445 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 663/1314] 10.222.0.21 () {60 vars in 1365 bytes} [Wed May 4 07:15:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 07:15:39.390884 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e54031-ce3f-4655-87b2-63513ce93e46 None None] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:15:39.391454 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e54031-ce3f-4655-87b2-63513ce93e46 None None] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:15:39.391454 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e54031-ce3f-4655-87b2-63513ce93e46 None None] PATH_INFO: `/` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:15:39.392834 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 652/1315] 10.222.0.21 () {54 vars in 926 bytes} [Wed May 4 07:15:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 07:15:39.398043 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2181f39b-0900-453f-ae43-f57b5f61c2c3 None None] REQUEST_METHOD: `POST` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:15:39.398441 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2181f39b-0900-453f-ae43-f57b5f61c2c3 None None] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:15:39.398591 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2181f39b-0900-453f-ae43-f57b5f61c2c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:15:39.461003 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.auth.core [None req-2181f39b-0900-453f-ae43-f57b5f61c2c3 None None] MFA Rules not processed for user `6fa76119d31c4c4a839f95afaefeda66`. Rule list: `[]` (Enabled: `True`). {{(pid=79744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:15:39.462204 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.fernet_utils [None req-2181f39b-0900-453f-ae43-f57b5f61c2c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:15:39.552623 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 664/1316] 10.222.0.21 () {58 vars in 1023 bytes} [Wed May 4 07:15:39 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 07:15:39.591397 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e54031-ce3f-4655-87b2-63513ce93e46 None None] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:15:39.592932 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.fernet_utils [None req-60e54031-ce3f-4655-87b2-63513ce93e46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:15:39.695972 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e54031-ce3f-4655-87b2-63513ce93e46 None None] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:15:39.765493 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a8fa86-b99c-4553-9363-8aa747c1fb85 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91cb92d00273402b837cb29b37325101', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9f9c44db4984653b8d4b5f6b3b949f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:15:39.766121 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a8fa86-b99c-4553-9363-8aa747c1fb85 service neutron] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:15:39.766394 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a8fa86-b99c-4553-9363-8aa747c1fb85 service neutron] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:15:39.766658 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a8fa86-b99c-4553-9363-8aa747c1fb85 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:15:39.768309 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.fernet_utils [None req-72a8fa86-b99c-4553-9363-8aa747c1fb85 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:15:39.869563 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a8fa86-b99c-4553-9363-8aa747c1fb85 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:15:39.870974 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a8fa86-b99c-4553-9363-8aa747c1fb85 service neutron] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:15:39.889738 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 653/1317] 10.222.0.21 () {60 vars in 1365 bytes} [Wed May 4 07:15:39 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 07:15:42.686935 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cceb07d-8c80-4dc6-bffa-7fb15aa3d801 None None] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:15:42.687534 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cceb07d-8c80-4dc6-bffa-7fb15aa3d801 None None] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:15:42.687534 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cceb07d-8c80-4dc6-bffa-7fb15aa3d801 None None] PATH_INFO: `/` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:15:42.688880 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 665/1318] 10.222.0.21 () {54 vars in 926 bytes} [Wed May 4 07:15:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 07:15:42.694754 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e4ead0-3aa0-4220-8795-b02fb24dd87f None None] REQUEST_METHOD: `POST` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:15:42.695217 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e4ead0-3aa0-4220-8795-b02fb24dd87f None None] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:15:42.695315 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e4ead0-3aa0-4220-8795-b02fb24dd87f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:15:42.756821 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.auth.core [None req-70e4ead0-3aa0-4220-8795-b02fb24dd87f None None] MFA Rules not processed for user `83c5e0dcb991496ea6dee38384514508`. Rule list: `[]` (Enabled: `True`). {{(pid=79745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:15:42.758184 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.fernet_utils [None req-70e4ead0-3aa0-4220-8795-b02fb24dd87f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:15:42.847043 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 654/1319] 10.222.0.21 () {58 vars in 1023 bytes} [Wed May 4 07:15:42 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 07:15:42.885831 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cceb07d-8c80-4dc6-bffa-7fb15aa3d801 None None] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:15:42.887386 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.fernet_utils [None req-8cceb07d-8c80-4dc6-bffa-7fb15aa3d801 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:15:42.984260 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cceb07d-8c80-4dc6-bffa-7fb15aa3d801 None None] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:15:43.052832 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040bff32-3bcd-4d82-9e1f-5d4fd67990b0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91cb92d00273402b837cb29b37325101', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9f9c44db4984653b8d4b5f6b3b949f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:15:43.053544 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040bff32-3bcd-4d82-9e1f-5d4fd67990b0 service neutron] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:15:43.053767 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040bff32-3bcd-4d82-9e1f-5d4fd67990b0 service neutron] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:15:43.054042 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040bff32-3bcd-4d82-9e1f-5d4fd67990b0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:15:43.055988 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.fernet_utils [None req-040bff32-3bcd-4d82-9e1f-5d4fd67990b0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:15:43.158676 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040bff32-3bcd-4d82-9e1f-5d4fd67990b0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:15:43.160107 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040bff32-3bcd-4d82-9e1f-5d4fd67990b0 service neutron] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:15:43.177394 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 666/1320] 10.222.0.21 () {60 vars in 1365 bytes} [Wed May 4 07:15:42 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 07:15:46.047594 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed0cb88-7d56-4c58-b617-01079bfd6c26 None None] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:15:46.048162 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed0cb88-7d56-4c58-b617-01079bfd6c26 None None] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:15:46.048162 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed0cb88-7d56-4c58-b617-01079bfd6c26 None None] PATH_INFO: `/` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:15:46.049531 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 655/1321] 10.222.0.21 () {54 vars in 926 bytes} [Wed May 4 07:15:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 07:15:46.055962 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34657e85-e62a-480a-93ca-a86a8e79884a None None] REQUEST_METHOD: `POST` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:15:46.056419 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34657e85-e62a-480a-93ca-a86a8e79884a None None] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:15:46.056605 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34657e85-e62a-480a-93ca-a86a8e79884a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:15:46.119067 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.auth.core [None req-34657e85-e62a-480a-93ca-a86a8e79884a None None] MFA Rules not processed for user `83c5e0dcb991496ea6dee38384514508`. Rule list: `[]` (Enabled: `True`). {{(pid=79744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:15:46.120259 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.fernet_utils [None req-34657e85-e62a-480a-93ca-a86a8e79884a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:15:46.212761 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 667/1322] 10.222.0.21 () {58 vars in 1023 bytes} [Wed May 4 07:15:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 07:15:46.248429 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed0cb88-7d56-4c58-b617-01079bfd6c26 None None] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:15:46.250079 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.fernet_utils [None req-4ed0cb88-7d56-4c58-b617-01079bfd6c26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:15:46.351535 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed0cb88-7d56-4c58-b617-01079bfd6c26 None None] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:15:46.421255 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18dafba5-86bc-4d36-bd34-c873dfacc5ac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91cb92d00273402b837cb29b37325101', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9f9c44db4984653b8d4b5f6b3b949f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:15:46.421892 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18dafba5-86bc-4d36-bd34-c873dfacc5ac service neutron] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:15:46.422169 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18dafba5-86bc-4d36-bd34-c873dfacc5ac service neutron] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:15:46.422438 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18dafba5-86bc-4d36-bd34-c873dfacc5ac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:15:46.424089 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.fernet_utils [None req-18dafba5-86bc-4d36-bd34-c873dfacc5ac service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:15:46.533651 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18dafba5-86bc-4d36-bd34-c873dfacc5ac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:15:46.535076 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18dafba5-86bc-4d36-bd34-c873dfacc5ac service neutron] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:15:46.554208 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 656/1323] 10.222.0.21 () {60 vars in 1365 bytes} [Wed May 4 07:15:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 07:15:48.831596 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a5484f-42c2-40d5-87a8-fbb7c95f11f6 None None] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:15:48.832171 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a5484f-42c2-40d5-87a8-fbb7c95f11f6 None None] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:15:48.832171 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a5484f-42c2-40d5-87a8-fbb7c95f11f6 None None] PATH_INFO: `/` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:15:48.833952 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 668/1324] 10.222.0.21 () {54 vars in 926 bytes} [Wed May 4 07:15:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 07:15:48.838978 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc70be7-4d63-4d21-bc0c-340c71a3b399 None None] REQUEST_METHOD: `POST` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:15:48.839413 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc70be7-4d63-4d21-bc0c-340c71a3b399 None None] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:15:48.839683 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc70be7-4d63-4d21-bc0c-340c71a3b399 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:15:48.904298 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.auth.core [None req-7cc70be7-4d63-4d21-bc0c-340c71a3b399 None None] MFA Rules not processed for user `83c5e0dcb991496ea6dee38384514508`. Rule list: `[]` (Enabled: `True`). {{(pid=79745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:15:48.905598 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.fernet_utils [None req-7cc70be7-4d63-4d21-bc0c-340c71a3b399 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:15:48.999347 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 657/1325] 10.222.0.21 () {58 vars in 1023 bytes} [Wed May 4 07:15:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 07:15:49.048954 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bf0a7e-d49c-4715-a428-4e2dc7ddb41c None None] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:15:49.049251 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bf0a7e-d49c-4715-a428-4e2dc7ddb41c None None] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:15:49.049562 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bf0a7e-d49c-4715-a428-4e2dc7ddb41c None None] PATH_INFO: `/` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:15:49.050977 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 669/1326] 10.222.0.21 () {54 vars in 964 bytes} [Wed May 4 07:15:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 07:15:49.057589 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2e3a86-d6c4-4143-a573-ba4b9b75324f None None] REQUEST_METHOD: `POST` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:15:49.057871 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2e3a86-d6c4-4143-a573-ba4b9b75324f None None] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:15:49.058144 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2e3a86-d6c4-4143-a573-ba4b9b75324f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:15:49.127861 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.auth.core [None req-6c2e3a86-d6c4-4143-a573-ba4b9b75324f None None] MFA Rules not processed for user `91cb92d00273402b837cb29b37325101`. Rule list: `[]` (Enabled: `True`). {{(pid=79745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:15:49.128947 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.fernet_utils [None req-6c2e3a86-d6c4-4143-a573-ba4b9b75324f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:15:49.201583 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 658/1327] 10.222.0.21 () {58 vars in 1061 bytes} [Wed May 4 07:15:49 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 07:15:49.210706 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bf0a7e-d49c-4715-a428-4e2dc7ddb41c None None] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:15:49.212343 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.fernet_utils [None req-79bf0a7e-d49c-4715-a428-4e2dc7ddb41c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:15:49.310011 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bf0a7e-d49c-4715-a428-4e2dc7ddb41c None None] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:15:49.380594 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a67df80-f7ee-4a44-85bf-2969343dd24f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91cb92d00273402b837cb29b37325101', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9f9c44db4984653b8d4b5f6b3b949f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:15:49.381154 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a67df80-f7ee-4a44-85bf-2969343dd24f service neutron] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:15:49.381428 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a67df80-f7ee-4a44-85bf-2969343dd24f service neutron] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:15:49.381697 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a67df80-f7ee-4a44-85bf-2969343dd24f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:15:49.383602 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.fernet_utils [None req-9a67df80-f7ee-4a44-85bf-2969343dd24f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:15:49.487967 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a67df80-f7ee-4a44-85bf-2969343dd24f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:15:49.490145 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a67df80-f7ee-4a44-85bf-2969343dd24f service neutron] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:15:49.508087 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 670/1328] 10.222.0.21 () {60 vars in 1365 bytes} [Wed May 4 07:15:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 07:15:52.026972 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2a611d-7e39-4d8e-9b3d-1fa48806aa8c None None] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:15:52.027933 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2a611d-7e39-4d8e-9b3d-1fa48806aa8c None None] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:15:52.028212 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2a611d-7e39-4d8e-9b3d-1fa48806aa8c None None] PATH_INFO: `/` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:15:52.029606 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 659/1329] 10.222.0.21 () {54 vars in 926 bytes} [Wed May 4 07:15:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 07:15:52.034888 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0d102c-2c62-4f25-aee3-a2905fb536ff None None] REQUEST_METHOD: `POST` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:15:52.035336 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0d102c-2c62-4f25-aee3-a2905fb536ff None None] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:15:52.035487 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0d102c-2c62-4f25-aee3-a2905fb536ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:15:52.099128 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.auth.core [None req-ea0d102c-2c62-4f25-aee3-a2905fb536ff None None] MFA Rules not processed for user `6fa76119d31c4c4a839f95afaefeda66`. Rule list: `[]` (Enabled: `True`). {{(pid=79744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:15:52.100328 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.fernet_utils [None req-ea0d102c-2c62-4f25-aee3-a2905fb536ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:15:52.193152 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 671/1330] 10.222.0.21 () {58 vars in 1023 bytes} [Wed May 4 07:15:52 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 07:15:52.230690 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2a611d-7e39-4d8e-9b3d-1fa48806aa8c None None] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:15:52.232233 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.fernet_utils [None req-da2a611d-7e39-4d8e-9b3d-1fa48806aa8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:15:52.331683 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2a611d-7e39-4d8e-9b3d-1fa48806aa8c None None] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:15:52.401873 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a611594-9645-4362-8de5-11661506330e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91cb92d00273402b837cb29b37325101', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9f9c44db4984653b8d4b5f6b3b949f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:15:52.402510 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a611594-9645-4362-8de5-11661506330e service neutron] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:15:52.402788 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a611594-9645-4362-8de5-11661506330e service neutron] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:15:52.403059 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a611594-9645-4362-8de5-11661506330e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:15:52.404739 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.fernet_utils [None req-6a611594-9645-4362-8de5-11661506330e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:15:52.509874 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a611594-9645-4362-8de5-11661506330e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:15:52.511347 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a611594-9645-4362-8de5-11661506330e service neutron] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:15:52.531774 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 660/1331] 10.222.0.21 () {60 vars in 1365 bytes} [Wed May 4 07:15:52 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 07:15:55.190282 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9935bdb7-30d6-46f3-936d-c400a3f85e84 None None] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:15:55.190753 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9935bdb7-30d6-46f3-936d-c400a3f85e84 None None] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:15:55.191038 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9935bdb7-30d6-46f3-936d-c400a3f85e84 None None] PATH_INFO: `/` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:15:55.192864 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 672/1332] 10.222.0.21 () {54 vars in 926 bytes} [Wed May 4 07:15:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 07:15:55.198437 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181c6fa6-6e43-4938-944a-ecc6fd8f9d82 None None] REQUEST_METHOD: `POST` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:15:55.198874 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181c6fa6-6e43-4938-944a-ecc6fd8f9d82 None None] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:15:55.199003 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181c6fa6-6e43-4938-944a-ecc6fd8f9d82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:15:55.263976 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.auth.core [None req-181c6fa6-6e43-4938-944a-ecc6fd8f9d82 None None] MFA Rules not processed for user `83c5e0dcb991496ea6dee38384514508`. Rule list: `[]` (Enabled: `True`). {{(pid=79745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:15:55.265559 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.fernet_utils [None req-181c6fa6-6e43-4938-944a-ecc6fd8f9d82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:15:55.364238 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 661/1333] 10.222.0.21 () {58 vars in 1023 bytes} [Wed May 4 07:15:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 07:15:55.400974 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9935bdb7-30d6-46f3-936d-c400a3f85e84 None None] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:15:55.402498 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.fernet_utils [None req-9935bdb7-30d6-46f3-936d-c400a3f85e84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:15:55.511714 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9935bdb7-30d6-46f3-936d-c400a3f85e84 None None] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:15:55.582959 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f295101-50f4-4504-8bb4-56417e86f725 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91cb92d00273402b837cb29b37325101', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9f9c44db4984653b8d4b5f6b3b949f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:15:55.583587 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f295101-50f4-4504-8bb4-56417e86f725 service neutron] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:15:55.583863 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f295101-50f4-4504-8bb4-56417e86f725 service neutron] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:15:55.584133 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f295101-50f4-4504-8bb4-56417e86f725 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:15:55.585741 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.fernet_utils [None req-7f295101-50f4-4504-8bb4-56417e86f725 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:15:55.691079 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f295101-50f4-4504-8bb4-56417e86f725 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:15:55.692653 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f295101-50f4-4504-8bb4-56417e86f725 service neutron] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:15:55.710444 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 673/1334] 10.222.0.21 () {60 vars in 1365 bytes} [Wed May 4 07:15:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 07:15:58.014259 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cd3014-15c1-466d-b777-3c82aa6212c2 None None] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:15:58.014834 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cd3014-15c1-466d-b777-3c82aa6212c2 None None] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:15:58.014834 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cd3014-15c1-466d-b777-3c82aa6212c2 None None] PATH_INFO: `/` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:15:58.016185 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 662/1335] 10.222.0.21 () {54 vars in 926 bytes} [Wed May 4 07:15:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 07:15:58.021667 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39dc6f65-4c7e-4bc1-8491-612829ee43aa None None] REQUEST_METHOD: `POST` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:15:58.022095 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39dc6f65-4c7e-4bc1-8491-612829ee43aa None None] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:15:58.022201 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39dc6f65-4c7e-4bc1-8491-612829ee43aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:15:58.083942 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.auth.core [None req-39dc6f65-4c7e-4bc1-8491-612829ee43aa None None] MFA Rules not processed for user `83c5e0dcb991496ea6dee38384514508`. Rule list: `[]` (Enabled: `True`). {{(pid=79744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:15:58.085115 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.fernet_utils [None req-39dc6f65-4c7e-4bc1-8491-612829ee43aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:15:58.178656 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 674/1336] 10.222.0.21 () {58 vars in 1023 bytes} [Wed May 4 07:15:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 07:15:58.218833 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21cd3014-15c1-466d-b777-3c82aa6212c2 None None] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:15:58.220422 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.fernet_utils [None req-21cd3014-15c1-466d-b777-3c82aa6212c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:15:58.320395 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21cd3014-15c1-466d-b777-3c82aa6212c2 None None] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:15:58.389087 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f432588c-49bd-470d-9bc3-c279062e64b0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91cb92d00273402b837cb29b37325101', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9f9c44db4984653b8d4b5f6b3b949f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:15:58.389714 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f432588c-49bd-470d-9bc3-c279062e64b0 service neutron] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:15:58.389992 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f432588c-49bd-470d-9bc3-c279062e64b0 service neutron] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:15:58.390265 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f432588c-49bd-470d-9bc3-c279062e64b0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:15:58.391906 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.fernet_utils [None req-f432588c-49bd-470d-9bc3-c279062e64b0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:15:58.497263 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f432588c-49bd-470d-9bc3-c279062e64b0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:15:58.498674 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f432588c-49bd-470d-9bc3-c279062e64b0 service neutron] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:15:58.517129 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 663/1337] 10.222.0.21 () {60 vars in 1365 bytes} [Wed May 4 07:15:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 07:16:01.046078 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf188e4-90ca-4ac9-a41d-fe4286a174ea None None] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:16:01.046634 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf188e4-90ca-4ac9-a41d-fe4286a174ea None None] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:16:01.046634 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf188e4-90ca-4ac9-a41d-fe4286a174ea None None] PATH_INFO: `/` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:16:01.048022 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 675/1338] 10.222.0.21 () {54 vars in 926 bytes} [Wed May 4 07:16:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 07:16:01.053743 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fb4e70-d4bc-4046-81ee-6b4888c4c907 None None] REQUEST_METHOD: `POST` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:16:01.054170 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fb4e70-d4bc-4046-81ee-6b4888c4c907 None None] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:16:01.054265 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fb4e70-d4bc-4046-81ee-6b4888c4c907 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:16:01.116898 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.auth.core [None req-57fb4e70-d4bc-4046-81ee-6b4888c4c907 None None] MFA Rules not processed for user `83c5e0dcb991496ea6dee38384514508`. Rule list: `[]` (Enabled: `True`). {{(pid=79745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:16:01.118087 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.fernet_utils [None req-57fb4e70-d4bc-4046-81ee-6b4888c4c907 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:16:01.209804 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 664/1339] 10.222.0.21 () {58 vars in 1023 bytes} [Wed May 4 07:16:01 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 07:16:01.245247 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf188e4-90ca-4ac9-a41d-fe4286a174ea None None] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:16:01.246746 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.fernet_utils [None req-daf188e4-90ca-4ac9-a41d-fe4286a174ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:16:01.344047 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf188e4-90ca-4ac9-a41d-fe4286a174ea None None] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:16:01.414041 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6da227-c899-4b59-aafb-2e272622338b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91cb92d00273402b837cb29b37325101', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9f9c44db4984653b8d4b5f6b3b949f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:16:01.414675 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6da227-c899-4b59-aafb-2e272622338b service neutron] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:16:01.414953 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6da227-c899-4b59-aafb-2e272622338b service neutron] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:16:01.415254 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6da227-c899-4b59-aafb-2e272622338b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:16:01.416862 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.fernet_utils [None req-9c6da227-c899-4b59-aafb-2e272622338b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:16:01.521174 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6da227-c899-4b59-aafb-2e272622338b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:16:01.522515 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6da227-c899-4b59-aafb-2e272622338b service neutron] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:16:01.540293 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 676/1340] 10.222.0.21 () {60 vars in 1365 bytes} [Wed May 4 07:16:01 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 07:16:05.737683 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f623b26-98b2-42eb-9b22-35c44672521e None None] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:16:05.738195 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f623b26-98b2-42eb-9b22-35c44672521e None None] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:16:05.738195 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f623b26-98b2-42eb-9b22-35c44672521e None None] PATH_INFO: `/` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:16:05.740014 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 665/1341] 10.222.0.21 () {54 vars in 926 bytes} [Wed May 4 07:16:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 07:16:05.745053 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15148fdb-acd5-436d-a4dc-9a2ef6b83b4b None None] REQUEST_METHOD: `POST` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:16:05.745477 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15148fdb-acd5-436d-a4dc-9a2ef6b83b4b None None] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:16:05.745631 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15148fdb-acd5-436d-a4dc-9a2ef6b83b4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:16:05.814255 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.auth.core [None req-15148fdb-acd5-436d-a4dc-9a2ef6b83b4b None None] MFA Rules not processed for user `83c5e0dcb991496ea6dee38384514508`. Rule list: `[]` (Enabled: `True`). {{(pid=79744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:16:05.815467 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.fernet_utils [None req-15148fdb-acd5-436d-a4dc-9a2ef6b83b4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:16:05.915925 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 677/1342] 10.222.0.21 () {58 vars in 1023 bytes} [Wed May 4 07:16:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 07:16:05.954094 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f623b26-98b2-42eb-9b22-35c44672521e None None] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:16:05.956222 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.fernet_utils [None req-8f623b26-98b2-42eb-9b22-35c44672521e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:16:06.049554 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f623b26-98b2-42eb-9b22-35c44672521e None None] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:16:06.053317 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c51e8c0-59d6-4dbf-894c-e1ea9e38c346 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91cb92d00273402b837cb29b37325101', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9f9c44db4984653b8d4b5f6b3b949f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:16:06.053960 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c51e8c0-59d6-4dbf-894c-e1ea9e38c346 service neutron] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:16:06.054238 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c51e8c0-59d6-4dbf-894c-e1ea9e38c346 service neutron] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:16:06.054509 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c51e8c0-59d6-4dbf-894c-e1ea9e38c346 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:16:06.065434 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c51e8c0-59d6-4dbf-894c-e1ea9e38c346 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:16:06.067555 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c51e8c0-59d6-4dbf-894c-e1ea9e38c346 service neutron] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:16:06.077030 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 666/1343] 10.222.0.21 () {60 vars in 1365 bytes} [Wed May 4 07:16:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 07:16:08.960159 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbfbd4a-c81d-42a6-a4d4-a8915b0803d7 None None] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:16:08.960743 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbfbd4a-c81d-42a6-a4d4-a8915b0803d7 None None] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:16:08.960743 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbfbd4a-c81d-42a6-a4d4-a8915b0803d7 None None] PATH_INFO: `/` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:16:08.962217 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 678/1344] 10.222.0.21 () {54 vars in 926 bytes} [Wed May 4 07:16:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 07:16:08.967227 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bf04e6-36c7-4105-a35f-3511dff39b3a None None] REQUEST_METHOD: `POST` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:16:08.967656 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bf04e6-36c7-4105-a35f-3511dff39b3a None None] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:16:08.967812 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bf04e6-36c7-4105-a35f-3511dff39b3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:16:08.996021 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.auth.core [None req-b6bf04e6-36c7-4105-a35f-3511dff39b3a None None] MFA Rules not processed for user `83c5e0dcb991496ea6dee38384514508`. Rule list: `[]` (Enabled: `True`). {{(pid=79745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:16:08.997191 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.fernet_utils [None req-b6bf04e6-36c7-4105-a35f-3511dff39b3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:16:09.072982 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 667/1345] 10.222.0.21 () {58 vars in 1023 bytes} [Wed May 4 07:16:08 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 07:16:09.115854 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbfbd4a-c81d-42a6-a4d4-a8915b0803d7 None None] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:16:09.117540 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.fernet_utils [None req-edbfbd4a-c81d-42a6-a4d4-a8915b0803d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:16:09.130255 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbfbd4a-c81d-42a6-a4d4-a8915b0803d7 None None] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:16:09.133942 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4af1d98-e85e-4089-baf4-dc51a56656c4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91cb92d00273402b837cb29b37325101', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9f9c44db4984653b8d4b5f6b3b949f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:16:09.134585 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4af1d98-e85e-4089-baf4-dc51a56656c4 service neutron] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:16:09.134864 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4af1d98-e85e-4089-baf4-dc51a56656c4 service neutron] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:16:09.135157 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4af1d98-e85e-4089-baf4-dc51a56656c4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:16:09.144081 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4af1d98-e85e-4089-baf4-dc51a56656c4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:16:09.145638 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4af1d98-e85e-4089-baf4-dc51a56656c4 service neutron] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:16:09.155085 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 679/1346] 10.222.0.21 () {60 vars in 1365 bytes} [Wed May 4 07:16:09 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 07:16:13.786317 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddff9758-4c89-4f96-9aa3-f1249b2e302b None None] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:16:13.786872 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddff9758-4c89-4f96-9aa3-f1249b2e302b None None] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:16:13.786872 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddff9758-4c89-4f96-9aa3-f1249b2e302b None None] PATH_INFO: `/` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:16:13.788261 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 668/1347] 10.222.0.21 () {54 vars in 926 bytes} [Wed May 4 07:16:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 07:16:13.793323 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1636c3-535d-4c78-ab1b-472e799b0c4a None None] REQUEST_METHOD: `POST` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:16:13.793725 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1636c3-535d-4c78-ab1b-472e799b0c4a None None] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:16:13.793982 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1636c3-535d-4c78-ab1b-472e799b0c4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:16:13.811941 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.auth.core [None req-6c1636c3-535d-4c78-ab1b-472e799b0c4a None None] MFA Rules not processed for user `83c5e0dcb991496ea6dee38384514508`. Rule list: `[]` (Enabled: `True`). {{(pid=79744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:16:13.813098 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.fernet_utils [None req-6c1636c3-535d-4c78-ab1b-472e799b0c4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:16:13.821756 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 680/1348] 10.222.0.21 () {58 vars in 1023 bytes} [Wed May 4 07:16:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 07:16:13.858487 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddff9758-4c89-4f96-9aa3-f1249b2e302b None None] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:16:13.869637 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddff9758-4c89-4f96-9aa3-f1249b2e302b None None] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:16:13.873156 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95d62e8-4b86-4721-b81b-c0ad2b91e73a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91cb92d00273402b837cb29b37325101', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9f9c44db4984653b8d4b5f6b3b949f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:16:13.873807 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95d62e8-4b86-4721-b81b-c0ad2b91e73a service neutron] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:16:13.874083 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95d62e8-4b86-4721-b81b-c0ad2b91e73a service neutron] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:16:13.874351 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95d62e8-4b86-4721-b81b-c0ad2b91e73a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:16:13.884210 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95d62e8-4b86-4721-b81b-c0ad2b91e73a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:16:13.885619 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95d62e8-4b86-4721-b81b-c0ad2b91e73a service neutron] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:16:13.895062 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 669/1349] 10.222.0.21 () {60 vars in 1365 bytes} [Wed May 4 07:16:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 07:16:19.233532 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f263cd-f54d-4fbd-8d99-00ebae86edb7 None None] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:16:19.235187 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f263cd-f54d-4fbd-8d99-00ebae86edb7 None None] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:16:19.235884 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f263cd-f54d-4fbd-8d99-00ebae86edb7 None None] PATH_INFO: `/` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:16:19.253923 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 681/1350] 10.222.0.21 () {54 vars in 921 bytes} [Wed May 4 07:16:19 2022] GET /identity => generated 270 bytes in 22 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 07:16:19.254794 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955bb550-4399-4c13-b8c4-136775f8e413 None None] REQUEST_METHOD: `POST` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:16:19.255340 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955bb550-4399-4c13-b8c4-136775f8e413 None None] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:16:19.255542 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955bb550-4399-4c13-b8c4-136775f8e413 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:16:19.323635 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.auth.core [None req-955bb550-4399-4c13-b8c4-136775f8e413 None None] MFA Rules not processed for user `ef28e980e8664d3eba4304e4589ea2df`. Rule list: `[]` (Enabled: `True`). {{(pid=79745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:16:19.325049 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.fernet_utils [None req-955bb550-4399-4c13-b8c4-136775f8e413 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:16:19.397772 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 670/1351] 10.222.0.21 () {58 vars in 1018 bytes} [Wed May 4 07:16:19 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 07:16:23.753293 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ee9d7e-7595-4e46-946b-9c1f223fe600 None None] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:16:23.753852 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ee9d7e-7595-4e46-946b-9c1f223fe600 None None] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:16:23.753955 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ee9d7e-7595-4e46-946b-9c1f223fe600 None None] PATH_INFO: `/` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:16:23.755614 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 682/1352] 10.222.0.21 () {54 vars in 921 bytes} [Wed May 4 07:16:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 07:16:23.760782 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa0cce0-d0fa-43fc-8f88-ff2f30288eec None None] REQUEST_METHOD: `POST` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:16:23.761196 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa0cce0-d0fa-43fc-8f88-ff2f30288eec None None] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:16:23.761328 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa0cce0-d0fa-43fc-8f88-ff2f30288eec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:16:23.779989 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.auth.core [None req-9aa0cce0-d0fa-43fc-8f88-ff2f30288eec None None] MFA Rules not processed for user `ef28e980e8664d3eba4304e4589ea2df`. Rule list: `[]` (Enabled: `True`). {{(pid=79745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:16:23.781171 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.fernet_utils [None req-9aa0cce0-d0fa-43fc-8f88-ff2f30288eec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:16:23.790649 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 671/1353] 10.222.0.21 () {58 vars in 1018 bytes} [Wed May 4 07:16:23 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 07:16:25.424600 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9736d2-8675-4b29-9d39-ab65274d7601 None None] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:16:25.425229 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9736d2-8675-4b29-9d39-ab65274d7601 None None] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:16:25.425229 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9736d2-8675-4b29-9d39-ab65274d7601 None None] PATH_INFO: `/` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:16:25.427200 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 683/1354] 10.222.0.21 () {54 vars in 921 bytes} [Wed May 4 07:16:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 07:16:25.432283 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9140967d-1bac-4e89-b5be-b18176691a9e None None] REQUEST_METHOD: `POST` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:16:25.432730 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9140967d-1bac-4e89-b5be-b18176691a9e None None] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:16:25.432835 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9140967d-1bac-4e89-b5be-b18176691a9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:16:25.451049 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.auth.core [None req-9140967d-1bac-4e89-b5be-b18176691a9e None None] MFA Rules not processed for user `ef28e980e8664d3eba4304e4589ea2df`. Rule list: `[]` (Enabled: `True`). {{(pid=79745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:16:25.452415 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.fernet_utils [None req-9140967d-1bac-4e89-b5be-b18176691a9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:16:25.461471 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 672/1355] 10.222.0.21 () {58 vars in 1018 bytes} [Wed May 4 07:16:25 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 07:16:29.398330 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46818668-426a-4900-904a-f74ecef79184 None None] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:16:29.398869 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46818668-426a-4900-904a-f74ecef79184 None None] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:16:29.398982 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46818668-426a-4900-904a-f74ecef79184 None None] PATH_INFO: `/` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:16:29.400545 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 684/1356] 10.222.0.21 () {54 vars in 926 bytes} [Wed May 4 07:16:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 07:16:29.406093 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62164557-1709-4e03-9992-9845ac578a08 None None] REQUEST_METHOD: `POST` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:16:29.406524 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62164557-1709-4e03-9992-9845ac578a08 None None] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:16:29.406639 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62164557-1709-4e03-9992-9845ac578a08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:16:29.426310 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.auth.core [None req-62164557-1709-4e03-9992-9845ac578a08 None None] MFA Rules not processed for user `83c5e0dcb991496ea6dee38384514508`. Rule list: `[]` (Enabled: `True`). {{(pid=79745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:16:29.427746 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.fernet_utils [None req-62164557-1709-4e03-9992-9845ac578a08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:16:29.436709 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 673/1357] 10.222.0.21 () {58 vars in 1023 bytes} [Wed May 4 07:16:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 07:16:29.485010 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010b95f2-aba3-4942-8310-7cba8b1d6d2b None None] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:16:29.485545 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010b95f2-aba3-4942-8310-7cba8b1d6d2b None None] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:16:29.485929 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010b95f2-aba3-4942-8310-7cba8b1d6d2b None None] PATH_INFO: `/` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:16:29.487422 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 685/1358] 10.222.0.21 () {54 vars in 960 bytes} [Wed May 4 07:16:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 07:16:29.493309 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae751820-80f4-4eb9-822b-9ad085afd9bb None None] REQUEST_METHOD: `POST` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:16:29.493592 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae751820-80f4-4eb9-822b-9ad085afd9bb None None] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:16:29.493861 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae751820-80f4-4eb9-822b-9ad085afd9bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:16:29.540661 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.auth.core [None req-ae751820-80f4-4eb9-822b-9ad085afd9bb None None] MFA Rules not processed for user `1077289fedae43b6be47be7f716d573a`. Rule list: `[]` (Enabled: `True`). {{(pid=79745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:16:29.541821 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.fernet_utils [None req-ae751820-80f4-4eb9-822b-9ad085afd9bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:16:29.621564 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 674/1359] 10.222.0.21 () {58 vars in 1057 bytes} [Wed May 4 07:16:29 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 07:16:29.629611 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010b95f2-aba3-4942-8310-7cba8b1d6d2b None None] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:16:29.644701 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010b95f2-aba3-4942-8310-7cba8b1d6d2b None None] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:16:29.650355 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b364b8a2-13c3-455b-93d4-cc027fa99d83 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1077289fedae43b6be47be7f716d573a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9f9c44db4984653b8d4b5f6b3b949f5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:16:29.651054 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b364b8a2-13c3-455b-93d4-cc027fa99d83 service nova] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:16:29.651427 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b364b8a2-13c3-455b-93d4-cc027fa99d83 service nova] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:16:29.651775 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b364b8a2-13c3-455b-93d4-cc027fa99d83 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:16:29.660278 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b364b8a2-13c3-455b-93d4-cc027fa99d83 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:16:29.661939 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b364b8a2-13c3-455b-93d4-cc027fa99d83 service nova] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:16:29.672185 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 686/1360] 10.222.0.21 () {60 vars in 1365 bytes} [Wed May 4 07:16:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 07:16:32.163517 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4c0779-ddf7-44e4-8b30-d9992ea4f24e None None] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:16:32.164390 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4c0779-ddf7-44e4-8b30-d9992ea4f24e None None] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:16:32.164673 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4c0779-ddf7-44e4-8b30-d9992ea4f24e None None] PATH_INFO: `/` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:16:32.166340 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 675/1361] 10.222.0.21 () {54 vars in 926 bytes} [Wed May 4 07:16:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 07:16:32.172668 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016c4261-13ea-4755-9ae4-e3d3c799e3fd None None] REQUEST_METHOD: `POST` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:16:32.173124 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016c4261-13ea-4755-9ae4-e3d3c799e3fd None None] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:16:32.173206 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016c4261-13ea-4755-9ae4-e3d3c799e3fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:16:32.192650 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.auth.core [None req-016c4261-13ea-4755-9ae4-e3d3c799e3fd None None] MFA Rules not processed for user `83c5e0dcb991496ea6dee38384514508`. Rule list: `[]` (Enabled: `True`). {{(pid=79744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:16:32.193859 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.fernet_utils [None req-016c4261-13ea-4755-9ae4-e3d3c799e3fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:16:32.202521 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 687/1362] 10.222.0.21 () {58 vars in 1023 bytes} [Wed May 4 07:16:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 07:16:32.249301 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4c0779-ddf7-44e4-8b30-d9992ea4f24e None None] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:16:32.265908 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4c0779-ddf7-44e4-8b30-d9992ea4f24e None None] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:16:32.271734 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19cafdb5-8428-4cf1-8f39-6e3a8b0e660b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1077289fedae43b6be47be7f716d573a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9f9c44db4984653b8d4b5f6b3b949f5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:16:32.272375 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cafdb5-8428-4cf1-8f39-6e3a8b0e660b service nova] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:16:32.272659 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cafdb5-8428-4cf1-8f39-6e3a8b0e660b service nova] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:16:32.272935 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cafdb5-8428-4cf1-8f39-6e3a8b0e660b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:16:32.281602 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19cafdb5-8428-4cf1-8f39-6e3a8b0e660b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:16:32.283695 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19cafdb5-8428-4cf1-8f39-6e3a8b0e660b service nova] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:16:32.294893 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 676/1363] 10.222.0.21 () {60 vars in 1365 bytes} [Wed May 4 07:16:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 07:16:34.885843 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3167a04-eaa9-4152-aa97-1308b79a83e4 None None] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:16:34.886330 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3167a04-eaa9-4152-aa97-1308b79a83e4 None None] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:16:34.886330 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3167a04-eaa9-4152-aa97-1308b79a83e4 None None] PATH_INFO: `/` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:16:34.887735 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 688/1364] 10.222.0.21 () {54 vars in 926 bytes} [Wed May 4 07:16:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 07:16:34.892840 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee62a85a-a1f5-40e9-b4bd-3947e5c2639f None None] REQUEST_METHOD: `POST` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:16:34.894264 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee62a85a-a1f5-40e9-b4bd-3947e5c2639f None None] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:16:34.894744 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee62a85a-a1f5-40e9-b4bd-3947e5c2639f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:16:34.914228 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.auth.core [None req-ee62a85a-a1f5-40e9-b4bd-3947e5c2639f None None] MFA Rules not processed for user `83c5e0dcb991496ea6dee38384514508`. Rule list: `[]` (Enabled: `True`). {{(pid=79745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:16:34.915537 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.fernet_utils [None req-ee62a85a-a1f5-40e9-b4bd-3947e5c2639f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:16:34.923582 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 677/1365] 10.222.0.21 () {58 vars in 1023 bytes} [Wed May 4 07:16:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 07:16:34.969599 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed6b4d2-720d-45d5-b1fa-e3608a334d02 None None] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:16:34.969886 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed6b4d2-720d-45d5-b1fa-e3608a334d02 None None] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:16:34.970164 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed6b4d2-720d-45d5-b1fa-e3608a334d02 None None] PATH_INFO: `/` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:16:34.971608 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 689/1366] 10.222.0.21 () {54 vars in 960 bytes} [Wed May 4 07:16:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 07:16:34.976919 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c650dd-e98e-4623-bdb6-a469f4137315 None None] REQUEST_METHOD: `POST` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:16:34.977218 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c650dd-e98e-4623-bdb6-a469f4137315 None None] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:16:34.977562 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c650dd-e98e-4623-bdb6-a469f4137315 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:16:34.995676 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.auth.core [None req-82c650dd-e98e-4623-bdb6-a469f4137315 None None] MFA Rules not processed for user `1077289fedae43b6be47be7f716d573a`. Rule list: `[]` (Enabled: `True`). {{(pid=79745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:16:34.996830 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.fernet_utils [None req-82c650dd-e98e-4623-bdb6-a469f4137315 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:16:35.007196 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 678/1367] 10.222.0.21 () {58 vars in 1057 bytes} [Wed May 4 07:16:34 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 07:16:35.014822 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed6b4d2-720d-45d5-b1fa-e3608a334d02 None None] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:16:35.029066 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed6b4d2-720d-45d5-b1fa-e3608a334d02 None None] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:16:35.034422 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5736ed-f630-4b89-8649-8461aac84a17 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1077289fedae43b6be47be7f716d573a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9f9c44db4984653b8d4b5f6b3b949f5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:16:35.035046 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5736ed-f630-4b89-8649-8461aac84a17 service nova] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:16:35.035429 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5736ed-f630-4b89-8649-8461aac84a17 service nova] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:16:35.035701 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5736ed-f630-4b89-8649-8461aac84a17 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:16:35.043556 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5736ed-f630-4b89-8649-8461aac84a17 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:16:35.045107 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5736ed-f630-4b89-8649-8461aac84a17 service nova] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:16:35.054761 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 690/1368] 10.222.0.21 () {60 vars in 1365 bytes} [Wed May 4 07:16:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 07:16:37.376100 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b9cefc-1d81-462b-9e58-92081c138667 None None] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:16:37.376693 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b9cefc-1d81-462b-9e58-92081c138667 None None] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:16:37.376693 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b9cefc-1d81-462b-9e58-92081c138667 None None] PATH_INFO: `/` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:16:37.378611 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 679/1369] 10.222.0.21 () {54 vars in 926 bytes} [Wed May 4 07:16:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 07:16:37.384757 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550efc22-6620-4bfa-8900-db7749ec705b None None] REQUEST_METHOD: `POST` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:16:37.385321 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550efc22-6620-4bfa-8900-db7749ec705b None None] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:16:37.385321 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550efc22-6620-4bfa-8900-db7749ec705b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:16:37.404927 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.auth.core [None req-550efc22-6620-4bfa-8900-db7749ec705b None None] MFA Rules not processed for user `83c5e0dcb991496ea6dee38384514508`. Rule list: `[]` (Enabled: `True`). {{(pid=79744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:16:37.406110 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.fernet_utils [None req-550efc22-6620-4bfa-8900-db7749ec705b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:16:37.419327 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 691/1370] 10.222.0.21 () {58 vars in 1023 bytes} [Wed May 4 07:16:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 07:16:37.462170 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b9cefc-1d81-462b-9e58-92081c138667 None None] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:16:37.477122 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b9cefc-1d81-462b-9e58-92081c138667 None None] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:16:37.482729 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8072bfd0-de27-425b-b679-686ec2dc7b36 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1077289fedae43b6be47be7f716d573a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9f9c44db4984653b8d4b5f6b3b949f5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:16:37.483535 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8072bfd0-de27-425b-b679-686ec2dc7b36 service nova] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:16:37.483926 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8072bfd0-de27-425b-b679-686ec2dc7b36 service nova] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:16:37.484308 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8072bfd0-de27-425b-b679-686ec2dc7b36 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:16:37.493278 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8072bfd0-de27-425b-b679-686ec2dc7b36 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:16:37.494993 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8072bfd0-de27-425b-b679-686ec2dc7b36 service nova] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:16:37.505978 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 680/1371] 10.222.0.21 () {60 vars in 1365 bytes} [Wed May 4 07:16:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 07:16:37.561919 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f96f80-a631-4a0a-9150-d2e2101b467c None None] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:16:37.562622 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f96f80-a631-4a0a-9150-d2e2101b467c None None] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:16:37.563081 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f96f80-a631-4a0a-9150-d2e2101b467c None None] PATH_INFO: `/` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:16:37.565824 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 692/1372] 10.222.0.21 () {54 vars in 926 bytes} [Wed May 4 07:16:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 07:16:37.571849 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f0bb92-161b-481c-9a6b-82d206fe4608 None None] REQUEST_METHOD: `POST` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:16:37.572819 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f0bb92-161b-481c-9a6b-82d206fe4608 None None] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:16:37.573199 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f0bb92-161b-481c-9a6b-82d206fe4608 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:16:37.594513 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.auth.core [None req-43f0bb92-161b-481c-9a6b-82d206fe4608 None None] MFA Rules not processed for user `83c5e0dcb991496ea6dee38384514508`. Rule list: `[]` (Enabled: `True`). {{(pid=79745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:16:37.596043 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.fernet_utils [None req-43f0bb92-161b-481c-9a6b-82d206fe4608 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:16:37.605749 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 681/1373] 10.222.0.21 () {58 vars in 1023 bytes} [Wed May 4 07:16:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 07:16:37.885200 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfdee32-8e47-4289-8654-01a9cadfec6d None None] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:16:37.885519 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfdee32-8e47-4289-8654-01a9cadfec6d None None] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:16:37.885797 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfdee32-8e47-4289-8654-01a9cadfec6d None None] PATH_INFO: `/` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:16:37.887323 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 693/1374] 10.222.0.21 () {54 vars in 963 bytes} [Wed May 4 07:16:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 07:16:37.892345 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fc5256-5baf-4784-970b-401a94313a34 None None] REQUEST_METHOD: `POST` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:16:37.892744 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fc5256-5baf-4784-970b-401a94313a34 None None] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:16:37.893058 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fc5256-5baf-4784-970b-401a94313a34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:16:37.942939 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.auth.core [None req-c1fc5256-5baf-4784-970b-401a94313a34 None None] MFA Rules not processed for user `bb341257aa8246b6847561e2fe1fa385`. Rule list: `[]` (Enabled: `True`). {{(pid=79745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:16:37.944297 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.fernet_utils [None req-c1fc5256-5baf-4784-970b-401a94313a34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:16:38.004551 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 682/1375] 10.222.0.21 () {58 vars in 1060 bytes} [Wed May 4 07:16:37 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 07:16:38.012625 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfdee32-8e47-4289-8654-01a9cadfec6d None None] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:16:38.024208 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfdee32-8e47-4289-8654-01a9cadfec6d None None] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:16:38.029337 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc024b5-2a6f-435c-9ef1-72a6b7a5d474 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb341257aa8246b6847561e2fe1fa385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9f9c44db4984653b8d4b5f6b3b949f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:16:38.030295 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc024b5-2a6f-435c-9ef1-72a6b7a5d474 service cinder] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:16:38.030687 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc024b5-2a6f-435c-9ef1-72a6b7a5d474 service cinder] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:16:38.031067 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc024b5-2a6f-435c-9ef1-72a6b7a5d474 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:16:38.044293 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc024b5-2a6f-435c-9ef1-72a6b7a5d474 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:16:38.046665 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc024b5-2a6f-435c-9ef1-72a6b7a5d474 service cinder] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:16:38.060363 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 694/1376] 10.222.0.21 () {60 vars in 1365 bytes} [Wed May 4 07:16:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 07:16:39.811390 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93494b2-a1ab-4ad5-8c5f-2aa29bf37362 None None] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:16:39.811963 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93494b2-a1ab-4ad5-8c5f-2aa29bf37362 None None] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:16:39.811963 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93494b2-a1ab-4ad5-8c5f-2aa29bf37362 None None] PATH_INFO: `/` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:16:39.813297 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 683/1377] 10.222.0.21 () {54 vars in 926 bytes} [Wed May 4 07:16:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 07:16:39.818928 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b56b95-3806-472e-b9f5-8e356a1487e6 None None] REQUEST_METHOD: `POST` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:16:39.819406 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b56b95-3806-472e-b9f5-8e356a1487e6 None None] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:16:39.819522 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b56b95-3806-472e-b9f5-8e356a1487e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:16:39.837578 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.auth.core [None req-25b56b95-3806-472e-b9f5-8e356a1487e6 None None] MFA Rules not processed for user `83c5e0dcb991496ea6dee38384514508`. Rule list: `[]` (Enabled: `True`). {{(pid=79744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:16:39.838762 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.fernet_utils [None req-25b56b95-3806-472e-b9f5-8e356a1487e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:16:39.847401 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 695/1378] 10.222.0.21 () {58 vars in 1023 bytes} [Wed May 4 07:16:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 07:16:39.892194 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93494b2-a1ab-4ad5-8c5f-2aa29bf37362 None None] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:16:39.907030 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93494b2-a1ab-4ad5-8c5f-2aa29bf37362 None None] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:16:39.913361 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f3f316-8d64-4f2b-b6cd-f1dd3de6f231 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1077289fedae43b6be47be7f716d573a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9f9c44db4984653b8d4b5f6b3b949f5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:16:39.913996 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f3f316-8d64-4f2b-b6cd-f1dd3de6f231 service nova] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:16:39.914279 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f3f316-8d64-4f2b-b6cd-f1dd3de6f231 service nova] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:16:39.914555 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f3f316-8d64-4f2b-b6cd-f1dd3de6f231 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:16:39.922887 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f3f316-8d64-4f2b-b6cd-f1dd3de6f231 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:16:39.924516 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f3f316-8d64-4f2b-b6cd-f1dd3de6f231 service nova] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:16:39.936329 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 684/1379] 10.222.0.21 () {60 vars in 1365 bytes} [Wed May 4 07:16:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 04 07:16:42.249428 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a90c3ee-213c-487b-91fc-5b7b31c1b8ad None None] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:16:42.250035 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a90c3ee-213c-487b-91fc-5b7b31c1b8ad None None] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:16:42.250282 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a90c3ee-213c-487b-91fc-5b7b31c1b8ad None None] PATH_INFO: `/` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:16:42.251899 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 696/1380] 10.222.0.21 () {54 vars in 926 bytes} [Wed May 4 07:16:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 07:16:42.257989 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b03a310-fa78-48cf-bfa6-728aa032728e None None] REQUEST_METHOD: `POST` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:16:42.258426 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b03a310-fa78-48cf-bfa6-728aa032728e None None] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:16:42.258693 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b03a310-fa78-48cf-bfa6-728aa032728e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:16:42.276348 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.auth.core [None req-6b03a310-fa78-48cf-bfa6-728aa032728e None None] MFA Rules not processed for user `83c5e0dcb991496ea6dee38384514508`. Rule list: `[]` (Enabled: `True`). {{(pid=79745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:16:42.277615 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.fernet_utils [None req-6b03a310-fa78-48cf-bfa6-728aa032728e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:16:42.285334 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 685/1381] 10.222.0.21 () {58 vars in 1023 bytes} [Wed May 4 07:16:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 07:16:42.329251 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a90c3ee-213c-487b-91fc-5b7b31c1b8ad None None] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:16:42.343765 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a90c3ee-213c-487b-91fc-5b7b31c1b8ad None None] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:16:42.349480 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e473e392-c0a2-44bb-ab78-7cad16ada2a0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1077289fedae43b6be47be7f716d573a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9f9c44db4984653b8d4b5f6b3b949f5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:16:42.350228 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e473e392-c0a2-44bb-ab78-7cad16ada2a0 service nova] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:16:42.350605 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e473e392-c0a2-44bb-ab78-7cad16ada2a0 service nova] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:16:42.350995 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e473e392-c0a2-44bb-ab78-7cad16ada2a0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:16:42.359129 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e473e392-c0a2-44bb-ab78-7cad16ada2a0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:16:42.360815 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e473e392-c0a2-44bb-ab78-7cad16ada2a0 service nova] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:16:42.371188 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 697/1382] 10.222.0.21 () {60 vars in 1365 bytes} [Wed May 4 07:16:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 07:16:44.650945 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2b7d5a-4d38-4071-ada1-e2692ef9c500 None None] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:16:44.651523 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2b7d5a-4d38-4071-ada1-e2692ef9c500 None None] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:16:44.651523 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2b7d5a-4d38-4071-ada1-e2692ef9c500 None None] PATH_INFO: `/` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:16:44.652867 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 686/1383] 10.222.0.21 () {54 vars in 926 bytes} [Wed May 4 07:16:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 07:16:44.658127 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d683cac-7f38-4db1-bbcb-aa04a2a16e31 None None] REQUEST_METHOD: `POST` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:16:44.658569 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d683cac-7f38-4db1-bbcb-aa04a2a16e31 None None] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:16:44.658675 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d683cac-7f38-4db1-bbcb-aa04a2a16e31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:16:44.676504 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.auth.core [None req-7d683cac-7f38-4db1-bbcb-aa04a2a16e31 None None] MFA Rules not processed for user `83c5e0dcb991496ea6dee38384514508`. Rule list: `[]` (Enabled: `True`). {{(pid=79744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:16:44.677679 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.fernet_utils [None req-7d683cac-7f38-4db1-bbcb-aa04a2a16e31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:16:44.685412 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 698/1384] 10.222.0.21 () {58 vars in 1023 bytes} [Wed May 4 07:16:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 07:16:44.727787 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2b7d5a-4d38-4071-ada1-e2692ef9c500 None None] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:16:44.743012 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2b7d5a-4d38-4071-ada1-e2692ef9c500 None None] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:16:44.748906 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3e2b73-fbab-4c9d-b08d-a36cba003e7e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1077289fedae43b6be47be7f716d573a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9f9c44db4984653b8d4b5f6b3b949f5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:16:44.749554 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3e2b73-fbab-4c9d-b08d-a36cba003e7e service nova] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:16:44.749836 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3e2b73-fbab-4c9d-b08d-a36cba003e7e service nova] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:16:44.750119 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3e2b73-fbab-4c9d-b08d-a36cba003e7e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:16:44.759486 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3e2b73-fbab-4c9d-b08d-a36cba003e7e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:16:44.761099 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3e2b73-fbab-4c9d-b08d-a36cba003e7e service nova] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:16:44.772277 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 687/1385] 10.222.0.21 () {60 vars in 1365 bytes} [Wed May 4 07:16:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 07:16:47.020886 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1ef69c-8fc4-4e14-8bf9-f80bfd37c444 None None] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:16:47.021434 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1ef69c-8fc4-4e14-8bf9-f80bfd37c444 None None] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:16:47.021580 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1ef69c-8fc4-4e14-8bf9-f80bfd37c444 None None] PATH_INFO: `/` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:16:47.023393 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 699/1386] 10.222.0.21 () {54 vars in 926 bytes} [Wed May 4 07:16:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 04 07:16:47.028738 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eba1ea8-1f8b-41e0-a3c6-91f69e1f4b0a None None] REQUEST_METHOD: `POST` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:16:47.029225 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eba1ea8-1f8b-41e0-a3c6-91f69e1f4b0a None None] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:16:47.029400 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eba1ea8-1f8b-41e0-a3c6-91f69e1f4b0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:16:47.046898 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.auth.core [None req-8eba1ea8-1f8b-41e0-a3c6-91f69e1f4b0a None None] MFA Rules not processed for user `83c5e0dcb991496ea6dee38384514508`. Rule list: `[]` (Enabled: `True`). {{(pid=79745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:16:47.048097 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.fernet_utils [None req-8eba1ea8-1f8b-41e0-a3c6-91f69e1f4b0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:16:47.055852 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 688/1387] 10.222.0.21 () {58 vars in 1023 bytes} [Wed May 4 07:16:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 07:16:47.100349 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1ef69c-8fc4-4e14-8bf9-f80bfd37c444 None None] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:16:47.117982 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1ef69c-8fc4-4e14-8bf9-f80bfd37c444 None None] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:16:47.124641 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55166bca-2326-4a8b-9e28-a499aaa51233 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1077289fedae43b6be47be7f716d573a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9f9c44db4984653b8d4b5f6b3b949f5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:16:47.125479 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55166bca-2326-4a8b-9e28-a499aaa51233 service nova] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:16:47.125759 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55166bca-2326-4a8b-9e28-a499aaa51233 service nova] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:16:47.126099 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55166bca-2326-4a8b-9e28-a499aaa51233 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:16:47.137690 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55166bca-2326-4a8b-9e28-a499aaa51233 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:16:47.139771 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55166bca-2326-4a8b-9e28-a499aaa51233 service nova] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:16:47.153993 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 700/1388] 10.222.0.21 () {60 vars in 1365 bytes} [Wed May 4 07:16:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 07:16:49.805732 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbc5f0d-ba13-4fa1-8cf2-1597356315ab None None] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:16:49.806292 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbc5f0d-ba13-4fa1-8cf2-1597356315ab None None] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:16:49.806292 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbc5f0d-ba13-4fa1-8cf2-1597356315ab None None] PATH_INFO: `/` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:16:49.807692 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 689/1389] 10.222.0.21 () {54 vars in 926 bytes} [Wed May 4 07:16:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 07:16:49.813345 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7bd51c-f0e7-4473-bfe9-45e6d40cd470 None None] REQUEST_METHOD: `POST` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:16:49.813803 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7bd51c-f0e7-4473-bfe9-45e6d40cd470 None None] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:16:49.814043 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7bd51c-f0e7-4473-bfe9-45e6d40cd470 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:16:49.836327 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.auth.core [None req-cd7bd51c-f0e7-4473-bfe9-45e6d40cd470 None None] MFA Rules not processed for user `83c5e0dcb991496ea6dee38384514508`. Rule list: `[]` (Enabled: `True`). {{(pid=79744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:16:49.840010 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.fernet_utils [None req-cd7bd51c-f0e7-4473-bfe9-45e6d40cd470 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:16:49.850621 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 701/1390] 10.222.0.21 () {58 vars in 1023 bytes} [Wed May 4 07:16:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 07:16:49.897511 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbc5f0d-ba13-4fa1-8cf2-1597356315ab None None] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:16:49.911645 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbc5f0d-ba13-4fa1-8cf2-1597356315ab None None] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:16:49.917054 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263b5273-e337-4eac-aaae-7ad6806da277 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1077289fedae43b6be47be7f716d573a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9f9c44db4984653b8d4b5f6b3b949f5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:16:49.917684 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263b5273-e337-4eac-aaae-7ad6806da277 service nova] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:16:49.917961 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263b5273-e337-4eac-aaae-7ad6806da277 service nova] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:16:49.918231 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263b5273-e337-4eac-aaae-7ad6806da277 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:16:49.926839 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263b5273-e337-4eac-aaae-7ad6806da277 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:16:49.928455 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263b5273-e337-4eac-aaae-7ad6806da277 service nova] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:16:49.937685 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 690/1391] 10.222.0.21 () {60 vars in 1365 bytes} [Wed May 4 07:16:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 07:16:52.267338 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2bca54-4e1f-4b28-8a3c-eb7e18c58cc4 None None] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:16:52.268514 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2bca54-4e1f-4b28-8a3c-eb7e18c58cc4 None None] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:16:52.269416 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2bca54-4e1f-4b28-8a3c-eb7e18c58cc4 None None] PATH_INFO: `/` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:16:52.270796 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 702/1392] 10.222.0.21 () {54 vars in 926 bytes} [Wed May 4 07:16:52 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 07:16:52.276021 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb7df6f-09b6-4f55-af82-5b273ec7527f None None] REQUEST_METHOD: `POST` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:16:52.276456 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb7df6f-09b6-4f55-af82-5b273ec7527f None None] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:16:52.276720 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb7df6f-09b6-4f55-af82-5b273ec7527f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:16:52.294767 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.auth.core [None req-8eb7df6f-09b6-4f55-af82-5b273ec7527f None None] MFA Rules not processed for user `83c5e0dcb991496ea6dee38384514508`. Rule list: `[]` (Enabled: `True`). {{(pid=79745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:16:52.295968 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.fernet_utils [None req-8eb7df6f-09b6-4f55-af82-5b273ec7527f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:16:52.303829 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 691/1393] 10.222.0.21 () {58 vars in 1023 bytes} [Wed May 4 07:16:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 07:16:52.348479 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2bca54-4e1f-4b28-8a3c-eb7e18c58cc4 None None] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:16:52.363093 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2bca54-4e1f-4b28-8a3c-eb7e18c58cc4 None None] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:16:52.368325 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9280594-fcd0-44b7-ad51-5a6b1d08de8d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1077289fedae43b6be47be7f716d573a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9f9c44db4984653b8d4b5f6b3b949f5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:16:52.368945 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9280594-fcd0-44b7-ad51-5a6b1d08de8d service nova] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:16:52.369218 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9280594-fcd0-44b7-ad51-5a6b1d08de8d service nova] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:16:52.369486 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9280594-fcd0-44b7-ad51-5a6b1d08de8d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:16:52.377756 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9280594-fcd0-44b7-ad51-5a6b1d08de8d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:16:52.379380 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9280594-fcd0-44b7-ad51-5a6b1d08de8d service nova] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:16:52.388606 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 703/1394] 10.222.0.21 () {60 vars in 1365 bytes} [Wed May 4 07:16:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 07:16:54.150732 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccfcd40-f16c-4219-a119-57d9589ec343 None None] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:16:54.151334 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccfcd40-f16c-4219-a119-57d9589ec343 None None] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:16:54.151334 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccfcd40-f16c-4219-a119-57d9589ec343 None None] PATH_INFO: `/` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:16:54.152685 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 692/1395] 10.222.0.21 () {54 vars in 926 bytes} [Wed May 4 07:16:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 07:16:54.157870 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d428bcba-bfa3-4e82-9d68-324c5e875f89 None None] REQUEST_METHOD: `POST` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:16:54.158306 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d428bcba-bfa3-4e82-9d68-324c5e875f89 None None] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:16:54.158929 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d428bcba-bfa3-4e82-9d68-324c5e875f89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:16:54.176613 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.auth.core [None req-d428bcba-bfa3-4e82-9d68-324c5e875f89 None None] MFA Rules not processed for user `83c5e0dcb991496ea6dee38384514508`. Rule list: `[]` (Enabled: `True`). {{(pid=79744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:16:54.177784 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.fernet_utils [None req-d428bcba-bfa3-4e82-9d68-324c5e875f89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:16:54.185379 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 704/1396] 10.222.0.21 () {58 vars in 1023 bytes} [Wed May 4 07:16:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 07:16:54.241839 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbf39a3-eda9-47d2-b213-ed598b78f726 None None] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:16:54.242200 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbf39a3-eda9-47d2-b213-ed598b78f726 None None] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:16:54.242561 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbf39a3-eda9-47d2-b213-ed598b78f726 None None] PATH_INFO: `/` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:16:54.244046 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 693/1397] 10.222.0.21 () {54 vars in 962 bytes} [Wed May 4 07:16:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 07:16:54.249279 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9da4de-0e82-4fa9-84ad-83b52a8a4703 None None] REQUEST_METHOD: `POST` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:16:54.249567 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9da4de-0e82-4fa9-84ad-83b52a8a4703 None None] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:16:54.249845 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9da4de-0e82-4fa9-84ad-83b52a8a4703 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:16:54.300067 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.auth.core [None req-5d9da4de-0e82-4fa9-84ad-83b52a8a4703 None None] MFA Rules not processed for user `7538f5cab3364625a3e909f5f117ef2d`. Rule list: `[]` (Enabled: `True`). {{(pid=79744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:16:54.301526 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.fernet_utils [None req-5d9da4de-0e82-4fa9-84ad-83b52a8a4703 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:16:54.358042 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 705/1398] 10.222.0.21 () {58 vars in 1059 bytes} [Wed May 4 07:16:54 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 07:16:54.366584 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbf39a3-eda9-47d2-b213-ed598b78f726 None None] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:16:54.377060 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbf39a3-eda9-47d2-b213-ed598b78f726 None None] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:16:54.382083 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6cf01e9-ad5c-437e-9173-b0b51ddda7c6 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7538f5cab3364625a3e909f5f117ef2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9f9c44db4984653b8d4b5f6b3b949f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:16:54.382732 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cf01e9-ad5c-437e-9173-b0b51ddda7c6 service glance] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:16:54.382989 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cf01e9-ad5c-437e-9173-b0b51ddda7c6 service glance] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:16:54.383294 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cf01e9-ad5c-437e-9173-b0b51ddda7c6 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:16:54.392148 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6cf01e9-ad5c-437e-9173-b0b51ddda7c6 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:16:54.393691 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6cf01e9-ad5c-437e-9173-b0b51ddda7c6 service glance] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:16:54.402817 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 694/1399] 10.222.0.21 () {60 vars in 1365 bytes} [Wed May 4 07:16:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 07:16:54.666127 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1aca42-1c11-49e6-b87c-a1e867674a2a None None] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:16:54.666345 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1aca42-1c11-49e6-b87c-a1e867674a2a None None] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:16:54.666588 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1aca42-1c11-49e6-b87c-a1e867674a2a None None] PATH_INFO: `/` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:16:54.668006 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 706/1400] 10.222.0.21 () {54 vars in 926 bytes} [Wed May 4 07:16:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 07:16:54.673169 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9bc39b-5946-4428-80ac-b58f788c5153 None None] REQUEST_METHOD: `POST` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:16:54.673473 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9bc39b-5946-4428-80ac-b58f788c5153 None None] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:16:54.673735 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9bc39b-5946-4428-80ac-b58f788c5153 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:16:54.692315 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.auth.core [None req-fa9bc39b-5946-4428-80ac-b58f788c5153 None None] MFA Rules not processed for user `83c5e0dcb991496ea6dee38384514508`. Rule list: `[]` (Enabled: `True`). {{(pid=79745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:16:54.693506 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.fernet_utils [None req-fa9bc39b-5946-4428-80ac-b58f788c5153 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:16:54.701312 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 695/1401] 10.222.0.21 () {58 vars in 1023 bytes} [Wed May 4 07:16:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 07:16:54.745462 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1aca42-1c11-49e6-b87c-a1e867674a2a None None] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:16:54.760154 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1aca42-1c11-49e6-b87c-a1e867674a2a None None] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:16:54.765509 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eac6c5f-109b-4bb3-b879-fc7e4d13ebac service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1077289fedae43b6be47be7f716d573a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9f9c44db4984653b8d4b5f6b3b949f5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:16:54.766149 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eac6c5f-109b-4bb3-b879-fc7e4d13ebac service nova] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:16:54.766430 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eac6c5f-109b-4bb3-b879-fc7e4d13ebac service nova] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:16:54.766702 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eac6c5f-109b-4bb3-b879-fc7e4d13ebac service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:16:54.775288 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eac6c5f-109b-4bb3-b879-fc7e4d13ebac service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:16:54.776992 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eac6c5f-109b-4bb3-b879-fc7e4d13ebac service nova] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:16:54.787553 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 707/1402] 10.222.0.21 () {60 vars in 1365 bytes} [Wed May 4 07:16:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 07:16:54.825884 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359a6625-2df3-4daf-b932-6f9e0befdb83 None None] REQUEST_METHOD: `POST` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:16:54.826269 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359a6625-2df3-4daf-b932-6f9e0befdb83 None None] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:16:54.826610 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359a6625-2df3-4daf-b932-6f9e0befdb83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:16:54.886824 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.auth.core [None req-359a6625-2df3-4daf-b932-6f9e0befdb83 None None] MFA Rules not processed for user `704cdbc22849413baa4e0189947ebebc`. Rule list: `[]` (Enabled: `True`). {{(pid=79745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:16:54.888082 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.fernet_utils [None req-359a6625-2df3-4daf-b932-6f9e0befdb83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:16:54.964323 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 696/1403] 10.222.0.21 () {58 vars in 1009 bytes} [Wed May 4 07:16:54 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 07:16:55.012979 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d4f42e-8f06-4037-b087-0fdd6813adb6 None None] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:16:55.013263 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d4f42e-8f06-4037-b087-0fdd6813adb6 None None] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:16:55.013542 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d4f42e-8f06-4037-b087-0fdd6813adb6 None None] PATH_INFO: `/` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:16:55.014935 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 708/1404] 10.222.0.21 () {54 vars in 942 bytes} [Wed May 4 07:16:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 07:16:55.021912 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc86789f-09cc-4d77-94db-52c729b5b056 None None] REQUEST_METHOD: `POST` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:16:55.022226 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc86789f-09cc-4d77-94db-52c729b5b056 None None] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:16:55.022509 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc86789f-09cc-4d77-94db-52c729b5b056 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:16:55.072411 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.auth.core [None req-dc86789f-09cc-4d77-94db-52c729b5b056 None None] MFA Rules not processed for user `084c9245d1da4e698c9c3945fa089e85`. Rule list: `[]` (Enabled: `True`). {{(pid=79745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:16:55.073813 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.fernet_utils [None req-dc86789f-09cc-4d77-94db-52c729b5b056 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:16:55.147402 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 697/1405] 10.222.0.21 () {58 vars in 1039 bytes} [Wed May 4 07:16:55 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 07:16:55.157004 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d4f42e-8f06-4037-b087-0fdd6813adb6 None None] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:16:55.170300 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d4f42e-8f06-4037-b087-0fdd6813adb6 None None] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:16:55.175865 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de454ee-9a8b-4367-aa7a-a554f841c478 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '084c9245d1da4e698c9c3945fa089e85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9f9c44db4984653b8d4b5f6b3b949f5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:16:55.176521 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de454ee-9a8b-4367-aa7a-a554f841c478 service swift] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:16:55.176803 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de454ee-9a8b-4367-aa7a-a554f841c478 service swift] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:16:55.177074 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de454ee-9a8b-4367-aa7a-a554f841c478 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:16:55.185019 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de454ee-9a8b-4367-aa7a-a554f841c478 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:16:55.186580 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de454ee-9a8b-4367-aa7a-a554f841c478 service swift] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:16:55.195599 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 709/1406] 10.222.0.21 () {60 vars in 1384 bytes} [Wed May 4 07:16:55 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 04 07:16:57.255465 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4c14ce-bd19-4df4-9730-118239f82f99 None None] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:16:57.255988 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4c14ce-bd19-4df4-9730-118239f82f99 None None] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:16:57.255988 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4c14ce-bd19-4df4-9730-118239f82f99 None None] PATH_INFO: `/` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:16:57.257551 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 698/1407] 10.222.0.21 () {54 vars in 926 bytes} [Wed May 4 07:16:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 07:16:57.262899 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c50c976-4315-4ee6-8329-20967671c47d None None] REQUEST_METHOD: `POST` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:16:57.263398 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c50c976-4315-4ee6-8329-20967671c47d None None] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:16:57.263496 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c50c976-4315-4ee6-8329-20967671c47d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:16:57.285506 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.auth.core [None req-3c50c976-4315-4ee6-8329-20967671c47d None None] MFA Rules not processed for user `83c5e0dcb991496ea6dee38384514508`. Rule list: `[]` (Enabled: `True`). {{(pid=79744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:16:57.287086 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.fernet_utils [None req-3c50c976-4315-4ee6-8329-20967671c47d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:16:57.296603 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 710/1408] 10.222.0.21 () {58 vars in 1023 bytes} [Wed May 4 07:16:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 07:16:57.342574 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4c14ce-bd19-4df4-9730-118239f82f99 None None] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:16:57.358846 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4c14ce-bd19-4df4-9730-118239f82f99 None None] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:16:57.364747 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc43bccf-e1cf-4dcd-a974-a5c43805856e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1077289fedae43b6be47be7f716d573a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9f9c44db4984653b8d4b5f6b3b949f5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:16:57.365596 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc43bccf-e1cf-4dcd-a974-a5c43805856e service nova] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:16:57.365947 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc43bccf-e1cf-4dcd-a974-a5c43805856e service nova] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:16:57.366288 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc43bccf-e1cf-4dcd-a974-a5c43805856e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:16:57.375076 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc43bccf-e1cf-4dcd-a974-a5c43805856e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:16:57.376829 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc43bccf-e1cf-4dcd-a974-a5c43805856e service nova] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:16:57.387202 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 699/1409] 10.222.0.21 () {60 vars in 1365 bytes} [Wed May 4 07:16:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 07:17:18.385867 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf2104a-7e8c-47b3-a9b8-a1c83373bece None None] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:17:18.386492 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf2104a-7e8c-47b3-a9b8-a1c83373bece None None] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:17:18.386492 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf2104a-7e8c-47b3-a9b8-a1c83373bece None None] PATH_INFO: `/` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:17:18.387796 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 711/1410] 10.222.0.21 () {54 vars in 918 bytes} [Wed May 4 07:17:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 07:17:18.393617 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c8af70-8aa0-4fc6-aaf6-55e2332e1a06 None None] REQUEST_METHOD: `POST` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:17:18.394106 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c8af70-8aa0-4fc6-aaf6-55e2332e1a06 None None] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:17:18.394212 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c8af70-8aa0-4fc6-aaf6-55e2332e1a06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:17:18.412218 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.auth.core [None req-b4c8af70-8aa0-4fc6-aaf6-55e2332e1a06 None None] MFA Rules not processed for user `ef28e980e8664d3eba4304e4589ea2df`. Rule list: `[]` (Enabled: `True`). {{(pid=79745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:17:18.413411 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.fernet_utils [None req-b4c8af70-8aa0-4fc6-aaf6-55e2332e1a06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:17:18.421726 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 700/1411] 10.222.0.21 () {58 vars in 1015 bytes} [Wed May 4 07:17:18 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 07:17:18.435780 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ed2eb1-fb32-4cb7-86b4-558b35886124 None None] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:17:18.436061 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ed2eb1-fb32-4cb7-86b4-558b35886124 None None] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:17:18.436336 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ed2eb1-fb32-4cb7-86b4-558b35886124 None None] PATH_INFO: `/` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:17:18.437690 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 712/1412] 10.222.0.21 () {54 vars in 918 bytes} [Wed May 4 07:17:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 07:17:18.442605 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f816082-0f30-4328-ae9e-1f11369905bf None None] REQUEST_METHOD: `POST` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:17:18.442888 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f816082-0f30-4328-ae9e-1f11369905bf None None] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:17:18.443215 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f816082-0f30-4328-ae9e-1f11369905bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:17:18.462102 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.auth.core [None req-2f816082-0f30-4328-ae9e-1f11369905bf None None] MFA Rules not processed for user `1077289fedae43b6be47be7f716d573a`. Rule list: `[]` (Enabled: `True`). {{(pid=79745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:17:18.463288 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.fernet_utils [None req-2f816082-0f30-4328-ae9e-1f11369905bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:17:18.473028 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 701/1413] 10.222.0.21 () {58 vars in 1015 bytes} [Wed May 4 07:17:18 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 07:17:21.194213 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109ceb15-a1c9-4636-ae70-55a25344d947 None None] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:17:21.194733 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109ceb15-a1c9-4636-ae70-55a25344d947 None None] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:17:21.194733 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109ceb15-a1c9-4636-ae70-55a25344d947 None None] PATH_INFO: `/` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:17:21.196084 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 713/1414] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 4 07:17:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 07:17:21.201181 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c483f8c-d82f-45b1-a962-6d7fee27715d None None] REQUEST_METHOD: `POST` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:17:21.201584 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c483f8c-d82f-45b1-a962-6d7fee27715d None None] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:17:21.201732 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c483f8c-d82f-45b1-a962-6d7fee27715d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:17:21.220119 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.auth.core [None req-4c483f8c-d82f-45b1-a962-6d7fee27715d None None] MFA Rules not processed for user `83c5e0dcb991496ea6dee38384514508`. Rule list: `[]` (Enabled: `True`). {{(pid=79745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:17:21.221314 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.fernet_utils [None req-4c483f8c-d82f-45b1-a962-6d7fee27715d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:17:21.229310 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 702/1415] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 4 07:17:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 07:17:21.271388 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109ceb15-a1c9-4636-ae70-55a25344d947 None None] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:17:21.285795 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109ceb15-a1c9-4636-ae70-55a25344d947 None None] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:17:21.291011 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5487b2c-f5ca-4d0f-bba3-cd5319a89de1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1077289fedae43b6be47be7f716d573a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9f9c44db4984653b8d4b5f6b3b949f5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:17:21.291665 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5487b2c-f5ca-4d0f-bba3-cd5319a89de1 service nova] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:17:21.291938 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5487b2c-f5ca-4d0f-bba3-cd5319a89de1 service nova] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:17:21.292203 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5487b2c-f5ca-4d0f-bba3-cd5319a89de1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:17:21.300579 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5487b2c-f5ca-4d0f-bba3-cd5319a89de1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:17:21.302121 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5487b2c-f5ca-4d0f-bba3-cd5319a89de1 service nova] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:17:21.311325 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 714/1416] 10.222.0.21 () {60 vars in 1365 bytes} [Wed May 4 07:17:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 07:17:22.608923 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3b6500-2756-4328-8011-622ecbd67425 None None] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:17:22.609503 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3b6500-2756-4328-8011-622ecbd67425 None None] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:17:22.609503 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3b6500-2756-4328-8011-622ecbd67425 None None] PATH_INFO: `/` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:17:22.611424 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 703/1417] 127.0.0.1 () {54 vars in 901 bytes} [Wed May 4 07:17:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 04 07:17:22.616470 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a322c6-dbbc-4ff3-bb56-aaae5549dc34 None None] REQUEST_METHOD: `POST` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:17:22.616939 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a322c6-dbbc-4ff3-bb56-aaae5549dc34 None None] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:17:22.617051 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a322c6-dbbc-4ff3-bb56-aaae5549dc34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:17:22.634635 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.auth.core [None req-58a322c6-dbbc-4ff3-bb56-aaae5549dc34 None None] MFA Rules not processed for user `83c5e0dcb991496ea6dee38384514508`. Rule list: `[]` (Enabled: `True`). {{(pid=79744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:17:22.635854 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.fernet_utils [None req-58a322c6-dbbc-4ff3-bb56-aaae5549dc34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:17:22.643845 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 715/1418] 127.0.0.1 () {58 vars in 998 bytes} [Wed May 4 07:17:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 07:17:22.805087 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3b6500-2756-4328-8011-622ecbd67425 None None] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:17:22.819416 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3b6500-2756-4328-8011-622ecbd67425 None None] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:17:22.824695 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07750d49-5fc6-41b0-a579-0390fb3cadbe service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1077289fedae43b6be47be7f716d573a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9f9c44db4984653b8d4b5f6b3b949f5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:17:22.825312 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07750d49-5fc6-41b0-a579-0390fb3cadbe service nova] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:17:22.825585 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07750d49-5fc6-41b0-a579-0390fb3cadbe service nova] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:17:22.825853 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07750d49-5fc6-41b0-a579-0390fb3cadbe service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:17:22.834156 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07750d49-5fc6-41b0-a579-0390fb3cadbe service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:17:22.835758 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07750d49-5fc6-41b0-a579-0390fb3cadbe service nova] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:17:22.844742 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 704/1419] 10.222.0.21 () {60 vars in 1365 bytes} [Wed May 4 07:17:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 07:17:24.115921 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b3aff1-3f9a-4fdd-879e-f87e33db9a50 None None] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:17:24.116472 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b3aff1-3f9a-4fdd-879e-f87e33db9a50 None None] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:17:24.116472 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b3aff1-3f9a-4fdd-879e-f87e33db9a50 None None] PATH_INFO: `/` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:17:24.117836 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 716/1420] 127.0.0.1 () {54 vars in 901 bytes} [Wed May 4 07:17:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 07:17:24.122664 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c400bd6-fb60-40a2-ba21-05e84bdda69e None None] REQUEST_METHOD: `POST` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:17:24.123074 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c400bd6-fb60-40a2-ba21-05e84bdda69e None None] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:17:24.123240 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c400bd6-fb60-40a2-ba21-05e84bdda69e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:17:24.141451 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.auth.core [None req-6c400bd6-fb60-40a2-ba21-05e84bdda69e None None] MFA Rules not processed for user `83c5e0dcb991496ea6dee38384514508`. Rule list: `[]` (Enabled: `True`). {{(pid=79745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:17:24.143455 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.fernet_utils [None req-6c400bd6-fb60-40a2-ba21-05e84bdda69e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:17:24.151112 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 705/1421] 127.0.0.1 () {58 vars in 998 bytes} [Wed May 4 07:17:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 07:17:24.301195 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b3aff1-3f9a-4fdd-879e-f87e33db9a50 None None] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:17:24.315749 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b3aff1-3f9a-4fdd-879e-f87e33db9a50 None None] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:17:24.320960 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be039c0e-a686-4fe8-94de-6cec053d38aa service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1077289fedae43b6be47be7f716d573a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9f9c44db4984653b8d4b5f6b3b949f5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:17:24.321581 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be039c0e-a686-4fe8-94de-6cec053d38aa service nova] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:17:24.321856 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be039c0e-a686-4fe8-94de-6cec053d38aa service nova] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:17:24.322125 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be039c0e-a686-4fe8-94de-6cec053d38aa service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:17:24.334879 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be039c0e-a686-4fe8-94de-6cec053d38aa service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:17:24.336528 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be039c0e-a686-4fe8-94de-6cec053d38aa service nova] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:17:24.346528 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 717/1422] 10.222.0.21 () {60 vars in 1365 bytes} [Wed May 4 07:17:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 07:17:25.615556 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2b0fdc-4cc0-4894-9a6b-a80be07277d9 None None] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:17:25.616144 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2b0fdc-4cc0-4894-9a6b-a80be07277d9 None None] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:17:25.616144 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2b0fdc-4cc0-4894-9a6b-a80be07277d9 None None] PATH_INFO: `/` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:17:25.617474 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 706/1423] 127.0.0.1 () {54 vars in 901 bytes} [Wed May 4 07:17:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 07:17:25.622213 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc75f14-b569-4ac9-8cdb-161557db5967 None None] REQUEST_METHOD: `POST` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:17:25.622601 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc75f14-b569-4ac9-8cdb-161557db5967 None None] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:17:25.622765 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc75f14-b569-4ac9-8cdb-161557db5967 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:17:25.640907 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.auth.core [None req-fcc75f14-b569-4ac9-8cdb-161557db5967 None None] MFA Rules not processed for user `83c5e0dcb991496ea6dee38384514508`. Rule list: `[]` (Enabled: `True`). {{(pid=79744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:17:25.642914 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.fernet_utils [None req-fcc75f14-b569-4ac9-8cdb-161557db5967 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:17:25.650606 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 718/1424] 127.0.0.1 () {58 vars in 998 bytes} [Wed May 4 07:17:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 07:17:25.797199 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2b0fdc-4cc0-4894-9a6b-a80be07277d9 None None] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:17:25.811711 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2b0fdc-4cc0-4894-9a6b-a80be07277d9 None None] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:17:25.817611 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26af610b-8677-4540-b2ae-9e58e829b761 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1077289fedae43b6be47be7f716d573a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9f9c44db4984653b8d4b5f6b3b949f5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:17:25.818229 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26af610b-8677-4540-b2ae-9e58e829b761 service nova] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:17:25.818506 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26af610b-8677-4540-b2ae-9e58e829b761 service nova] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:17:25.818776 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26af610b-8677-4540-b2ae-9e58e829b761 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:17:25.826741 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26af610b-8677-4540-b2ae-9e58e829b761 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:17:25.828367 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26af610b-8677-4540-b2ae-9e58e829b761 service nova] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:17:25.837629 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 707/1425] 10.222.0.21 () {60 vars in 1365 bytes} [Wed May 4 07:17:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 07:17:27.143979 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1492b58d-11f1-4ec5-8a53-81175b152208 None None] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:17:27.144521 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1492b58d-11f1-4ec5-8a53-81175b152208 None None] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:17:27.144521 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1492b58d-11f1-4ec5-8a53-81175b152208 None None] PATH_INFO: `/` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:17:27.145876 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 719/1426] 127.0.0.1 () {54 vars in 901 bytes} [Wed May 4 07:17:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 07:17:27.150757 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c909da01-0734-4de2-ad2f-b8914b33ee86 None None] REQUEST_METHOD: `POST` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:17:27.151243 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c909da01-0734-4de2-ad2f-b8914b33ee86 None None] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:17:27.151370 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c909da01-0734-4de2-ad2f-b8914b33ee86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:17:27.168965 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.auth.core [None req-c909da01-0734-4de2-ad2f-b8914b33ee86 None None] MFA Rules not processed for user `83c5e0dcb991496ea6dee38384514508`. Rule list: `[]` (Enabled: `True`). {{(pid=79745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:17:27.170125 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.fernet_utils [None req-c909da01-0734-4de2-ad2f-b8914b33ee86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:17:27.178501 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 708/1427] 127.0.0.1 () {58 vars in 998 bytes} [Wed May 4 07:17:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 07:17:27.325881 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1492b58d-11f1-4ec5-8a53-81175b152208 None None] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:17:27.340436 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1492b58d-11f1-4ec5-8a53-81175b152208 None None] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:17:27.346538 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3b62c6-ea27-4f59-a61c-1c0f9af780da service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1077289fedae43b6be47be7f716d573a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9f9c44db4984653b8d4b5f6b3b949f5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:17:27.347186 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3b62c6-ea27-4f59-a61c-1c0f9af780da service nova] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:17:27.347470 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3b62c6-ea27-4f59-a61c-1c0f9af780da service nova] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:17:27.347741 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3b62c6-ea27-4f59-a61c-1c0f9af780da service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:17:27.355655 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3b62c6-ea27-4f59-a61c-1c0f9af780da service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:17:27.357251 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3b62c6-ea27-4f59-a61c-1c0f9af780da service nova] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:17:27.366877 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 720/1428] 10.222.0.21 () {60 vars in 1365 bytes} [Wed May 4 07:17:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 07:17:28.568866 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313358ba-4628-44cd-80bc-7c1bd4bf225c None None] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:17:28.569460 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313358ba-4628-44cd-80bc-7c1bd4bf225c None None] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:17:28.569460 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313358ba-4628-44cd-80bc-7c1bd4bf225c None None] PATH_INFO: `/` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:17:28.570774 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 709/1429] 127.0.0.1 () {54 vars in 901 bytes} [Wed May 4 07:17:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 07:17:28.575615 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715a1533-3d1e-4327-8502-8b3d43da7b39 None None] REQUEST_METHOD: `POST` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:17:28.576019 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715a1533-3d1e-4327-8502-8b3d43da7b39 None None] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:17:28.576281 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715a1533-3d1e-4327-8502-8b3d43da7b39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:17:28.594067 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.auth.core [None req-715a1533-3d1e-4327-8502-8b3d43da7b39 None None] MFA Rules not processed for user `83c5e0dcb991496ea6dee38384514508`. Rule list: `[]` (Enabled: `True`). {{(pid=79744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:17:28.595317 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.fernet_utils [None req-715a1533-3d1e-4327-8502-8b3d43da7b39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:17:28.602964 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 721/1430] 127.0.0.1 () {58 vars in 998 bytes} [Wed May 4 07:17:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 07:17:28.753765 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313358ba-4628-44cd-80bc-7c1bd4bf225c None None] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:17:28.768020 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313358ba-4628-44cd-80bc-7c1bd4bf225c None None] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:17:28.773315 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2f834b-cd8e-4d61-a3b3-f77741b5c6d2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1077289fedae43b6be47be7f716d573a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9f9c44db4984653b8d4b5f6b3b949f5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:17:28.773935 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2f834b-cd8e-4d61-a3b3-f77741b5c6d2 service nova] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:17:28.774214 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2f834b-cd8e-4d61-a3b3-f77741b5c6d2 service nova] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:17:28.774490 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2f834b-cd8e-4d61-a3b3-f77741b5c6d2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:17:28.782263 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2f834b-cd8e-4d61-a3b3-f77741b5c6d2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:17:28.783854 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2f834b-cd8e-4d61-a3b3-f77741b5c6d2 service nova] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:17:28.793117 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 710/1431] 10.222.0.21 () {60 vars in 1365 bytes} [Wed May 4 07:17:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 07:17:29.984937 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75cdbc7-9209-4143-8bbd-927f2f267c80 None None] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:17:29.985458 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75cdbc7-9209-4143-8bbd-927f2f267c80 None None] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:17:29.985690 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75cdbc7-9209-4143-8bbd-927f2f267c80 None None] PATH_INFO: `/` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:17:29.987250 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 722/1432] 127.0.0.1 () {54 vars in 901 bytes} [Wed May 4 07:17:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 07:17:29.992446 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51a8428-dd0a-495d-9dcd-d0f4e0632be3 None None] REQUEST_METHOD: `POST` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:17:29.992878 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51a8428-dd0a-495d-9dcd-d0f4e0632be3 None None] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:17:29.992974 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51a8428-dd0a-495d-9dcd-d0f4e0632be3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:17:30.013155 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.auth.core [None req-e51a8428-dd0a-495d-9dcd-d0f4e0632be3 None None] MFA Rules not processed for user `83c5e0dcb991496ea6dee38384514508`. Rule list: `[]` (Enabled: `True`). {{(pid=79745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:17:30.014330 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.fernet_utils [None req-e51a8428-dd0a-495d-9dcd-d0f4e0632be3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:17:30.022656 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 711/1433] 127.0.0.1 () {58 vars in 998 bytes} [Wed May 4 07:17:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 07:17:30.170759 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75cdbc7-9209-4143-8bbd-927f2f267c80 None None] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:17:30.184866 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75cdbc7-9209-4143-8bbd-927f2f267c80 None None] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:17:30.190984 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b412ed6-27eb-45dc-961c-dcdb686f03b6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1077289fedae43b6be47be7f716d573a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9f9c44db4984653b8d4b5f6b3b949f5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:17:30.191638 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b412ed6-27eb-45dc-961c-dcdb686f03b6 service nova] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:17:30.191912 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b412ed6-27eb-45dc-961c-dcdb686f03b6 service nova] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:17:30.192469 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b412ed6-27eb-45dc-961c-dcdb686f03b6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:17:30.200351 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b412ed6-27eb-45dc-961c-dcdb686f03b6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:17:30.201901 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b412ed6-27eb-45dc-961c-dcdb686f03b6 service nova] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:17:30.212408 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 723/1434] 10.222.0.21 () {60 vars in 1365 bytes} [Wed May 4 07:17:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 07:17:31.395873 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48daed96-4229-453e-99da-1c477d59c70f None None] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:17:31.396571 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48daed96-4229-453e-99da-1c477d59c70f None None] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:17:31.396571 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48daed96-4229-453e-99da-1c477d59c70f None None] PATH_INFO: `/` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:17:31.397987 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 712/1435] 127.0.0.1 () {54 vars in 901 bytes} [Wed May 4 07:17:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 07:17:31.403210 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799fe3b8-f20a-4744-8fac-14dcebafc51f None None] REQUEST_METHOD: `POST` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:17:31.403653 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799fe3b8-f20a-4744-8fac-14dcebafc51f None None] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:17:31.403750 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799fe3b8-f20a-4744-8fac-14dcebafc51f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:17:31.422072 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.auth.core [None req-799fe3b8-f20a-4744-8fac-14dcebafc51f None None] MFA Rules not processed for user `83c5e0dcb991496ea6dee38384514508`. Rule list: `[]` (Enabled: `True`). {{(pid=79744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:17:31.423917 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.fernet_utils [None req-799fe3b8-f20a-4744-8fac-14dcebafc51f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:17:31.431643 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 724/1436] 127.0.0.1 () {58 vars in 998 bytes} [Wed May 4 07:17:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 07:17:31.581252 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48daed96-4229-453e-99da-1c477d59c70f None None] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:17:31.595737 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48daed96-4229-453e-99da-1c477d59c70f None None] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:17:31.601052 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4078708f-3cab-4847-a961-2319ab81e1e1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1077289fedae43b6be47be7f716d573a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9f9c44db4984653b8d4b5f6b3b949f5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:17:31.601674 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4078708f-3cab-4847-a961-2319ab81e1e1 service nova] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:17:31.601952 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4078708f-3cab-4847-a961-2319ab81e1e1 service nova] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:17:31.602228 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4078708f-3cab-4847-a961-2319ab81e1e1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:17:31.610025 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4078708f-3cab-4847-a961-2319ab81e1e1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:17:31.612296 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4078708f-3cab-4847-a961-2319ab81e1e1 service nova] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:17:31.621436 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 713/1437] 10.222.0.21 () {60 vars in 1365 bytes} [Wed May 4 07:17:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 07:17:32.808956 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4633f7b-d026-41cb-85b9-3eafcfcfa0fc None None] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:17:32.809550 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4633f7b-d026-41cb-85b9-3eafcfcfa0fc None None] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:17:32.809550 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4633f7b-d026-41cb-85b9-3eafcfcfa0fc None None] PATH_INFO: `/` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:17:32.810863 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 725/1438] 127.0.0.1 () {54 vars in 901 bytes} [Wed May 4 07:17:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 07:17:32.815883 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b311f19c-5293-4fca-9891-04784f34c9c9 None None] REQUEST_METHOD: `POST` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:17:32.816293 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b311f19c-5293-4fca-9891-04784f34c9c9 None None] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:17:32.816430 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b311f19c-5293-4fca-9891-04784f34c9c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:17:32.833835 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.auth.core [None req-b311f19c-5293-4fca-9891-04784f34c9c9 None None] MFA Rules not processed for user `83c5e0dcb991496ea6dee38384514508`. Rule list: `[]` (Enabled: `True`). {{(pid=79745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:17:32.834997 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.fernet_utils [None req-b311f19c-5293-4fca-9891-04784f34c9c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:17:32.842542 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 714/1439] 127.0.0.1 () {58 vars in 998 bytes} [Wed May 4 07:17:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 07:17:32.990079 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4633f7b-d026-41cb-85b9-3eafcfcfa0fc None None] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:17:33.003929 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4633f7b-d026-41cb-85b9-3eafcfcfa0fc None None] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:17:33.009487 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc65294-ae2a-40c5-b344-91ca4ce51269 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1077289fedae43b6be47be7f716d573a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9f9c44db4984653b8d4b5f6b3b949f5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:17:33.010105 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc65294-ae2a-40c5-b344-91ca4ce51269 service nova] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:17:33.010379 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc65294-ae2a-40c5-b344-91ca4ce51269 service nova] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:17:33.010646 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc65294-ae2a-40c5-b344-91ca4ce51269 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:17:33.018972 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc65294-ae2a-40c5-b344-91ca4ce51269 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:17:33.020570 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc65294-ae2a-40c5-b344-91ca4ce51269 service nova] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:17:33.030040 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 726/1440] 10.222.0.21 () {60 vars in 1365 bytes} [Wed May 4 07:17:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 07:17:35.182078 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6705f699-e510-4c7f-be16-1765836fdfd5 None None] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:17:35.182653 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6705f699-e510-4c7f-be16-1765836fdfd5 None None] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:17:35.182653 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6705f699-e510-4c7f-be16-1765836fdfd5 None None] PATH_INFO: `/` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:17:35.183994 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 715/1441] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 4 07:17:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 07:17:35.189724 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5604d535-4963-4fba-a3c1-91fe2cf13aef None None] REQUEST_METHOD: `POST` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:17:35.190153 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5604d535-4963-4fba-a3c1-91fe2cf13aef None None] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:17:35.190276 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5604d535-4963-4fba-a3c1-91fe2cf13aef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:17:35.208106 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.auth.core [None req-5604d535-4963-4fba-a3c1-91fe2cf13aef None None] MFA Rules not processed for user `83c5e0dcb991496ea6dee38384514508`. Rule list: `[]` (Enabled: `True`). {{(pid=79744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:17:35.209285 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.fernet_utils [None req-5604d535-4963-4fba-a3c1-91fe2cf13aef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:17:35.216962 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 727/1442] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 4 07:17:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 07:17:35.254528 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6705f699-e510-4c7f-be16-1765836fdfd5 None None] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:17:35.265091 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6705f699-e510-4c7f-be16-1765836fdfd5 None None] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:17:35.269408 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2f061d-ba0c-45bb-b96b-c39c0040a922 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91cb92d00273402b837cb29b37325101', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9f9c44db4984653b8d4b5f6b3b949f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:17:35.270033 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2f061d-ba0c-45bb-b96b-c39c0040a922 service neutron] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:17:35.270307 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2f061d-ba0c-45bb-b96b-c39c0040a922 service neutron] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:17:35.270578 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2f061d-ba0c-45bb-b96b-c39c0040a922 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:17:35.279096 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2f061d-ba0c-45bb-b96b-c39c0040a922 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:17:35.280535 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2f061d-ba0c-45bb-b96b-c39c0040a922 service neutron] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:17:35.289669 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 716/1443] 10.222.0.21 () {60 vars in 1365 bytes} [Wed May 4 07:17:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 07:17:37.670465 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0464fe3b-2816-4dea-906e-5f8410422aea None None] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:17:37.671035 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0464fe3b-2816-4dea-906e-5f8410422aea None None] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:17:37.671035 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0464fe3b-2816-4dea-906e-5f8410422aea None None] PATH_INFO: `/` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:17:37.672422 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 728/1444] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 4 07:17:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 07:17:37.678227 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5d5a9b-9323-4df3-9975-851302a2cefd None None] REQUEST_METHOD: `POST` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:17:37.678675 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5d5a9b-9323-4df3-9975-851302a2cefd None None] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:17:37.678783 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5d5a9b-9323-4df3-9975-851302a2cefd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:17:37.695878 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.auth.core [None req-0d5d5a9b-9323-4df3-9975-851302a2cefd None None] MFA Rules not processed for user `83c5e0dcb991496ea6dee38384514508`. Rule list: `[]` (Enabled: `True`). {{(pid=79745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:17:37.697050 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.fernet_utils [None req-0d5d5a9b-9323-4df3-9975-851302a2cefd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:17:37.705236 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 717/1445] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 4 07:17:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 07:17:37.743332 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0464fe3b-2816-4dea-906e-5f8410422aea None None] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:17:37.754338 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0464fe3b-2816-4dea-906e-5f8410422aea None None] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:17:37.758107 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92207eb-99e8-4066-8fee-1275f6016f96 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91cb92d00273402b837cb29b37325101', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9f9c44db4984653b8d4b5f6b3b949f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:17:37.758739 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92207eb-99e8-4066-8fee-1275f6016f96 service neutron] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:17:37.759012 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92207eb-99e8-4066-8fee-1275f6016f96 service neutron] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:17:37.759311 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92207eb-99e8-4066-8fee-1275f6016f96 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:17:37.768964 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92207eb-99e8-4066-8fee-1275f6016f96 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:17:37.770376 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92207eb-99e8-4066-8fee-1275f6016f96 service neutron] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:17:37.779578 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 729/1446] 10.222.0.21 () {60 vars in 1365 bytes} [Wed May 4 07:17:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 07:17:40.350910 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d31d942-b5ef-4644-8742-9da9fc1631cf None None] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:17:40.351550 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d31d942-b5ef-4644-8742-9da9fc1631cf None None] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:17:40.351550 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d31d942-b5ef-4644-8742-9da9fc1631cf None None] PATH_INFO: `/` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:17:40.352855 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 718/1447] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 4 07:17:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 07:17:40.358107 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbcf408-ac76-49d3-8720-1065f0805d04 None None] REQUEST_METHOD: `POST` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:17:40.358581 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbcf408-ac76-49d3-8720-1065f0805d04 None None] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:17:40.358690 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbcf408-ac76-49d3-8720-1065f0805d04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:17:40.376580 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.auth.core [None req-fdbcf408-ac76-49d3-8720-1065f0805d04 None None] MFA Rules not processed for user `83c5e0dcb991496ea6dee38384514508`. Rule list: `[]` (Enabled: `True`). {{(pid=79744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:17:40.377742 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.fernet_utils [None req-fdbcf408-ac76-49d3-8720-1065f0805d04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:17:40.385615 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 730/1448] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 4 07:17:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 07:17:40.426851 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d31d942-b5ef-4644-8742-9da9fc1631cf None None] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:17:40.437208 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d31d942-b5ef-4644-8742-9da9fc1631cf None None] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:17:40.440753 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db666b9-1f18-46df-9afa-a21280af02ee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91cb92d00273402b837cb29b37325101', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9f9c44db4984653b8d4b5f6b3b949f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:17:40.441370 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db666b9-1f18-46df-9afa-a21280af02ee service neutron] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:17:40.441646 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db666b9-1f18-46df-9afa-a21280af02ee service neutron] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:17:40.441915 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db666b9-1f18-46df-9afa-a21280af02ee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:17:40.450807 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db666b9-1f18-46df-9afa-a21280af02ee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:17:40.452253 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db666b9-1f18-46df-9afa-a21280af02ee service neutron] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:17:40.461654 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 719/1449] 10.222.0.21 () {60 vars in 1365 bytes} [Wed May 4 07:17:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 07:17:42.873132 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe04c89-70e0-4f33-91a1-527e61c3ef0a None None] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:17:42.873703 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe04c89-70e0-4f33-91a1-527e61c3ef0a None None] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:17:42.873703 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe04c89-70e0-4f33-91a1-527e61c3ef0a None None] PATH_INFO: `/` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:17:42.875042 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 731/1450] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 4 07:17:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 07:17:42.881611 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c3536b-94ee-46ba-a6ca-6a21a4fa3e45 None None] REQUEST_METHOD: `POST` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:17:42.882043 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c3536b-94ee-46ba-a6ca-6a21a4fa3e45 None None] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:17:42.882198 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c3536b-94ee-46ba-a6ca-6a21a4fa3e45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:17:42.900073 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.auth.core [None req-d2c3536b-94ee-46ba-a6ca-6a21a4fa3e45 None None] MFA Rules not processed for user `83c5e0dcb991496ea6dee38384514508`. Rule list: `[]` (Enabled: `True`). {{(pid=79745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:17:42.901260 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.fernet_utils [None req-d2c3536b-94ee-46ba-a6ca-6a21a4fa3e45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:17:42.909104 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 720/1451] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 4 07:17:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 07:17:42.947594 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe04c89-70e0-4f33-91a1-527e61c3ef0a None None] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:17:42.958140 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe04c89-70e0-4f33-91a1-527e61c3ef0a None None] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:17:42.961653 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad05bb6-2393-49fb-b0fa-9ea22b769bad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91cb92d00273402b837cb29b37325101', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9f9c44db4984653b8d4b5f6b3b949f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:17:42.962272 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad05bb6-2393-49fb-b0fa-9ea22b769bad service neutron] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:17:42.962547 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad05bb6-2393-49fb-b0fa-9ea22b769bad service neutron] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:17:42.962822 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad05bb6-2393-49fb-b0fa-9ea22b769bad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:17:42.971476 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad05bb6-2393-49fb-b0fa-9ea22b769bad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:17:42.972874 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad05bb6-2393-49fb-b0fa-9ea22b769bad service neutron] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:17:42.981892 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 732/1452] 10.222.0.21 () {60 vars in 1365 bytes} [Wed May 4 07:17:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 07:17:45.293616 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09292dfe-2555-46ee-a5cb-7b730e1a4e36 None None] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:17:45.294162 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09292dfe-2555-46ee-a5cb-7b730e1a4e36 None None] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:17:45.294162 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09292dfe-2555-46ee-a5cb-7b730e1a4e36 None None] PATH_INFO: `/` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:17:45.295567 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 721/1453] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 4 07:17:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 07:17:45.301159 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80c3905-3553-4762-85d7-e31cdc0858a9 None None] REQUEST_METHOD: `POST` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:17:45.301594 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80c3905-3553-4762-85d7-e31cdc0858a9 None None] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:17:45.301696 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80c3905-3553-4762-85d7-e31cdc0858a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:17:45.318730 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.auth.core [None req-f80c3905-3553-4762-85d7-e31cdc0858a9 None None] MFA Rules not processed for user `83c5e0dcb991496ea6dee38384514508`. Rule list: `[]` (Enabled: `True`). {{(pid=79744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:17:45.319930 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.fernet_utils [None req-f80c3905-3553-4762-85d7-e31cdc0858a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:17:45.327510 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 733/1454] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 4 07:17:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 07:17:45.365064 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09292dfe-2555-46ee-a5cb-7b730e1a4e36 None None] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:17:45.375435 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09292dfe-2555-46ee-a5cb-7b730e1a4e36 None None] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:17:45.378961 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e1c814-a7a5-4b1e-95e7-5d5ba89fb262 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91cb92d00273402b837cb29b37325101', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9f9c44db4984653b8d4b5f6b3b949f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:17:45.379618 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e1c814-a7a5-4b1e-95e7-5d5ba89fb262 service neutron] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:17:45.379900 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e1c814-a7a5-4b1e-95e7-5d5ba89fb262 service neutron] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:17:45.380194 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e1c814-a7a5-4b1e-95e7-5d5ba89fb262 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:17:45.389059 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e1c814-a7a5-4b1e-95e7-5d5ba89fb262 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:17:45.390476 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e1c814-a7a5-4b1e-95e7-5d5ba89fb262 service neutron] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:17:45.400222 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 722/1455] 10.222.0.21 () {60 vars in 1365 bytes} [Wed May 4 07:17:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 07:17:47.752988 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff927de-c98a-46da-84c0-9b0e9db0e41e None None] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:17:47.753503 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff927de-c98a-46da-84c0-9b0e9db0e41e None None] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:17:47.753503 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff927de-c98a-46da-84c0-9b0e9db0e41e None None] PATH_INFO: `/` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:17:47.754900 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 734/1456] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 4 07:17:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 07:17:47.760664 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1106e127-50b7-4ebd-889b-67c025753438 None None] REQUEST_METHOD: `POST` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:17:47.761135 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1106e127-50b7-4ebd-889b-67c025753438 None None] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:17:47.761234 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1106e127-50b7-4ebd-889b-67c025753438 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:17:47.778741 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.auth.core [None req-1106e127-50b7-4ebd-889b-67c025753438 None None] MFA Rules not processed for user `83c5e0dcb991496ea6dee38384514508`. Rule list: `[]` (Enabled: `True`). {{(pid=79745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:17:47.779939 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.fernet_utils [None req-1106e127-50b7-4ebd-889b-67c025753438 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:17:47.790444 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 723/1457] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 4 07:17:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 07:17:47.828651 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff927de-c98a-46da-84c0-9b0e9db0e41e None None] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:17:47.839617 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff927de-c98a-46da-84c0-9b0e9db0e41e None None] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:17:47.843060 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a1b27f-88f3-4412-9f0e-4176a9e0153f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91cb92d00273402b837cb29b37325101', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9f9c44db4984653b8d4b5f6b3b949f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:17:47.843716 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a1b27f-88f3-4412-9f0e-4176a9e0153f service neutron] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:17:47.843994 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a1b27f-88f3-4412-9f0e-4176a9e0153f service neutron] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:17:47.844264 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a1b27f-88f3-4412-9f0e-4176a9e0153f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:17:47.852804 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a1b27f-88f3-4412-9f0e-4176a9e0153f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:17:47.854246 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a1b27f-88f3-4412-9f0e-4176a9e0153f service neutron] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:17:47.863386 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 735/1458] 10.222.0.21 () {60 vars in 1365 bytes} [Wed May 4 07:17:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 07:17:50.151173 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffab2096-8b7e-4c63-9934-80767aa92015 None None] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:17:50.151727 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffab2096-8b7e-4c63-9934-80767aa92015 None None] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:17:50.151727 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffab2096-8b7e-4c63-9934-80767aa92015 None None] PATH_INFO: `/` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:17:50.153097 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 724/1459] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 4 07:17:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 07:17:50.159306 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f3e7e5-9115-42a0-9b1b-70c8af4d8651 None None] REQUEST_METHOD: `POST` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:17:50.159740 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f3e7e5-9115-42a0-9b1b-70c8af4d8651 None None] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:17:50.159852 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f3e7e5-9115-42a0-9b1b-70c8af4d8651 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:17:50.177821 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.auth.core [None req-03f3e7e5-9115-42a0-9b1b-70c8af4d8651 None None] MFA Rules not processed for user `83c5e0dcb991496ea6dee38384514508`. Rule list: `[]` (Enabled: `True`). {{(pid=79744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:17:50.179012 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.fernet_utils [None req-03f3e7e5-9115-42a0-9b1b-70c8af4d8651 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:17:50.186725 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 736/1460] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 4 07:17:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 07:17:50.224722 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffab2096-8b7e-4c63-9934-80767aa92015 None None] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:17:50.235910 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffab2096-8b7e-4c63-9934-80767aa92015 None None] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:17:50.239486 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3302be46-fc9e-4dd1-b66b-485e87a0a48e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91cb92d00273402b837cb29b37325101', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9f9c44db4984653b8d4b5f6b3b949f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:17:50.240128 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3302be46-fc9e-4dd1-b66b-485e87a0a48e service neutron] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:17:50.240404 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3302be46-fc9e-4dd1-b66b-485e87a0a48e service neutron] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:17:50.240674 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3302be46-fc9e-4dd1-b66b-485e87a0a48e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:17:50.249325 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3302be46-fc9e-4dd1-b66b-485e87a0a48e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:17:50.250741 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3302be46-fc9e-4dd1-b66b-485e87a0a48e service neutron] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:17:50.260060 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 725/1461] 10.222.0.21 () {60 vars in 1365 bytes} [Wed May 4 07:17:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 07:17:52.566443 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac62013-ea9b-40a2-8957-23b2f11daf26 None None] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:17:52.567009 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac62013-ea9b-40a2-8957-23b2f11daf26 None None] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:17:52.567009 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac62013-ea9b-40a2-8957-23b2f11daf26 None None] PATH_INFO: `/` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:17:52.568443 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 737/1462] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 4 07:17:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 07:17:52.573695 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc9f49d-9d0c-48e4-9244-a1e6459353d7 None None] REQUEST_METHOD: `POST` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:17:52.574149 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc9f49d-9d0c-48e4-9244-a1e6459353d7 None None] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:17:52.574260 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc9f49d-9d0c-48e4-9244-a1e6459353d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:17:52.591775 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.auth.core [None req-abc9f49d-9d0c-48e4-9244-a1e6459353d7 None None] MFA Rules not processed for user `83c5e0dcb991496ea6dee38384514508`. Rule list: `[]` (Enabled: `True`). {{(pid=79745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:17:52.592942 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.fernet_utils [None req-abc9f49d-9d0c-48e4-9244-a1e6459353d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:17:52.600710 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 726/1463] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 4 07:17:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 07:17:52.638858 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac62013-ea9b-40a2-8957-23b2f11daf26 None None] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:17:52.649944 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac62013-ea9b-40a2-8957-23b2f11daf26 None None] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:17:52.653426 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc48f80-1729-4a9d-90a5-66bc848bf1b9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91cb92d00273402b837cb29b37325101', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9f9c44db4984653b8d4b5f6b3b949f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:17:52.654051 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc48f80-1729-4a9d-90a5-66bc848bf1b9 service neutron] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:17:52.654332 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc48f80-1729-4a9d-90a5-66bc848bf1b9 service neutron] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:17:52.654605 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc48f80-1729-4a9d-90a5-66bc848bf1b9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:17:52.663400 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc48f80-1729-4a9d-90a5-66bc848bf1b9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:17:52.664818 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc48f80-1729-4a9d-90a5-66bc848bf1b9 service neutron] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:17:52.674532 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 738/1464] 10.222.0.21 () {60 vars in 1365 bytes} [Wed May 4 07:17:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 07:17:54.924549 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985420a7-27b7-42df-a0f9-6a086b2b295e None None] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:17:54.925139 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985420a7-27b7-42df-a0f9-6a086b2b295e None None] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:17:54.925139 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985420a7-27b7-42df-a0f9-6a086b2b295e None None] PATH_INFO: `/` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:17:54.926462 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 727/1465] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 4 07:17:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 07:17:54.931614 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4048754-8998-4c89-920b-55f67b70eb02 None None] REQUEST_METHOD: `POST` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:17:54.932040 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4048754-8998-4c89-920b-55f67b70eb02 None None] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:17:54.932191 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4048754-8998-4c89-920b-55f67b70eb02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:17:54.949545 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.auth.core [None req-d4048754-8998-4c89-920b-55f67b70eb02 None None] MFA Rules not processed for user `83c5e0dcb991496ea6dee38384514508`. Rule list: `[]` (Enabled: `True`). {{(pid=79744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:17:54.950748 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.fernet_utils [None req-d4048754-8998-4c89-920b-55f67b70eb02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:17:54.958946 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 739/1466] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 4 07:17:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 07:17:54.994357 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985420a7-27b7-42df-a0f9-6a086b2b295e None None] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:17:55.004778 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985420a7-27b7-42df-a0f9-6a086b2b295e None None] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:17:55.008483 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f79ba20-cdcb-4f60-bfe0-93bc0a02a31a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91cb92d00273402b837cb29b37325101', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9f9c44db4984653b8d4b5f6b3b949f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:17:55.009101 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f79ba20-cdcb-4f60-bfe0-93bc0a02a31a service neutron] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:17:55.009376 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f79ba20-cdcb-4f60-bfe0-93bc0a02a31a service neutron] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:17:55.009646 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f79ba20-cdcb-4f60-bfe0-93bc0a02a31a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:17:55.018789 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f79ba20-cdcb-4f60-bfe0-93bc0a02a31a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:17:55.020224 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f79ba20-cdcb-4f60-bfe0-93bc0a02a31a service neutron] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:17:55.029172 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 728/1467] 10.222.0.21 () {60 vars in 1365 bytes} [Wed May 4 07:17:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 07:17:57.308703 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bec360-3730-40c8-a700-89b345e19f2f None None] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:17:57.309256 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bec360-3730-40c8-a700-89b345e19f2f None None] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:17:57.309256 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bec360-3730-40c8-a700-89b345e19f2f None None] PATH_INFO: `/` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:17:57.310616 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 740/1468] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 4 07:17:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 07:17:57.315940 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093ba8a5-35d5-4b17-93f0-d547533b8ced None None] REQUEST_METHOD: `POST` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:17:57.316398 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093ba8a5-35d5-4b17-93f0-d547533b8ced None None] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:17:57.316530 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093ba8a5-35d5-4b17-93f0-d547533b8ced None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:17:57.334777 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.auth.core [None req-093ba8a5-35d5-4b17-93f0-d547533b8ced None None] MFA Rules not processed for user `83c5e0dcb991496ea6dee38384514508`. Rule list: `[]` (Enabled: `True`). {{(pid=79745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:17:57.336008 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.fernet_utils [None req-093ba8a5-35d5-4b17-93f0-d547533b8ced None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:17:57.343848 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 729/1469] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 4 07:17:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 07:17:57.380050 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1bec360-3730-40c8-a700-89b345e19f2f None None] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:17:57.390678 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1bec360-3730-40c8-a700-89b345e19f2f None None] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:17:57.394867 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3480bf0f-6c12-47a5-b694-535afc22e6fc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91cb92d00273402b837cb29b37325101', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9f9c44db4984653b8d4b5f6b3b949f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:17:57.395516 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3480bf0f-6c12-47a5-b694-535afc22e6fc service neutron] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:17:57.395794 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3480bf0f-6c12-47a5-b694-535afc22e6fc service neutron] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:17:57.396063 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3480bf0f-6c12-47a5-b694-535afc22e6fc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:17:57.404786 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3480bf0f-6c12-47a5-b694-535afc22e6fc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:17:57.406248 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3480bf0f-6c12-47a5-b694-535afc22e6fc service neutron] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:17:57.416673 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 741/1470] 10.222.0.21 () {60 vars in 1365 bytes} [Wed May 4 07:17:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 07:18:30.668399 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efea6171-7847-43eb-8300-d18caaafbffb None None] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:18:30.669011 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efea6171-7847-43eb-8300-d18caaafbffb None None] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:18:30.669011 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efea6171-7847-43eb-8300-d18caaafbffb None None] PATH_INFO: `/` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:18:30.670308 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 730/1471] 10.222.0.21 () {54 vars in 926 bytes} [Wed May 4 07:18:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 07:18:30.675724 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175327ad-0c56-4d1b-8062-fa35783408d2 None None] REQUEST_METHOD: `POST` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:18:30.676187 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175327ad-0c56-4d1b-8062-fa35783408d2 None None] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:18:30.676301 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175327ad-0c56-4d1b-8062-fa35783408d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:18:30.694844 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.auth.core [None req-175327ad-0c56-4d1b-8062-fa35783408d2 None None] MFA Rules not processed for user `83c5e0dcb991496ea6dee38384514508`. Rule list: `[]` (Enabled: `True`). {{(pid=79744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:18:30.696066 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.fernet_utils [None req-175327ad-0c56-4d1b-8062-fa35783408d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:18:30.704541 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 742/1472] 10.222.0.21 () {58 vars in 1023 bytes} [Wed May 4 07:18:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 07:18:30.750661 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e5364a-a045-4468-871c-37244abb1b1e None None] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:18:30.750941 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e5364a-a045-4468-871c-37244abb1b1e None None] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:18:30.751252 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e5364a-a045-4468-871c-37244abb1b1e None None] PATH_INFO: `/` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:18:30.752575 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 731/1473] 10.222.0.21 () {54 vars in 962 bytes} [Wed May 4 07:18:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 07:18:30.757489 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b63aa84-05a7-46e6-a41d-07303aebe146 None None] REQUEST_METHOD: `POST` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:18:30.757776 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b63aa84-05a7-46e6-a41d-07303aebe146 None None] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:18:30.758070 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b63aa84-05a7-46e6-a41d-07303aebe146 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:18:30.775917 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.auth.core [None req-3b63aa84-05a7-46e6-a41d-07303aebe146 None None] MFA Rules not processed for user `7538f5cab3364625a3e909f5f117ef2d`. Rule list: `[]` (Enabled: `True`). {{(pid=79744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:18:30.777069 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.fernet_utils [None req-3b63aa84-05a7-46e6-a41d-07303aebe146 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:18:30.783351 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 743/1474] 10.222.0.21 () {58 vars in 1059 bytes} [Wed May 4 07:18:30 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 07:18:30.790274 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e5364a-a045-4468-871c-37244abb1b1e None None] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:18:30.800722 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e5364a-a045-4468-871c-37244abb1b1e None None] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:18:30.804258 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b245af9-cdc0-46c6-9a83-c5a504071310 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7538f5cab3364625a3e909f5f117ef2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9f9c44db4984653b8d4b5f6b3b949f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:18:30.804875 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b245af9-cdc0-46c6-9a83-c5a504071310 service glance] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:18:30.805154 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b245af9-cdc0-46c6-9a83-c5a504071310 service glance] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:18:30.805427 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b245af9-cdc0-46c6-9a83-c5a504071310 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:18:30.814592 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b245af9-cdc0-46c6-9a83-c5a504071310 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:18:30.816044 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b245af9-cdc0-46c6-9a83-c5a504071310 service glance] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:18:30.825128 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 732/1475] 10.222.0.21 () {60 vars in 1365 bytes} [Wed May 4 07:18:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 07:18:33.139414 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a9f8b1-f1e4-4cdc-8aaf-9f4420ccdc13 None None] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:18:33.140572 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a9f8b1-f1e4-4cdc-8aaf-9f4420ccdc13 None None] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:18:33.140822 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a9f8b1-f1e4-4cdc-8aaf-9f4420ccdc13 None None] PATH_INFO: `/` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:18:33.142191 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 744/1476] 10.222.0.21 () {54 vars in 926 bytes} [Wed May 4 07:18:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 07:18:33.147421 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7dd200-89eb-4af1-a622-e7a754d239f9 None None] REQUEST_METHOD: `POST` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:18:33.147839 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7dd200-89eb-4af1-a622-e7a754d239f9 None None] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:18:33.147967 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7dd200-89eb-4af1-a622-e7a754d239f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:18:33.164984 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.auth.core [None req-7b7dd200-89eb-4af1-a622-e7a754d239f9 None None] MFA Rules not processed for user `83c5e0dcb991496ea6dee38384514508`. Rule list: `[]` (Enabled: `True`). {{(pid=79745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:18:33.166146 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.fernet_utils [None req-7b7dd200-89eb-4af1-a622-e7a754d239f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:18:33.174550 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 733/1477] 10.222.0.21 () {58 vars in 1023 bytes} [Wed May 4 07:18:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 07:18:33.198256 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a9f8b1-f1e4-4cdc-8aaf-9f4420ccdc13 None None] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:18:33.210887 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a9f8b1-f1e4-4cdc-8aaf-9f4420ccdc13 None None] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:18:33.215408 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3aabad2-da2b-4a15-bad8-de4a86ef676e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:18:33.215989 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3aabad2-da2b-4a15-bad8-de4a86ef676e admin admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:18:33.216264 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3aabad2-da2b-4a15-bad8-de4a86ef676e admin admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:18:33.216555 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3aabad2-da2b-4a15-bad8-de4a86ef676e admin admin] PATH_INFO: `/v3/projects` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:18:33.217279 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3aabad2-da2b-4a15-bad8-de4a86ef676e admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:18:33.219031 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: WARNING py.warnings [None req-f3aabad2-da2b-4a15-bad8-de4a86ef676e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 04 07:18:33.219031 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: warnings.warn(msg) May 04 07:18:33.219031 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: May 04 07:18:33.220194 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3aabad2-da2b-4a15-bad8-de4a86ef676e admin admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:18:33.239459 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 745/1478] 10.222.0.21 () {56 vars in 1108 bytes} [Wed May 4 07:18:33 2022] GET /identity/v3/projects => generated 2553 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 07:18:35.496797 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5368343c-6f88-4c2f-9652-4db21e04d293 None None] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:18:35.497326 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5368343c-6f88-4c2f-9652-4db21e04d293 None None] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:18:35.497326 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5368343c-6f88-4c2f-9652-4db21e04d293 None None] PATH_INFO: `/` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:18:35.498772 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 734/1479] 10.222.0.21 () {54 vars in 926 bytes} [Wed May 4 07:18:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 07:18:35.504778 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda7cccd-965e-432b-bee4-422ca0dec8be None None] REQUEST_METHOD: `POST` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:18:35.505197 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda7cccd-965e-432b-bee4-422ca0dec8be None None] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:18:35.505335 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda7cccd-965e-432b-bee4-422ca0dec8be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:18:35.522955 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.auth.core [None req-fda7cccd-965e-432b-bee4-422ca0dec8be None None] MFA Rules not processed for user `83c5e0dcb991496ea6dee38384514508`. Rule list: `[]` (Enabled: `True`). {{(pid=79744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:18:35.524190 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.fernet_utils [None req-fda7cccd-965e-432b-bee4-422ca0dec8be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:18:35.532011 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 746/1480] 10.222.0.21 () {58 vars in 1023 bytes} [Wed May 4 07:18:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 07:18:35.574056 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5368343c-6f88-4c2f-9652-4db21e04d293 None None] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:18:35.588228 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5368343c-6f88-4c2f-9652-4db21e04d293 None None] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:18:35.593791 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a00d7b6-0a9f-4290-9a08-f8a291170090 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1077289fedae43b6be47be7f716d573a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9f9c44db4984653b8d4b5f6b3b949f5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:18:35.594412 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a00d7b6-0a9f-4290-9a08-f8a291170090 service nova] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:18:35.594684 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a00d7b6-0a9f-4290-9a08-f8a291170090 service nova] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:18:35.594952 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a00d7b6-0a9f-4290-9a08-f8a291170090 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:18:35.602860 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a00d7b6-0a9f-4290-9a08-f8a291170090 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:18:35.604444 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a00d7b6-0a9f-4290-9a08-f8a291170090 service nova] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:18:35.614023 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 735/1481] 10.222.0.21 () {60 vars in 1365 bytes} [Wed May 4 07:18:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 07:18:38.015185 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1312b21f-f3bb-4e64-9ad7-5ba30689d771 None None] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:18:38.015750 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1312b21f-f3bb-4e64-9ad7-5ba30689d771 None None] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:18:38.015750 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1312b21f-f3bb-4e64-9ad7-5ba30689d771 None None] PATH_INFO: `/` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:18:38.017096 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 747/1482] 10.222.0.21 () {54 vars in 926 bytes} [Wed May 4 07:18:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 07:18:38.022265 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdf5734-742d-4b86-a000-9c52ee5fe964 None None] REQUEST_METHOD: `POST` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:18:38.022653 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdf5734-742d-4b86-a000-9c52ee5fe964 None None] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:18:38.022858 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdf5734-742d-4b86-a000-9c52ee5fe964 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:18:38.040834 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.auth.core [None req-7fdf5734-742d-4b86-a000-9c52ee5fe964 None None] MFA Rules not processed for user `83c5e0dcb991496ea6dee38384514508`. Rule list: `[]` (Enabled: `True`). {{(pid=79745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:18:38.042015 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.fernet_utils [None req-7fdf5734-742d-4b86-a000-9c52ee5fe964 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:18:38.050312 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 736/1483] 10.222.0.21 () {58 vars in 1023 bytes} [Wed May 4 07:18:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 07:18:38.087255 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1312b21f-f3bb-4e64-9ad7-5ba30689d771 None None] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:18:38.098041 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1312b21f-f3bb-4e64-9ad7-5ba30689d771 None None] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:18:38.101441 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b40a804-e926-45b2-bd5c-1819a0a493de service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91cb92d00273402b837cb29b37325101', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9f9c44db4984653b8d4b5f6b3b949f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:18:38.102057 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b40a804-e926-45b2-bd5c-1819a0a493de service neutron] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:18:38.102330 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b40a804-e926-45b2-bd5c-1819a0a493de service neutron] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:18:38.102597 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b40a804-e926-45b2-bd5c-1819a0a493de service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:18:38.112313 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b40a804-e926-45b2-bd5c-1819a0a493de service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:18:38.113716 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b40a804-e926-45b2-bd5c-1819a0a493de service neutron] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:18:38.122909 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 748/1484] 10.222.0.21 () {60 vars in 1365 bytes} [Wed May 4 07:18:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 07:18:40.432841 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a031680-4f0b-493e-91a1-f261ebc2e7d0 None None] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:18:40.433504 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a031680-4f0b-493e-91a1-f261ebc2e7d0 None None] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:18:40.433504 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a031680-4f0b-493e-91a1-f261ebc2e7d0 None None] PATH_INFO: `/` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:18:40.434744 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 737/1485] 10.222.0.21 () {54 vars in 926 bytes} [Wed May 4 07:18:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 07:18:40.440522 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb4f3cf-77b4-4ef4-90bf-6fa827173cc6 None None] REQUEST_METHOD: `POST` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:18:40.440982 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb4f3cf-77b4-4ef4-90bf-6fa827173cc6 None None] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:18:40.441092 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb4f3cf-77b4-4ef4-90bf-6fa827173cc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:18:40.459397 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.auth.core [None req-aeb4f3cf-77b4-4ef4-90bf-6fa827173cc6 None None] MFA Rules not processed for user `83c5e0dcb991496ea6dee38384514508`. Rule list: `[]` (Enabled: `True`). {{(pid=79744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:18:40.460579 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.fernet_utils [None req-aeb4f3cf-77b4-4ef4-90bf-6fa827173cc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:18:40.468502 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 749/1486] 10.222.0.21 () {58 vars in 1023 bytes} [Wed May 4 07:18:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 07:18:40.506768 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a031680-4f0b-493e-91a1-f261ebc2e7d0 None None] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:18:40.517871 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a031680-4f0b-493e-91a1-f261ebc2e7d0 None None] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:18:40.521352 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256aa0bd-7ba5-4602-a6e9-21dace31af2b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91cb92d00273402b837cb29b37325101', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9f9c44db4984653b8d4b5f6b3b949f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:18:40.521978 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256aa0bd-7ba5-4602-a6e9-21dace31af2b service neutron] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:18:40.522250 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256aa0bd-7ba5-4602-a6e9-21dace31af2b service neutron] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:18:40.522517 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256aa0bd-7ba5-4602-a6e9-21dace31af2b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:18:40.531055 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256aa0bd-7ba5-4602-a6e9-21dace31af2b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:18:40.532501 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256aa0bd-7ba5-4602-a6e9-21dace31af2b service neutron] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:18:40.541450 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 738/1487] 10.222.0.21 () {60 vars in 1365 bytes} [Wed May 4 07:18:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 07:18:42.966327 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13cc4a7-0d6e-4cf1-8f2c-4b21f5520814 None None] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:18:42.966927 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13cc4a7-0d6e-4cf1-8f2c-4b21f5520814 None None] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:18:42.966927 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13cc4a7-0d6e-4cf1-8f2c-4b21f5520814 None None] PATH_INFO: `/` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:18:42.968869 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 750/1488] 10.222.0.21 () {54 vars in 926 bytes} [Wed May 4 07:18:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 07:18:42.974165 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149c1d33-046e-4be6-a363-621d1fcfae74 None None] REQUEST_METHOD: `POST` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:18:42.974573 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149c1d33-046e-4be6-a363-621d1fcfae74 None None] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:18:42.974708 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149c1d33-046e-4be6-a363-621d1fcfae74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:18:42.992151 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.auth.core [None req-149c1d33-046e-4be6-a363-621d1fcfae74 None None] MFA Rules not processed for user `83c5e0dcb991496ea6dee38384514508`. Rule list: `[]` (Enabled: `True`). {{(pid=79745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:18:42.993328 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.fernet_utils [None req-149c1d33-046e-4be6-a363-621d1fcfae74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:18:43.001212 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 739/1489] 10.222.0.21 () {58 vars in 1023 bytes} [Wed May 4 07:18:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 07:18:43.041334 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13cc4a7-0d6e-4cf1-8f2c-4b21f5520814 None None] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:18:43.051597 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13cc4a7-0d6e-4cf1-8f2c-4b21f5520814 None None] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:18:43.054990 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd741f8-9868-4a3a-8c03-787b91d57b30 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91cb92d00273402b837cb29b37325101', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9f9c44db4984653b8d4b5f6b3b949f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:18:43.055638 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd741f8-9868-4a3a-8c03-787b91d57b30 service neutron] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:18:43.055912 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd741f8-9868-4a3a-8c03-787b91d57b30 service neutron] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:18:43.056179 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd741f8-9868-4a3a-8c03-787b91d57b30 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:18:43.064786 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd741f8-9868-4a3a-8c03-787b91d57b30 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:18:43.066176 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd741f8-9868-4a3a-8c03-787b91d57b30 service neutron] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:18:43.075506 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 751/1490] 10.222.0.21 () {60 vars in 1365 bytes} [Wed May 4 07:18:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 07:18:45.509545 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922a33df-fc5a-4a9b-a658-63c2cf4406ce None None] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:18:45.510072 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922a33df-fc5a-4a9b-a658-63c2cf4406ce None None] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:18:45.510072 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922a33df-fc5a-4a9b-a658-63c2cf4406ce None None] PATH_INFO: `/` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:18:45.511474 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 740/1491] 10.222.0.21 () {54 vars in 926 bytes} [Wed May 4 07:18:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 07:18:45.516687 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b55494-2484-4e7e-bf3a-8584f5b4dbae None None] REQUEST_METHOD: `POST` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:18:45.517101 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b55494-2484-4e7e-bf3a-8584f5b4dbae None None] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:18:45.517269 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b55494-2484-4e7e-bf3a-8584f5b4dbae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:18:45.538626 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.auth.core [None req-14b55494-2484-4e7e-bf3a-8584f5b4dbae None None] MFA Rules not processed for user `83c5e0dcb991496ea6dee38384514508`. Rule list: `[]` (Enabled: `True`). {{(pid=79744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:18:45.539865 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.fernet_utils [None req-14b55494-2484-4e7e-bf3a-8584f5b4dbae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:18:45.548386 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 752/1492] 10.222.0.21 () {58 vars in 1023 bytes} [Wed May 4 07:18:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 07:18:45.587123 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922a33df-fc5a-4a9b-a658-63c2cf4406ce None None] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:18:45.597971 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922a33df-fc5a-4a9b-a658-63c2cf4406ce None None] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:18:45.601445 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c4d1ba-f407-43db-a1fc-b4f4df37f299 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91cb92d00273402b837cb29b37325101', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9f9c44db4984653b8d4b5f6b3b949f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:18:45.602068 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c4d1ba-f407-43db-a1fc-b4f4df37f299 service neutron] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:18:45.602344 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c4d1ba-f407-43db-a1fc-b4f4df37f299 service neutron] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:18:45.602614 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c4d1ba-f407-43db-a1fc-b4f4df37f299 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:18:45.612038 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c4d1ba-f407-43db-a1fc-b4f4df37f299 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:18:45.613455 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c4d1ba-f407-43db-a1fc-b4f4df37f299 service neutron] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:18:45.622503 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 741/1493] 10.222.0.21 () {60 vars in 1365 bytes} [Wed May 4 07:18:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 07:20:20.656667 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67f7917-a9b1-4c95-961e-22d1d807a3f7 None None] REQUEST_METHOD: `POST` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:20:20.657268 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67f7917-a9b1-4c95-961e-22d1d807a3f7 None None] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:20:20.657373 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67f7917-a9b1-4c95-961e-22d1d807a3f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:20:20.675164 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.auth.core [None req-a67f7917-a9b1-4c95-961e-22d1d807a3f7 None None] MFA Rules not processed for user `83c5e0dcb991496ea6dee38384514508`. Rule list: `[]` (Enabled: `True`). {{(pid=79744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:20:20.676351 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.fernet_utils [None req-a67f7917-a9b1-4c95-961e-22d1d807a3f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:20:20.684547 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 753/1494] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 07:20:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 07:20:20.692544 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93db126c-5c06-4950-bedf-a1dddb8acfe4 None None] REQUEST_METHOD: `POST` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:20:20.693054 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93db126c-5c06-4950-bedf-a1dddb8acfe4 None None] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:20:20.693174 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93db126c-5c06-4950-bedf-a1dddb8acfe4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:20:20.712516 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.auth.core [None req-93db126c-5c06-4950-bedf-a1dddb8acfe4 None None] MFA Rules not processed for user `83c5e0dcb991496ea6dee38384514508`. Rule list: `[]` (Enabled: `True`). {{(pid=79745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:20:20.713969 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.fernet_utils [None req-93db126c-5c06-4950-bedf-a1dddb8acfe4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:20:20.723383 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 742/1495] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 07:20:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 07:20:20.728196 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67f7917-a9b1-4c95-961e-22d1d807a3f7 None None] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:20:20.738711 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67f7917-a9b1-4c95-961e-22d1d807a3f7 None None] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:20:20.743460 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c55077-89fa-4ae1-a16c-abf302a54524 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:20:20.744108 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c55077-89fa-4ae1-a16c-abf302a54524 admin admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:20:20.744386 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c55077-89fa-4ae1-a16c-abf302a54524 admin admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:20:20.744658 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c55077-89fa-4ae1-a16c-abf302a54524 admin admin] PATH_INFO: `/v3/domains` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:20:20.745379 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c55077-89fa-4ae1-a16c-abf302a54524 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79744) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 07:20:20.745735 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c55077-89fa-4ae1-a16c-abf302a54524 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:20:20.746909 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: WARNING py.warnings [None req-60c55077-89fa-4ae1-a16c-abf302a54524 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 04 07:20:20.746909 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: warnings.warn(msg) May 04 07:20:20.746909 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: May 04 07:20:20.747817 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c55077-89fa-4ae1-a16c-abf302a54524 admin admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:20:20.759673 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 754/1496] 10.222.0.21 () {58 vars in 1152 bytes} [Wed May 4 07:20:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 07:20:20.768036 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93db126c-5c06-4950-bedf-a1dddb8acfe4 None None] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:20:20.778769 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93db126c-5c06-4950-bedf-a1dddb8acfe4 None None] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:20:20.783547 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed64026f-fdac-413c-8615-6e5d018514ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:20:20.784198 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed64026f-fdac-413c-8615-6e5d018514ee admin admin] REQUEST_METHOD: `POST` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:20:20.784473 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed64026f-fdac-413c-8615-6e5d018514ee admin admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:20:20.784744 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed64026f-fdac-413c-8615-6e5d018514ee admin admin] PATH_INFO: `/v3/projects` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:20:20.785436 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed64026f-fdac-413c-8615-6e5d018514ee admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:20:20.787229 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: WARNING py.warnings [None req-ed64026f-fdac-413c-8615-6e5d018514ee admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 04 07:20:20.787229 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: warnings.warn(msg) May 04 07:20:20.787229 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: May 04 07:20:20.788426 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed64026f-fdac-413c-8615-6e5d018514ee admin admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:20:20.824606 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 743/1497] 10.222.0.21 () {60 vars in 1152 bytes} [Wed May 4 07:20:20 2022] POST /identity/v3/projects => generated 379 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 07:20:20.829389 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c55077-89fa-4ae1-a16c-abf302a54524 admin admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:20:20.840170 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c55077-89fa-4ae1-a16c-abf302a54524 admin admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:20:20.898573 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672e4fe7-d92f-4192-9981-1dd406a99e0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:20:20.899270 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672e4fe7-d92f-4192-9981-1dd406a99e0f admin admin] REQUEST_METHOD: `POST` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:20:20.899557 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672e4fe7-d92f-4192-9981-1dd406a99e0f admin admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:20:20.899836 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672e4fe7-d92f-4192-9981-1dd406a99e0f admin admin] PATH_INFO: `/v3/users` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:20:20.900543 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672e4fe7-d92f-4192-9981-1dd406a99e0f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:20:20.901543 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: WARNING py.warnings [None req-672e4fe7-d92f-4192-9981-1dd406a99e0f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 04 07:20:20.901543 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: warnings.warn(msg) May 04 07:20:20.901543 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: May 04 07:20:20.903121 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672e4fe7-d92f-4192-9981-1dd406a99e0f admin admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:20:20.923740 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 755/1498] 10.222.0.21 () {60 vars in 1143 bytes} [Wed May 4 07:20:20 2022] POST /identity/v3/users => generated 290 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 07:20:20.927845 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed64026f-fdac-413c-8615-6e5d018514ee admin admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:20:20.938485 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed64026f-fdac-413c-8615-6e5d018514ee admin admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:20:20.942995 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694a80f9-e50b-4952-ad0e-6c35c551b0ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:20:20.943680 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694a80f9-e50b-4952-ad0e-6c35c551b0ad admin admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:20:20.943966 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694a80f9-e50b-4952-ad0e-6c35c551b0ad admin admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:20:20.944235 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694a80f9-e50b-4952-ad0e-6c35c551b0ad admin admin] PATH_INFO: `/v3/roles` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:20:20.944954 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694a80f9-e50b-4952-ad0e-6c35c551b0ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:20:20.945971 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: WARNING py.warnings [None req-694a80f9-e50b-4952-ad0e-6c35c551b0ad admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 04 07:20:20.945971 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: warnings.warn(msg) May 04 07:20:20.945971 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: May 04 07:20:20.946842 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694a80f9-e50b-4952-ad0e-6c35c551b0ad admin admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:20:20.961390 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 744/1499] 10.222.0.21 () {58 vars in 1121 bytes} [Wed May 4 07:20:20 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 07:20:20.965550 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672e4fe7-d92f-4192-9981-1dd406a99e0f admin admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:20:20.976446 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672e4fe7-d92f-4192-9981-1dd406a99e0f admin admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:20:20.981040 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0a9369-0dee-41aa-b925-e540866fd09f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:20:20.981703 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0a9369-0dee-41aa-b925-e540866fd09f admin admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:20:20.981977 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0a9369-0dee-41aa-b925-e540866fd09f admin admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:20:20.982247 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0a9369-0dee-41aa-b925-e540866fd09f admin admin] PATH_INFO: `/v3/roles` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:20:20.982967 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0a9369-0dee-41aa-b925-e540866fd09f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:20:20.983998 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: WARNING py.warnings [None req-af0a9369-0dee-41aa-b925-e540866fd09f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 04 07:20:20.983998 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: warnings.warn(msg) May 04 07:20:20.983998 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: May 04 07:20:20.984889 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0a9369-0dee-41aa-b925-e540866fd09f admin admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:20:21.001600 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 756/1500] 10.222.0.21 () {58 vars in 1121 bytes} [Wed May 4 07:20:20 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 07:20:21.006224 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694a80f9-e50b-4952-ad0e-6c35c551b0ad admin admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:20:21.017210 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694a80f9-e50b-4952-ad0e-6c35c551b0ad admin admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:20:21.021733 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d60daf-3f7b-437d-a77b-b2722824df95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:20:21.022736 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d60daf-3f7b-437d-a77b-b2722824df95 admin admin] REQUEST_METHOD: `PUT` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:20:21.023041 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d60daf-3f7b-437d-a77b-b2722824df95 admin admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:20:21.023353 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d60daf-3f7b-437d-a77b-b2722824df95 admin admin] PATH_INFO: `/v3/projects/a7d62ce77f794354ad76de7b02ed85df/users/eeefaf82997b43b2baf8abd62574080e/roles/9f89c07b05a14f18836116af22cba5f6` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:20:21.040247 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d60daf-3f7b-437d-a77b-b2722824df95 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a7d62ce77f794354ad76de7b02ed85df, user_id=eeefaf82997b43b2baf8abd62574080e, role_id=9f89c07b05a14f18836116af22cba5f6)` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:20:21.041274 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: WARNING py.warnings [None req-52d60daf-3f7b-437d-a77b-b2722824df95 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 04 07:20:21.041274 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: warnings.warn(msg) May 04 07:20:21.041274 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: May 04 07:20:21.043598 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d60daf-3f7b-437d-a77b-b2722824df95 admin admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:20:21.056006 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 745/1501] 10.222.0.21 () {60 vars in 1482 bytes} [Wed May 4 07:20:21 2022] PUT /identity/v3/projects/a7d62ce77f794354ad76de7b02ed85df/users/eeefaf82997b43b2baf8abd62574080e/roles/9f89c07b05a14f18836116af22cba5f6 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 07:20:21.068115 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa60239c-8ddd-417d-9b3d-13e3f638dbbd None None] REQUEST_METHOD: `POST` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:20:21.068404 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa60239c-8ddd-417d-9b3d-13e3f638dbbd None None] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:20:21.068677 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa60239c-8ddd-417d-9b3d-13e3f638dbbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:20:21.094961 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.auth.core [None req-aa60239c-8ddd-417d-9b3d-13e3f638dbbd None None] MFA Rules not processed for user `eeefaf82997b43b2baf8abd62574080e`. Rule list: `[]` (Enabled: `True`). {{(pid=79744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:20:21.096206 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.fernet_utils [None req-aa60239c-8ddd-417d-9b3d-13e3f638dbbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:20:21.169013 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 757/1502] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 07:20:21 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 07:20:21.180648 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d60daf-3f7b-437d-a77b-b2722824df95 admin admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:20:21.247713 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d60daf-3f7b-437d-a77b-b2722824df95 admin admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:20:21.253158 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46fc992-40fc-479e-8105-7dcf84d770f3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1077289fedae43b6be47be7f716d573a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9f9c44db4984653b8d4b5f6b3b949f5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:20:21.253831 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46fc992-40fc-479e-8105-7dcf84d770f3 service nova] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:20:21.254140 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46fc992-40fc-479e-8105-7dcf84d770f3 service nova] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:20:21.254413 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46fc992-40fc-479e-8105-7dcf84d770f3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:20:21.262727 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46fc992-40fc-479e-8105-7dcf84d770f3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:20:21.264334 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46fc992-40fc-479e-8105-7dcf84d770f3 service nova] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:20:21.272888 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 746/1503] 10.222.0.21 () {60 vars in 1365 bytes} [Wed May 4 07:20:21 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 07:20:21.348179 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1f8a3f-8a32-4525-8deb-2fea0f4cc819 None None] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:20:21.348473 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1f8a3f-8a32-4525-8deb-2fea0f4cc819 None None] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:20:21.348757 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1f8a3f-8a32-4525-8deb-2fea0f4cc819 None None] PATH_INFO: `/` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:20:21.350046 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 758/1504] 10.222.0.21 () {52 vars in 829 bytes} [Wed May 4 07:20:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 07:20:21.353571 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46fc992-40fc-479e-8105-7dcf84d770f3 service nova] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:20:21.414976 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46fc992-40fc-479e-8105-7dcf84d770f3 service nova] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:20:21.420097 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0449debd-48a0-4188-bbd4-d50a9cf6ad56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:20:21.420952 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0449debd-48a0-4188-bbd4-d50a9cf6ad56 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:20:21.421231 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0449debd-48a0-4188-bbd4-d50a9cf6ad56 admin admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:20:21.421504 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0449debd-48a0-4188-bbd4-d50a9cf6ad56 admin admin] PATH_INFO: `/v3/users/eeefaf82997b43b2baf8abd62574080e` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:20:21.422682 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0449debd-48a0-4188-bbd4-d50a9cf6ad56 admin admin] RBAC: Authorizing `identity:delete_user(user_id=eeefaf82997b43b2baf8abd62574080e)` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:20:21.423736 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: WARNING py.warnings [None req-0449debd-48a0-4188-bbd4-d50a9cf6ad56 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 04 07:20:21.423736 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: warnings.warn(msg) May 04 07:20:21.423736 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: May 04 07:20:21.424943 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0449debd-48a0-4188-bbd4-d50a9cf6ad56 admin admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:20:21.490202 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-0449debd-48a0-4188-bbd4-d50a9cf6ad56 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eeefaf82997b43b2baf8abd62574080e'} {{(pid=79745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:20:21.509146 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-0449debd-48a0-4188-bbd4-d50a9cf6ad56 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eeefaf82997b43b2baf8abd62574080e'} {{(pid=79745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:20:21.509815 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-0449debd-48a0-4188-bbd4-d50a9cf6ad56 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eeefaf82997b43b2baf8abd62574080e'} {{(pid=79745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:20:21.510538 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-0449debd-48a0-4188-bbd4-d50a9cf6ad56 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eeefaf82997b43b2baf8abd62574080e'} {{(pid=79745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:20:21.523525 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-0449debd-48a0-4188-bbd4-d50a9cf6ad56 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eeefaf82997b43b2baf8abd62574080e'} {{(pid=79745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:20:21.539994 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 747/1505] 10.222.0.21 () {58 vars in 1223 bytes} [Wed May 4 07:20:21 2022] DELETE /identity/v3/users/eeefaf82997b43b2baf8abd62574080e => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 07:20:21.544933 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ffad54-e575-43eb-9d2b-f70deb386962 None None] REQUEST_METHOD: `POST` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:20:21.545218 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ffad54-e575-43eb-9d2b-f70deb386962 None None] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:20:21.545578 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ffad54-e575-43eb-9d2b-f70deb386962 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:20:21.563242 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.auth.core [None req-e1ffad54-e575-43eb-9d2b-f70deb386962 None None] MFA Rules not processed for user `83c5e0dcb991496ea6dee38384514508`. Rule list: `[]` (Enabled: `True`). {{(pid=79744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:20:21.564427 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.fernet_utils [None req-e1ffad54-e575-43eb-9d2b-f70deb386962 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:20:21.621738 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 759/1506] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 07:20:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 07:20:21.632238 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0449debd-48a0-4188-bbd4-d50a9cf6ad56 admin admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:20:21.633898 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.fernet_utils [None req-0449debd-48a0-4188-bbd4-d50a9cf6ad56 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:20:21.693663 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0449debd-48a0-4188-bbd4-d50a9cf6ad56 admin admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:20:21.697417 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb7c317-86d8-40e1-accc-beb8f30a1a09 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91cb92d00273402b837cb29b37325101', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9f9c44db4984653b8d4b5f6b3b949f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:20:21.698065 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb7c317-86d8-40e1-accc-beb8f30a1a09 service neutron] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:20:21.698344 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb7c317-86d8-40e1-accc-beb8f30a1a09 service neutron] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:20:21.698616 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb7c317-86d8-40e1-accc-beb8f30a1a09 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:20:21.708552 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb7c317-86d8-40e1-accc-beb8f30a1a09 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:20:21.709983 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb7c317-86d8-40e1-accc-beb8f30a1a09 service neutron] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:20:21.720561 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 748/1507] 10.222.0.21 () {60 vars in 1365 bytes} [Wed May 4 07:20:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 04 07:20:22.090728 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ffad54-e575-43eb-9d2b-f70deb386962 None None] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:20:22.092286 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.fernet_utils [None req-e1ffad54-e575-43eb-9d2b-f70deb386962 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:20:22.104362 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ffad54-e575-43eb-9d2b-f70deb386962 None None] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:20:22.110309 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30cb1967-4efd-4e5e-a82d-3d4976ae62e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:20:22.111236 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cb1967-4efd-4e5e-a82d-3d4976ae62e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:20:22.111519 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cb1967-4efd-4e5e-a82d-3d4976ae62e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:20:22.112288 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cb1967-4efd-4e5e-a82d-3d4976ae62e6 admin admin] PATH_INFO: `/v3/projects/a7d62ce77f794354ad76de7b02ed85df` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:20:22.113104 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30cb1967-4efd-4e5e-a82d-3d4976ae62e6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a7d62ce77f794354ad76de7b02ed85df)` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:20:22.115047 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: WARNING py.warnings [None req-30cb1967-4efd-4e5e-a82d-3d4976ae62e6 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 04 07:20:22.115047 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: warnings.warn(msg) May 04 07:20:22.115047 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: May 04 07:20:22.116504 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30cb1967-4efd-4e5e-a82d-3d4976ae62e6 admin admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:20:22.176862 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-30cb1967-4efd-4e5e-a82d-3d4976ae62e6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a7d62ce77f794354ad76de7b02ed85df', 'request_id': 'req-30cb1967-4efd-4e5e-a82d-3d4976ae62e6'} {{(pid=79744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:20:22.182953 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-30cb1967-4efd-4e5e-a82d-3d4976ae62e6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a7d62ce77f794354ad76de7b02ed85df', 'request_id': 'req-30cb1967-4efd-4e5e-a82d-3d4976ae62e6'} {{(pid=79744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:20:22.192859 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-30cb1967-4efd-4e5e-a82d-3d4976ae62e6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a7d62ce77f794354ad76de7b02ed85df', 'request_id': 'req-30cb1967-4efd-4e5e-a82d-3d4976ae62e6'} {{(pid=79744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:20:22.214612 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-30cb1967-4efd-4e5e-a82d-3d4976ae62e6 admin admin] The token cache is being invalidate because project a7d62ce77f794354ad76de7b02ed85df was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79744) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 07:20:22.215660 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-30cb1967-4efd-4e5e-a82d-3d4976ae62e6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:20:22.216280 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-30cb1967-4efd-4e5e-a82d-3d4976ae62e6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:20:22.217828 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 760/1508] 10.222.0.21 () {58 vars in 1232 bytes} [Wed May 4 07:20:22 2022] DELETE /identity/v3/projects/a7d62ce77f794354ad76de7b02ed85df => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 07:22:07.489175 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b778fa17-49de-4d77-b774-0ee4c715f570 None None] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:22:07.489730 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b778fa17-49de-4d77-b774-0ee4c715f570 None None] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:22:07.489730 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b778fa17-49de-4d77-b774-0ee4c715f570 None None] PATH_INFO: `/` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:22:07.491074 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 749/1509] 127.0.0.1 () {54 vars in 901 bytes} [Wed May 4 07:22:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 04 07:22:07.495805 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a6db18-5a2b-462f-a095-a0569771ab7b None None] REQUEST_METHOD: `POST` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:22:07.496256 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a6db18-5a2b-462f-a095-a0569771ab7b None None] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:22:07.496366 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a6db18-5a2b-462f-a095-a0569771ab7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:22:07.514352 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.auth.core [None req-f6a6db18-5a2b-462f-a095-a0569771ab7b None None] MFA Rules not processed for user `83c5e0dcb991496ea6dee38384514508`. Rule list: `[]` (Enabled: `True`). {{(pid=79744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:22:07.515571 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.fernet_utils [None req-f6a6db18-5a2b-462f-a095-a0569771ab7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:22:07.572288 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 761/1510] 127.0.0.1 () {58 vars in 998 bytes} [Wed May 4 07:22:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 07:22:07.725653 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b778fa17-49de-4d77-b774-0ee4c715f570 None None] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:22:07.727380 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.fernet_utils [None req-b778fa17-49de-4d77-b774-0ee4c715f570 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:22:07.768181 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0359056a-c2f5-4271-84fa-b045c2521376 None None] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:22:07.768468 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0359056a-c2f5-4271-84fa-b045c2521376 None None] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:22:07.768793 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0359056a-c2f5-4271-84fa-b045c2521376 None None] PATH_INFO: `/v3` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:22:07.770788 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 762/1511] 10.222.0.26 () {54 vars in 925 bytes} [Wed May 4 07:22:07 2022] GET /identity/v3 => generated 255 bytes in 4 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 07:22:07.777395 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0f0070-f05d-4d7c-b7b7-fded3f9b3a31 None None] REQUEST_METHOD: `POST` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:22:07.777780 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0f0070-f05d-4d7c-b7b7-fded3f9b3a31 None None] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:22:07.778069 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0f0070-f05d-4d7c-b7b7-fded3f9b3a31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:22:07.797783 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.auth.core [None req-1e0f0070-f05d-4d7c-b7b7-fded3f9b3a31 None None] MFA Rules not processed for user `ef28e980e8664d3eba4304e4589ea2df`. Rule list: `[]` (Enabled: `True`). {{(pid=79744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:22:07.799066 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.fernet_utils [None req-1e0f0070-f05d-4d7c-b7b7-fded3f9b3a31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:22:07.867078 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 763/1512] 10.222.0.26 () {58 vars in 1015 bytes} [Wed May 4 07:22:07 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 07:22:07.927707 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b778fa17-49de-4d77-b774-0ee4c715f570 None None] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:22:07.933445 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b326d6-3c18-4927-b582-4c9794ffd000 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1077289fedae43b6be47be7f716d573a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9f9c44db4984653b8d4b5f6b3b949f5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:22:07.934129 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b326d6-3c18-4927-b582-4c9794ffd000 service nova] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:22:07.934410 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b326d6-3c18-4927-b582-4c9794ffd000 service nova] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:22:07.934692 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b326d6-3c18-4927-b582-4c9794ffd000 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:22:07.943400 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b326d6-3c18-4927-b582-4c9794ffd000 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:22:07.944985 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b326d6-3c18-4927-b582-4c9794ffd000 service nova] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:22:07.954307 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 750/1513] 10.222.0.21 () {60 vars in 1365 bytes} [Wed May 4 07:22:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 229 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 07:22:09.226795 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6d5bd0-e2d4-4d8c-bd1e-ccbb7fe448d7 None None] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:22:09.227405 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6d5bd0-e2d4-4d8c-bd1e-ccbb7fe448d7 None None] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:22:09.227405 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6d5bd0-e2d4-4d8c-bd1e-ccbb7fe448d7 None None] PATH_INFO: `/` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:22:09.228849 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 764/1514] 127.0.0.1 () {54 vars in 901 bytes} [Wed May 4 07:22:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 07:22:09.233679 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b23ee55-21ff-4f24-9fa2-cf591f0f130b None None] REQUEST_METHOD: `POST` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:22:09.234112 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b23ee55-21ff-4f24-9fa2-cf591f0f130b None None] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:22:09.234229 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b23ee55-21ff-4f24-9fa2-cf591f0f130b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:22:09.252672 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.auth.core [None req-4b23ee55-21ff-4f24-9fa2-cf591f0f130b None None] MFA Rules not processed for user `83c5e0dcb991496ea6dee38384514508`. Rule list: `[]` (Enabled: `True`). {{(pid=79745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:22:09.253938 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.fernet_utils [None req-4b23ee55-21ff-4f24-9fa2-cf591f0f130b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:22:09.263752 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 751/1515] 127.0.0.1 () {58 vars in 998 bytes} [Wed May 4 07:22:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 07:22:09.415851 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6d5bd0-e2d4-4d8c-bd1e-ccbb7fe448d7 None None] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:22:09.430347 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6d5bd0-e2d4-4d8c-bd1e-ccbb7fe448d7 None None] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:22:09.435710 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb4f000-84ac-43dc-8a11-bca1cc838e43 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1077289fedae43b6be47be7f716d573a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9f9c44db4984653b8d4b5f6b3b949f5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:22:09.436338 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb4f000-84ac-43dc-8a11-bca1cc838e43 service nova] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:22:09.436613 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb4f000-84ac-43dc-8a11-bca1cc838e43 service nova] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:22:09.436885 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb4f000-84ac-43dc-8a11-bca1cc838e43 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:22:09.445092 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb4f000-84ac-43dc-8a11-bca1cc838e43 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:22:09.446690 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb4f000-84ac-43dc-8a11-bca1cc838e43 service nova] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:22:09.456276 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 765/1516] 10.222.0.21 () {60 vars in 1365 bytes} [Wed May 4 07:22:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 04 07:22:16.923432 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5a6962-867c-44c7-841f-506e5f37f417 None None] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:22:16.924055 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5a6962-867c-44c7-841f-506e5f37f417 None None] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:22:16.924055 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5a6962-867c-44c7-841f-506e5f37f417 None None] PATH_INFO: `/` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:22:16.925331 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 752/1517] 10.222.0.21 () {54 vars in 960 bytes} [Wed May 4 07:22:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 07:22:16.930523 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72114104-ae87-4a7f-8a37-826b82db2ed6 None None] REQUEST_METHOD: `POST` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:22:16.930993 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72114104-ae87-4a7f-8a37-826b82db2ed6 None None] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:22:16.931104 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72114104-ae87-4a7f-8a37-826b82db2ed6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:22:16.949269 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.auth.core [None req-72114104-ae87-4a7f-8a37-826b82db2ed6 None None] MFA Rules not processed for user `ef28e980e8664d3eba4304e4589ea2df`. Rule list: `[]` (Enabled: `True`). {{(pid=79744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:22:16.950471 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.fernet_utils [None req-72114104-ae87-4a7f-8a37-826b82db2ed6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:22:16.960005 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 766/1518] 10.222.0.21 () {58 vars in 1057 bytes} [Wed May 4 07:22:16 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 07:22:16.967558 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5a6962-867c-44c7-841f-506e5f37f417 None None] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:22:16.980920 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5a6962-867c-44c7-841f-506e5f37f417 None None] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:22:16.985937 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf55d3b-f246-4d8b-ad76-181337ad19a1 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef28e980e8664d3eba4304e4589ea2df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9f9c44db4984653b8d4b5f6b3b949f5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:22:16.986559 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf55d3b-f246-4d8b-ad76-181337ad19a1 service placement] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:22:16.986833 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf55d3b-f246-4d8b-ad76-181337ad19a1 service placement] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:22:16.987102 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf55d3b-f246-4d8b-ad76-181337ad19a1 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:22:16.995707 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf55d3b-f246-4d8b-ad76-181337ad19a1 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:22:16.997275 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf55d3b-f246-4d8b-ad76-181337ad19a1 service placement] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:22:17.008881 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 753/1519] 10.222.0.21 () {60 vars in 1365 bytes} [Wed May 4 07:22:16 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 07:22:21.111401 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03726d05-94f8-4861-a03e-10e9cbb75a02 None None] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:22:21.111880 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03726d05-94f8-4861-a03e-10e9cbb75a02 None None] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:22:21.111981 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03726d05-94f8-4861-a03e-10e9cbb75a02 None None] PATH_INFO: `/` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:22:21.113420 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 767/1520] 127.0.0.1 () {54 vars in 901 bytes} [Wed May 4 07:22:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 07:22:21.118771 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc37d3cf-5291-42f4-acc7-b3895d238dba None None] REQUEST_METHOD: `POST` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:22:21.119269 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc37d3cf-5291-42f4-acc7-b3895d238dba None None] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:22:21.119375 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc37d3cf-5291-42f4-acc7-b3895d238dba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:22:21.138031 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.auth.core [None req-dc37d3cf-5291-42f4-acc7-b3895d238dba None None] MFA Rules not processed for user `83c5e0dcb991496ea6dee38384514508`. Rule list: `[]` (Enabled: `True`). {{(pid=79745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:22:21.139235 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.fernet_utils [None req-dc37d3cf-5291-42f4-acc7-b3895d238dba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:22:21.147599 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 754/1521] 127.0.0.1 () {58 vars in 998 bytes} [Wed May 4 07:22:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 07:22:21.300527 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03726d05-94f8-4861-a03e-10e9cbb75a02 None None] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:22:21.314878 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03726d05-94f8-4861-a03e-10e9cbb75a02 None None] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:22:21.320291 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb50e5d1-7044-4c47-b3bc-9cb690764d76 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1077289fedae43b6be47be7f716d573a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9f9c44db4984653b8d4b5f6b3b949f5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:22:21.320918 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb50e5d1-7044-4c47-b3bc-9cb690764d76 service nova] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:22:21.321198 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb50e5d1-7044-4c47-b3bc-9cb690764d76 service nova] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:22:21.321466 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb50e5d1-7044-4c47-b3bc-9cb690764d76 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:22:21.329488 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb50e5d1-7044-4c47-b3bc-9cb690764d76 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:22:21.331125 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb50e5d1-7044-4c47-b3bc-9cb690764d76 service nova] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:22:21.341476 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 768/1522] 10.222.0.21 () {60 vars in 1365 bytes} [Wed May 4 07:22:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 07:22:22.589264 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f856458-6a96-4224-86b7-ca7f95d44477 None None] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:22:22.589841 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f856458-6a96-4224-86b7-ca7f95d44477 None None] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:22:22.589841 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f856458-6a96-4224-86b7-ca7f95d44477 None None] PATH_INFO: `/` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:22:22.591226 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 755/1523] 127.0.0.1 () {54 vars in 901 bytes} [Wed May 4 07:22:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 07:22:22.596155 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f3ad65-6656-4cef-8c29-82ffb74deb78 None None] REQUEST_METHOD: `POST` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:22:22.596720 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f3ad65-6656-4cef-8c29-82ffb74deb78 None None] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:22:22.596843 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f3ad65-6656-4cef-8c29-82ffb74deb78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:22:22.614813 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.auth.core [None req-30f3ad65-6656-4cef-8c29-82ffb74deb78 None None] MFA Rules not processed for user `83c5e0dcb991496ea6dee38384514508`. Rule list: `[]` (Enabled: `True`). {{(pid=79744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:22:22.616027 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.fernet_utils [None req-30f3ad65-6656-4cef-8c29-82ffb74deb78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:22:22.624365 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 769/1524] 127.0.0.1 () {58 vars in 998 bytes} [Wed May 4 07:22:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 07:22:22.778075 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f856458-6a96-4224-86b7-ca7f95d44477 None None] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:22:22.793067 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f856458-6a96-4224-86b7-ca7f95d44477 None None] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:22:22.798530 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2320ae-9c91-41fc-87ff-acbcb0131bc1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1077289fedae43b6be47be7f716d573a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9f9c44db4984653b8d4b5f6b3b949f5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:22:22.799183 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2320ae-9c91-41fc-87ff-acbcb0131bc1 service nova] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:22:22.799468 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2320ae-9c91-41fc-87ff-acbcb0131bc1 service nova] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:22:22.799739 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2320ae-9c91-41fc-87ff-acbcb0131bc1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:22:22.808257 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2320ae-9c91-41fc-87ff-acbcb0131bc1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:22:22.809873 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2320ae-9c91-41fc-87ff-acbcb0131bc1 service nova] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:22:22.821194 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 756/1525] 10.222.0.21 () {60 vars in 1365 bytes} [Wed May 4 07:22:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 07:22:27.162936 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fc5608-34e8-49c8-8e63-a6e77d827790 None None] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:22:27.163582 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fc5608-34e8-49c8-8e63-a6e77d827790 None None] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:22:27.163582 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fc5608-34e8-49c8-8e63-a6e77d827790 None None] PATH_INFO: `/` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:22:27.164902 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 770/1526] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 4 07:22:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 07:22:27.170721 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e1c510-68f9-4315-9be0-3ff80427a786 None None] REQUEST_METHOD: `POST` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:22:27.171268 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e1c510-68f9-4315-9be0-3ff80427a786 None None] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:22:27.171403 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e1c510-68f9-4315-9be0-3ff80427a786 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:22:27.194423 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.auth.core [None req-83e1c510-68f9-4315-9be0-3ff80427a786 None None] MFA Rules not processed for user `83c5e0dcb991496ea6dee38384514508`. Rule list: `[]` (Enabled: `True`). {{(pid=79745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:22:27.195808 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.fernet_utils [None req-83e1c510-68f9-4315-9be0-3ff80427a786 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:22:27.205059 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 757/1527] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 4 07:22:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 07:22:27.244033 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fc5608-34e8-49c8-8e63-a6e77d827790 None None] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:22:27.246255 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.fernet_utils [None req-72fc5608-34e8-49c8-8e63-a6e77d827790 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:22:27.314708 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fc5608-34e8-49c8-8e63-a6e77d827790 None None] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:22:27.318446 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695776d4-70ea-4a22-b8d6-bb203b2af1bb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91cb92d00273402b837cb29b37325101', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9f9c44db4984653b8d4b5f6b3b949f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:22:27.319097 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695776d4-70ea-4a22-b8d6-bb203b2af1bb service neutron] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:22:27.319439 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695776d4-70ea-4a22-b8d6-bb203b2af1bb service neutron] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:22:27.319805 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695776d4-70ea-4a22-b8d6-bb203b2af1bb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:22:27.330625 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695776d4-70ea-4a22-b8d6-bb203b2af1bb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:22:27.332176 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695776d4-70ea-4a22-b8d6-bb203b2af1bb service neutron] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:22:27.342434 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 771/1528] 10.222.0.21 () {60 vars in 1365 bytes} [Wed May 4 07:22:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 07:22:29.702433 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be0dcb4-584d-403a-8c9f-0d888bd9060d None None] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:22:29.702972 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be0dcb4-584d-403a-8c9f-0d888bd9060d None None] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:22:29.702972 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be0dcb4-584d-403a-8c9f-0d888bd9060d None None] PATH_INFO: `/` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:22:29.704297 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 758/1529] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 4 07:22:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 07:22:29.709655 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6607c61e-dc8d-4459-9086-4dc6fbfa678e None None] REQUEST_METHOD: `POST` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:22:29.710094 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6607c61e-dc8d-4459-9086-4dc6fbfa678e None None] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:22:29.710195 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6607c61e-dc8d-4459-9086-4dc6fbfa678e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:22:29.729185 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.auth.core [None req-6607c61e-dc8d-4459-9086-4dc6fbfa678e None None] MFA Rules not processed for user `83c5e0dcb991496ea6dee38384514508`. Rule list: `[]` (Enabled: `True`). {{(pid=79744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:22:29.730412 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.fernet_utils [None req-6607c61e-dc8d-4459-9086-4dc6fbfa678e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:22:29.738168 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 772/1530] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 4 07:22:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 07:22:29.776628 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be0dcb4-584d-403a-8c9f-0d888bd9060d None None] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:22:29.778380 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.fernet_utils [None req-3be0dcb4-584d-403a-8c9f-0d888bd9060d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:22:29.793795 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be0dcb4-584d-403a-8c9f-0d888bd9060d None None] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:22:29.797812 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57ece22-b089-4bcd-99a0-4fb8ab0f7691 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91cb92d00273402b837cb29b37325101', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9f9c44db4984653b8d4b5f6b3b949f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:22:29.798498 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57ece22-b089-4bcd-99a0-4fb8ab0f7691 service neutron] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:22:29.798782 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57ece22-b089-4bcd-99a0-4fb8ab0f7691 service neutron] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:22:29.799056 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57ece22-b089-4bcd-99a0-4fb8ab0f7691 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:22:29.809831 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57ece22-b089-4bcd-99a0-4fb8ab0f7691 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:22:29.811357 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57ece22-b089-4bcd-99a0-4fb8ab0f7691 service neutron] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:22:29.822066 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 759/1531] 10.222.0.21 () {60 vars in 1365 bytes} [Wed May 4 07:22:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 07:22:33.835877 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8d150e-7e2a-4222-87b5-49cfc789c3ba None None] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:22:33.836455 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8d150e-7e2a-4222-87b5-49cfc789c3ba None None] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:22:33.836455 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8d150e-7e2a-4222-87b5-49cfc789c3ba None None] PATH_INFO: `/` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:22:33.837948 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 773/1532] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 4 07:22:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 04 07:22:33.843667 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f437b6-7f4f-4dcc-b152-e731a337b1cc None None] REQUEST_METHOD: `POST` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:22:33.844213 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f437b6-7f4f-4dcc-b152-e731a337b1cc None None] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:22:33.844213 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f437b6-7f4f-4dcc-b152-e731a337b1cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:22:33.863176 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.auth.core [None req-80f437b6-7f4f-4dcc-b152-e731a337b1cc None None] MFA Rules not processed for user `83c5e0dcb991496ea6dee38384514508`. Rule list: `[]` (Enabled: `True`). {{(pid=79745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:22:33.864360 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.fernet_utils [None req-80f437b6-7f4f-4dcc-b152-e731a337b1cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:22:33.873593 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 760/1533] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 4 07:22:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 07:22:34.155838 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8d150e-7e2a-4222-87b5-49cfc789c3ba None None] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:22:34.157526 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.fernet_utils [None req-7b8d150e-7e2a-4222-87b5-49cfc789c3ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:22:34.216671 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8d150e-7e2a-4222-87b5-49cfc789c3ba None None] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:22:34.220195 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19df103b-3c4f-46dc-86a6-547e6441635c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb341257aa8246b6847561e2fe1fa385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9f9c44db4984653b8d4b5f6b3b949f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:22:34.220832 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19df103b-3c4f-46dc-86a6-547e6441635c service cinder] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:22:34.221128 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19df103b-3c4f-46dc-86a6-547e6441635c service cinder] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:22:34.221380 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19df103b-3c4f-46dc-86a6-547e6441635c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:22:34.230864 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19df103b-3c4f-46dc-86a6-547e6441635c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:22:34.232320 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19df103b-3c4f-46dc-86a6-547e6441635c service cinder] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:22:34.241958 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 774/1534] 10.222.0.21 () {60 vars in 1365 bytes} [Wed May 4 07:22:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 07:22:36.622334 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f88903-1d73-4eb4-9a19-9e2a095ce046 None None] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:22:36.623033 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f88903-1d73-4eb4-9a19-9e2a095ce046 None None] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:22:36.623033 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f88903-1d73-4eb4-9a19-9e2a095ce046 None None] PATH_INFO: `/` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:22:36.624266 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 761/1535] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 4 07:22:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 07:22:36.630208 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335fd48b-bb9a-4b6b-b939-7d829bec08e1 None None] REQUEST_METHOD: `POST` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:22:36.630713 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335fd48b-bb9a-4b6b-b939-7d829bec08e1 None None] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:22:36.630832 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335fd48b-bb9a-4b6b-b939-7d829bec08e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:22:36.654719 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.auth.core [None req-335fd48b-bb9a-4b6b-b939-7d829bec08e1 None None] MFA Rules not processed for user `83c5e0dcb991496ea6dee38384514508`. Rule list: `[]` (Enabled: `True`). {{(pid=79744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:22:36.656834 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.fernet_utils [None req-335fd48b-bb9a-4b6b-b939-7d829bec08e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:22:36.666718 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 775/1536] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 4 07:22:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 07:22:36.970243 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1821c6da-642f-4ab6-a823-8417bf0a117f None None] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:22:36.970531 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1821c6da-642f-4ab6-a823-8417bf0a117f None None] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:22:36.970807 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1821c6da-642f-4ab6-a823-8417bf0a117f None None] PATH_INFO: `/` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:22:36.972231 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 762/1537] 10.222.0.21 () {54 vars in 963 bytes} [Wed May 4 07:22:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 07:22:36.981306 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d9b692-98c9-4fe9-91dd-14a6ed63495b None None] REQUEST_METHOD: `POST` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:22:36.981586 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d9b692-98c9-4fe9-91dd-14a6ed63495b None None] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:22:36.981867 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d9b692-98c9-4fe9-91dd-14a6ed63495b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:22:37.001137 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.auth.core [None req-46d9b692-98c9-4fe9-91dd-14a6ed63495b None None] MFA Rules not processed for user `bb341257aa8246b6847561e2fe1fa385`. Rule list: `[]` (Enabled: `True`). {{(pid=79744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:22:37.002332 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.fernet_utils [None req-46d9b692-98c9-4fe9-91dd-14a6ed63495b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:22:37.015510 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 776/1538] 10.222.0.21 () {58 vars in 1060 bytes} [Wed May 4 07:22:36 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 07:22:37.024056 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1821c6da-642f-4ab6-a823-8417bf0a117f None None] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:22:37.036470 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1821c6da-642f-4ab6-a823-8417bf0a117f None None] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:22:37.040380 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f58caa8-28af-4c10-b9ca-fa28f854e9f2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb341257aa8246b6847561e2fe1fa385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9f9c44db4984653b8d4b5f6b3b949f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:22:37.041034 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f58caa8-28af-4c10-b9ca-fa28f854e9f2 service cinder] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:22:37.041297 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f58caa8-28af-4c10-b9ca-fa28f854e9f2 service cinder] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:22:37.041600 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f58caa8-28af-4c10-b9ca-fa28f854e9f2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:22:37.051140 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f58caa8-28af-4c10-b9ca-fa28f854e9f2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:22:37.052769 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f58caa8-28af-4c10-b9ca-fa28f854e9f2 service cinder] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:22:37.063200 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 763/1539] 10.222.0.21 () {60 vars in 1365 bytes} [Wed May 4 07:22:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 04 07:24:12.160513 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97bb622-9d04-4608-bf82-241f7675be07 None None] REQUEST_METHOD: `POST` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:24:12.161454 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97bb622-9d04-4608-bf82-241f7675be07 None None] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:24:12.161454 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97bb622-9d04-4608-bf82-241f7675be07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:24:12.193935 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.auth.core [None req-a97bb622-9d04-4608-bf82-241f7675be07 None None] MFA Rules not processed for user `83c5e0dcb991496ea6dee38384514508`. Rule list: `[]` (Enabled: `True`). {{(pid=79744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:24:12.195218 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.fernet_utils [None req-a97bb622-9d04-4608-bf82-241f7675be07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:24:12.204453 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 777/1540] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 07:24:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 07:24:12.216955 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fa3b88-6f18-4f1d-879f-5d5affd87d6d None None] REQUEST_METHOD: `POST` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:24:12.218497 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fa3b88-6f18-4f1d-879f-5d5affd87d6d None None] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:24:12.219312 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fa3b88-6f18-4f1d-879f-5d5affd87d6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:24:12.226060 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7864d1-25b1-4444-a821-4bafb097258e None None] REQUEST_METHOD: `POST` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:24:12.226365 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7864d1-25b1-4444-a821-4bafb097258e None None] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:24:12.226602 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7864d1-25b1-4444-a821-4bafb097258e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:24:12.257855 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.auth.core [None req-aa7864d1-25b1-4444-a821-4bafb097258e None None] MFA Rules not processed for user `83c5e0dcb991496ea6dee38384514508`. Rule list: `[]` (Enabled: `True`). {{(pid=79744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:24:12.259997 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.fernet_utils [None req-aa7864d1-25b1-4444-a821-4bafb097258e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:24:12.268316 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.auth.core [None req-d1fa3b88-6f18-4f1d-879f-5d5affd87d6d None None] MFA Rules not processed for user `83c5e0dcb991496ea6dee38384514508`. Rule list: `[]` (Enabled: `True`). {{(pid=79745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:24:12.271286 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.fernet_utils [None req-d1fa3b88-6f18-4f1d-879f-5d5affd87d6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:24:12.275761 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 778/1541] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 07:24:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 07:24:12.286754 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a1718e-9a36-48e9-883d-d36cc928c93d None None] REQUEST_METHOD: `POST` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:24:12.287429 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a1718e-9a36-48e9-883d-d36cc928c93d None None] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:24:12.287960 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a1718e-9a36-48e9-883d-d36cc928c93d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:24:12.310737 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 764/1542] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 07:24:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 07:24:12.310955 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409ba4b1-9bfb-446e-b5c6-60b6d65369e6 None None] REQUEST_METHOD: `POST` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:24:12.311292 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409ba4b1-9bfb-446e-b5c6-60b6d65369e6 None None] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:24:12.311770 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409ba4b1-9bfb-446e-b5c6-60b6d65369e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:24:12.325074 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.auth.core [None req-56a1718e-9a36-48e9-883d-d36cc928c93d None None] MFA Rules not processed for user `83c5e0dcb991496ea6dee38384514508`. Rule list: `[]` (Enabled: `True`). {{(pid=79744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:24:12.326767 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.fernet_utils [None req-56a1718e-9a36-48e9-883d-d36cc928c93d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:24:12.338340 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 779/1543] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 07:24:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 07:24:12.340214 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d3ef55-404c-484f-8f52-3d7e08f31586 None None] REQUEST_METHOD: `POST` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:24:12.340683 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d3ef55-404c-484f-8f52-3d7e08f31586 None None] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:24:12.341152 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d3ef55-404c-484f-8f52-3d7e08f31586 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:24:12.362442 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.auth.core [None req-409ba4b1-9bfb-446e-b5c6-60b6d65369e6 None None] MFA Rules not processed for user `83c5e0dcb991496ea6dee38384514508`. Rule list: `[]` (Enabled: `True`). {{(pid=79745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:24:12.362701 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.fernet_utils [None req-409ba4b1-9bfb-446e-b5c6-60b6d65369e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:24:12.372087 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.auth.core [None req-05d3ef55-404c-484f-8f52-3d7e08f31586 None None] MFA Rules not processed for user `83c5e0dcb991496ea6dee38384514508`. Rule list: `[]` (Enabled: `True`). {{(pid=79744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:24:12.373627 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.fernet_utils [None req-05d3ef55-404c-484f-8f52-3d7e08f31586 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:24:12.387929 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 780/1544] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 07:24:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 07:24:12.389132 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d3ef55-404c-484f-8f52-3d7e08f31586 None None] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:24:12.401980 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 765/1545] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 07:24:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 07:24:12.403505 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409ba4b1-9bfb-446e-b5c6-60b6d65369e6 None None] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:24:12.409661 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d3ef55-404c-484f-8f52-3d7e08f31586 None None] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:24:12.415179 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1236a8ca-00f6-49cd-b85e-2c1f4f1d6bd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:24:12.420531 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1236a8ca-00f6-49cd-b85e-2c1f4f1d6bd7 admin admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:24:12.421074 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1236a8ca-00f6-49cd-b85e-2c1f4f1d6bd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:24:12.421572 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1236a8ca-00f6-49cd-b85e-2c1f4f1d6bd7 admin admin] PATH_INFO: `/v3/domains` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:24:12.422819 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1236a8ca-00f6-49cd-b85e-2c1f4f1d6bd7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79744) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 07:24:12.423326 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1236a8ca-00f6-49cd-b85e-2c1f4f1d6bd7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:24:12.425326 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1236a8ca-00f6-49cd-b85e-2c1f4f1d6bd7 admin admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:24:12.442044 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409ba4b1-9bfb-446e-b5c6-60b6d65369e6 None None] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:24:12.443376 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 781/1546] 10.222.0.21 () {58 vars in 1152 bytes} [Wed May 4 07:24:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 07:24:12.445441 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7458df96-b7aa-4b2b-95a7-2c696a9b12c2 None None] REQUEST_METHOD: `POST` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:24:12.446505 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7458df96-b7aa-4b2b-95a7-2c696a9b12c2 None None] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:24:12.446928 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7458df96-b7aa-4b2b-95a7-2c696a9b12c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:24:12.453999 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8394f8-a152-4b25-b1a9-942f28355abc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:24:12.454816 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8394f8-a152-4b25-b1a9-942f28355abc admin admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:24:12.455072 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8394f8-a152-4b25-b1a9-942f28355abc admin admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:24:12.455379 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8394f8-a152-4b25-b1a9-942f28355abc admin admin] PATH_INFO: `/v3/domains` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:24:12.456124 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8394f8-a152-4b25-b1a9-942f28355abc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 07:24:12.456428 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8394f8-a152-4b25-b1a9-942f28355abc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:24:12.457538 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: WARNING py.warnings [None req-fd8394f8-a152-4b25-b1a9-942f28355abc admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 04 07:24:12.457538 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: warnings.warn(msg) May 04 07:24:12.457538 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: May 04 07:24:12.458630 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8394f8-a152-4b25-b1a9-942f28355abc admin admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:24:12.483853 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 766/1547] 10.222.0.21 () {58 vars in 1152 bytes} [Wed May 4 07:24:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 07:24:12.485585 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d39429-10b2-4d88-a435-4d3301fe0f14 None None] REQUEST_METHOD: `POST` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:24:12.485879 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d39429-10b2-4d88-a435-4d3301fe0f14 None None] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:24:12.486725 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d39429-10b2-4d88-a435-4d3301fe0f14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:24:12.518582 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.auth.core [None req-7458df96-b7aa-4b2b-95a7-2c696a9b12c2 None None] MFA Rules not processed for user `83c5e0dcb991496ea6dee38384514508`. Rule list: `[]` (Enabled: `True`). {{(pid=79744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:24:12.519832 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.fernet_utils [None req-7458df96-b7aa-4b2b-95a7-2c696a9b12c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:24:12.523302 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.auth.core [None req-56d39429-10b2-4d88-a435-4d3301fe0f14 None None] MFA Rules not processed for user `83c5e0dcb991496ea6dee38384514508`. Rule list: `[]` (Enabled: `True`). {{(pid=79745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:24:12.524682 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.fernet_utils [None req-56d39429-10b2-4d88-a435-4d3301fe0f14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:24:12.533061 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 782/1548] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 07:24:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 07:24:12.534512 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58df614-9015-4882-b8fe-6b6e95f32bc2 None None] REQUEST_METHOD: `POST` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:24:12.534795 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58df614-9015-4882-b8fe-6b6e95f32bc2 None None] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:24:12.535066 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58df614-9015-4882-b8fe-6b6e95f32bc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:24:12.537991 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 767/1549] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 07:24:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 07:24:12.540646 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d39429-10b2-4d88-a435-4d3301fe0f14 None None] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:24:12.557370 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d39429-10b2-4d88-a435-4d3301fe0f14 None None] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:24:12.568898 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca92d4e1-0869-4bdd-83aa-0d152e3f1c60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:24:12.570017 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca92d4e1-0869-4bdd-83aa-0d152e3f1c60 admin admin] REQUEST_METHOD: `POST` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:24:12.570315 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca92d4e1-0869-4bdd-83aa-0d152e3f1c60 admin admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:24:12.571608 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca92d4e1-0869-4bdd-83aa-0d152e3f1c60 admin admin] PATH_INFO: `/v3/projects` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:24:12.571872 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca92d4e1-0869-4bdd-83aa-0d152e3f1c60 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:24:12.573144 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.auth.core [None req-b58df614-9015-4882-b8fe-6b6e95f32bc2 None None] MFA Rules not processed for user `83c5e0dcb991496ea6dee38384514508`. Rule list: `[]` (Enabled: `True`). {{(pid=79744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:24:12.573865 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca92d4e1-0869-4bdd-83aa-0d152e3f1c60 admin admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:24:12.574359 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.fernet_utils [None req-b58df614-9015-4882-b8fe-6b6e95f32bc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:24:12.588241 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 783/1550] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 07:24:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 07:24:12.589741 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58df614-9015-4882-b8fe-6b6e95f32bc2 None None] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:24:12.603632 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58df614-9015-4882-b8fe-6b6e95f32bc2 None None] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:24:12.607410 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 768/1551] 10.222.0.21 () {60 vars in 1152 bytes} [Wed May 4 07:24:12 2022] POST /identity/v3/projects => generated 393 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 07:24:12.609105 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dab389b-8c82-404b-8933-3f48e579917a None None] REQUEST_METHOD: `POST` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:24:12.609257 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc927523-0bbc-4505-a1d4-7e0001c2f83d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:24:12.609375 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dab389b-8c82-404b-8933-3f48e579917a None None] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:24:12.609615 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dab389b-8c82-404b-8933-3f48e579917a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:24:12.609864 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc927523-0bbc-4505-a1d4-7e0001c2f83d admin admin] REQUEST_METHOD: `POST` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:24:12.610101 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc927523-0bbc-4505-a1d4-7e0001c2f83d admin admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:24:12.610553 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc927523-0bbc-4505-a1d4-7e0001c2f83d admin admin] PATH_INFO: `/v3/projects` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:24:12.611435 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc927523-0bbc-4505-a1d4-7e0001c2f83d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:24:12.612568 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: WARNING py.warnings [None req-bc927523-0bbc-4505-a1d4-7e0001c2f83d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 04 07:24:12.612568 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: warnings.warn(msg) May 04 07:24:12.612568 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: May 04 07:24:12.613869 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc927523-0bbc-4505-a1d4-7e0001c2f83d admin admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:24:12.630702 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.auth.core [None req-8dab389b-8c82-404b-8933-3f48e579917a None None] MFA Rules not processed for user `83c5e0dcb991496ea6dee38384514508`. Rule list: `[]` (Enabled: `True`). {{(pid=79745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:24:12.632029 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.fernet_utils [None req-8dab389b-8c82-404b-8933-3f48e579917a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:24:12.650831 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 784/1552] 10.222.0.21 () {60 vars in 1152 bytes} [Wed May 4 07:24:12 2022] POST /identity/v3/projects => generated 377 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 07:24:12.652214 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc927523-0bbc-4505-a1d4-7e0001c2f83d admin admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:24:12.705635 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 769/1553] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 07:24:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 07:24:12.707027 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c045de55-0406-40b7-8f33-93abd2251783 None None] REQUEST_METHOD: `POST` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:24:12.707353 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c045de55-0406-40b7-8f33-93abd2251783 None None] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:24:12.707670 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c045de55-0406-40b7-8f33-93abd2251783 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:24:12.727067 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.auth.core [None req-c045de55-0406-40b7-8f33-93abd2251783 None None] MFA Rules not processed for user `83c5e0dcb991496ea6dee38384514508`. Rule list: `[]` (Enabled: `True`). {{(pid=79745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:24:12.728602 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.fernet_utils [None req-c045de55-0406-40b7-8f33-93abd2251783 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:24:12.730122 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc927523-0bbc-4505-a1d4-7e0001c2f83d admin admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:24:12.734773 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182406cb-d49b-46f5-8e87-476a47828555 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:24:12.735485 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182406cb-d49b-46f5-8e87-476a47828555 admin admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:24:12.735767 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182406cb-d49b-46f5-8e87-476a47828555 admin admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:24:12.736045 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182406cb-d49b-46f5-8e87-476a47828555 admin admin] PATH_INFO: `/v3/domains` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:24:12.736534 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 770/1554] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 07:24:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 07:24:12.736867 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182406cb-d49b-46f5-8e87-476a47828555 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79744) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 07:24:12.737180 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182406cb-d49b-46f5-8e87-476a47828555 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:24:12.739894 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182406cb-d49b-46f5-8e87-476a47828555 admin admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:24:12.740928 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fbdf34-607d-47d8-ad6b-bbb4866a51bd None None] REQUEST_METHOD: `POST` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:24:12.741213 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fbdf34-607d-47d8-ad6b-bbb4866a51bd None None] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:24:12.741493 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fbdf34-607d-47d8-ad6b-bbb4866a51bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:24:12.760314 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 785/1555] 10.222.0.21 () {58 vars in 1152 bytes} [Wed May 4 07:24:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 07:24:12.761834 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d3c38f-b249-4d51-9cbb-e0c652efbecd None None] REQUEST_METHOD: `POST` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:24:12.762118 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d3c38f-b249-4d51-9cbb-e0c652efbecd None None] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:24:12.762569 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d3c38f-b249-4d51-9cbb-e0c652efbecd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:24:12.763471 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.auth.core [None req-f7fbdf34-607d-47d8-ad6b-bbb4866a51bd None None] MFA Rules not processed for user `83c5e0dcb991496ea6dee38384514508`. Rule list: `[]` (Enabled: `True`). {{(pid=79745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:24:12.764822 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.fernet_utils [None req-f7fbdf34-607d-47d8-ad6b-bbb4866a51bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:24:12.777131 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 771/1556] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 07:24:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 07:24:12.778886 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7fbdf34-607d-47d8-ad6b-bbb4866a51bd None None] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:24:12.786602 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.auth.core [None req-68d3c38f-b249-4d51-9cbb-e0c652efbecd None None] MFA Rules not processed for user `83c5e0dcb991496ea6dee38384514508`. Rule list: `[]` (Enabled: `True`). {{(pid=79744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:24:12.787893 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.fernet_utils [None req-68d3c38f-b249-4d51-9cbb-e0c652efbecd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:24:12.790114 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7fbdf34-607d-47d8-ad6b-bbb4866a51bd None None] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:24:12.795082 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04222e4e-cc79-42a1-9485-a73256530737 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:24:12.795860 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04222e4e-cc79-42a1-9485-a73256530737 admin admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:24:12.796138 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04222e4e-cc79-42a1-9485-a73256530737 admin admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:24:12.796414 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04222e4e-cc79-42a1-9485-a73256530737 admin admin] PATH_INFO: `/v3/domains` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:24:12.796665 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 786/1557] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 07:24:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 07:24:12.797160 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04222e4e-cc79-42a1-9485-a73256530737 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 07:24:12.797466 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04222e4e-cc79-42a1-9485-a73256530737 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:24:12.797636 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d3c38f-b249-4d51-9cbb-e0c652efbecd None None] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:24:12.799186 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04222e4e-cc79-42a1-9485-a73256530737 admin admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:24:12.807998 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d3c38f-b249-4d51-9cbb-e0c652efbecd None None] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:24:12.813064 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0eab50-4d6c-4740-bbba-08cb7885881f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:24:12.813390 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 772/1558] 10.222.0.21 () {58 vars in 1152 bytes} [Wed May 4 07:24:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 07:24:12.813764 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0eab50-4d6c-4740-bbba-08cb7885881f admin admin] REQUEST_METHOD: `POST` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:24:12.814078 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0eab50-4d6c-4740-bbba-08cb7885881f admin admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:24:12.814269 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04222e4e-cc79-42a1-9485-a73256530737 admin admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:24:12.814432 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0eab50-4d6c-4740-bbba-08cb7885881f admin admin] PATH_INFO: `/v3/users` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:24:12.815116 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0eab50-4d6c-4740-bbba-08cb7885881f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:24:12.817186 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0eab50-4d6c-4740-bbba-08cb7885881f admin admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:24:12.826534 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04222e4e-cc79-42a1-9485-a73256530737 admin admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:24:12.833218 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d235b2e4-2c1d-442e-a0b3-b1e2103effea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:24:12.834169 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d235b2e4-2c1d-442e-a0b3-b1e2103effea admin admin] REQUEST_METHOD: `POST` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:24:12.834386 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d235b2e4-2c1d-442e-a0b3-b1e2103effea admin admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:24:12.834779 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d235b2e4-2c1d-442e-a0b3-b1e2103effea admin admin] PATH_INFO: `/v3/users` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:24:12.835641 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d235b2e4-2c1d-442e-a0b3-b1e2103effea admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:24:12.837519 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: WARNING py.warnings [None req-d235b2e4-2c1d-442e-a0b3-b1e2103effea admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 04 07:24:12.837519 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: warnings.warn(msg) May 04 07:24:12.837519 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: May 04 07:24:12.838746 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d235b2e4-2c1d-442e-a0b3-b1e2103effea admin admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:24:12.843729 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 787/1559] 10.222.0.21 () {60 vars in 1143 bytes} [Wed May 4 07:24:12 2022] POST /identity/v3/users => generated 297 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 07:24:12.848736 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96e1bc1-2a64-4417-9368-ee7e6ac9cd8c None None] REQUEST_METHOD: `POST` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:24:12.848973 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96e1bc1-2a64-4417-9368-ee7e6ac9cd8c None None] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:24:12.849460 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96e1bc1-2a64-4417-9368-ee7e6ac9cd8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:24:12.871715 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.auth.core [None req-f96e1bc1-2a64-4417-9368-ee7e6ac9cd8c None None] MFA Rules not processed for user `83c5e0dcb991496ea6dee38384514508`. Rule list: `[]` (Enabled: `True`). {{(pid=79744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:24:12.873344 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.fernet_utils [None req-f96e1bc1-2a64-4417-9368-ee7e6ac9cd8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:24:12.881857 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 773/1560] 10.222.0.21 () {60 vars in 1143 bytes} [Wed May 4 07:24:12 2022] POST /identity/v3/users => generated 289 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 07:24:12.882572 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 788/1561] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 07:24:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 07:24:12.882718 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d235b2e4-2c1d-442e-a0b3-b1e2103effea admin admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:24:12.887480 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96e1bc1-2a64-4417-9368-ee7e6ac9cd8c None None] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:24:12.894019 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d235b2e4-2c1d-442e-a0b3-b1e2103effea admin admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:24:12.897350 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96e1bc1-2a64-4417-9368-ee7e6ac9cd8c None None] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:24:12.899065 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbd1908-0411-4972-8532-9774e46ca41b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:24:12.899785 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbd1908-0411-4972-8532-9774e46ca41b admin admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:24:12.899952 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbd1908-0411-4972-8532-9774e46ca41b admin admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:24:12.900223 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbd1908-0411-4972-8532-9774e46ca41b admin admin] PATH_INFO: `/v3/domains` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:24:12.900961 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffbd1908-0411-4972-8532-9774e46ca41b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 07:24:12.901266 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffbd1908-0411-4972-8532-9774e46ca41b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:24:12.902058 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5862614e-c3f4-417c-9093-56734bb24933 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:24:12.902727 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5862614e-c3f4-417c-9093-56734bb24933 admin admin] REQUEST_METHOD: `POST` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:24:12.902898 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffbd1908-0411-4972-8532-9774e46ca41b admin admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:24:12.903060 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5862614e-c3f4-417c-9093-56734bb24933 admin admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:24:12.903304 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5862614e-c3f4-417c-9093-56734bb24933 admin admin] PATH_INFO: `/v3/projects` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:24:12.903981 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5862614e-c3f4-417c-9093-56734bb24933 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:24:12.905903 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5862614e-c3f4-417c-9093-56734bb24933 admin admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:24:12.917589 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 774/1562] 10.222.0.21 () {58 vars in 1152 bytes} [Wed May 4 07:24:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 07:24:12.918610 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8f1577-1d10-4f97-96ae-3ec0a4ecb8b1 None None] REQUEST_METHOD: `POST` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:24:12.918899 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8f1577-1d10-4f97-96ae-3ec0a4ecb8b1 None None] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:24:12.919212 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8f1577-1d10-4f97-96ae-3ec0a4ecb8b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:24:12.938058 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 789/1563] 10.222.0.21 () {60 vars in 1152 bytes} [Wed May 4 07:24:12 2022] POST /identity/v3/projects => generated 377 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 07:24:12.939546 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.auth.core [None req-8e8f1577-1d10-4f97-96ae-3ec0a4ecb8b1 None None] MFA Rules not processed for user `83c5e0dcb991496ea6dee38384514508`. Rule list: `[]` (Enabled: `True`). {{(pid=79745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:24:12.940442 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd63ba06-5e5d-416b-9e3a-e4414ed3b079 None None] REQUEST_METHOD: `POST` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:24:12.940776 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.fernet_utils [None req-8e8f1577-1d10-4f97-96ae-3ec0a4ecb8b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:24:12.941587 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd63ba06-5e5d-416b-9e3a-e4414ed3b079 None None] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:24:12.942030 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd63ba06-5e5d-416b-9e3a-e4414ed3b079 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:24:12.964925 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.auth.core [None req-dd63ba06-5e5d-416b-9e3a-e4414ed3b079 None None] MFA Rules not processed for user `83c5e0dcb991496ea6dee38384514508`. Rule list: `[]` (Enabled: `True`). {{(pid=79744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:24:12.966337 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.fernet_utils [None req-dd63ba06-5e5d-416b-9e3a-e4414ed3b079 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:24:13.009657 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 775/1564] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 07:24:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 07:24:13.010028 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8f1577-1d10-4f97-96ae-3ec0a4ecb8b1 None None] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:24:13.021940 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8f1577-1d10-4f97-96ae-3ec0a4ecb8b1 None None] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:24:13.027339 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2931ced5-0aba-4338-9036-c724db33a8bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:24:13.028017 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2931ced5-0aba-4338-9036-c724db33a8bf admin admin] REQUEST_METHOD: `POST` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:24:13.028294 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2931ced5-0aba-4338-9036-c724db33a8bf admin admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:24:13.028564 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2931ced5-0aba-4338-9036-c724db33a8bf admin admin] PATH_INFO: `/v3/projects` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:24:13.029257 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2931ced5-0aba-4338-9036-c724db33a8bf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:24:13.031214 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2931ced5-0aba-4338-9036-c724db33a8bf admin admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:24:13.031557 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 790/1565] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 07:24:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 07:24:13.032504 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd63ba06-5e5d-416b-9e3a-e4414ed3b079 None None] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:24:13.042716 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd63ba06-5e5d-416b-9e3a-e4414ed3b079 None None] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:24:13.047525 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7ae31a-1d36-425d-abe8-4a11c2f6190b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:24:13.048271 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7ae31a-1d36-425d-abe8-4a11c2f6190b admin admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:24:13.048656 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7ae31a-1d36-425d-abe8-4a11c2f6190b admin admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:24:13.049050 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7ae31a-1d36-425d-abe8-4a11c2f6190b admin admin] PATH_INFO: `/v3/roles` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:24:13.049810 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7ae31a-1d36-425d-abe8-4a11c2f6190b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:24:13.051804 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7ae31a-1d36-425d-abe8-4a11c2f6190b admin admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:24:13.066623 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 791/1566] 10.222.0.21 () {58 vars in 1121 bytes} [Wed May 4 07:24:13 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 07:24:13.066623 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7ae31a-1d36-425d-abe8-4a11c2f6190b admin admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:24:13.066940 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 776/1567] 10.222.0.21 () {60 vars in 1152 bytes} [Wed May 4 07:24:13 2022] POST /identity/v3/projects => generated 385 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 07:24:13.066940 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2931ced5-0aba-4338-9036-c724db33a8bf admin admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:24:13.076462 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7ae31a-1d36-425d-abe8-4a11c2f6190b admin admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:24:13.140679 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2931ced5-0aba-4338-9036-c724db33a8bf admin admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:24:13.142782 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88216db9-5c8c-4f41-88fb-2a92dd820fb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:24:13.143504 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88216db9-5c8c-4f41-88fb-2a92dd820fb7 admin admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:24:13.143803 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88216db9-5c8c-4f41-88fb-2a92dd820fb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:24:13.144065 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88216db9-5c8c-4f41-88fb-2a92dd820fb7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:24:13.144811 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88216db9-5c8c-4f41-88fb-2a92dd820fb7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:24:13.145652 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0937a31a-c24e-4d7b-a9b3-f05a4c58f345 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:24:13.146325 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0937a31a-c24e-4d7b-a9b3-f05a4c58f345 admin admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:24:13.146526 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88216db9-5c8c-4f41-88fb-2a92dd820fb7 admin admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:24:13.146638 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0937a31a-c24e-4d7b-a9b3-f05a4c58f345 admin admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:24:13.146858 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0937a31a-c24e-4d7b-a9b3-f05a4c58f345 admin admin] PATH_INFO: `/v3/domains` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:24:13.147635 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0937a31a-c24e-4d7b-a9b3-f05a4c58f345 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 07:24:13.147939 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0937a31a-c24e-4d7b-a9b3-f05a4c58f345 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:24:13.149625 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0937a31a-c24e-4d7b-a9b3-f05a4c58f345 admin admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:24:13.163950 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 792/1568] 10.222.0.21 () {58 vars in 1121 bytes} [Wed May 4 07:24:13 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 07:24:13.163950 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88216db9-5c8c-4f41-88fb-2a92dd820fb7 admin admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:24:13.165994 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 777/1569] 10.222.0.21 () {58 vars in 1152 bytes} [Wed May 4 07:24:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 07:24:13.165994 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0937a31a-c24e-4d7b-a9b3-f05a4c58f345 admin admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:24:13.176355 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0937a31a-c24e-4d7b-a9b3-f05a4c58f345 admin admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:24:13.180924 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88216db9-5c8c-4f41-88fb-2a92dd820fb7 admin admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:24:13.182147 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3114d403-1061-4a9c-b310-8843977fb2f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:24:13.182837 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3114d403-1061-4a9c-b310-8843977fb2f4 admin admin] REQUEST_METHOD: `POST` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:24:13.183177 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3114d403-1061-4a9c-b310-8843977fb2f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:24:13.183501 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3114d403-1061-4a9c-b310-8843977fb2f4 admin admin] PATH_INFO: `/v3/users` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:24:13.184212 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3114d403-1061-4a9c-b310-8843977fb2f4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:24:13.186186 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3114d403-1061-4a9c-b310-8843977fb2f4 admin admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:24:13.186445 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c7cfd8-83c4-4162-8df4-4e27e1ad8dff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:24:13.187129 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c7cfd8-83c4-4162-8df4-4e27e1ad8dff admin admin] REQUEST_METHOD: `POST` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:24:13.187452 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c7cfd8-83c4-4162-8df4-4e27e1ad8dff admin admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:24:13.187725 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c7cfd8-83c4-4162-8df4-4e27e1ad8dff admin admin] PATH_INFO: `/v3/projects` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:24:13.188444 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c7cfd8-83c4-4162-8df4-4e27e1ad8dff admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:24:13.190408 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c7cfd8-83c4-4162-8df4-4e27e1ad8dff admin admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:24:13.214097 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 778/1570] 10.222.0.21 () {60 vars in 1143 bytes} [Wed May 4 07:24:13 2022] POST /identity/v3/users => generated 289 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 07:24:13.214684 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3114d403-1061-4a9c-b310-8843977fb2f4 admin admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:24:13.225603 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3114d403-1061-4a9c-b310-8843977fb2f4 admin admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:24:13.226560 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 793/1571] 10.222.0.21 () {60 vars in 1152 bytes} [Wed May 4 07:24:13 2022] POST /identity/v3/projects => generated 405 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 07:24:13.228825 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c7cfd8-83c4-4162-8df4-4e27e1ad8dff admin admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:24:13.296942 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c7cfd8-83c4-4162-8df4-4e27e1ad8dff admin admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:24:13.301646 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be92c66-8f83-43dc-bf41-3e766796ba99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:24:13.301857 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f424ba0-19ec-4d83-a8f5-f25cb3c85b4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:24:13.302305 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be92c66-8f83-43dc-bf41-3e766796ba99 admin admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:24:13.302479 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f424ba0-19ec-4d83-a8f5-f25cb3c85b4d admin admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:24:13.302665 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be92c66-8f83-43dc-bf41-3e766796ba99 admin admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:24:13.302824 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f424ba0-19ec-4d83-a8f5-f25cb3c85b4d admin admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:24:13.302987 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be92c66-8f83-43dc-bf41-3e766796ba99 admin admin] PATH_INFO: `/v3/domains` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:24:13.303165 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f424ba0-19ec-4d83-a8f5-f25cb3c85b4d admin admin] PATH_INFO: `/v3/domains` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:24:13.303621 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be92c66-8f83-43dc-bf41-3e766796ba99 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 07:24:13.303814 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f424ba0-19ec-4d83-a8f5-f25cb3c85b4d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79744) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 07:24:13.303989 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be92c66-8f83-43dc-bf41-3e766796ba99 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:24:13.304158 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f424ba0-19ec-4d83-a8f5-f25cb3c85b4d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:24:13.306160 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be92c66-8f83-43dc-bf41-3e766796ba99 admin admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:24:13.306402 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f424ba0-19ec-4d83-a8f5-f25cb3c85b4d admin admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:24:13.319035 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 779/1572] 10.222.0.21 () {58 vars in 1152 bytes} [Wed May 4 07:24:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 07:24:13.327482 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 794/1573] 10.222.0.21 () {58 vars in 1152 bytes} [Wed May 4 07:24:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 07:24:13.327482 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f424ba0-19ec-4d83-a8f5-f25cb3c85b4d admin admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:24:13.327808 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be92c66-8f83-43dc-bf41-3e766796ba99 admin admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:24:13.339353 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be92c66-8f83-43dc-bf41-3e766796ba99 admin admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:24:13.341975 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f424ba0-19ec-4d83-a8f5-f25cb3c85b4d admin admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:24:13.344854 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5336e42f-f8fe-4214-92dc-c4b7713fc4ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:24:13.345654 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5336e42f-f8fe-4214-92dc-c4b7713fc4ee admin admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:24:13.346019 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5336e42f-f8fe-4214-92dc-c4b7713fc4ee admin admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:24:13.346433 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5336e42f-f8fe-4214-92dc-c4b7713fc4ee admin admin] PATH_INFO: `/v3/roles` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:24:13.347320 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5336e42f-f8fe-4214-92dc-c4b7713fc4ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:24:13.348422 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8ef842-ac13-4001-9406-87b3d22a0b57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:24:13.349363 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8ef842-ac13-4001-9406-87b3d22a0b57 admin admin] REQUEST_METHOD: `POST` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:24:13.349546 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5336e42f-f8fe-4214-92dc-c4b7713fc4ee admin admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:24:13.349795 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8ef842-ac13-4001-9406-87b3d22a0b57 admin admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:24:13.350260 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8ef842-ac13-4001-9406-87b3d22a0b57 admin admin] PATH_INFO: `/v3/users` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:24:13.351380 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8ef842-ac13-4001-9406-87b3d22a0b57 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:24:13.354812 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8ef842-ac13-4001-9406-87b3d22a0b57 admin admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:24:13.362110 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 780/1574] 10.222.0.21 () {58 vars in 1121 bytes} [Wed May 4 07:24:13 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 07:24:13.363118 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5336e42f-f8fe-4214-92dc-c4b7713fc4ee admin admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:24:13.375975 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5336e42f-f8fe-4214-92dc-c4b7713fc4ee admin admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:24:13.380921 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735afd29-58c2-4187-bfb8-92b0c4c2fc78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:24:13.381603 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735afd29-58c2-4187-bfb8-92b0c4c2fc78 admin admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:24:13.381880 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735afd29-58c2-4187-bfb8-92b0c4c2fc78 admin admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:24:13.382148 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735afd29-58c2-4187-bfb8-92b0c4c2fc78 admin admin] PATH_INFO: `/v3/roles` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:24:13.382865 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735afd29-58c2-4187-bfb8-92b0c4c2fc78 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:24:13.383540 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 795/1575] 10.222.0.21 () {60 vars in 1143 bytes} [Wed May 4 07:24:13 2022] POST /identity/v3/users => generated 293 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 07:24:13.384989 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8ef842-ac13-4001-9406-87b3d22a0b57 admin admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:24:13.385231 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735afd29-58c2-4187-bfb8-92b0c4c2fc78 admin admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:24:13.397751 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 781/1576] 10.222.0.21 () {58 vars in 1121 bytes} [Wed May 4 07:24:13 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 07:24:13.398518 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735afd29-58c2-4187-bfb8-92b0c4c2fc78 admin admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:24:13.404845 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8ef842-ac13-4001-9406-87b3d22a0b57 admin admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:24:13.408939 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735afd29-58c2-4187-bfb8-92b0c4c2fc78 admin admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:24:13.411522 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6be640f-e7c0-40a0-8dcb-7776ef570b60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:24:13.412194 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6be640f-e7c0-40a0-8dcb-7776ef570b60 admin admin] REQUEST_METHOD: `POST` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:24:13.412472 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6be640f-e7c0-40a0-8dcb-7776ef570b60 admin admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:24:13.412792 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6be640f-e7c0-40a0-8dcb-7776ef570b60 admin admin] PATH_INFO: `/v3/projects` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:24:13.413491 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6be640f-e7c0-40a0-8dcb-7776ef570b60 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:24:13.413761 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efd33a2-417d-41f1-8620-2f0c0bec0e4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:24:13.414464 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efd33a2-417d-41f1-8620-2f0c0bec0e4d admin admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:24:13.414740 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efd33a2-417d-41f1-8620-2f0c0bec0e4d admin admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:24:13.415014 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efd33a2-417d-41f1-8620-2f0c0bec0e4d admin admin] PATH_INFO: `/v3/roles` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:24:13.415627 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6be640f-e7c0-40a0-8dcb-7776ef570b60 admin admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:24:13.415769 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8efd33a2-417d-41f1-8620-2f0c0bec0e4d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:24:13.417323 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8efd33a2-417d-41f1-8620-2f0c0bec0e4d admin admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:24:13.427924 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 782/1577] 10.222.0.21 () {58 vars in 1121 bytes} [Wed May 4 07:24:13 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 07:24:13.429106 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efd33a2-417d-41f1-8620-2f0c0bec0e4d admin admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:24:13.440876 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efd33a2-417d-41f1-8620-2f0c0bec0e4d admin admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:24:13.447605 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 796/1578] 10.222.0.21 () {60 vars in 1152 bytes} [Wed May 4 07:24:13 2022] POST /identity/v3/projects => generated 371 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 07:24:13.447605 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6be640f-e7c0-40a0-8dcb-7776ef570b60 admin admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:24:13.451961 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c938d6-771e-4467-b621-1ee2fa88a9cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:24:13.452654 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c938d6-771e-4467-b621-1ee2fa88a9cd admin admin] REQUEST_METHOD: `POST` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:24:13.452941 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c938d6-771e-4467-b621-1ee2fa88a9cd admin admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:24:13.453220 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c938d6-771e-4467-b621-1ee2fa88a9cd admin admin] PATH_INFO: `/v3/users` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:24:13.453939 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c938d6-771e-4467-b621-1ee2fa88a9cd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:24:13.455879 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c938d6-771e-4467-b621-1ee2fa88a9cd admin admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:24:13.477822 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 783/1579] 10.222.0.21 () {60 vars in 1143 bytes} [Wed May 4 07:24:13 2022] POST /identity/v3/users => generated 303 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 07:24:13.478884 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c938d6-771e-4467-b621-1ee2fa88a9cd admin admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:24:13.489118 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c938d6-771e-4467-b621-1ee2fa88a9cd admin admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:24:13.518964 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6be640f-e7c0-40a0-8dcb-7776ef570b60 admin admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:24:13.526384 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e467f3d6-eea0-4c1d-80c0-7986e6a2fb2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:24:13.527189 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e467f3d6-eea0-4c1d-80c0-7986e6a2fb2e admin admin] REQUEST_METHOD: `POST` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:24:13.527479 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e467f3d6-eea0-4c1d-80c0-7986e6a2fb2e admin admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:24:13.527801 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e467f3d6-eea0-4c1d-80c0-7986e6a2fb2e admin admin] PATH_INFO: `/v3/projects` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:24:13.528518 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e467f3d6-eea0-4c1d-80c0-7986e6a2fb2e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:24:13.530449 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e467f3d6-eea0-4c1d-80c0-7986e6a2fb2e admin admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:24:13.550049 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc25fdf3-b0bf-4e91-a806-64dda2979d4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:24:13.550735 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc25fdf3-b0bf-4e91-a806-64dda2979d4e admin admin] REQUEST_METHOD: `POST` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:24:13.551021 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc25fdf3-b0bf-4e91-a806-64dda2979d4e admin admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:24:13.551321 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc25fdf3-b0bf-4e91-a806-64dda2979d4e admin admin] PATH_INFO: `/v3/projects` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:24:13.552022 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc25fdf3-b0bf-4e91-a806-64dda2979d4e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:24:13.553917 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc25fdf3-b0bf-4e91-a806-64dda2979d4e admin admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:24:13.569447 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 797/1580] 10.222.0.21 () {60 vars in 1152 bytes} [Wed May 4 07:24:13 2022] POST /identity/v3/projects => generated 363 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 07:24:13.569447 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e467f3d6-eea0-4c1d-80c0-7986e6a2fb2e admin admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:24:13.581554 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 784/1581] 10.222.0.21 () {60 vars in 1152 bytes} [Wed May 4 07:24:13 2022] POST /identity/v3/projects => generated 373 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 07:24:13.582562 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc25fdf3-b0bf-4e91-a806-64dda2979d4e admin admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:24:13.639051 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e467f3d6-eea0-4c1d-80c0-7986e6a2fb2e admin admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:24:13.652421 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc25fdf3-b0bf-4e91-a806-64dda2979d4e admin admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:24:13.657272 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4dfb0d-9073-463d-9066-daf09a1430b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:24:13.657949 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4dfb0d-9073-463d-9066-daf09a1430b2 admin admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:24:13.658232 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4dfb0d-9073-463d-9066-daf09a1430b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:24:13.658509 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4dfb0d-9073-463d-9066-daf09a1430b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:24:13.659295 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4dfb0d-9073-463d-9066-daf09a1430b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:24:13.660897 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4dfb0d-9073-463d-9066-daf09a1430b2 admin admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:24:13.672422 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 785/1582] 10.222.0.21 () {58 vars in 1121 bytes} [Wed May 4 07:24:13 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 07:24:13.673353 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4dfb0d-9073-463d-9066-daf09a1430b2 admin admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:24:13.684788 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4dfb0d-9073-463d-9066-daf09a1430b2 admin admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:24:13.689559 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc426ff-9354-4c35-867e-2277c7bf6c18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:24:13.690584 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc426ff-9354-4c35-867e-2277c7bf6c18 admin admin] REQUEST_METHOD: `PUT` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:24:13.690871 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc426ff-9354-4c35-867e-2277c7bf6c18 admin admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:24:13.691164 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc426ff-9354-4c35-867e-2277c7bf6c18 admin admin] PATH_INFO: `/v3/projects/2fc5d661ed384c7bacc40c58b18c0b8b/users/a3a8add267e0435fa6e61eb3e65257de/roles/9f89c07b05a14f18836116af22cba5f6` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:24:13.699362 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c272f3f-f23d-4625-ad09-7a600f8f0e3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:24:13.700264 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c272f3f-f23d-4625-ad09-7a600f8f0e3b admin admin] REQUEST_METHOD: `PUT` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:24:13.700545 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c272f3f-f23d-4625-ad09-7a600f8f0e3b admin admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:24:13.700823 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c272f3f-f23d-4625-ad09-7a600f8f0e3b admin admin] PATH_INFO: `/v3/projects/4f0a51ac1da141dba1d58c7ec9c5a15f/users/20497d01a7c34e2eb5a56bfabf95dced/roles/9f89c07b05a14f18836116af22cba5f6` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:24:13.708946 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc426ff-9354-4c35-867e-2277c7bf6c18 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2fc5d661ed384c7bacc40c58b18c0b8b, user_id=a3a8add267e0435fa6e61eb3e65257de, role_id=9f89c07b05a14f18836116af22cba5f6)` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:24:13.711967 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc426ff-9354-4c35-867e-2277c7bf6c18 admin admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:24:13.716551 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c272f3f-f23d-4625-ad09-7a600f8f0e3b admin admin] RBAC: Authorizing `identity:create_grant(project_id=4f0a51ac1da141dba1d58c7ec9c5a15f, user_id=20497d01a7c34e2eb5a56bfabf95dced, role_id=9f89c07b05a14f18836116af22cba5f6)` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:24:13.717786 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: WARNING py.warnings [None req-6c272f3f-f23d-4625-ad09-7a600f8f0e3b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 04 07:24:13.717786 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: warnings.warn(msg) May 04 07:24:13.717786 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: May 04 07:24:13.720106 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c272f3f-f23d-4625-ad09-7a600f8f0e3b admin admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:24:13.725782 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 786/1583] 10.222.0.21 () {60 vars in 1482 bytes} [Wed May 4 07:24:13 2022] PUT /identity/v3/projects/2fc5d661ed384c7bacc40c58b18c0b8b/users/a3a8add267e0435fa6e61eb3e65257de/roles/9f89c07b05a14f18836116af22cba5f6 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 07:24:13.727692 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc426ff-9354-4c35-867e-2277c7bf6c18 admin admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:24:13.746592 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 798/1584] 10.222.0.21 () {60 vars in 1482 bytes} [Wed May 4 07:24:13 2022] PUT /identity/v3/projects/4f0a51ac1da141dba1d58c7ec9c5a15f/users/20497d01a7c34e2eb5a56bfabf95dced/roles/9f89c07b05a14f18836116af22cba5f6 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 07:24:13.746592 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c272f3f-f23d-4625-ad09-7a600f8f0e3b admin admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:24:13.791873 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc426ff-9354-4c35-867e-2277c7bf6c18 admin admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:24:13.847778 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c272f3f-f23d-4625-ad09-7a600f8f0e3b admin admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:24:13.848223 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f258c948-5a40-47c2-97d1-626e5da4a4c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:24:13.849070 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f258c948-5a40-47c2-97d1-626e5da4a4c4 admin admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:24:13.849510 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f258c948-5a40-47c2-97d1-626e5da4a4c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:24:13.849793 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f258c948-5a40-47c2-97d1-626e5da4a4c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:24:13.850535 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f258c948-5a40-47c2-97d1-626e5da4a4c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:24:13.852549 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f258c948-5a40-47c2-97d1-626e5da4a4c4 admin admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:24:13.855590 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f15752c-44bd-4f05-91f1-7509faa839e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:24:13.856670 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f15752c-44bd-4f05-91f1-7509faa839e9 admin admin] REQUEST_METHOD: `POST` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:24:13.857151 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f15752c-44bd-4f05-91f1-7509faa839e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:24:13.857648 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f15752c-44bd-4f05-91f1-7509faa839e9 admin admin] PATH_INFO: `/v3/users` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:24:13.858885 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f15752c-44bd-4f05-91f1-7509faa839e9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:24:13.862379 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f15752c-44bd-4f05-91f1-7509faa839e9 admin admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:24:13.862956 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 787/1585] 10.222.0.21 () {58 vars in 1121 bytes} [Wed May 4 07:24:13 2022] GET /identity/v3/roles => generated 1420 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 07:24:13.862956 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f258c948-5a40-47c2-97d1-626e5da4a4c4 admin admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:24:13.876745 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f258c948-5a40-47c2-97d1-626e5da4a4c4 admin admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:24:13.881948 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2e40c4-a83d-4fdc-80a2-3fa02e6b93ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:24:13.882617 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2e40c4-a83d-4fdc-80a2-3fa02e6b93ea admin admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:24:13.882898 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2e40c4-a83d-4fdc-80a2-3fa02e6b93ea admin admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:24:13.883786 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2e40c4-a83d-4fdc-80a2-3fa02e6b93ea admin admin] PATH_INFO: `/v3/roles` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:24:13.884518 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2e40c4-a83d-4fdc-80a2-3fa02e6b93ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:24:13.886142 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2e40c4-a83d-4fdc-80a2-3fa02e6b93ea admin admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:24:13.890870 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 799/1586] 10.222.0.21 () {60 vars in 1143 bytes} [Wed May 4 07:24:13 2022] POST /identity/v3/users => generated 286 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 07:24:13.890870 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f15752c-44bd-4f05-91f1-7509faa839e9 admin admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:24:13.899710 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 788/1587] 10.222.0.21 () {58 vars in 1121 bytes} [Wed May 4 07:24:13 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 07:24:13.899710 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2e40c4-a83d-4fdc-80a2-3fa02e6b93ea admin admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:24:13.900041 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f15752c-44bd-4f05-91f1-7509faa839e9 admin admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:24:13.904366 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2f8bcd-64aa-4315-9483-b0f25da2dcc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:24:13.905157 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2f8bcd-64aa-4315-9483-b0f25da2dcc9 admin admin] REQUEST_METHOD: `POST` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:24:13.905689 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2f8bcd-64aa-4315-9483-b0f25da2dcc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:24:13.913635 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2f8bcd-64aa-4315-9483-b0f25da2dcc9 admin admin] PATH_INFO: `/v3/users` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:24:13.913635 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2f8bcd-64aa-4315-9483-b0f25da2dcc9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:24:13.913940 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2e40c4-a83d-4fdc-80a2-3fa02e6b93ea admin admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:24:13.914034 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2f8bcd-64aa-4315-9483-b0f25da2dcc9 admin admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:24:13.914113 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12973d40-f0c7-461c-a620-b392fe16ceb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:24:13.914113 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12973d40-f0c7-461c-a620-b392fe16ceb9 admin admin] REQUEST_METHOD: `POST` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:24:13.914478 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12973d40-f0c7-461c-a620-b392fe16ceb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:24:13.914638 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12973d40-f0c7-461c-a620-b392fe16ceb9 admin admin] PATH_INFO: `/v3/users` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:24:13.915333 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12973d40-f0c7-461c-a620-b392fe16ceb9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:24:13.917283 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12973d40-f0c7-461c-a620-b392fe16ceb9 admin admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:24:13.930455 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 800/1588] 10.222.0.21 () {60 vars in 1143 bytes} [Wed May 4 07:24:13 2022] POST /identity/v3/users => generated 282 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 07:24:13.931842 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2f8bcd-64aa-4315-9483-b0f25da2dcc9 admin admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:24:13.942183 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2f8bcd-64aa-4315-9483-b0f25da2dcc9 admin admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:24:13.943393 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 789/1589] 10.222.0.21 () {60 vars in 1143 bytes} [Wed May 4 07:24:13 2022] POST /identity/v3/users => generated 287 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 07:24:13.945228 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a9f402-e50f-40d9-998f-297d82c84dc5 None None] REQUEST_METHOD: `POST` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:24:13.947298 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a9f402-e50f-40d9-998f-297d82c84dc5 None None] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:24:13.947794 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a9f402-e50f-40d9-998f-297d82c84dc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:24:13.948941 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c49b92-b8a3-4ae6-a04b-dd0f8a41c8fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:24:13.949615 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c49b92-b8a3-4ae6-a04b-dd0f8a41c8fc admin admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:24:13.949920 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c49b92-b8a3-4ae6-a04b-dd0f8a41c8fc admin admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:24:13.950185 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c49b92-b8a3-4ae6-a04b-dd0f8a41c8fc admin admin] PATH_INFO: `/v3/roles` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:24:13.950916 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c49b92-b8a3-4ae6-a04b-dd0f8a41c8fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:24:13.952751 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c49b92-b8a3-4ae6-a04b-dd0f8a41c8fc admin admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:24:13.967918 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 801/1590] 10.222.0.21 () {58 vars in 1121 bytes} [Wed May 4 07:24:13 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 07:24:13.969293 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c801a6d-47e4-479c-828b-96a97b5c2848 None None] REQUEST_METHOD: `POST` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:24:13.969579 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c801a6d-47e4-479c-828b-96a97b5c2848 None None] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:24:13.969854 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c801a6d-47e4-479c-828b-96a97b5c2848 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:24:13.983702 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.auth.core [None req-c4a9f402-e50f-40d9-998f-297d82c84dc5 None None] MFA Rules not processed for user `a3a8add267e0435fa6e61eb3e65257de`. Rule list: `[]` (Enabled: `True`). {{(pid=79745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:24:13.984940 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.fernet_utils [None req-c4a9f402-e50f-40d9-998f-297d82c84dc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:24:13.987449 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.auth.core [None req-1c801a6d-47e4-479c-828b-96a97b5c2848 None None] MFA Rules not processed for user `83c5e0dcb991496ea6dee38384514508`. Rule list: `[]` (Enabled: `True`). {{(pid=79744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:24:13.988647 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.fernet_utils [None req-1c801a6d-47e4-479c-828b-96a97b5c2848 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:24:13.997134 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 802/1591] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 07:24:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 07:24:13.997946 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c801a6d-47e4-479c-828b-96a97b5c2848 None None] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:24:14.009171 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c801a6d-47e4-479c-828b-96a97b5c2848 None None] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:24:14.014361 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed82b49-375e-412f-8b33-c73cc679d90a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:24:14.015345 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed82b49-375e-412f-8b33-c73cc679d90a admin admin] REQUEST_METHOD: `PUT` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:24:14.015629 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed82b49-375e-412f-8b33-c73cc679d90a admin admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:24:14.015901 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed82b49-375e-412f-8b33-c73cc679d90a admin admin] PATH_INFO: `/v3/projects/c2edc784041949ea978066369bd4aa29/users/9d6690ce7a1448a7b10e619bfddee852/roles/9f89c07b05a14f18836116af22cba5f6` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:24:14.032347 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed82b49-375e-412f-8b33-c73cc679d90a admin admin] RBAC: Authorizing `identity:create_grant(project_id=c2edc784041949ea978066369bd4aa29, user_id=9d6690ce7a1448a7b10e619bfddee852, role_id=9f89c07b05a14f18836116af22cba5f6)` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:24:14.035459 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed82b49-375e-412f-8b33-c73cc679d90a admin admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:24:14.050821 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 803/1592] 10.222.0.21 () {60 vars in 1482 bytes} [Wed May 4 07:24:13 2022] PUT /identity/v3/projects/c2edc784041949ea978066369bd4aa29/users/9d6690ce7a1448a7b10e619bfddee852/roles/9f89c07b05a14f18836116af22cba5f6 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 07:24:14.052143 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed82b49-375e-412f-8b33-c73cc679d90a admin admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:24:14.063251 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 790/1593] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 07:24:13 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 07:24:14.064211 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a9f402-e50f-40d9-998f-297d82c84dc5 None None] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:24:14.077269 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a9f402-e50f-40d9-998f-297d82c84dc5 None None] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:24:14.132856 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed82b49-375e-412f-8b33-c73cc679d90a admin admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:24:14.138876 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eded597b-5ee7-4bc1-875c-bc8bd123dded admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:24:14.139609 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eded597b-5ee7-4bc1-875c-bc8bd123dded admin admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:24:14.139896 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eded597b-5ee7-4bc1-875c-bc8bd123dded admin admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:24:14.140173 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eded597b-5ee7-4bc1-875c-bc8bd123dded admin admin] PATH_INFO: `/v3/roles` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:24:14.140920 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eded597b-5ee7-4bc1-875c-bc8bd123dded admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:24:14.142586 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eded597b-5ee7-4bc1-875c-bc8bd123dded admin admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:24:14.143871 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9546385d-2f8f-4e81-abb0-8089bc1b499c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:24:14.144558 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9546385d-2f8f-4e81-abb0-8089bc1b499c admin admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:24:14.144996 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9546385d-2f8f-4e81-abb0-8089bc1b499c admin admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:24:14.145705 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9546385d-2f8f-4e81-abb0-8089bc1b499c admin admin] PATH_INFO: `/v3/roles` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:24:14.146222 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9546385d-2f8f-4e81-abb0-8089bc1b499c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:24:14.147922 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9546385d-2f8f-4e81-abb0-8089bc1b499c admin admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:24:14.154918 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 804/1594] 10.222.0.21 () {58 vars in 1121 bytes} [Wed May 4 07:24:14 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 07:24:14.155854 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eded597b-5ee7-4bc1-875c-bc8bd123dded admin admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:24:14.160568 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 791/1595] 10.222.0.21 () {58 vars in 1121 bytes} [Wed May 4 07:24:14 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 07:24:14.161515 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9546385d-2f8f-4e81-abb0-8089bc1b499c admin admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:24:14.168309 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eded597b-5ee7-4bc1-875c-bc8bd123dded admin admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:24:14.176271 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0433ec-9846-43e7-845e-d637995098a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:24:14.177075 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0433ec-9846-43e7-845e-d637995098a6 admin admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:24:14.177362 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0433ec-9846-43e7-845e-d637995098a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:24:14.177641 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0433ec-9846-43e7-845e-d637995098a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:24:14.178395 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0433ec-9846-43e7-845e-d637995098a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:24:14.181213 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0433ec-9846-43e7-845e-d637995098a6 admin admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:24:14.182201 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9546385d-2f8f-4e81-abb0-8089bc1b499c admin admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:24:14.186997 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf24c1f-ca07-402d-acfc-397ad2f29fc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:24:14.187754 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf24c1f-ca07-402d-acfc-397ad2f29fc0 admin admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:24:14.188032 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf24c1f-ca07-402d-acfc-397ad2f29fc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:24:14.188302 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf24c1f-ca07-402d-acfc-397ad2f29fc0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:24:14.189119 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf24c1f-ca07-402d-acfc-397ad2f29fc0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:24:14.190705 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf24c1f-ca07-402d-acfc-397ad2f29fc0 admin admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:24:14.192277 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 805/1596] 10.222.0.21 () {58 vars in 1121 bytes} [Wed May 4 07:24:14 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 07:24:14.193300 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0433ec-9846-43e7-845e-d637995098a6 admin admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:24:14.205288 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 792/1597] 10.222.0.21 () {58 vars in 1121 bytes} [Wed May 4 07:24:14 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 07:24:14.205288 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf24c1f-ca07-402d-acfc-397ad2f29fc0 admin admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:24:14.205597 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0433ec-9846-43e7-845e-d637995098a6 admin admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:24:14.209411 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31c9a79-365a-4de3-9fff-32f9ecc12dbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:24:14.210319 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31c9a79-365a-4de3-9fff-32f9ecc12dbd admin admin] REQUEST_METHOD: `PUT` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:24:14.210593 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31c9a79-365a-4de3-9fff-32f9ecc12dbd admin admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:24:14.210868 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31c9a79-365a-4de3-9fff-32f9ecc12dbd admin admin] PATH_INFO: `/v3/projects/0f0c5ea01f6041f8a293df107ceb208e/users/10265d473a5c49e6960740b21114fee1/roles/9f89c07b05a14f18836116af22cba5f6` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:24:14.235256 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31c9a79-365a-4de3-9fff-32f9ecc12dbd admin admin] RBAC: Authorizing `identity:create_grant(project_id=0f0c5ea01f6041f8a293df107ceb208e, user_id=10265d473a5c49e6960740b21114fee1, role_id=9f89c07b05a14f18836116af22cba5f6)` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:24:14.239799 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31c9a79-365a-4de3-9fff-32f9ecc12dbd admin admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:24:14.256353 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 806/1598] 10.222.0.21 () {60 vars in 1482 bytes} [Wed May 4 07:24:14 2022] PUT /identity/v3/projects/0f0c5ea01f6041f8a293df107ceb208e/users/10265d473a5c49e6960740b21114fee1/roles/9f89c07b05a14f18836116af22cba5f6 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 07:24:14.257966 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2063df9-9e7b-47f1-92bf-f0154cf634a8 None None] REQUEST_METHOD: `POST` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:24:14.258336 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2063df9-9e7b-47f1-92bf-f0154cf634a8 None None] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:24:14.258685 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2063df9-9e7b-47f1-92bf-f0154cf634a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:24:14.271139 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf24c1f-ca07-402d-acfc-397ad2f29fc0 admin admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:24:14.276903 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.auth.core [None req-d2063df9-9e7b-47f1-92bf-f0154cf634a8 None None] MFA Rules not processed for user `83c5e0dcb991496ea6dee38384514508`. Rule list: `[]` (Enabled: `True`). {{(pid=79744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:24:14.278143 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.fernet_utils [None req-d2063df9-9e7b-47f1-92bf-f0154cf634a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:24:14.330916 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0e3e21-441d-4df6-8f7d-c97693c824e9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91cb92d00273402b837cb29b37325101', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9f9c44db4984653b8d4b5f6b3b949f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:24:14.331662 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0e3e21-441d-4df6-8f7d-c97693c824e9 service neutron] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:24:14.332100 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0e3e21-441d-4df6-8f7d-c97693c824e9 service neutron] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:24:14.332378 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0e3e21-441d-4df6-8f7d-c97693c824e9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:24:14.345349 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 807/1599] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 07:24:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 07:24:14.346507 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2063df9-9e7b-47f1-92bf-f0154cf634a8 None None] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:24:14.357674 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2063df9-9e7b-47f1-92bf-f0154cf634a8 None None] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:24:14.362948 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d45c3bd-195e-41ae-ae26-6ca6e8046cac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:24:14.363664 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d45c3bd-195e-41ae-ae26-6ca6e8046cac admin admin] REQUEST_METHOD: `POST` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:24:14.363948 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d45c3bd-195e-41ae-ae26-6ca6e8046cac admin admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:24:14.364224 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d45c3bd-195e-41ae-ae26-6ca6e8046cac admin admin] PATH_INFO: `/v3/projects` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:24:14.364937 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d45c3bd-195e-41ae-ae26-6ca6e8046cac admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:24:14.366885 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d45c3bd-195e-41ae-ae26-6ca6e8046cac admin admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:24:14.397369 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 808/1600] 10.222.0.21 () {60 vars in 1152 bytes} [Wed May 4 07:24:14 2022] POST /identity/v3/projects => generated 377 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 07:24:14.399751 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d45c3bd-195e-41ae-ae26-6ca6e8046cac admin admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:24:14.404307 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0e3e21-441d-4df6-8f7d-c97693c824e9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:24:14.406885 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0e3e21-441d-4df6-8f7d-c97693c824e9 service neutron] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:24:14.418297 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 793/1601] 10.222.0.21 () {60 vars in 1365 bytes} [Wed May 4 07:24:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 07:24:14.419451 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0e3e21-441d-4df6-8f7d-c97693c824e9 service neutron] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:24:14.433159 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0e3e21-441d-4df6-8f7d-c97693c824e9 service neutron] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:24:14.498503 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d45c3bd-195e-41ae-ae26-6ca6e8046cac admin admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:24:14.505150 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97dca610-54f6-4388-9734-23466f458cc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:24:14.506278 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97dca610-54f6-4388-9734-23466f458cc0 admin admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:24:14.506778 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97dca610-54f6-4388-9734-23466f458cc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:24:14.507267 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97dca610-54f6-4388-9734-23466f458cc0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:24:14.508602 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97dca610-54f6-4388-9734-23466f458cc0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:24:14.510754 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97dca610-54f6-4388-9734-23466f458cc0 admin admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:24:14.524837 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c52cc2b-49a9-4179-8b41-4d18fa28cb6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:24:14.526297 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c52cc2b-49a9-4179-8b41-4d18fa28cb6f admin admin] REQUEST_METHOD: `PUT` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:24:14.526986 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c52cc2b-49a9-4179-8b41-4d18fa28cb6f admin admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:24:14.527459 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c52cc2b-49a9-4179-8b41-4d18fa28cb6f admin admin] PATH_INFO: `/v3/projects/c6ff4b88e8594f1685564aea41c1e0c3/users/49ff22cc977d44aaa6fcd7962d917a23/roles/9f89c07b05a14f18836116af22cba5f6` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:24:14.528936 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 809/1602] 10.222.0.21 () {58 vars in 1121 bytes} [Wed May 4 07:24:14 2022] GET /identity/v3/roles => generated 1420 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 07:24:14.532114 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97dca610-54f6-4388-9734-23466f458cc0 admin admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:24:14.550429 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97dca610-54f6-4388-9734-23466f458cc0 admin admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:24:14.552355 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c52cc2b-49a9-4179-8b41-4d18fa28cb6f admin admin] RBAC: Authorizing `identity:create_grant(project_id=c6ff4b88e8594f1685564aea41c1e0c3, user_id=49ff22cc977d44aaa6fcd7962d917a23, role_id=9f89c07b05a14f18836116af22cba5f6)` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:24:14.556359 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c52cc2b-49a9-4179-8b41-4d18fa28cb6f admin admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:24:14.559645 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abdf27e-f737-4204-a8d1-d6de3e8aa6ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:24:14.560825 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abdf27e-f737-4204-a8d1-d6de3e8aa6ba admin admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:24:14.561662 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abdf27e-f737-4204-a8d1-d6de3e8aa6ba admin admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:24:14.561818 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abdf27e-f737-4204-a8d1-d6de3e8aa6ba admin admin] PATH_INFO: `/v3/roles` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:24:14.562946 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5abdf27e-f737-4204-a8d1-d6de3e8aa6ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:24:14.567355 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5abdf27e-f737-4204-a8d1-d6de3e8aa6ba admin admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:24:14.576382 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 794/1603] 10.222.0.21 () {60 vars in 1482 bytes} [Wed May 4 07:24:14 2022] PUT /identity/v3/projects/c6ff4b88e8594f1685564aea41c1e0c3/users/49ff22cc977d44aaa6fcd7962d917a23/roles/9f89c07b05a14f18836116af22cba5f6 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 07:24:14.577952 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c52cc2b-49a9-4179-8b41-4d18fa28cb6f admin admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:24:14.582703 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 810/1604] 10.222.0.21 () {58 vars in 1121 bytes} [Wed May 4 07:24:14 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 07:24:14.584003 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104a1e44-c115-4a60-bb19-ca5924218ba1 None None] REQUEST_METHOD: `POST` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:24:14.584435 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104a1e44-c115-4a60-bb19-ca5924218ba1 None None] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:24:14.584726 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104a1e44-c115-4a60-bb19-ca5924218ba1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:24:14.606385 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.auth.core [None req-104a1e44-c115-4a60-bb19-ca5924218ba1 None None] MFA Rules not processed for user `83c5e0dcb991496ea6dee38384514508`. Rule list: `[]` (Enabled: `True`). {{(pid=79744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:24:14.607716 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.fernet_utils [None req-104a1e44-c115-4a60-bb19-ca5924218ba1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:24:14.670073 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c52cc2b-49a9-4179-8b41-4d18fa28cb6f admin admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:24:14.681341 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94098300-e2a5-4471-ad99-11d8a0961834 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:24:14.682202 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94098300-e2a5-4471-ad99-11d8a0961834 admin admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:24:14.685441 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94098300-e2a5-4471-ad99-11d8a0961834 admin admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:24:14.685441 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94098300-e2a5-4471-ad99-11d8a0961834 admin admin] PATH_INFO: `/v3/roles` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:24:14.686404 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94098300-e2a5-4471-ad99-11d8a0961834 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:24:14.688412 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94098300-e2a5-4471-ad99-11d8a0961834 admin admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:24:14.697903 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 811/1605] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 07:24:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 07:24:14.699906 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104a1e44-c115-4a60-bb19-ca5924218ba1 None None] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:24:14.717632 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 795/1606] 10.222.0.21 () {58 vars in 1121 bytes} [Wed May 4 07:24:14 2022] GET /identity/v3/roles => generated 1420 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 07:24:14.718864 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94098300-e2a5-4471-ad99-11d8a0961834 admin admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:24:14.734050 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94098300-e2a5-4471-ad99-11d8a0961834 admin admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:24:14.739810 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b1fe4b-44dc-47d1-8bd1-b385bd848d10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:24:14.740663 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b1fe4b-44dc-47d1-8bd1-b385bd848d10 admin admin] REQUEST_METHOD: `POST` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:24:14.740946 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b1fe4b-44dc-47d1-8bd1-b385bd848d10 admin admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:24:14.741219 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b1fe4b-44dc-47d1-8bd1-b385bd848d10 admin admin] PATH_INFO: `/v3/users` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:24:14.742080 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b1fe4b-44dc-47d1-8bd1-b385bd848d10 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:24:14.744892 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b1fe4b-44dc-47d1-8bd1-b385bd848d10 admin admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:24:14.774059 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 796/1607] 10.222.0.21 () {60 vars in 1143 bytes} [Wed May 4 07:24:14 2022] POST /identity/v3/users => generated 295 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 07:24:14.774059 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b1fe4b-44dc-47d1-8bd1-b385bd848d10 admin admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:24:14.784294 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b1fe4b-44dc-47d1-8bd1-b385bd848d10 admin admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:24:14.791214 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57881061-6c92-4b97-90e5-80fbfbe11d36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:24:14.792808 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57881061-6c92-4b97-90e5-80fbfbe11d36 admin admin] REQUEST_METHOD: `PUT` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:24:14.793110 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57881061-6c92-4b97-90e5-80fbfbe11d36 admin admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:24:14.793241 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104a1e44-c115-4a60-bb19-ca5924218ba1 None None] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:24:14.793403 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57881061-6c92-4b97-90e5-80fbfbe11d36 admin admin] PATH_INFO: `/v3/projects/4e22e157b88649d283774564a0d1768f/users/ef6560b3988541b49295d432e0baaca4/roles/9f89c07b05a14f18836116af22cba5f6` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:24:14.797730 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354d0c82-9d2c-45fc-b932-8a7d1089f05c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91cb92d00273402b837cb29b37325101', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9f9c44db4984653b8d4b5f6b3b949f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:24:14.797992 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354d0c82-9d2c-45fc-b932-8a7d1089f05c service neutron] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:24:14.798146 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354d0c82-9d2c-45fc-b932-8a7d1089f05c service neutron] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:24:14.798334 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354d0c82-9d2c-45fc-b932-8a7d1089f05c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:24:14.810127 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354d0c82-9d2c-45fc-b932-8a7d1089f05c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:24:14.812238 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354d0c82-9d2c-45fc-b932-8a7d1089f05c service neutron] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:24:14.817030 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57881061-6c92-4b97-90e5-80fbfbe11d36 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4e22e157b88649d283774564a0d1768f, user_id=ef6560b3988541b49295d432e0baaca4, role_id=9f89c07b05a14f18836116af22cba5f6)` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:24:14.820309 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57881061-6c92-4b97-90e5-80fbfbe11d36 admin admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:24:14.827006 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 812/1608] 10.222.0.21 () {60 vars in 1365 bytes} [Wed May 4 07:24:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 07:24:14.828002 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354d0c82-9d2c-45fc-b932-8a7d1089f05c service neutron] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:24:14.846326 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354d0c82-9d2c-45fc-b932-8a7d1089f05c service neutron] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:24:14.852557 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 797/1609] 10.222.0.21 () {60 vars in 1482 bytes} [Wed May 4 07:24:14 2022] PUT /identity/v3/projects/4e22e157b88649d283774564a0d1768f/users/ef6560b3988541b49295d432e0baaca4/roles/9f89c07b05a14f18836116af22cba5f6 => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 07:24:14.855451 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e662a2f9-80e7-47bd-9283-1a8c263267fa None None] REQUEST_METHOD: `POST` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:24:14.855451 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e662a2f9-80e7-47bd-9283-1a8c263267fa None None] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:24:14.855788 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e662a2f9-80e7-47bd-9283-1a8c263267fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:24:14.899828 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.auth.core [None req-e662a2f9-80e7-47bd-9283-1a8c263267fa None None] MFA Rules not processed for user `49ff22cc977d44aaa6fcd7962d917a23`. Rule list: `[]` (Enabled: `True`). {{(pid=79745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:24:14.902222 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.fernet_utils [None req-e662a2f9-80e7-47bd-9283-1a8c263267fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:24:14.925005 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efd2397-cfef-48a4-8451-6f867bdabb89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:24:14.926344 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efd2397-cfef-48a4-8451-6f867bdabb89 admin admin] REQUEST_METHOD: `PUT` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:24:14.926676 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efd2397-cfef-48a4-8451-6f867bdabb89 admin admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:24:14.926993 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efd2397-cfef-48a4-8451-6f867bdabb89 admin admin] PATH_INFO: `/v3/projects/96751f9596554a5e95439a67b973ac97/users/b8e46273d48d447599c836534b715d7c/roles/9f89c07b05a14f18836116af22cba5f6` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:24:14.946966 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9efd2397-cfef-48a4-8451-6f867bdabb89 admin admin] RBAC: Authorizing `identity:create_grant(project_id=96751f9596554a5e95439a67b973ac97, user_id=b8e46273d48d447599c836534b715d7c, role_id=9f89c07b05a14f18836116af22cba5f6)` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:24:14.950116 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9efd2397-cfef-48a4-8451-6f867bdabb89 admin admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:24:14.966849 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 813/1610] 10.222.0.21 () {60 vars in 1482 bytes} [Wed May 4 07:24:14 2022] PUT /identity/v3/projects/96751f9596554a5e95439a67b973ac97/users/b8e46273d48d447599c836534b715d7c/roles/9f89c07b05a14f18836116af22cba5f6 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 07:24:14.967866 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efd2397-cfef-48a4-8451-6f867bdabb89 admin admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:24:15.073105 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 798/1611] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 07:24:14 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 07:24:15.074086 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efd2397-cfef-48a4-8451-6f867bdabb89 admin admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:24:15.075069 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e662a2f9-80e7-47bd-9283-1a8c263267fa None None] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:24:15.085081 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13cb7b85-cddd-44f0-8728-4280335adbaf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91cb92d00273402b837cb29b37325101', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9f9c44db4984653b8d4b5f6b3b949f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:24:15.087097 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cb7b85-cddd-44f0-8728-4280335adbaf service neutron] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:24:15.087868 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cb7b85-cddd-44f0-8728-4280335adbaf service neutron] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:24:15.088275 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cb7b85-cddd-44f0-8728-4280335adbaf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:24:15.104518 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e662a2f9-80e7-47bd-9283-1a8c263267fa None None] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:24:15.172958 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542f4c39-0970-4cff-942e-087320dfcfe4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:24:15.174025 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542f4c39-0970-4cff-942e-087320dfcfe4 admin admin] REQUEST_METHOD: `PUT` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:24:15.174543 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542f4c39-0970-4cff-942e-087320dfcfe4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:24:15.174825 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542f4c39-0970-4cff-942e-087320dfcfe4 admin admin] PATH_INFO: `/v3/projects/9356c17c19604e92a3b0fb4578a5fb4f/users/465ffa7cede44b9e87523eb2c2db2dde/roles/9f89c07b05a14f18836116af22cba5f6` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:24:15.194821 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542f4c39-0970-4cff-942e-087320dfcfe4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9356c17c19604e92a3b0fb4578a5fb4f, user_id=465ffa7cede44b9e87523eb2c2db2dde, role_id=9f89c07b05a14f18836116af22cba5f6)` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:24:15.198392 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542f4c39-0970-4cff-942e-087320dfcfe4 admin admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:24:15.220895 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 799/1612] 10.222.0.21 () {60 vars in 1482 bytes} [Wed May 4 07:24:15 2022] PUT /identity/v3/projects/9356c17c19604e92a3b0fb4578a5fb4f/users/465ffa7cede44b9e87523eb2c2db2dde/roles/9f89c07b05a14f18836116af22cba5f6 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 07:24:15.221522 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542f4c39-0970-4cff-942e-087320dfcfe4 admin admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:24:15.278037 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13cb7b85-cddd-44f0-8728-4280335adbaf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:24:15.278037 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13cb7b85-cddd-44f0-8728-4280335adbaf service neutron] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:24:15.302081 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 814/1613] 10.222.0.21 () {60 vars in 1365 bytes} [Wed May 4 07:24:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 07:24:15.304445 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9008c07-0efc-4b03-81ee-0abb76794dc3 None None] REQUEST_METHOD: `POST` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:24:15.306322 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9008c07-0efc-4b03-81ee-0abb76794dc3 None None] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:24:15.306853 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9008c07-0efc-4b03-81ee-0abb76794dc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:24:15.332455 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542f4c39-0970-4cff-942e-087320dfcfe4 admin admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:24:15.342938 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fd4cff-27a7-4376-a5d9-01c729417702 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:24:15.349074 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.auth.core [None req-e9008c07-0efc-4b03-81ee-0abb76794dc3 None None] MFA Rules not processed for user `ef6560b3988541b49295d432e0baaca4`. Rule list: `[]` (Enabled: `True`). {{(pid=79744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:24:15.349403 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fd4cff-27a7-4376-a5d9-01c729417702 admin admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:24:15.349694 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fd4cff-27a7-4376-a5d9-01c729417702 admin admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:24:15.350647 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fd4cff-27a7-4376-a5d9-01c729417702 admin admin] PATH_INFO: `/v3/roles` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:24:15.350854 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.fernet_utils [None req-e9008c07-0efc-4b03-81ee-0abb76794dc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:24:15.352946 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67fd4cff-27a7-4376-a5d9-01c729417702 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:24:15.358252 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67fd4cff-27a7-4376-a5d9-01c729417702 admin admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:24:15.381404 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 800/1614] 10.222.0.21 () {58 vars in 1121 bytes} [Wed May 4 07:24:15 2022] GET /identity/v3/roles => generated 1420 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 07:24:15.387474 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c910e8cc-9c35-4ac9-be98-490fc74ed485 None None] REQUEST_METHOD: `POST` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:24:15.387957 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c910e8cc-9c35-4ac9-be98-490fc74ed485 None None] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:24:15.388097 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c910e8cc-9c35-4ac9-be98-490fc74ed485 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:24:15.459165 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.auth.core [None req-c910e8cc-9c35-4ac9-be98-490fc74ed485 None None] MFA Rules not processed for user `b8e46273d48d447599c836534b715d7c`. Rule list: `[]` (Enabled: `True`). {{(pid=79745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:24:15.460573 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.fernet_utils [None req-c910e8cc-9c35-4ac9-be98-490fc74ed485 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:24:15.485551 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 815/1615] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 07:24:15 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 07:24:15.487118 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9008c07-0efc-4b03-81ee-0abb76794dc3 None None] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:24:15.522328 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9008c07-0efc-4b03-81ee-0abb76794dc3 None None] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:24:15.531654 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00703ad2-06c2-490f-8b1a-96aacafdecec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:24:15.532890 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00703ad2-06c2-490f-8b1a-96aacafdecec admin admin] REQUEST_METHOD: `POST` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:24:15.533265 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00703ad2-06c2-490f-8b1a-96aacafdecec admin admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:24:15.534305 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00703ad2-06c2-490f-8b1a-96aacafdecec admin admin] PATH_INFO: `/v3/projects` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:24:15.535261 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00703ad2-06c2-490f-8b1a-96aacafdecec admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:24:15.537474 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00703ad2-06c2-490f-8b1a-96aacafdecec admin admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:24:15.584817 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 816/1616] 10.222.0.21 () {60 vars in 1152 bytes} [Wed May 4 07:24:15 2022] POST /identity/v3/projects => generated 403 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 07:24:15.588417 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a5ae53-3a63-44d1-8d25-83ebdc4761e6 None None] REQUEST_METHOD: `POST` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:24:15.588793 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a5ae53-3a63-44d1-8d25-83ebdc4761e6 None None] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:24:15.589212 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a5ae53-3a63-44d1-8d25-83ebdc4761e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:24:15.598191 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 801/1617] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 07:24:15 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 07:24:15.600150 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c910e8cc-9c35-4ac9-be98-490fc74ed485 None None] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:24:15.614668 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c910e8cc-9c35-4ac9-be98-490fc74ed485 None None] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:24:15.635514 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.auth.core [None req-a8a5ae53-3a63-44d1-8d25-83ebdc4761e6 None None] MFA Rules not processed for user `465ffa7cede44b9e87523eb2c2db2dde`. Rule list: `[]` (Enabled: `True`). {{(pid=79744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:24:15.637513 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.fernet_utils [None req-a8a5ae53-3a63-44d1-8d25-83ebdc4761e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:24:15.708609 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed8e42c-3d65-4bab-a394-cfd81823e3db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:24:15.709832 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed8e42c-3d65-4bab-a394-cfd81823e3db admin admin] REQUEST_METHOD: `PUT` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:24:15.710296 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed8e42c-3d65-4bab-a394-cfd81823e3db admin admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:24:15.710982 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed8e42c-3d65-4bab-a394-cfd81823e3db admin admin] PATH_INFO: `/v3/projects/ade60cc96c3c4a33a053475a74d6a50f/users/a288b1ec473e46b38c2fe2ee8ede7ae8/roles/eb54c9cea2774a25b1fe8c79724408ee` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:24:15.737123 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed8e42c-3d65-4bab-a394-cfd81823e3db admin admin] RBAC: Authorizing `identity:create_grant(project_id=ade60cc96c3c4a33a053475a74d6a50f, user_id=a288b1ec473e46b38c2fe2ee8ede7ae8, role_id=eb54c9cea2774a25b1fe8c79724408ee)` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:24:15.741053 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed8e42c-3d65-4bab-a394-cfd81823e3db admin admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:24:15.766901 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 802/1618] 10.222.0.21 () {60 vars in 1482 bytes} [Wed May 4 07:24:15 2022] PUT /identity/v3/projects/ade60cc96c3c4a33a053475a74d6a50f/users/a288b1ec473e46b38c2fe2ee8ede7ae8/roles/eb54c9cea2774a25b1fe8c79724408ee => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 07:24:15.769024 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25aef12-2788-4aeb-8b2e-a094a90f7ab9 None None] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:24:15.769302 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25aef12-2788-4aeb-8b2e-a094a90f7ab9 None None] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:24:15.769580 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25aef12-2788-4aeb-8b2e-a094a90f7ab9 None None] PATH_INFO: `/` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:24:15.774715 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 803/1619] 10.222.0.21 () {54 vars in 960 bytes} [Wed May 4 07:24:15 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 07:24:15.780474 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25aef12-2788-4aeb-8b2e-a094a90f7ab9 None None] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:24:15.802091 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 817/1620] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 07:24:15 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 07:24:15.804161 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a5ae53-3a63-44d1-8d25-83ebdc4761e6 None None] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:24:15.835075 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a5ae53-3a63-44d1-8d25-83ebdc4761e6 None None] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:24:15.912183 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25aef12-2788-4aeb-8b2e-a094a90f7ab9 None None] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:24:15.924901 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4541440-81f4-4880-9e7c-1c49f511cc46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:24:15.926448 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4541440-81f4-4880-9e7c-1c49f511cc46 admin admin] REQUEST_METHOD: `POST` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:24:15.927078 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4541440-81f4-4880-9e7c-1c49f511cc46 admin admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:24:15.927738 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4541440-81f4-4880-9e7c-1c49f511cc46 admin admin] PATH_INFO: `/v3/users` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:24:15.929249 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4541440-81f4-4880-9e7c-1c49f511cc46 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:24:15.934234 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4541440-81f4-4880-9e7c-1c49f511cc46 admin admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:24:15.940464 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940e4765-6600-445e-b457-3dd816648ed8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:24:15.941482 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940e4765-6600-445e-b457-3dd816648ed8 admin admin] REQUEST_METHOD: `POST` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:24:15.941922 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940e4765-6600-445e-b457-3dd816648ed8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:24:15.942423 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940e4765-6600-445e-b457-3dd816648ed8 admin admin] PATH_INFO: `/v3/projects` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:24:15.943355 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940e4765-6600-445e-b457-3dd816648ed8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:24:15.946153 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940e4765-6600-445e-b457-3dd816648ed8 admin admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:24:15.973857 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 804/1621] 10.222.0.21 () {60 vars in 1143 bytes} [Wed May 4 07:24:15 2022] POST /identity/v3/users => generated 308 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 07:24:15.975181 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4541440-81f4-4880-9e7c-1c49f511cc46 admin admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:24:15.992748 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4541440-81f4-4880-9e7c-1c49f511cc46 admin admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:24:15.999126 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281445c2-7bc2-44af-8a9f-3d656bd06b26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:24:16.000379 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281445c2-7bc2-44af-8a9f-3d656bd06b26 admin admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:24:16.000668 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281445c2-7bc2-44af-8a9f-3d656bd06b26 admin admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:24:16.001680 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 818/1622] 10.222.0.21 () {60 vars in 1152 bytes} [Wed May 4 07:24:15 2022] POST /identity/v3/projects => generated 363 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 07:24:16.003495 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b35d7f3-1d7a-47af-b5f9-90f0de26b247 None None] REQUEST_METHOD: `POST` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:24:16.003990 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b35d7f3-1d7a-47af-b5f9-90f0de26b247 None None] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:24:16.005418 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281445c2-7bc2-44af-8a9f-3d656bd06b26 admin admin] PATH_INFO: `/v3/roles` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:24:16.006340 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281445c2-7bc2-44af-8a9f-3d656bd06b26 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:24:16.006490 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b35d7f3-1d7a-47af-b5f9-90f0de26b247 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:24:16.009782 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281445c2-7bc2-44af-8a9f-3d656bd06b26 admin admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:24:16.028355 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 805/1623] 10.222.0.21 () {58 vars in 1121 bytes} [Wed May 4 07:24:15 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 07:24:16.030965 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fbe253-bfca-43c2-a7e3-05ed48d8c4c5 None None] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:24:16.032054 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fbe253-bfca-43c2-a7e3-05ed48d8c4c5 None None] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:24:16.032417 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fbe253-bfca-43c2-a7e3-05ed48d8c4c5 None None] PATH_INFO: `/` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:24:16.041878 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 806/1624] 10.222.0.21 () {54 vars in 960 bytes} [Wed May 4 07:24:16 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 07:24:16.043040 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fbe253-bfca-43c2-a7e3-05ed48d8c4c5 None None] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:24:16.066180 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.auth.core [None req-4b35d7f3-1d7a-47af-b5f9-90f0de26b247 None None] MFA Rules not processed for user `1077289fedae43b6be47be7f716d573a`. Rule list: `[]` (Enabled: `True`). {{(pid=79744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:24:16.067490 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.fernet_utils [None req-4b35d7f3-1d7a-47af-b5f9-90f0de26b247 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:24:16.132755 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fbe253-bfca-43c2-a7e3-05ed48d8c4c5 None None] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:24:16.138422 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c9be59-e80a-4fa3-85ae-99849973b981 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:24:16.139267 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c9be59-e80a-4fa3-85ae-99849973b981 admin admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:24:16.139613 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c9be59-e80a-4fa3-85ae-99849973b981 admin admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:24:16.139955 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c9be59-e80a-4fa3-85ae-99849973b981 admin admin] PATH_INFO: `/v3/roles` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:24:16.140965 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c9be59-e80a-4fa3-85ae-99849973b981 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:24:16.143074 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c9be59-e80a-4fa3-85ae-99849973b981 admin admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:24:16.160855 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 807/1625] 10.222.0.21 () {58 vars in 1121 bytes} [Wed May 4 07:24:16 2022] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 07:24:16.162194 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c9be59-e80a-4fa3-85ae-99849973b981 admin admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:24:16.178322 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c9be59-e80a-4fa3-85ae-99849973b981 admin admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:24:16.190221 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10bf36a-de73-455a-9a39-e0c500a5590a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:24:16.192472 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10bf36a-de73-455a-9a39-e0c500a5590a admin admin] REQUEST_METHOD: `POST` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:24:16.192917 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10bf36a-de73-455a-9a39-e0c500a5590a admin admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:24:16.193344 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10bf36a-de73-455a-9a39-e0c500a5590a admin admin] PATH_INFO: `/v3/users` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:24:16.194467 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10bf36a-de73-455a-9a39-e0c500a5590a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:24:16.203816 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10bf36a-de73-455a-9a39-e0c500a5590a admin admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:24:16.257979 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 808/1626] 10.222.0.21 () {60 vars in 1143 bytes} [Wed May 4 07:24:16 2022] POST /identity/v3/users => generated 288 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 07:24:16.259726 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10bf36a-de73-455a-9a39-e0c500a5590a admin admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:24:16.268857 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 819/1627] 10.222.0.21 () {58 vars in 1057 bytes} [Wed May 4 07:24:16 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 266 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 07:24:16.270482 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878c5ff4-7970-4800-bcd4-3fcf10faff27 None None] REQUEST_METHOD: `POST` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:24:16.270864 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878c5ff4-7970-4800-bcd4-3fcf10faff27 None None] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:24:16.271785 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878c5ff4-7970-4800-bcd4-3fcf10faff27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:24:16.284838 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10bf36a-de73-455a-9a39-e0c500a5590a admin admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:24:16.294683 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f254da3f-6e29-450d-b9c3-2179381d3984 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:24:16.296038 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f254da3f-6e29-450d-b9c3-2179381d3984 admin admin] REQUEST_METHOD: `PUT` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:24:16.296803 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f254da3f-6e29-450d-b9c3-2179381d3984 admin admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:24:16.297262 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f254da3f-6e29-450d-b9c3-2179381d3984 admin admin] PATH_INFO: `/v3/projects/ade60cc96c3c4a33a053475a74d6a50f/users/a288b1ec473e46b38c2fe2ee8ede7ae8/roles/eb54c9cea2774a25b1fe8c79724408ee` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:24:16.299845 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f254da3f-6e29-450d-b9c3-2179381d3984 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ade60cc96c3c4a33a053475a74d6a50f, user_id=a288b1ec473e46b38c2fe2ee8ede7ae8, role_id=eb54c9cea2774a25b1fe8c79724408ee)` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:24:16.303015 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.auth.core [None req-878c5ff4-7970-4800-bcd4-3fcf10faff27 None None] MFA Rules not processed for user `1077289fedae43b6be47be7f716d573a`. Rule list: `[]` (Enabled: `True`). {{(pid=79744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:24:16.303730 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f254da3f-6e29-450d-b9c3-2179381d3984 admin admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:24:16.306202 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.fernet_utils [None req-878c5ff4-7970-4800-bcd4-3fcf10faff27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:24:16.319400 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 809/1628] 10.222.0.21 () {60 vars in 1482 bytes} [Wed May 4 07:24:16 2022] PUT /identity/v3/projects/ade60cc96c3c4a33a053475a74d6a50f/users/a288b1ec473e46b38c2fe2ee8ede7ae8/roles/eb54c9cea2774a25b1fe8c79724408ee => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 07:24:16.321519 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f254da3f-6e29-450d-b9c3-2179381d3984 admin admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:24:16.346436 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 820/1629] 10.222.0.21 () {58 vars in 1057 bytes} [Wed May 4 07:24:16 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 07:24:16.348250 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878c5ff4-7970-4800-bcd4-3fcf10faff27 None None] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:24:16.369797 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878c5ff4-7970-4800-bcd4-3fcf10faff27 None None] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:24:16.472405 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f254da3f-6e29-450d-b9c3-2179381d3984 admin admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:24:16.488346 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f79d61-8078-4c3d-99e8-d8c6b62b59b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:24:16.489215 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f79d61-8078-4c3d-99e8-d8c6b62b59b9 admin admin] REQUEST_METHOD: `PUT` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:24:16.489492 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f79d61-8078-4c3d-99e8-d8c6b62b59b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:24:16.489761 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f79d61-8078-4c3d-99e8-d8c6b62b59b9 admin admin] PATH_INFO: `/v3/projects/bfaa7274c9fb4d32997a5748fe58f001/users/b2d79162f68547b3b782c3d40efad491/roles/eb54c9cea2774a25b1fe8c79724408ee` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:24:16.522715 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f79d61-8078-4c3d-99e8-d8c6b62b59b9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bfaa7274c9fb4d32997a5748fe58f001, user_id=b2d79162f68547b3b782c3d40efad491, role_id=eb54c9cea2774a25b1fe8c79724408ee)` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:24:16.527463 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f79d61-8078-4c3d-99e8-d8c6b62b59b9 admin admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:24:16.548977 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d323e878-a715-4bf9-bae1-048fd2a8ed17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:24:16.550063 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d323e878-a715-4bf9-bae1-048fd2a8ed17 admin admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:24:16.550571 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d323e878-a715-4bf9-bae1-048fd2a8ed17 admin admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:24:16.551470 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d323e878-a715-4bf9-bae1-048fd2a8ed17 admin admin] PATH_INFO: `/v3/roles` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:24:16.553508 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d323e878-a715-4bf9-bae1-048fd2a8ed17 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:24:16.555987 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d323e878-a715-4bf9-bae1-048fd2a8ed17 admin admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:24:16.560029 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 810/1630] 10.222.0.21 () {60 vars in 1482 bytes} [Wed May 4 07:24:16 2022] PUT /identity/v3/projects/bfaa7274c9fb4d32997a5748fe58f001/users/b2d79162f68547b3b782c3d40efad491/roles/eb54c9cea2774a25b1fe8c79724408ee => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 07:24:16.561000 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f79d61-8078-4c3d-99e8-d8c6b62b59b9 admin admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:24:16.575241 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 821/1631] 10.222.0.21 () {58 vars in 1121 bytes} [Wed May 4 07:24:16 2022] GET /identity/v3/roles => generated 1420 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 07:24:16.578043 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29ca4ce-1dfc-46dd-84e6-069599202413 None None] REQUEST_METHOD: `POST` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:24:16.578579 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29ca4ce-1dfc-46dd-84e6-069599202413 None None] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:24:16.579101 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29ca4ce-1dfc-46dd-84e6-069599202413 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:24:16.631538 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.auth.core [None req-c29ca4ce-1dfc-46dd-84e6-069599202413 None None] MFA Rules not processed for user `a288b1ec473e46b38c2fe2ee8ede7ae8`. Rule list: `[]` (Enabled: `True`). {{(pid=79744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:24:16.634714 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.fernet_utils [None req-c29ca4ce-1dfc-46dd-84e6-069599202413 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:24:16.765783 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f79d61-8078-4c3d-99e8-d8c6b62b59b9 admin admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:24:16.775807 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 822/1632] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 07:24:16 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 07:24:16.776781 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29ca4ce-1dfc-46dd-84e6-069599202413 None None] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:24:16.793178 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29ca4ce-1dfc-46dd-84e6-069599202413 None None] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:24:16.800589 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7c6ec2-592f-4cc5-bc2c-c6f4ff163634 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1077289fedae43b6be47be7f716d573a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9f9c44db4984653b8d4b5f6b3b949f5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:24:16.802637 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7c6ec2-592f-4cc5-bc2c-c6f4ff163634 service nova] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:24:16.803161 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7c6ec2-592f-4cc5-bc2c-c6f4ff163634 service nova] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:24:16.803621 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7c6ec2-592f-4cc5-bc2c-c6f4ff163634 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:24:16.804558 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e597e62-03c9-4e13-b909-aa9b003524fa service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1077289fedae43b6be47be7f716d573a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9f9c44db4984653b8d4b5f6b3b949f5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:24:16.806469 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e597e62-03c9-4e13-b909-aa9b003524fa service nova] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:24:16.807082 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e597e62-03c9-4e13-b909-aa9b003524fa service nova] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:24:16.807646 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e597e62-03c9-4e13-b909-aa9b003524fa service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:24:16.891643 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7c6ec2-592f-4cc5-bc2c-c6f4ff163634 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:24:16.898495 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7c6ec2-592f-4cc5-bc2c-c6f4ff163634 service nova] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:24:16.920109 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 811/1633] 10.222.0.21 () {60 vars in 1365 bytes} [Wed May 4 07:24:16 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 07:24:16.921065 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7c6ec2-592f-4cc5-bc2c-c6f4ff163634 service nova] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:24:16.941913 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e597e62-03c9-4e13-b909-aa9b003524fa service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:24:16.943907 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e597e62-03c9-4e13-b909-aa9b003524fa service nova] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:24:16.964088 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 823/1634] 10.222.0.21 () {60 vars in 1365 bytes} [Wed May 4 07:24:16 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 07:24:16.965331 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e597e62-03c9-4e13-b909-aa9b003524fa service nova] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:24:17.155842 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e597e62-03c9-4e13-b909-aa9b003524fa service nova] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:24:17.168554 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb1994e-ae07-4b4f-a57b-871cc26087d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:24:17.172189 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb1994e-ae07-4b4f-a57b-871cc26087d8 admin admin] REQUEST_METHOD: `PUT` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:24:17.172592 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb1994e-ae07-4b4f-a57b-871cc26087d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:24:17.172901 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb1994e-ae07-4b4f-a57b-871cc26087d8 admin admin] PATH_INFO: `/v3/projects/1560252c7e25481388f0822dc1a83cd2/users/33ac0c9a9fe443a2a26be6cb0a70bdb2/roles/eb54c9cea2774a25b1fe8c79724408ee` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:24:17.199367 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7c6ec2-592f-4cc5-bc2c-c6f4ff163634 service nova] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:24:17.217420 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d98407e-b646-48d8-acee-17364effdbc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:24:17.219996 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d98407e-b646-48d8-acee-17364effdbc9 admin admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:24:17.220571 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d98407e-b646-48d8-acee-17364effdbc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:24:17.221537 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d98407e-b646-48d8-acee-17364effdbc9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:24:17.223170 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d98407e-b646-48d8-acee-17364effdbc9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:24:17.228221 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d98407e-b646-48d8-acee-17364effdbc9 admin admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:24:17.229974 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb1994e-ae07-4b4f-a57b-871cc26087d8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1560252c7e25481388f0822dc1a83cd2, user_id=33ac0c9a9fe443a2a26be6cb0a70bdb2, role_id=eb54c9cea2774a25b1fe8c79724408ee)` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:24:17.233909 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb1994e-ae07-4b4f-a57b-871cc26087d8 admin admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:24:17.271649 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 824/1635] 10.222.0.21 () {60 vars in 1482 bytes} [Wed May 4 07:24:16 2022] PUT /identity/v3/projects/1560252c7e25481388f0822dc1a83cd2/users/33ac0c9a9fe443a2a26be6cb0a70bdb2/roles/eb54c9cea2774a25b1fe8c79724408ee => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 07:24:17.272515 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb1994e-ae07-4b4f-a57b-871cc26087d8 admin admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:24:17.281745 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 812/1636] 10.222.0.21 () {58 vars in 1121 bytes} [Wed May 4 07:24:16 2022] GET /identity/v3/roles => generated 1420 bytes in 361 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 07:24:17.283659 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d98407e-b646-48d8-acee-17364effdbc9 admin admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:24:17.314721 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d98407e-b646-48d8-acee-17364effdbc9 admin admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:24:17.398144 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a944da9c-5fac-4cce-b6e0-914ce2ec98f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:24:17.399379 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a944da9c-5fac-4cce-b6e0-914ce2ec98f4 admin admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:24:17.399886 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a944da9c-5fac-4cce-b6e0-914ce2ec98f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:24:17.400360 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a944da9c-5fac-4cce-b6e0-914ce2ec98f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:24:17.401356 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a944da9c-5fac-4cce-b6e0-914ce2ec98f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:24:17.403828 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a944da9c-5fac-4cce-b6e0-914ce2ec98f4 admin admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:24:17.420810 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb1994e-ae07-4b4f-a57b-871cc26087d8 admin admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:24:17.421913 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 813/1637] 10.222.0.21 () {58 vars in 1121 bytes} [Wed May 4 07:24:17 2022] GET /identity/v3/roles => generated 1420 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 07:24:17.423426 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a944da9c-5fac-4cce-b6e0-914ce2ec98f4 admin admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:24:17.432773 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06ba09b-a508-42e9-98fa-87788c0f64b1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb341257aa8246b6847561e2fe1fa385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9f9c44db4984653b8d4b5f6b3b949f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:24:17.434033 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06ba09b-a508-42e9-98fa-87788c0f64b1 service cinder] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:24:17.434525 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06ba09b-a508-42e9-98fa-87788c0f64b1 service cinder] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:24:17.435268 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06ba09b-a508-42e9-98fa-87788c0f64b1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:24:17.443444 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a944da9c-5fac-4cce-b6e0-914ce2ec98f4 admin admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:24:17.468764 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe25007c-9d4e-4732-ae28-a537842766ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:24:17.469709 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe25007c-9d4e-4732-ae28-a537842766ca admin admin] REQUEST_METHOD: `PUT` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:24:17.469989 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe25007c-9d4e-4732-ae28-a537842766ca admin admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:24:17.470264 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe25007c-9d4e-4732-ae28-a537842766ca admin admin] PATH_INFO: `/v3/projects/bfaa7274c9fb4d32997a5748fe58f001/users/b2d79162f68547b3b782c3d40efad491/roles/eb54c9cea2774a25b1fe8c79724408ee` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:24:17.495350 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe25007c-9d4e-4732-ae28-a537842766ca admin admin] RBAC: Authorizing `identity:create_grant(project_id=bfaa7274c9fb4d32997a5748fe58f001, user_id=b2d79162f68547b3b782c3d40efad491, role_id=eb54c9cea2774a25b1fe8c79724408ee)` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:24:17.497703 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe25007c-9d4e-4732-ae28-a537842766ca admin admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:24:17.522626 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 814/1638] 10.222.0.21 () {60 vars in 1482 bytes} [Wed May 4 07:24:17 2022] PUT /identity/v3/projects/bfaa7274c9fb4d32997a5748fe58f001/users/b2d79162f68547b3b782c3d40efad491/roles/eb54c9cea2774a25b1fe8c79724408ee => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 07:24:17.523921 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06ba09b-a508-42e9-98fa-87788c0f64b1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:24:17.525634 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06ba09b-a508-42e9-98fa-87788c0f64b1 service cinder] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:24:17.526158 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d491a36-a751-4951-95e8-8d4b6fd3c414 None None] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:24:17.526452 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d491a36-a751-4951-95e8-8d4b6fd3c414 None None] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:24:17.526731 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d491a36-a751-4951-95e8-8d4b6fd3c414 None None] PATH_INFO: `/` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:24:17.535944 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 815/1639] 10.222.0.21 () {54 vars in 912 bytes} [Wed May 4 07:24:17 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 07:24:17.537672 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d491a36-a751-4951-95e8-8d4b6fd3c414 None None] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:24:17.539398 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 825/1640] 10.222.0.21 () {60 vars in 1365 bytes} [Wed May 4 07:24:17 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 267 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 07:24:17.540945 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20532255-3c7f-4be7-b6a2-078021425bc4 None None] REQUEST_METHOD: `POST` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:24:17.541448 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20532255-3c7f-4be7-b6a2-078021425bc4 None None] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:24:17.541965 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20532255-3c7f-4be7-b6a2-078021425bc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:24:17.573931 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.auth.core [None req-20532255-3c7f-4be7-b6a2-078021425bc4 None None] MFA Rules not processed for user `9d6690ce7a1448a7b10e619bfddee852`. Rule list: `[]` (Enabled: `True`). {{(pid=79744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:24:17.575777 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.fernet_utils [None req-20532255-3c7f-4be7-b6a2-078021425bc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:24:17.687964 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 826/1641] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 07:24:17 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 07:24:17.689588 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0d5b0c-88a1-4846-91da-9ed76ea85a6c None None] REQUEST_METHOD: `POST` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:24:17.690056 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0d5b0c-88a1-4846-91da-9ed76ea85a6c None None] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:24:17.690744 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0d5b0c-88a1-4846-91da-9ed76ea85a6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:24:17.714411 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d491a36-a751-4951-95e8-8d4b6fd3c414 None None] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:24:17.725866 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6070b5c2-1e6b-4d22-9abc-3981b9be6e73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:24:17.728886 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6070b5c2-1e6b-4d22-9abc-3981b9be6e73 admin admin] REQUEST_METHOD: `PUT` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:24:17.729511 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6070b5c2-1e6b-4d22-9abc-3981b9be6e73 admin admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:24:17.729906 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6070b5c2-1e6b-4d22-9abc-3981b9be6e73 admin admin] PATH_INFO: `/v3/projects/1560252c7e25481388f0822dc1a83cd2/users/33ac0c9a9fe443a2a26be6cb0a70bdb2/roles/eb54c9cea2774a25b1fe8c79724408ee` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:24:17.732584 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6070b5c2-1e6b-4d22-9abc-3981b9be6e73 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1560252c7e25481388f0822dc1a83cd2, user_id=33ac0c9a9fe443a2a26be6cb0a70bdb2, role_id=eb54c9cea2774a25b1fe8c79724408ee)` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:24:17.736678 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6070b5c2-1e6b-4d22-9abc-3981b9be6e73 admin admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:24:17.750738 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 816/1642] 10.222.0.21 () {60 vars in 1482 bytes} [Wed May 4 07:24:17 2022] PUT /identity/v3/projects/1560252c7e25481388f0822dc1a83cd2/users/33ac0c9a9fe443a2a26be6cb0a70bdb2/roles/eb54c9cea2774a25b1fe8c79724408ee => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 07:24:17.763358 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3ee59e-8858-4908-8030-e27174ee10c3 None None] REQUEST_METHOD: `POST` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:24:17.763707 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3ee59e-8858-4908-8030-e27174ee10c3 None None] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:24:17.764248 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3ee59e-8858-4908-8030-e27174ee10c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:24:17.771001 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.auth.core [None req-6e0d5b0c-88a1-4846-91da-9ed76ea85a6c None None] MFA Rules not processed for user `b2d79162f68547b3b782c3d40efad491`. Rule list: `[]` (Enabled: `True`). {{(pid=79744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:24:17.772891 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.fernet_utils [None req-6e0d5b0c-88a1-4846-91da-9ed76ea85a6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:24:17.787123 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.auth.core [None req-5e3ee59e-8858-4908-8030-e27174ee10c3 None None] MFA Rules not processed for user `1077289fedae43b6be47be7f716d573a`. Rule list: `[]` (Enabled: `True`). {{(pid=79745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:24:17.788399 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.fernet_utils [None req-5e3ee59e-8858-4908-8030-e27174ee10c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:24:17.907271 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 827/1643] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 07:24:17 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 07:24:17.907271 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b22cc4-302d-4058-b596-cf90f0046c22 None None] REQUEST_METHOD: `POST` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:24:17.907271 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b22cc4-302d-4058-b596-cf90f0046c22 None None] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:24:17.907271 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b22cc4-302d-4058-b596-cf90f0046c22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:24:17.952391 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.auth.core [None req-36b22cc4-302d-4058-b596-cf90f0046c22 None None] MFA Rules not processed for user `9d6690ce7a1448a7b10e619bfddee852`. Rule list: `[]` (Enabled: `True`). {{(pid=79744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:24:17.956975 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.fernet_utils [None req-36b22cc4-302d-4058-b596-cf90f0046c22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:24:17.982520 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 817/1644] 10.222.0.21 () {58 vars in 1009 bytes} [Wed May 4 07:24:17 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 07:24:17.988333 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43788215-d25c-4c23-882b-fae1bcb48ff2 None None] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:24:17.988830 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43788215-d25c-4c23-882b-fae1bcb48ff2 None None] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:24:17.989317 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43788215-d25c-4c23-882b-fae1bcb48ff2 None None] PATH_INFO: `/` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:24:17.997872 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 818/1645] 10.222.0.21 () {54 vars in 912 bytes} [Wed May 4 07:24:17 2022] GET /identity => generated 270 bytes in 15 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 07:24:18.000551 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97173ce-123a-4cf6-9b38-41d04ed5330c None None] REQUEST_METHOD: `POST` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:24:18.000839 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97173ce-123a-4cf6-9b38-41d04ed5330c None None] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:24:18.001119 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97173ce-123a-4cf6-9b38-41d04ed5330c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:24:18.060826 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.auth.core [None req-c97173ce-123a-4cf6-9b38-41d04ed5330c None None] MFA Rules not processed for user `33ac0c9a9fe443a2a26be6cb0a70bdb2`. Rule list: `[]` (Enabled: `True`). {{(pid=79745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:24:18.062381 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.fernet_utils [None req-c97173ce-123a-4cf6-9b38-41d04ed5330c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:24:18.093913 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 828/1646] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 07:24:17 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 07:24:18.095528 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b22cc4-302d-4058-b596-cf90f0046c22 None None] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:24:18.214236 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 819/1647] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 07:24:17 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 07:24:18.215903 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32e864e-823d-4814-84ba-801fabb97139 None None] REQUEST_METHOD: `POST` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:24:18.216359 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32e864e-823d-4814-84ba-801fabb97139 None None] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:24:18.216802 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32e864e-823d-4814-84ba-801fabb97139 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:24:18.224763 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b22cc4-302d-4058-b596-cf90f0046c22 None None] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:24:18.235704 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050ebd6e-9874-42f7-ab41-7589026506b2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb341257aa8246b6847561e2fe1fa385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9f9c44db4984653b8d4b5f6b3b949f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:24:18.236681 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050ebd6e-9874-42f7-ab41-7589026506b2 service cinder] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:24:18.238356 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050ebd6e-9874-42f7-ab41-7589026506b2 service cinder] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:24:18.240502 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050ebd6e-9874-42f7-ab41-7589026506b2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:24:18.258445 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.auth.core [None req-a32e864e-823d-4814-84ba-801fabb97139 None None] MFA Rules not processed for user `1077289fedae43b6be47be7f716d573a`. Rule list: `[]` (Enabled: `True`). {{(pid=79745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:24:18.260138 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050ebd6e-9874-42f7-ab41-7589026506b2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:24:18.260978 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.fernet_utils [None req-a32e864e-823d-4814-84ba-801fabb97139 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:24:18.262082 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050ebd6e-9874-42f7-ab41-7589026506b2 service cinder] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:24:18.273940 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 820/1648] 10.222.0.21 () {58 vars in 1009 bytes} [Wed May 4 07:24:18 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 07:24:18.277224 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 829/1649] 10.222.0.21 () {60 vars in 1365 bytes} [Wed May 4 07:24:18 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 07:24:18.384409 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32e864e-823d-4814-84ba-801fabb97139 None None] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:24:18.416485 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32e864e-823d-4814-84ba-801fabb97139 None None] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:24:18.423202 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ede1ba5-c8e7-4025-bab8-b4c90abcc3f7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb341257aa8246b6847561e2fe1fa385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9f9c44db4984653b8d4b5f6b3b949f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:24:18.424788 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ede1ba5-c8e7-4025-bab8-b4c90abcc3f7 service cinder] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:24:18.425490 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ede1ba5-c8e7-4025-bab8-b4c90abcc3f7 service cinder] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:24:18.426063 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ede1ba5-c8e7-4025-bab8-b4c90abcc3f7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:24:18.477380 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ede1ba5-c8e7-4025-bab8-b4c90abcc3f7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:24:18.479124 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ede1ba5-c8e7-4025-bab8-b4c90abcc3f7 service cinder] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:24:18.495312 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 821/1650] 10.222.0.21 () {60 vars in 1365 bytes} [Wed May 4 07:24:18 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 04 07:24:19.070945 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050ebd6e-9874-42f7-ab41-7589026506b2 service cinder] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:24:19.085173 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050ebd6e-9874-42f7-ab41-7589026506b2 service cinder] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:24:19.096274 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9906187-34fb-4530-8277-8f84025b3437 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb341257aa8246b6847561e2fe1fa385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9f9c44db4984653b8d4b5f6b3b949f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:24:19.097013 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9906187-34fb-4530-8277-8f84025b3437 service cinder] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:24:19.097304 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9906187-34fb-4530-8277-8f84025b3437 service cinder] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:24:19.098451 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9906187-34fb-4530-8277-8f84025b3437 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:24:19.135673 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9906187-34fb-4530-8277-8f84025b3437 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:24:19.141825 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9906187-34fb-4530-8277-8f84025b3437 service cinder] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:24:19.171837 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 830/1651] 10.222.0.21 () {60 vars in 1365 bytes} [Wed May 4 07:24:19 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 07:24:19.275336 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ede1ba5-c8e7-4025-bab8-b4c90abcc3f7 service cinder] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:24:19.291494 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ede1ba5-c8e7-4025-bab8-b4c90abcc3f7 service cinder] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:24:19.303159 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e60eff-19b9-48d9-9152-441c517fd1ac service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb341257aa8246b6847561e2fe1fa385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9f9c44db4984653b8d4b5f6b3b949f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:24:19.304064 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e60eff-19b9-48d9-9152-441c517fd1ac service cinder] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:24:19.304346 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e60eff-19b9-48d9-9152-441c517fd1ac service cinder] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:24:19.304694 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e60eff-19b9-48d9-9152-441c517fd1ac service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:24:19.340561 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e60eff-19b9-48d9-9152-441c517fd1ac service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:24:19.342381 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e60eff-19b9-48d9-9152-441c517fd1ac service cinder] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:24:19.371735 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 822/1652] 10.222.0.21 () {60 vars in 1365 bytes} [Wed May 4 07:24:19 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 04 07:24:19.477230 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9906187-34fb-4530-8277-8f84025b3437 service cinder] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:24:19.512390 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9906187-34fb-4530-8277-8f84025b3437 service cinder] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:24:19.543127 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785a35e3-1506-4c23-b14d-ab07efdc1a26 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1077289fedae43b6be47be7f716d573a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9f9c44db4984653b8d4b5f6b3b949f5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:24:19.544080 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785a35e3-1506-4c23-b14d-ab07efdc1a26 service nova] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:24:19.544514 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785a35e3-1506-4c23-b14d-ab07efdc1a26 service nova] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:24:19.544971 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785a35e3-1506-4c23-b14d-ab07efdc1a26 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:24:19.577027 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785a35e3-1506-4c23-b14d-ab07efdc1a26 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:24:19.578910 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785a35e3-1506-4c23-b14d-ab07efdc1a26 service nova] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:24:19.626062 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 831/1653] 10.222.0.21 () {60 vars in 1365 bytes} [Wed May 4 07:24:19 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 07:24:20.071033 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e60eff-19b9-48d9-9152-441c517fd1ac service cinder] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:24:20.250504 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785a35e3-1506-4c23-b14d-ab07efdc1a26 service nova] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:24:20.297498 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e60eff-19b9-48d9-9152-441c517fd1ac service cinder] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:24:20.313173 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725fd7c3-c579-4677-a62e-723886b2217d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:24:20.314059 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725fd7c3-c579-4677-a62e-723886b2217d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:24:20.314345 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725fd7c3-c579-4677-a62e-723886b2217d admin admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:24:20.315712 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725fd7c3-c579-4677-a62e-723886b2217d admin admin] PATH_INFO: `/v3/users/49ff22cc977d44aaa6fcd7962d917a23` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:24:20.322376 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725fd7c3-c579-4677-a62e-723886b2217d admin admin] RBAC: Authorizing `identity:delete_user(user_id=49ff22cc977d44aaa6fcd7962d917a23)` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:24:20.324494 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725fd7c3-c579-4677-a62e-723886b2217d admin admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:24:20.439857 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785a35e3-1506-4c23-b14d-ab07efdc1a26 service nova] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:24:20.447670 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-725fd7c3-c579-4677-a62e-723886b2217d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '49ff22cc977d44aaa6fcd7962d917a23'} {{(pid=79745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:24:20.455114 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af223d60-c41b-44c6-875c-02eb1919cb22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:24:20.459002 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af223d60-c41b-44c6-875c-02eb1919cb22 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:24:20.459461 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af223d60-c41b-44c6-875c-02eb1919cb22 admin admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:24:20.460225 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af223d60-c41b-44c6-875c-02eb1919cb22 admin admin] PATH_INFO: `/v3/users/465ffa7cede44b9e87523eb2c2db2dde` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:24:20.463065 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af223d60-c41b-44c6-875c-02eb1919cb22 admin admin] RBAC: Authorizing `identity:delete_user(user_id=465ffa7cede44b9e87523eb2c2db2dde)` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:24:20.467522 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: WARNING py.warnings [None req-af223d60-c41b-44c6-875c-02eb1919cb22 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 04 07:24:20.467522 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: warnings.warn(msg) May 04 07:24:20.467522 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: May 04 07:24:20.471843 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af223d60-c41b-44c6-875c-02eb1919cb22 admin admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:24:20.482814 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-725fd7c3-c579-4677-a62e-723886b2217d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '49ff22cc977d44aaa6fcd7962d917a23'} {{(pid=79745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:24:20.485855 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-725fd7c3-c579-4677-a62e-723886b2217d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '49ff22cc977d44aaa6fcd7962d917a23'} {{(pid=79745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:24:20.487469 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-725fd7c3-c579-4677-a62e-723886b2217d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '49ff22cc977d44aaa6fcd7962d917a23'} {{(pid=79745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:24:20.510972 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-725fd7c3-c579-4677-a62e-723886b2217d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '49ff22cc977d44aaa6fcd7962d917a23'} {{(pid=79745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:24:20.540447 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 823/1654] 10.222.0.21 () {58 vars in 1223 bytes} [Wed May 4 07:24:20 2022] DELETE /identity/v3/users/49ff22cc977d44aaa6fcd7962d917a23 => generated 0 bytes in 470 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 07:24:20.541656 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4e7f17-fc31-4ff3-94c6-6b59afdfc002 None None] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:24:20.542833 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4e7f17-fc31-4ff3-94c6-6b59afdfc002 None None] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:24:20.543255 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4e7f17-fc31-4ff3-94c6-6b59afdfc002 None None] PATH_INFO: `/` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:24:20.546508 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 824/1655] 10.222.0.21 () {54 vars in 912 bytes} [Wed May 4 07:24:20 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 07:24:20.549336 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee72ad4a-aa3b-406b-a298-71cf547ff238 None None] REQUEST_METHOD: `POST` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:24:20.551497 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee72ad4a-aa3b-406b-a298-71cf547ff238 None None] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:24:20.551926 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee72ad4a-aa3b-406b-a298-71cf547ff238 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:24:20.575593 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.auth.core [None req-ee72ad4a-aa3b-406b-a298-71cf547ff238 None None] MFA Rules not processed for user `83c5e0dcb991496ea6dee38384514508`. Rule list: `[]` (Enabled: `True`). {{(pid=79745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:24:20.577009 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.fernet_utils [None req-ee72ad4a-aa3b-406b-a298-71cf547ff238 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:24:20.630119 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-af223d60-c41b-44c6-875c-02eb1919cb22 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '465ffa7cede44b9e87523eb2c2db2dde'} {{(pid=79744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:24:20.630997 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-af223d60-c41b-44c6-875c-02eb1919cb22 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '465ffa7cede44b9e87523eb2c2db2dde'} {{(pid=79744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:24:20.661579 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-af223d60-c41b-44c6-875c-02eb1919cb22 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '465ffa7cede44b9e87523eb2c2db2dde'} {{(pid=79744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:24:20.662507 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-af223d60-c41b-44c6-875c-02eb1919cb22 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '465ffa7cede44b9e87523eb2c2db2dde'} {{(pid=79744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:24:20.668663 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 825/1656] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 07:24:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 07:24:20.669839 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee72ad4a-aa3b-406b-a298-71cf547ff238 None None] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:24:20.675442 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.fernet_utils [None req-ee72ad4a-aa3b-406b-a298-71cf547ff238 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:24:20.690846 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee72ad4a-aa3b-406b-a298-71cf547ff238 None None] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:24:20.697390 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf614dd-ec88-4508-847b-bc7e56011be0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:24:20.698490 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf614dd-ec88-4508-847b-bc7e56011be0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:24:20.698807 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-af223d60-c41b-44c6-875c-02eb1919cb22 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '465ffa7cede44b9e87523eb2c2db2dde'} {{(pid=79744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:24:20.699115 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf614dd-ec88-4508-847b-bc7e56011be0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:24:20.699594 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf614dd-ec88-4508-847b-bc7e56011be0 admin admin] PATH_INFO: `/v3/users/b8e46273d48d447599c836534b715d7c` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:24:20.701010 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf614dd-ec88-4508-847b-bc7e56011be0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b8e46273d48d447599c836534b715d7c)` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:24:20.703319 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf614dd-ec88-4508-847b-bc7e56011be0 admin admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:24:20.718419 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 832/1657] 10.222.0.21 () {58 vars in 1223 bytes} [Wed May 4 07:24:20 2022] DELETE /identity/v3/users/465ffa7cede44b9e87523eb2c2db2dde => generated 0 bytes in 469 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 07:24:20.719896 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15521dcd-6820-47ff-943d-c882eeb733ce None None] REQUEST_METHOD: `POST` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:24:20.720181 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15521dcd-6820-47ff-943d-c882eeb733ce None None] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:24:20.720459 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15521dcd-6820-47ff-943d-c882eeb733ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:24:20.772236 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-cbf614dd-ec88-4508-847b-bc7e56011be0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b8e46273d48d447599c836534b715d7c'} {{(pid=79745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:24:20.775389 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.auth.core [None req-15521dcd-6820-47ff-943d-c882eeb733ce None None] MFA Rules not processed for user `91cb92d00273402b837cb29b37325101`. Rule list: `[]` (Enabled: `True`). {{(pid=79744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:24:20.776813 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.fernet_utils [None req-15521dcd-6820-47ff-943d-c882eeb733ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:24:20.792629 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-cbf614dd-ec88-4508-847b-bc7e56011be0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b8e46273d48d447599c836534b715d7c'} {{(pid=79745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:24:20.794067 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-cbf614dd-ec88-4508-847b-bc7e56011be0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b8e46273d48d447599c836534b715d7c'} {{(pid=79745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:24:20.795066 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-cbf614dd-ec88-4508-847b-bc7e56011be0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b8e46273d48d447599c836534b715d7c'} {{(pid=79745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:24:20.803854 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-cbf614dd-ec88-4508-847b-bc7e56011be0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b8e46273d48d447599c836534b715d7c'} {{(pid=79745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:24:20.832182 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 826/1658] 10.222.0.21 () {58 vars in 1223 bytes} [Wed May 4 07:24:20 2022] DELETE /identity/v3/users/b8e46273d48d447599c836534b715d7c => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 07:24:20.836847 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf614dd-ec88-4508-847b-bc7e56011be0 admin admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:24:20.849074 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.fernet_utils [None req-cbf614dd-ec88-4508-847b-bc7e56011be0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:24:20.894905 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 833/1659] 10.222.0.21 () {58 vars in 1009 bytes} [Wed May 4 07:24:20 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 07:24:20.896915 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6febed15-bfe7-4f80-868d-f111708ed377 None None] REQUEST_METHOD: `POST` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:24:20.897545 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6febed15-bfe7-4f80-868d-f111708ed377 None None] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:24:20.898372 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6febed15-bfe7-4f80-868d-f111708ed377 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:24:20.939645 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.auth.core [None req-6febed15-bfe7-4f80-868d-f111708ed377 None None] MFA Rules not processed for user `83c5e0dcb991496ea6dee38384514508`. Rule list: `[]` (Enabled: `True`). {{(pid=79744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:24:20.942395 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.fernet_utils [None req-6febed15-bfe7-4f80-868d-f111708ed377 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:24:20.977242 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf614dd-ec88-4508-847b-bc7e56011be0 admin admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:24:20.985168 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de11ea70-66e2-47ef-807a-262a7dccff53 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91cb92d00273402b837cb29b37325101', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9f9c44db4984653b8d4b5f6b3b949f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:24:20.985830 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de11ea70-66e2-47ef-807a-262a7dccff53 service neutron] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:24:20.986114 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de11ea70-66e2-47ef-807a-262a7dccff53 service neutron] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:24:20.986382 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de11ea70-66e2-47ef-807a-262a7dccff53 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:24:20.988545 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.fernet_utils [None req-de11ea70-66e2-47ef-807a-262a7dccff53 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:24:21.092105 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 834/1660] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 07:24:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 07:24:21.093848 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7787c093-a92f-40f2-9326-c1c0196389cc None None] REQUEST_METHOD: `POST` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:24:21.094316 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7787c093-a92f-40f2-9326-c1c0196389cc None None] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:24:21.094693 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7787c093-a92f-40f2-9326-c1c0196389cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:24:21.133674 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.auth.core [None req-7787c093-a92f-40f2-9326-c1c0196389cc None None] MFA Rules not processed for user `83c5e0dcb991496ea6dee38384514508`. Rule list: `[]` (Enabled: `True`). {{(pid=79744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:24:21.135549 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.fernet_utils [None req-7787c093-a92f-40f2-9326-c1c0196389cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:24:21.147947 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 835/1661] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 07:24:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 07:24:21.150233 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7787c093-a92f-40f2-9326-c1c0196389cc None None] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:24:21.184083 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de11ea70-66e2-47ef-807a-262a7dccff53 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:24:21.187343 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de11ea70-66e2-47ef-807a-262a7dccff53 service neutron] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:24:21.198956 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 827/1662] 10.222.0.21 () {60 vars in 1365 bytes} [Wed May 4 07:24:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 07:24:21.199624 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7787c093-a92f-40f2-9326-c1c0196389cc None None] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:24:21.200609 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de11ea70-66e2-47ef-807a-262a7dccff53 service neutron] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:24:21.203682 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.fernet_utils [None req-de11ea70-66e2-47ef-807a-262a7dccff53 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:24:21.230158 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de11ea70-66e2-47ef-807a-262a7dccff53 service neutron] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:24:21.232582 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fbb3af-934a-4c2b-85f2-95a35849ad72 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91cb92d00273402b837cb29b37325101', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9f9c44db4984653b8d4b5f6b3b949f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:24:21.233288 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fbb3af-934a-4c2b-85f2-95a35849ad72 service neutron] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:24:21.233583 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fbb3af-934a-4c2b-85f2-95a35849ad72 service neutron] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:24:21.237613 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fbb3af-934a-4c2b-85f2-95a35849ad72 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:24:21.240506 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0fb347-7fd8-4b53-97a2-2f16ae737f4f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91cb92d00273402b837cb29b37325101', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9f9c44db4984653b8d4b5f6b3b949f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:24:21.243329 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0fb347-7fd8-4b53-97a2-2f16ae737f4f service neutron] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:24:21.243329 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0fb347-7fd8-4b53-97a2-2f16ae737f4f service neutron] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:24:21.243329 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0fb347-7fd8-4b53-97a2-2f16ae737f4f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:24:21.270834 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0fb347-7fd8-4b53-97a2-2f16ae737f4f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:24:21.272477 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0fb347-7fd8-4b53-97a2-2f16ae737f4f service neutron] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:24:21.288207 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 828/1663] 10.222.0.21 () {60 vars in 1365 bytes} [Wed May 4 07:24:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 07:24:21.290200 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0fb347-7fd8-4b53-97a2-2f16ae737f4f service neutron] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:24:21.291287 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60fbb3af-934a-4c2b-85f2-95a35849ad72 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:24:21.295773 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60fbb3af-934a-4c2b-85f2-95a35849ad72 service neutron] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:24:21.313876 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0fb347-7fd8-4b53-97a2-2f16ae737f4f service neutron] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:24:21.322184 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ffd871-94d4-40ca-97db-ac583b39dadd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91cb92d00273402b837cb29b37325101', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9f9c44db4984653b8d4b5f6b3b949f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:24:21.322741 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ffd871-94d4-40ca-97db-ac583b39dadd service neutron] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:24:21.323125 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ffd871-94d4-40ca-97db-ac583b39dadd service neutron] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:24:21.323528 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ffd871-94d4-40ca-97db-ac583b39dadd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:24:21.345112 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ffd871-94d4-40ca-97db-ac583b39dadd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:24:21.346673 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ffd871-94d4-40ca-97db-ac583b39dadd service neutron] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:24:21.352547 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 836/1664] 10.222.0.21 () {60 vars in 1365 bytes} [Wed May 4 07:24:21 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 07:24:21.376505 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 829/1665] 10.222.0.21 () {60 vars in 1365 bytes} [Wed May 4 07:24:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 07:24:22.391706 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e9d5e0-2c4c-428e-b75e-36fd43815e9b None None] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:24:22.392504 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e9d5e0-2c4c-428e-b75e-36fd43815e9b None None] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:24:22.392504 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e9d5e0-2c4c-428e-b75e-36fd43815e9b None None] PATH_INFO: `/` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:24:22.393931 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 837/1666] 10.222.0.21 () {54 vars in 960 bytes} [Wed May 4 07:24:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 07:24:22.402738 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb0f6be-760c-46eb-9354-f20de9e3e3b1 None None] REQUEST_METHOD: `POST` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:24:22.403562 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb0f6be-760c-46eb-9354-f20de9e3e3b1 None None] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:24:22.403764 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb0f6be-760c-46eb-9354-f20de9e3e3b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:24:22.442178 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.auth.core [None req-ceb0f6be-760c-46eb-9354-f20de9e3e3b1 None None] MFA Rules not processed for user `ef28e980e8664d3eba4304e4589ea2df`. Rule list: `[]` (Enabled: `True`). {{(pid=79745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:24:22.444735 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.fernet_utils [None req-ceb0f6be-760c-46eb-9354-f20de9e3e3b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:24:22.636373 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 830/1667] 10.222.0.21 () {58 vars in 1057 bytes} [Wed May 4 07:24:22 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 07:24:22.647892 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e9d5e0-2c4c-428e-b75e-36fd43815e9b None None] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:24:22.688847 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e9d5e0-2c4c-428e-b75e-36fd43815e9b None None] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:24:22.705488 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c36035d-c187-4ca6-904c-1a368da6ca0c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef28e980e8664d3eba4304e4589ea2df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9f9c44db4984653b8d4b5f6b3b949f5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:24:22.706433 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c36035d-c187-4ca6-904c-1a368da6ca0c service placement] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:24:22.706915 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c36035d-c187-4ca6-904c-1a368da6ca0c service placement] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:24:22.707521 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c36035d-c187-4ca6-904c-1a368da6ca0c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:24:22.709725 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.fernet_utils [None req-1c36035d-c187-4ca6-904c-1a368da6ca0c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:24:22.723800 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c36035d-c187-4ca6-904c-1a368da6ca0c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:24:22.726332 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c36035d-c187-4ca6-904c-1a368da6ca0c service placement] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:24:22.741134 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 838/1668] 10.222.0.21 () {60 vars in 1365 bytes} [Wed May 4 07:24:22 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 07:24:22.927201 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb0f6be-760c-46eb-9354-f20de9e3e3b1 None None] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:24:22.928670 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.fernet_utils [None req-ceb0f6be-760c-46eb-9354-f20de9e3e3b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:24:22.971733 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb0f6be-760c-46eb-9354-f20de9e3e3b1 None None] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:24:22.985545 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af56e21-2390-4849-8e90-e5c50d9cebbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:24:22.986430 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af56e21-2390-4849-8e90-e5c50d9cebbb admin admin] REQUEST_METHOD: `DELETE` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:24:22.986711 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af56e21-2390-4849-8e90-e5c50d9cebbb admin admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:24:22.986984 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af56e21-2390-4849-8e90-e5c50d9cebbb admin admin] PATH_INFO: `/v3/projects/c6ff4b88e8594f1685564aea41c1e0c3` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:24:23.001093 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af56e21-2390-4849-8e90-e5c50d9cebbb admin admin] RBAC: Authorizing `identity:delete_project(project_id=c6ff4b88e8594f1685564aea41c1e0c3)` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:24:23.002345 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: WARNING py.warnings [None req-5af56e21-2390-4849-8e90-e5c50d9cebbb admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 04 07:24:23.002345 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: warnings.warn(msg) May 04 07:24:23.002345 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: May 04 07:24:23.005540 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af56e21-2390-4849-8e90-e5c50d9cebbb admin admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:24:23.155003 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-5af56e21-2390-4849-8e90-e5c50d9cebbb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c6ff4b88e8594f1685564aea41c1e0c3', 'request_id': 'req-5af56e21-2390-4849-8e90-e5c50d9cebbb'} {{(pid=79745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:24:23.206455 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-5af56e21-2390-4849-8e90-e5c50d9cebbb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c6ff4b88e8594f1685564aea41c1e0c3', 'request_id': 'req-5af56e21-2390-4849-8e90-e5c50d9cebbb'} {{(pid=79745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:24:23.225104 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-5af56e21-2390-4849-8e90-e5c50d9cebbb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c6ff4b88e8594f1685564aea41c1e0c3', 'request_id': 'req-5af56e21-2390-4849-8e90-e5c50d9cebbb'} {{(pid=79745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:24:23.226328 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c36035d-c187-4ca6-904c-1a368da6ca0c service placement] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:24:23.230664 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.fernet_utils [None req-1c36035d-c187-4ca6-904c-1a368da6ca0c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:24:23.275941 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-5af56e21-2390-4849-8e90-e5c50d9cebbb admin admin] The token cache is being invalidate because project c6ff4b88e8594f1685564aea41c1e0c3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79745) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 07:24:23.276420 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-5af56e21-2390-4849-8e90-e5c50d9cebbb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:24:23.282850 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-5af56e21-2390-4849-8e90-e5c50d9cebbb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:24:23.285031 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 831/1669] 10.222.0.21 () {58 vars in 1232 bytes} [Wed May 4 07:24:22 2022] DELETE /identity/v3/projects/c6ff4b88e8594f1685564aea41c1e0c3 => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 07:24:23.285997 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af56e21-2390-4849-8e90-e5c50d9cebbb admin admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:24:23.296357 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.fernet_utils [None req-5af56e21-2390-4849-8e90-e5c50d9cebbb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:24:23.300010 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c36035d-c187-4ca6-904c-1a368da6ca0c service placement] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:24:23.472348 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af56e21-2390-4849-8e90-e5c50d9cebbb admin admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:24:23.487921 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d927d99d-36d6-43d7-8216-a85d496bfbe0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:24:23.488815 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d927d99d-36d6-43d7-8216-a85d496bfbe0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:24:23.489093 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d927d99d-36d6-43d7-8216-a85d496bfbe0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:24:23.489361 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d927d99d-36d6-43d7-8216-a85d496bfbe0 admin admin] PATH_INFO: `/v3/projects/96751f9596554a5e95439a67b973ac97` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:24:23.505142 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa162f0-831b-4c19-b5c5-fc21ae1ea5ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:24:23.506083 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa162f0-831b-4c19-b5c5-fc21ae1ea5ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:24:23.506362 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa162f0-831b-4c19-b5c5-fc21ae1ea5ae admin admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:24:23.506636 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa162f0-831b-4c19-b5c5-fc21ae1ea5ae admin admin] PATH_INFO: `/v3/projects/9356c17c19604e92a3b0fb4578a5fb4f` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:24:23.508427 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d927d99d-36d6-43d7-8216-a85d496bfbe0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=96751f9596554a5e95439a67b973ac97)` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:24:23.515636 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d927d99d-36d6-43d7-8216-a85d496bfbe0 admin admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:24:23.518542 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa162f0-831b-4c19-b5c5-fc21ae1ea5ae admin admin] RBAC: Authorizing `identity:delete_project(project_id=9356c17c19604e92a3b0fb4578a5fb4f)` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:24:23.524456 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa162f0-831b-4c19-b5c5-fc21ae1ea5ae admin admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:24:23.627937 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-daa162f0-831b-4c19-b5c5-fc21ae1ea5ae admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9356c17c19604e92a3b0fb4578a5fb4f', 'request_id': 'req-daa162f0-831b-4c19-b5c5-fc21ae1ea5ae'} {{(pid=79744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:24:23.647754 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-daa162f0-831b-4c19-b5c5-fc21ae1ea5ae admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9356c17c19604e92a3b0fb4578a5fb4f', 'request_id': 'req-daa162f0-831b-4c19-b5c5-fc21ae1ea5ae'} {{(pid=79744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:24:23.666998 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-daa162f0-831b-4c19-b5c5-fc21ae1ea5ae admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9356c17c19604e92a3b0fb4578a5fb4f', 'request_id': 'req-daa162f0-831b-4c19-b5c5-fc21ae1ea5ae'} {{(pid=79744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:24:23.688409 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-daa162f0-831b-4c19-b5c5-fc21ae1ea5ae admin admin] The token cache is being invalidate because project 9356c17c19604e92a3b0fb4578a5fb4f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79744) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 07:24:23.688702 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-daa162f0-831b-4c19-b5c5-fc21ae1ea5ae admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:24:23.690515 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-d927d99d-36d6-43d7-8216-a85d496bfbe0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '96751f9596554a5e95439a67b973ac97', 'request_id': 'req-d927d99d-36d6-43d7-8216-a85d496bfbe0'} {{(pid=79745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:24:23.692365 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-daa162f0-831b-4c19-b5c5-fc21ae1ea5ae admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:24:23.696934 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 839/1670] 10.222.0.21 () {58 vars in 1232 bytes} [Wed May 4 07:24:23 2022] DELETE /identity/v3/projects/9356c17c19604e92a3b0fb4578a5fb4f => generated 0 bytes in 472 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 07:24:23.704050 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa162f0-831b-4c19-b5c5-fc21ae1ea5ae admin admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:24:23.708126 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.fernet_utils [None req-daa162f0-831b-4c19-b5c5-fc21ae1ea5ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:24:23.715665 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-d927d99d-36d6-43d7-8216-a85d496bfbe0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '96751f9596554a5e95439a67b973ac97', 'request_id': 'req-d927d99d-36d6-43d7-8216-a85d496bfbe0'} {{(pid=79745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:24:23.736066 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-d927d99d-36d6-43d7-8216-a85d496bfbe0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '96751f9596554a5e95439a67b973ac97', 'request_id': 'req-d927d99d-36d6-43d7-8216-a85d496bfbe0'} {{(pid=79745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:24:23.764970 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-d927d99d-36d6-43d7-8216-a85d496bfbe0 admin admin] The token cache is being invalidate because project 96751f9596554a5e95439a67b973ac97 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79745) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 07:24:23.766783 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-d927d99d-36d6-43d7-8216-a85d496bfbe0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:24:23.769619 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-d927d99d-36d6-43d7-8216-a85d496bfbe0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:24:23.780929 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 832/1671] 10.222.0.21 () {58 vars in 1232 bytes} [Wed May 4 07:24:23 2022] DELETE /identity/v3/projects/96751f9596554a5e95439a67b973ac97 => generated 0 bytes in 492 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 07:24:23.785959 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865b5763-3283-48ad-934a-77ebacc18159 None None] REQUEST_METHOD: `POST` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:24:23.786538 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865b5763-3283-48ad-934a-77ebacc18159 None None] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:24:23.787049 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865b5763-3283-48ad-934a-77ebacc18159 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:24:23.828904 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.auth.core [None req-865b5763-3283-48ad-934a-77ebacc18159 None None] MFA Rules not processed for user `83c5e0dcb991496ea6dee38384514508`. Rule list: `[]` (Enabled: `True`). {{(pid=79745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:24:23.835534 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.fernet_utils [None req-865b5763-3283-48ad-934a-77ebacc18159 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:24:23.927370 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa162f0-831b-4c19-b5c5-fc21ae1ea5ae admin admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:24:23.972691 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 833/1672] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 07:24:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 07:24:23.976207 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865b5763-3283-48ad-934a-77ebacc18159 None None] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:24:23.980478 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.fernet_utils [None req-865b5763-3283-48ad-934a-77ebacc18159 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:24:24.004869 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865b5763-3283-48ad-934a-77ebacc18159 None None] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:24:24.022403 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197580d7-c847-4948-8a51-1dc4383b6851 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:24:24.024316 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197580d7-c847-4948-8a51-1dc4383b6851 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:24:24.026981 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197580d7-c847-4948-8a51-1dc4383b6851 admin admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:24:24.027673 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197580d7-c847-4948-8a51-1dc4383b6851 admin admin] PATH_INFO: `/v3/users/33ac0c9a9fe443a2a26be6cb0a70bdb2` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:24:24.031802 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197580d7-c847-4948-8a51-1dc4383b6851 admin admin] RBAC: Authorizing `identity:delete_user(user_id=33ac0c9a9fe443a2a26be6cb0a70bdb2)` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:24:24.036663 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197580d7-c847-4948-8a51-1dc4383b6851 admin admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:24:24.081889 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4adb880-9fe3-4beb-a395-b904c38ad04b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:24:24.083104 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4adb880-9fe3-4beb-a395-b904c38ad04b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:24:24.083604 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4adb880-9fe3-4beb-a395-b904c38ad04b admin admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:24:24.083922 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4adb880-9fe3-4beb-a395-b904c38ad04b admin admin] PATH_INFO: `/v3/users/b2d79162f68547b3b782c3d40efad491` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:24:24.087310 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4adb880-9fe3-4beb-a395-b904c38ad04b admin admin] RBAC: Authorizing `identity:delete_user(user_id=b2d79162f68547b3b782c3d40efad491)` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:24:24.093418 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4adb880-9fe3-4beb-a395-b904c38ad04b admin admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:24:24.155105 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-197580d7-c847-4948-8a51-1dc4383b6851 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '33ac0c9a9fe443a2a26be6cb0a70bdb2'} {{(pid=79745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:24:24.211755 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-197580d7-c847-4948-8a51-1dc4383b6851 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '33ac0c9a9fe443a2a26be6cb0a70bdb2'} {{(pid=79745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:24:24.213044 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-197580d7-c847-4948-8a51-1dc4383b6851 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '33ac0c9a9fe443a2a26be6cb0a70bdb2'} {{(pid=79745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:24:24.213976 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-197580d7-c847-4948-8a51-1dc4383b6851 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '33ac0c9a9fe443a2a26be6cb0a70bdb2'} {{(pid=79745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:24:24.232459 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-197580d7-c847-4948-8a51-1dc4383b6851 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '33ac0c9a9fe443a2a26be6cb0a70bdb2'} {{(pid=79745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:24:24.240908 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-c4adb880-9fe3-4beb-a395-b904c38ad04b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b2d79162f68547b3b782c3d40efad491'} {{(pid=79744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:24:24.244726 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-c4adb880-9fe3-4beb-a395-b904c38ad04b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b2d79162f68547b3b782c3d40efad491'} {{(pid=79744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:24:24.271759 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 834/1673] 10.222.0.21 () {58 vars in 1223 bytes} [Wed May 4 07:24:23 2022] DELETE /identity/v3/users/33ac0c9a9fe443a2a26be6cb0a70bdb2 => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 07:24:24.274714 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e04f57b-1db2-403c-b3ce-649a6b3cff63 None None] REQUEST_METHOD: `POST` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:24:24.276934 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-c4adb880-9fe3-4beb-a395-b904c38ad04b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b2d79162f68547b3b782c3d40efad491'} {{(pid=79744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:24:24.278456 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-c4adb880-9fe3-4beb-a395-b904c38ad04b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b2d79162f68547b3b782c3d40efad491'} {{(pid=79744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:24:24.292998 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e04f57b-1db2-403c-b3ce-649a6b3cff63 None None] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:24:24.295515 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e04f57b-1db2-403c-b3ce-649a6b3cff63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:24:24.313409 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-c4adb880-9fe3-4beb-a395-b904c38ad04b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b2d79162f68547b3b782c3d40efad491'} {{(pid=79744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:24:24.337784 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 840/1674] 10.222.0.21 () {58 vars in 1223 bytes} [Wed May 4 07:24:23 2022] DELETE /identity/v3/users/b2d79162f68547b3b782c3d40efad491 => generated 0 bytes in 635 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 07:24:24.371976 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.auth.core [None req-0e04f57b-1db2-403c-b3ce-649a6b3cff63 None None] MFA Rules not processed for user `83c5e0dcb991496ea6dee38384514508`. Rule list: `[]` (Enabled: `True`). {{(pid=79745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:24:24.375600 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.fernet_utils [None req-0e04f57b-1db2-403c-b3ce-649a6b3cff63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:24:24.531369 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 835/1675] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 07:24:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 07:24:24.536672 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4adb880-9fe3-4beb-a395-b904c38ad04b admin admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:24:24.556406 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4adb880-9fe3-4beb-a395-b904c38ad04b admin admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:24:24.566133 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409f3cf9-c8fb-4881-b021-e9102fea9bcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:24:24.567120 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409f3cf9-c8fb-4881-b021-e9102fea9bcd admin admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:24:24.567608 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409f3cf9-c8fb-4881-b021-e9102fea9bcd admin admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:24:24.568170 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409f3cf9-c8fb-4881-b021-e9102fea9bcd admin admin] PATH_INFO: `/v3/domains` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:24:24.569415 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409f3cf9-c8fb-4881-b021-e9102fea9bcd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79744) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 07:24:24.569921 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409f3cf9-c8fb-4881-b021-e9102fea9bcd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:24:24.576842 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409f3cf9-c8fb-4881-b021-e9102fea9bcd admin admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:24:24.596445 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 841/1676] 10.222.0.21 () {58 vars in 1152 bytes} [Wed May 4 07:24:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 07:24:24.600639 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e04f57b-1db2-403c-b3ce-649a6b3cff63 None None] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:24:24.636785 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e04f57b-1db2-403c-b3ce-649a6b3cff63 None None] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:24:24.659455 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9ed03c-3f74-47a0-b276-60d2d837b98c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:24:24.660450 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9ed03c-3f74-47a0-b276-60d2d837b98c admin admin] REQUEST_METHOD: `POST` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:24:24.660908 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9ed03c-3f74-47a0-b276-60d2d837b98c admin admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:24:24.662428 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9ed03c-3f74-47a0-b276-60d2d837b98c admin admin] PATH_INFO: `/v3/projects` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:24:24.663186 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9ed03c-3f74-47a0-b276-60d2d837b98c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:24:24.666499 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9ed03c-3f74-47a0-b276-60d2d837b98c admin admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:24:24.730579 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 836/1677] 10.222.0.21 () {60 vars in 1152 bytes} [Wed May 4 07:24:24 2022] POST /identity/v3/projects => generated 405 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 07:24:24.736703 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409f3cf9-c8fb-4881-b021-e9102fea9bcd admin admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:24:24.758125 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409f3cf9-c8fb-4881-b021-e9102fea9bcd admin admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:24:24.917655 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a241063-f8d9-45c8-816d-6af68a964dae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:24:24.918816 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a241063-f8d9-45c8-816d-6af68a964dae admin admin] REQUEST_METHOD: `POST` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:24:24.927948 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a241063-f8d9-45c8-816d-6af68a964dae admin admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:24:24.928520 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a241063-f8d9-45c8-816d-6af68a964dae admin admin] PATH_INFO: `/v3/users` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:24:24.933887 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a241063-f8d9-45c8-816d-6af68a964dae admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:24:24.944811 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a241063-f8d9-45c8-816d-6af68a964dae admin admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:24:25.004226 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 842/1678] 10.222.0.21 () {60 vars in 1143 bytes} [Wed May 4 07:24:24 2022] POST /identity/v3/users => generated 303 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 07:24:25.007430 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9ed03c-3f74-47a0-b276-60d2d837b98c admin admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:24:25.029546 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9ed03c-3f74-47a0-b276-60d2d837b98c admin admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:24:25.049928 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f51917-b4f0-46c1-a48f-3d40b0457f71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:24:25.051247 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f51917-b4f0-46c1-a48f-3d40b0457f71 admin admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:24:25.051608 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f51917-b4f0-46c1-a48f-3d40b0457f71 admin admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:24:25.052129 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f51917-b4f0-46c1-a48f-3d40b0457f71 admin admin] PATH_INFO: `/v3/roles` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:24:25.057656 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f51917-b4f0-46c1-a48f-3d40b0457f71 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:24:25.065675 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f51917-b4f0-46c1-a48f-3d40b0457f71 admin admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:24:25.099936 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 837/1679] 10.222.0.21 () {58 vars in 1121 bytes} [Wed May 4 07:24:25 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 07:24:25.104227 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a241063-f8d9-45c8-816d-6af68a964dae admin admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:24:25.135544 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a241063-f8d9-45c8-816d-6af68a964dae admin admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:24:25.138243 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e05818-6be6-4a86-9a33-db33eaa91f9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:24:25.138924 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e05818-6be6-4a86-9a33-db33eaa91f9b admin admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:24:25.139234 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e05818-6be6-4a86-9a33-db33eaa91f9b admin admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:24:25.139564 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e05818-6be6-4a86-9a33-db33eaa91f9b admin admin] PATH_INFO: `/v3/roles` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:24:25.140486 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e05818-6be6-4a86-9a33-db33eaa91f9b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:24:25.142939 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e05818-6be6-4a86-9a33-db33eaa91f9b admin admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:24:25.163257 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 843/1680] 10.222.0.21 () {58 vars in 1121 bytes} [Wed May 4 07:24:25 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 07:24:25.169507 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f51917-b4f0-46c1-a48f-3d40b0457f71 admin admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:24:25.192859 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f51917-b4f0-46c1-a48f-3d40b0457f71 admin admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:24:25.227957 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5045f12-262e-4e0e-9fa8-eabdb6adfe63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:24:25.229393 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5045f12-262e-4e0e-9fa8-eabdb6adfe63 admin admin] REQUEST_METHOD: `PUT` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:24:25.233172 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5045f12-262e-4e0e-9fa8-eabdb6adfe63 admin admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:24:25.236291 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5045f12-262e-4e0e-9fa8-eabdb6adfe63 admin admin] PATH_INFO: `/v3/projects/e6ce6db2e0f94ba1a6ea0481c2366e2b/users/008e0eba2544495ebb7f0d121b5f6a37/roles/9f89c07b05a14f18836116af22cba5f6` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:24:25.288894 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5045f12-262e-4e0e-9fa8-eabdb6adfe63 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e6ce6db2e0f94ba1a6ea0481c2366e2b, user_id=008e0eba2544495ebb7f0d121b5f6a37, role_id=9f89c07b05a14f18836116af22cba5f6)` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:24:25.291961 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5045f12-262e-4e0e-9fa8-eabdb6adfe63 admin admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:24:25.336481 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 838/1681] 10.222.0.21 () {60 vars in 1482 bytes} [Wed May 4 07:24:25 2022] PUT /identity/v3/projects/e6ce6db2e0f94ba1a6ea0481c2366e2b/users/008e0eba2544495ebb7f0d121b5f6a37/roles/9f89c07b05a14f18836116af22cba5f6 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 07:24:25.341795 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69958f1-ff83-43f9-bc0d-543d8658fc42 None None] REQUEST_METHOD: `POST` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:24:25.342252 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69958f1-ff83-43f9-bc0d-543d8658fc42 None None] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:24:25.342593 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69958f1-ff83-43f9-bc0d-543d8658fc42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:24:25.394441 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.auth.core [None req-b69958f1-ff83-43f9-bc0d-543d8658fc42 None None] MFA Rules not processed for user `83c5e0dcb991496ea6dee38384514508`. Rule list: `[]` (Enabled: `True`). {{(pid=79744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:24:25.395815 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.fernet_utils [None req-b69958f1-ff83-43f9-bc0d-543d8658fc42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:24:25.609194 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 844/1682] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 07:24:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 269 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 07:24:25.624553 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5045f12-262e-4e0e-9fa8-eabdb6adfe63 admin admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:24:25.633263 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.fernet_utils [None req-e5045f12-262e-4e0e-9fa8-eabdb6adfe63 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:24:25.661039 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6baeb888-034f-4769-8cfd-815462ae884e None None] REQUEST_METHOD: `POST` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:24:25.661340 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6baeb888-034f-4769-8cfd-815462ae884e None None] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:24:25.661608 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6baeb888-034f-4769-8cfd-815462ae884e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:24:25.728073 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.auth.core [None req-6baeb888-034f-4769-8cfd-815462ae884e None None] MFA Rules not processed for user `20497d01a7c34e2eb5a56bfabf95dced`. Rule list: `[]` (Enabled: `True`). {{(pid=79744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:24:25.729850 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.fernet_utils [None req-6baeb888-034f-4769-8cfd-815462ae884e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:24:25.817211 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5045f12-262e-4e0e-9fa8-eabdb6adfe63 admin admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:24:25.825785 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2f5fb4-1817-4916-8c13-d3a9a3d171d7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91cb92d00273402b837cb29b37325101', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9f9c44db4984653b8d4b5f6b3b949f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:24:25.829980 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2f5fb4-1817-4916-8c13-d3a9a3d171d7 service neutron] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:24:25.831812 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2f5fb4-1817-4916-8c13-d3a9a3d171d7 service neutron] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:24:25.832617 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2f5fb4-1817-4916-8c13-d3a9a3d171d7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:24:25.860338 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2f5fb4-1817-4916-8c13-d3a9a3d171d7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:24:25.862124 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2f5fb4-1817-4916-8c13-d3a9a3d171d7 service neutron] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:24:25.897582 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 839/1683] 10.222.0.21 () {60 vars in 1365 bytes} [Wed May 4 07:24:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 274 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 07:24:25.899573 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2f5fb4-1817-4916-8c13-d3a9a3d171d7 service neutron] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:24:25.902425 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.fernet_utils [None req-de2f5fb4-1817-4916-8c13-d3a9a3d171d7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:24:25.926605 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2f5fb4-1817-4916-8c13-d3a9a3d171d7 service neutron] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:24:25.932361 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 845/1684] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 07:24:25 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 272 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 07:24:25.946798 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbc3b1b-e459-46e2-9892-c6ec12fc9e8f None None] REQUEST_METHOD: `POST` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:24:25.947096 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbc3b1b-e459-46e2-9892-c6ec12fc9e8f None None] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:24:25.947480 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbc3b1b-e459-46e2-9892-c6ec12fc9e8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:24:25.949911 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b042ea-ef79-41d7-991d-d0db4c136652 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:24:25.950915 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b042ea-ef79-41d7-991d-d0db4c136652 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:24:25.951329 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b042ea-ef79-41d7-991d-d0db4c136652 admin admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:24:25.951702 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b042ea-ef79-41d7-991d-d0db4c136652 admin admin] PATH_INFO: `/v3/projects/1560252c7e25481388f0822dc1a83cd2` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:24:25.953098 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b042ea-ef79-41d7-991d-d0db4c136652 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1560252c7e25481388f0822dc1a83cd2)` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:24:25.955116 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b042ea-ef79-41d7-991d-d0db4c136652 admin admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:24:25.982943 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.auth.core [None req-5bbc3b1b-e459-46e2-9892-c6ec12fc9e8f None None] MFA Rules not processed for user `20497d01a7c34e2eb5a56bfabf95dced`. Rule list: `[]` (Enabled: `True`). {{(pid=79744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:24:25.984673 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.fernet_utils [None req-5bbc3b1b-e459-46e2-9892-c6ec12fc9e8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:24:26.019475 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 846/1685] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 07:24:25 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 07:24:26.034312 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbc3b1b-e459-46e2-9892-c6ec12fc9e8f None None] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:24:26.036281 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.fernet_utils [None req-5bbc3b1b-e459-46e2-9892-c6ec12fc9e8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:24:26.071905 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-b8b042ea-ef79-41d7-991d-d0db4c136652 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1560252c7e25481388f0822dc1a83cd2', 'request_id': 'req-b8b042ea-ef79-41d7-991d-d0db4c136652'} {{(pid=79745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:24:26.090414 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-b8b042ea-ef79-41d7-991d-d0db4c136652 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1560252c7e25481388f0822dc1a83cd2', 'request_id': 'req-b8b042ea-ef79-41d7-991d-d0db4c136652'} {{(pid=79745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:24:26.103856 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-b8b042ea-ef79-41d7-991d-d0db4c136652 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1560252c7e25481388f0822dc1a83cd2', 'request_id': 'req-b8b042ea-ef79-41d7-991d-d0db4c136652'} {{(pid=79745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:24:26.122447 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-b8b042ea-ef79-41d7-991d-d0db4c136652 admin admin] The token cache is being invalidate because project 1560252c7e25481388f0822dc1a83cd2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79745) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 07:24:26.122870 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-b8b042ea-ef79-41d7-991d-d0db4c136652 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:24:26.123662 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-b8b042ea-ef79-41d7-991d-d0db4c136652 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:24:26.128941 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 840/1686] 10.222.0.21 () {58 vars in 1232 bytes} [Wed May 4 07:24:25 2022] DELETE /identity/v3/projects/1560252c7e25481388f0822dc1a83cd2 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 07:24:26.143845 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7a9323-4b5f-47ce-94b0-8fd0750827a1 None None] REQUEST_METHOD: `POST` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:24:26.150865 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7a9323-4b5f-47ce-94b0-8fd0750827a1 None None] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:24:26.151420 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7a9323-4b5f-47ce-94b0-8fd0750827a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:24:26.187114 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.auth.core [None req-4f7a9323-4b5f-47ce-94b0-8fd0750827a1 None None] MFA Rules not processed for user `83c5e0dcb991496ea6dee38384514508`. Rule list: `[]` (Enabled: `True`). {{(pid=79745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:24:26.190983 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.fernet_utils [None req-4f7a9323-4b5f-47ce-94b0-8fd0750827a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:24:26.259286 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbc3b1b-e459-46e2-9892-c6ec12fc9e8f None None] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:24:26.365849 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 841/1687] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 07:24:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 07:24:26.366781 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099f05ce-5416-4c61-a718-851f15c0cb57 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1077289fedae43b6be47be7f716d573a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9f9c44db4984653b8d4b5f6b3b949f5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:24:26.368040 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7a9323-4b5f-47ce-94b0-8fd0750827a1 None None] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:24:26.368872 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099f05ce-5416-4c61-a718-851f15c0cb57 service nova] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:24:26.369899 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.fernet_utils [None req-4f7a9323-4b5f-47ce-94b0-8fd0750827a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:24:26.370270 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099f05ce-5416-4c61-a718-851f15c0cb57 service nova] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:24:26.370645 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099f05ce-5416-4c61-a718-851f15c0cb57 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:24:26.375098 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.fernet_utils [None req-099f05ce-5416-4c61-a718-851f15c0cb57 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:24:26.386849 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7a9323-4b5f-47ce-94b0-8fd0750827a1 None None] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:24:26.392635 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3a4e59-49e1-41a8-bf06-e2633f8130d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:24:26.394761 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3a4e59-49e1-41a8-bf06-e2633f8130d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:24:26.395729 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3a4e59-49e1-41a8-bf06-e2633f8130d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:24:26.396181 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3a4e59-49e1-41a8-bf06-e2633f8130d5 admin admin] PATH_INFO: `/v3/projects/bfaa7274c9fb4d32997a5748fe58f001` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:24:26.399040 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3a4e59-49e1-41a8-bf06-e2633f8130d5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bfaa7274c9fb4d32997a5748fe58f001)` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:24:26.401986 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3a4e59-49e1-41a8-bf06-e2633f8130d5 admin admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:24:26.511291 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-fc3a4e59-49e1-41a8-bf06-e2633f8130d5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bfaa7274c9fb4d32997a5748fe58f001', 'request_id': 'req-fc3a4e59-49e1-41a8-bf06-e2633f8130d5'} {{(pid=79745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:24:26.516720 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099f05ce-5416-4c61-a718-851f15c0cb57 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:24:26.518369 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099f05ce-5416-4c61-a718-851f15c0cb57 service nova] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:24:26.524267 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-fc3a4e59-49e1-41a8-bf06-e2633f8130d5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bfaa7274c9fb4d32997a5748fe58f001', 'request_id': 'req-fc3a4e59-49e1-41a8-bf06-e2633f8130d5'} {{(pid=79745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:24:26.548152 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 847/1688] 10.222.0.21 () {60 vars in 1365 bytes} [Wed May 4 07:24:26 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 514 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 04 07:24:26.550311 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d99318f-f4a9-462c-81e9-bef0646abc3c None None] REQUEST_METHOD: `POST` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:24:26.550655 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d99318f-f4a9-462c-81e9-bef0646abc3c None None] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:24:26.550938 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d99318f-f4a9-462c-81e9-bef0646abc3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:24:26.556250 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-fc3a4e59-49e1-41a8-bf06-e2633f8130d5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bfaa7274c9fb4d32997a5748fe58f001', 'request_id': 'req-fc3a4e59-49e1-41a8-bf06-e2633f8130d5'} {{(pid=79745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:24:26.574854 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-fc3a4e59-49e1-41a8-bf06-e2633f8130d5 admin admin] The token cache is being invalidate because project bfaa7274c9fb4d32997a5748fe58f001 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79745) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 07:24:26.575579 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-fc3a4e59-49e1-41a8-bf06-e2633f8130d5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:24:26.578001 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-fc3a4e59-49e1-41a8-bf06-e2633f8130d5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:24:26.582150 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 842/1689] 10.222.0.21 () {58 vars in 1232 bytes} [Wed May 4 07:24:26 2022] DELETE /identity/v3/projects/bfaa7274c9fb4d32997a5748fe58f001 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 07:24:26.589411 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.auth.core [None req-9d99318f-f4a9-462c-81e9-bef0646abc3c None None] MFA Rules not processed for user `83c5e0dcb991496ea6dee38384514508`. Rule list: `[]` (Enabled: `True`). {{(pid=79744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:24:26.590733 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129e9f26-6d90-4450-b32c-106ede532e01 None None] REQUEST_METHOD: `POST` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:24:26.591942 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129e9f26-6d90-4450-b32c-106ede532e01 None None] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:24:26.593421 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129e9f26-6d90-4450-b32c-106ede532e01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:24:26.597989 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.fernet_utils [None req-9d99318f-f4a9-462c-81e9-bef0646abc3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:24:26.646343 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.auth.core [None req-129e9f26-6d90-4450-b32c-106ede532e01 None None] MFA Rules not processed for user `83c5e0dcb991496ea6dee38384514508`. Rule list: `[]` (Enabled: `True`). {{(pid=79745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:24:26.647717 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.fernet_utils [None req-129e9f26-6d90-4450-b32c-106ede532e01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:24:26.731256 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 848/1690] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 07:24:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 07:24:26.732989 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d99318f-f4a9-462c-81e9-bef0646abc3c None None] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:24:26.749644 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d99318f-f4a9-462c-81e9-bef0646abc3c None None] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:24:26.764943 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95cf40d-de8f-461e-be0b-6f220af269b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:24:26.767026 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95cf40d-de8f-461e-be0b-6f220af269b0 admin admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:24:26.767525 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95cf40d-de8f-461e-be0b-6f220af269b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:24:26.767984 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95cf40d-de8f-461e-be0b-6f220af269b0 admin admin] PATH_INFO: `/v3/domains` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:24:26.769243 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95cf40d-de8f-461e-be0b-6f220af269b0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79744) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 07:24:26.769758 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95cf40d-de8f-461e-be0b-6f220af269b0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:24:26.777809 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95cf40d-de8f-461e-be0b-6f220af269b0 admin admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:24:26.805683 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 849/1691] 10.222.0.21 () {58 vars in 1152 bytes} [Wed May 4 07:24:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 07:24:26.810644 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95cf40d-de8f-461e-be0b-6f220af269b0 admin admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:24:26.855022 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95cf40d-de8f-461e-be0b-6f220af269b0 admin admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:24:26.875836 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723c8d8e-8f3e-4641-9499-e2f783c90576 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:24:26.878729 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723c8d8e-8f3e-4641-9499-e2f783c90576 admin admin] REQUEST_METHOD: `POST` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:24:26.879055 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723c8d8e-8f3e-4641-9499-e2f783c90576 admin admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:24:26.883329 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723c8d8e-8f3e-4641-9499-e2f783c90576 admin admin] PATH_INFO: `/v3/projects` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:24:26.884916 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723c8d8e-8f3e-4641-9499-e2f783c90576 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:24:26.891760 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723c8d8e-8f3e-4641-9499-e2f783c90576 admin admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:24:26.899610 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 843/1692] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 07:24:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 314 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 07:24:26.901800 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455e1ae7-9d9a-423b-a721-9d6fc8331d43 None None] REQUEST_METHOD: `POST` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:24:26.902039 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455e1ae7-9d9a-423b-a721-9d6fc8331d43 None None] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:24:26.902304 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455e1ae7-9d9a-423b-a721-9d6fc8331d43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:24:26.950965 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.auth.core [None req-455e1ae7-9d9a-423b-a721-9d6fc8331d43 None None] MFA Rules not processed for user `83c5e0dcb991496ea6dee38384514508`. Rule list: `[]` (Enabled: `True`). {{(pid=79745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:24:26.960956 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.fernet_utils [None req-455e1ae7-9d9a-423b-a721-9d6fc8331d43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:24:26.991106 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 844/1693] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 07:24:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 07:24:26.992753 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455e1ae7-9d9a-423b-a721-9d6fc8331d43 None None] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:24:27.018286 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455e1ae7-9d9a-423b-a721-9d6fc8331d43 None None] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:24:27.027595 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 850/1694] 10.222.0.21 () {60 vars in 1152 bytes} [Wed May 4 07:24:26 2022] POST /identity/v3/projects => generated 375 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 07:24:27.028739 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723c8d8e-8f3e-4641-9499-e2f783c90576 admin admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:24:27.190635 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83042ffe-2c62-48b9-b0af-96f2d7885290 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:24:27.192433 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83042ffe-2c62-48b9-b0af-96f2d7885290 admin admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:24:27.193077 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83042ffe-2c62-48b9-b0af-96f2d7885290 admin admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:24:27.193532 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83042ffe-2c62-48b9-b0af-96f2d7885290 admin admin] PATH_INFO: `/v3/domains` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:24:27.196691 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83042ffe-2c62-48b9-b0af-96f2d7885290 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 07:24:27.197464 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83042ffe-2c62-48b9-b0af-96f2d7885290 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:24:27.200362 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83042ffe-2c62-48b9-b0af-96f2d7885290 admin admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:24:27.216693 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723c8d8e-8f3e-4641-9499-e2f783c90576 admin admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:24:27.233596 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caab9a68-26d9-43aa-8926-dd591675db02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:24:27.234464 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caab9a68-26d9-43aa-8926-dd591675db02 admin admin] REQUEST_METHOD: `POST` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:24:27.234846 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caab9a68-26d9-43aa-8926-dd591675db02 admin admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:24:27.235450 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caab9a68-26d9-43aa-8926-dd591675db02 admin admin] PATH_INFO: `/v3/users` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:24:27.239704 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caab9a68-26d9-43aa-8926-dd591675db02 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:24:27.246027 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caab9a68-26d9-43aa-8926-dd591675db02 admin admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:24:27.275884 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 845/1695] 10.222.0.21 () {58 vars in 1152 bytes} [Wed May 4 07:24:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 07:24:27.278462 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83042ffe-2c62-48b9-b0af-96f2d7885290 admin admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:24:27.292658 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 851/1696] 10.222.0.21 () {60 vars in 1143 bytes} [Wed May 4 07:24:27 2022] POST /identity/v3/users => generated 288 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 07:24:27.297687 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caab9a68-26d9-43aa-8926-dd591675db02 admin admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:24:27.312122 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83042ffe-2c62-48b9-b0af-96f2d7885290 admin admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:24:27.312843 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caab9a68-26d9-43aa-8926-dd591675db02 admin admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:24:27.322864 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f9a431-c63e-49e8-9d99-f559e95d5864 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:24:27.323592 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f9a431-c63e-49e8-9d99-f559e95d5864 admin admin] REQUEST_METHOD: `POST` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:24:27.323875 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f9a431-c63e-49e8-9d99-f559e95d5864 admin admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:24:27.324152 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f9a431-c63e-49e8-9d99-f559e95d5864 admin admin] PATH_INFO: `/v3/projects` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:24:27.324418 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54015a62-5f74-4d2f-a9b9-abdc45cde49d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:24:27.324846 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f9a431-c63e-49e8-9d99-f559e95d5864 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:24:27.325572 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54015a62-5f74-4d2f-a9b9-abdc45cde49d admin admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:24:27.326057 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54015a62-5f74-4d2f-a9b9-abdc45cde49d admin admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:24:27.326604 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54015a62-5f74-4d2f-a9b9-abdc45cde49d admin admin] PATH_INFO: `/v3/roles` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:24:27.327559 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54015a62-5f74-4d2f-a9b9-abdc45cde49d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:24:27.327754 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f9a431-c63e-49e8-9d99-f559e95d5864 admin admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:24:27.330585 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54015a62-5f74-4d2f-a9b9-abdc45cde49d admin admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:24:27.346629 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 852/1697] 10.222.0.21 () {58 vars in 1121 bytes} [Wed May 4 07:24:27 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 07:24:27.350929 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54015a62-5f74-4d2f-a9b9-abdc45cde49d admin admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:24:27.376882 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54015a62-5f74-4d2f-a9b9-abdc45cde49d admin admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:24:27.385438 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38d20fa-6dcf-487e-86c6-16ae30cca240 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:24:27.386234 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38d20fa-6dcf-487e-86c6-16ae30cca240 admin admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:24:27.386596 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38d20fa-6dcf-487e-86c6-16ae30cca240 admin admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:24:27.386865 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38d20fa-6dcf-487e-86c6-16ae30cca240 admin admin] PATH_INFO: `/v3/roles` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:24:27.396477 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38d20fa-6dcf-487e-86c6-16ae30cca240 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:24:27.401143 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38d20fa-6dcf-487e-86c6-16ae30cca240 admin admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:24:27.402429 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 846/1698] 10.222.0.21 () {60 vars in 1152 bytes} [Wed May 4 07:24:27 2022] POST /identity/v3/projects => generated 393 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 07:24:27.404346 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f9a431-c63e-49e8-9d99-f559e95d5864 admin admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:24:27.431746 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 853/1699] 10.222.0.21 () {58 vars in 1121 bytes} [Wed May 4 07:24:27 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 07:24:27.450699 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38d20fa-6dcf-487e-86c6-16ae30cca240 admin admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:24:27.489769 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38d20fa-6dcf-487e-86c6-16ae30cca240 admin admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:24:27.589887 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f9a431-c63e-49e8-9d99-f559e95d5864 admin admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:24:27.597916 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747916d3-ac45-42b9-b04f-7c633e931e01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:24:27.598766 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747916d3-ac45-42b9-b04f-7c633e931e01 admin admin] REQUEST_METHOD: `POST` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:24:27.599434 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747916d3-ac45-42b9-b04f-7c633e931e01 admin admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:24:27.599743 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747916d3-ac45-42b9-b04f-7c633e931e01 admin admin] PATH_INFO: `/v3/users` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:24:27.600771 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747916d3-ac45-42b9-b04f-7c633e931e01 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:24:27.605350 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9049aeb3-8ef5-4c67-ae7a-3b6f6e9f5ab0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:24:27.606016 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9049aeb3-8ef5-4c67-ae7a-3b6f6e9f5ab0 admin admin] REQUEST_METHOD: `PUT` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:24:27.606285 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9049aeb3-8ef5-4c67-ae7a-3b6f6e9f5ab0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:24:27.606605 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9049aeb3-8ef5-4c67-ae7a-3b6f6e9f5ab0 admin admin] PATH_INFO: `/v3/projects/bd893026da4047e2bcb6a905737d4d6d/users/c7321f8b62a749479c6722c12344808c/roles/9f89c07b05a14f18836116af22cba5f6` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:24:27.612835 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747916d3-ac45-42b9-b04f-7c633e931e01 admin admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:24:27.625999 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9049aeb3-8ef5-4c67-ae7a-3b6f6e9f5ab0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bd893026da4047e2bcb6a905737d4d6d, user_id=c7321f8b62a749479c6722c12344808c, role_id=9f89c07b05a14f18836116af22cba5f6)` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:24:27.629624 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9049aeb3-8ef5-4c67-ae7a-3b6f6e9f5ab0 admin admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:24:27.650947 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 854/1700] 10.222.0.21 () {60 vars in 1482 bytes} [Wed May 4 07:24:27 2022] PUT /identity/v3/projects/bd893026da4047e2bcb6a905737d4d6d/users/c7321f8b62a749479c6722c12344808c/roles/9f89c07b05a14f18836116af22cba5f6 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 07:24:27.657629 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 847/1701] 10.222.0.21 () {60 vars in 1143 bytes} [Wed May 4 07:24:27 2022] POST /identity/v3/users => generated 297 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 07:24:27.659975 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9049aeb3-8ef5-4c67-ae7a-3b6f6e9f5ab0 admin admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:24:27.661435 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2bdbf2-0c0a-420e-a14c-366aea97ca5f None None] REQUEST_METHOD: `POST` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:24:27.661953 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2bdbf2-0c0a-420e-a14c-366aea97ca5f None None] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:24:27.662023 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2bdbf2-0c0a-420e-a14c-366aea97ca5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:24:27.746514 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.auth.core [None req-af2bdbf2-0c0a-420e-a14c-366aea97ca5f None None] MFA Rules not processed for user `c7321f8b62a749479c6722c12344808c`. Rule list: `[]` (Enabled: `True`). {{(pid=79745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:24:27.748101 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.fernet_utils [None req-af2bdbf2-0c0a-420e-a14c-366aea97ca5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:24:27.819220 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9049aeb3-8ef5-4c67-ae7a-3b6f6e9f5ab0 admin admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:24:27.834888 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de70da9-5aa9-46aa-840e-c626fdd0df4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:24:27.836216 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de70da9-5aa9-46aa-840e-c626fdd0df4f admin admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:24:27.837473 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de70da9-5aa9-46aa-840e-c626fdd0df4f admin admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:24:27.837772 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de70da9-5aa9-46aa-840e-c626fdd0df4f admin admin] PATH_INFO: `/v3/roles` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:24:27.838973 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de70da9-5aa9-46aa-840e-c626fdd0df4f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:24:27.840644 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de70da9-5aa9-46aa-840e-c626fdd0df4f admin admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:24:27.887678 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 855/1702] 10.222.0.21 () {58 vars in 1121 bytes} [Wed May 4 07:24:27 2022] GET /identity/v3/roles => generated 1420 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 07:24:27.891713 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de70da9-5aa9-46aa-840e-c626fdd0df4f admin admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:24:27.917923 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de70da9-5aa9-46aa-840e-c626fdd0df4f admin admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:24:27.944268 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 848/1703] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 07:24:27 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 284 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 07:24:27.948225 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66ad1dd-fe25-4ab7-b647-20c4d7f18675 None None] REQUEST_METHOD: `POST` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:24:27.949771 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d3a92b-edbc-4647-8413-7cb11c4ffcb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:24:27.950979 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d3a92b-edbc-4647-8413-7cb11c4ffcb9 admin admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:24:27.951537 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66ad1dd-fe25-4ab7-b647-20c4d7f18675 None None] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:24:27.952015 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66ad1dd-fe25-4ab7-b647-20c4d7f18675 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:24:27.954382 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d3a92b-edbc-4647-8413-7cb11c4ffcb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:24:27.954804 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d3a92b-edbc-4647-8413-7cb11c4ffcb9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:24:27.956686 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d3a92b-edbc-4647-8413-7cb11c4ffcb9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:24:27.959479 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d3a92b-edbc-4647-8413-7cb11c4ffcb9 admin admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:24:28.009739 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 856/1704] 10.222.0.21 () {58 vars in 1121 bytes} [Wed May 4 07:24:27 2022] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 07:24:28.010692 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d3a92b-edbc-4647-8413-7cb11c4ffcb9 admin admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:24:28.042731 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d3a92b-edbc-4647-8413-7cb11c4ffcb9 admin admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:24:28.045943 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.auth.core [None req-f66ad1dd-fe25-4ab7-b647-20c4d7f18675 None None] MFA Rules not processed for user `008e0eba2544495ebb7f0d121b5f6a37`. Rule list: `[]` (Enabled: `True`). {{(pid=79745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:24:28.053315 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.fernet_utils [None req-f66ad1dd-fe25-4ab7-b647-20c4d7f18675 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:24:28.058235 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80718f4a-425c-4151-9dfd-418783c51dd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:24:28.058916 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80718f4a-425c-4151-9dfd-418783c51dd0 admin admin] REQUEST_METHOD: `POST` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:24:28.059304 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80718f4a-425c-4151-9dfd-418783c51dd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:24:28.059636 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80718f4a-425c-4151-9dfd-418783c51dd0 admin admin] PATH_INFO: `/v3/projects` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:24:28.060339 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80718f4a-425c-4151-9dfd-418783c51dd0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:24:28.071755 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80718f4a-425c-4151-9dfd-418783c51dd0 admin admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:24:28.128829 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 857/1705] 10.222.0.21 () {60 vars in 1152 bytes} [Wed May 4 07:24:28 2022] POST /identity/v3/projects => generated 373 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 07:24:28.133072 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80718f4a-425c-4151-9dfd-418783c51dd0 admin admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:24:28.193787 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 849/1706] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 07:24:27 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 07:24:28.196060 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e65c551-8b3b-49b4-92b8-b736f8ed5168 None None] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:24:28.196471 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e65c551-8b3b-49b4-92b8-b736f8ed5168 None None] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:24:28.196894 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e65c551-8b3b-49b4-92b8-b736f8ed5168 None None] PATH_INFO: `/` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:24:28.205504 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 850/1707] 10.222.0.21 () {54 vars in 912 bytes} [Wed May 4 07:24:28 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 07:24:28.207225 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac98f11-54ca-44ba-9de8-0f727d3de827 None None] REQUEST_METHOD: `POST` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:24:28.207609 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac98f11-54ca-44ba-9de8-0f727d3de827 None None] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:24:28.207873 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac98f11-54ca-44ba-9de8-0f727d3de827 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:24:28.268724 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.auth.core [None req-1ac98f11-54ca-44ba-9de8-0f727d3de827 None None] MFA Rules not processed for user `10265d473a5c49e6960740b21114fee1`. Rule list: `[]` (Enabled: `True`). {{(pid=79745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:24:28.270603 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.fernet_utils [None req-1ac98f11-54ca-44ba-9de8-0f727d3de827 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:24:28.329570 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80718f4a-425c-4151-9dfd-418783c51dd0 admin admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:24:28.344097 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73fe2b87-d276-470f-9818-9707edfde44b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:24:28.345028 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fe2b87-d276-470f-9818-9707edfde44b admin admin] REQUEST_METHOD: `PUT` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:24:28.345460 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fe2b87-d276-470f-9818-9707edfde44b admin admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:24:28.345753 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fe2b87-d276-470f-9818-9707edfde44b admin admin] PATH_INFO: `/v3/projects/e99d205d911a47df8eec67326748e6d4/users/f1fe1b17796c4acf959ddf60dee67c99/roles/9f89c07b05a14f18836116af22cba5f6` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:24:28.387474 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73fe2b87-d276-470f-9818-9707edfde44b admin admin] RBAC: Authorizing `identity:create_grant(project_id=e99d205d911a47df8eec67326748e6d4, user_id=f1fe1b17796c4acf959ddf60dee67c99, role_id=9f89c07b05a14f18836116af22cba5f6)` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:24:28.390804 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73fe2b87-d276-470f-9818-9707edfde44b admin admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:24:28.420080 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 858/1708] 10.222.0.21 () {60 vars in 1482 bytes} [Wed May 4 07:24:28 2022] PUT /identity/v3/projects/e99d205d911a47df8eec67326748e6d4/users/f1fe1b17796c4acf959ddf60dee67c99/roles/9f89c07b05a14f18836116af22cba5f6 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 07:24:28.421814 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73fe2b87-d276-470f-9818-9707edfde44b admin admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:24:28.430030 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 851/1709] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 07:24:28 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 07:24:28.431410 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac98f11-54ca-44ba-9de8-0f727d3de827 None None] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:24:28.433660 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.fernet_utils [None req-1ac98f11-54ca-44ba-9de8-0f727d3de827 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:24:28.459554 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac98f11-54ca-44ba-9de8-0f727d3de827 None None] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:24:28.571970 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73fe2b87-d276-470f-9818-9707edfde44b admin admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:24:28.590176 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4571fe6e-3606-4f93-8eba-9e32803ee573 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:24:28.590176 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4571fe6e-3606-4f93-8eba-9e32803ee573 admin admin] REQUEST_METHOD: `POST` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:24:28.590176 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4571fe6e-3606-4f93-8eba-9e32803ee573 admin admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:24:28.590176 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4571fe6e-3606-4f93-8eba-9e32803ee573 admin admin] PATH_INFO: `/v3/users` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:24:28.590798 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4571fe6e-3606-4f93-8eba-9e32803ee573 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:24:28.594304 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4571fe6e-3606-4f93-8eba-9e32803ee573 admin admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:24:28.630876 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbfbce8-8065-49e5-90b7-f7427e16d69d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:24:28.631582 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbfbce8-8065-49e5-90b7-f7427e16d69d admin admin] REQUEST_METHOD: `POST` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:24:28.631860 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbfbce8-8065-49e5-90b7-f7427e16d69d admin admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:24:28.632131 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbfbce8-8065-49e5-90b7-f7427e16d69d admin admin] PATH_INFO: `/v3/projects` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:24:28.632909 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcbfbce8-8065-49e5-90b7-f7427e16d69d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:24:28.635000 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcbfbce8-8065-49e5-90b7-f7427e16d69d admin admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:24:28.644698 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 859/1710] 10.222.0.21 () {60 vars in 1143 bytes} [Wed May 4 07:24:28 2022] POST /identity/v3/users => generated 293 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 07:24:28.644698 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25909d6b-3ade-4a90-8993-b4aacc85e710 None None] REQUEST_METHOD: `POST` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:24:28.644698 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25909d6b-3ade-4a90-8993-b4aacc85e710 None None] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:24:28.644698 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25909d6b-3ade-4a90-8993-b4aacc85e710 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:24:28.690688 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 852/1711] 10.222.0.21 () {60 vars in 1152 bytes} [Wed May 4 07:24:28 2022] POST /identity/v3/projects => generated 405 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 07:24:28.691815 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281da989-c5cd-4a5e-a530-5f065e89571e None None] REQUEST_METHOD: `POST` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:24:28.692098 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281da989-c5cd-4a5e-a530-5f065e89571e None None] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:24:28.692374 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281da989-c5cd-4a5e-a530-5f065e89571e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:24:28.701137 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.auth.core [None req-25909d6b-3ade-4a90-8993-b4aacc85e710 None None] MFA Rules not processed for user `91cb92d00273402b837cb29b37325101`. Rule list: `[]` (Enabled: `True`). {{(pid=79744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:24:28.703900 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.fernet_utils [None req-25909d6b-3ade-4a90-8993-b4aacc85e710 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:24:28.744803 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.auth.core [None req-281da989-c5cd-4a5e-a530-5f065e89571e None None] MFA Rules not processed for user `f1fe1b17796c4acf959ddf60dee67c99`. Rule list: `[]` (Enabled: `True`). {{(pid=79745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:24:28.746047 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.fernet_utils [None req-281da989-c5cd-4a5e-a530-5f065e89571e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:24:28.875554 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 853/1712] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 07:24:28 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 07:24:28.876650 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281da989-c5cd-4a5e-a530-5f065e89571e None None] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:24:28.878401 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 860/1713] 10.222.0.21 () {58 vars in 1009 bytes} [Wed May 4 07:24:28 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 07:24:28.880338 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25909d6b-3ade-4a90-8993-b4aacc85e710 None None] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:24:28.884667 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.fernet_utils [None req-281da989-c5cd-4a5e-a530-5f065e89571e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:24:29.087226 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25909d6b-3ade-4a90-8993-b4aacc85e710 None None] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:24:29.102779 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281da989-c5cd-4a5e-a530-5f065e89571e None None] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:24:29.103256 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5982a1-770c-42da-b5d7-8ca075d8c43d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:24:29.105538 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5982a1-770c-42da-b5d7-8ca075d8c43d admin admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:24:29.105824 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5982a1-770c-42da-b5d7-8ca075d8c43d admin admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:24:29.106098 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5982a1-770c-42da-b5d7-8ca075d8c43d admin admin] PATH_INFO: `/v3/roles` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:24:29.106847 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5982a1-770c-42da-b5d7-8ca075d8c43d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:24:29.111057 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5982a1-770c-42da-b5d7-8ca075d8c43d admin admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:24:29.116007 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de42880-9b49-4c11-a91f-f25c7b917ff4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1077289fedae43b6be47be7f716d573a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9f9c44db4984653b8d4b5f6b3b949f5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:24:29.116993 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de42880-9b49-4c11-a91f-f25c7b917ff4 service nova] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:24:29.117895 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de42880-9b49-4c11-a91f-f25c7b917ff4 service nova] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:24:29.118485 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de42880-9b49-4c11-a91f-f25c7b917ff4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:24:29.137792 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 861/1714] 10.222.0.21 () {58 vars in 1121 bytes} [Wed May 4 07:24:28 2022] GET /identity/v3/roles => generated 1420 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 07:24:29.141459 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5982a1-770c-42da-b5d7-8ca075d8c43d admin admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:24:29.189402 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5982a1-770c-42da-b5d7-8ca075d8c43d admin admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:24:29.205034 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61376a5c-0076-4cf8-943f-c176be0a972d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:24:29.205892 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61376a5c-0076-4cf8-943f-c176be0a972d admin admin] REQUEST_METHOD: `POST` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:24:29.206283 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61376a5c-0076-4cf8-943f-c176be0a972d admin admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:24:29.206654 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61376a5c-0076-4cf8-943f-c176be0a972d admin admin] PATH_INFO: `/v3/users` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:24:29.207762 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61376a5c-0076-4cf8-943f-c176be0a972d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:24:29.210226 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61376a5c-0076-4cf8-943f-c176be0a972d admin admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:24:29.267853 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 862/1715] 10.222.0.21 () {60 vars in 1143 bytes} [Wed May 4 07:24:29 2022] POST /identity/v3/users => generated 309 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 07:24:29.269409 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61376a5c-0076-4cf8-943f-c176be0a972d admin admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:24:29.271616 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.fernet_utils [None req-61376a5c-0076-4cf8-943f-c176be0a972d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:24:29.301866 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de42880-9b49-4c11-a91f-f25c7b917ff4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:24:29.303557 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de42880-9b49-4c11-a91f-f25c7b917ff4 service nova] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:24:29.326751 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 854/1716] 10.222.0.21 () {60 vars in 1365 bytes} [Wed May 4 07:24:28 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 450 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 07:24:29.327402 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de42880-9b49-4c11-a91f-f25c7b917ff4 service nova] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:24:29.354355 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de42880-9b49-4c11-a91f-f25c7b917ff4 service nova] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:24:29.371983 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61376a5c-0076-4cf8-943f-c176be0a972d admin admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:24:29.375773 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbd425b-5b7d-4d33-bd99-be768e93c590 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:24:29.376469 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbd425b-5b7d-4d33-bd99-be768e93c590 admin admin] REQUEST_METHOD: `POST` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:24:29.376614 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c257ef-334f-4db4-b98a-614f3b412dce service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb341257aa8246b6847561e2fe1fa385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9f9c44db4984653b8d4b5f6b3b949f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:24:29.376760 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbd425b-5b7d-4d33-bd99-be768e93c590 admin admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:24:29.377043 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbd425b-5b7d-4d33-bd99-be768e93c590 admin admin] PATH_INFO: `/v3/projects` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:24:29.377271 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c257ef-334f-4db4-b98a-614f3b412dce service cinder] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:24:29.377519 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c257ef-334f-4db4-b98a-614f3b412dce service cinder] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:24:29.377750 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fbd425b-5b7d-4d33-bd99-be768e93c590 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:24:29.377895 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c257ef-334f-4db4-b98a-614f3b412dce service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:24:29.379947 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fbd425b-5b7d-4d33-bd99-be768e93c590 admin admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:24:29.380126 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.fernet_utils [None req-f1c257ef-334f-4db4-b98a-614f3b412dce service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:24:29.493468 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c257ef-334f-4db4-b98a-614f3b412dce service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:24:29.495867 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c257ef-334f-4db4-b98a-614f3b412dce service cinder] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:24:29.497536 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 855/1717] 10.222.0.21 () {60 vars in 1152 bytes} [Wed May 4 07:24:29 2022] POST /identity/v3/projects => generated 393 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 07:24:29.506040 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbd425b-5b7d-4d33-bd99-be768e93c590 admin admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:24:29.509333 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.fernet_utils [None req-6fbd425b-5b7d-4d33-bd99-be768e93c590 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:24:29.522199 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 863/1718] 10.222.0.21 () {60 vars in 1365 bytes} [Wed May 4 07:24:29 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 253 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 07:24:29.540889 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c257ef-334f-4db4-b98a-614f3b412dce service cinder] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:24:29.595884 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c257ef-334f-4db4-b98a-614f3b412dce service cinder] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:24:29.650771 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbd425b-5b7d-4d33-bd99-be768e93c590 admin admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:24:29.663556 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071fbf0a-8d08-4e99-a21b-5f6a9dbb47ea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91cb92d00273402b837cb29b37325101', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9f9c44db4984653b8d4b5f6b3b949f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:24:29.664804 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071fbf0a-8d08-4e99-a21b-5f6a9dbb47ea service neutron] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:24:29.665122 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071fbf0a-8d08-4e99-a21b-5f6a9dbb47ea service neutron] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:24:29.665407 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071fbf0a-8d08-4e99-a21b-5f6a9dbb47ea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:24:29.682154 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071fbf0a-8d08-4e99-a21b-5f6a9dbb47ea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:24:29.690995 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071fbf0a-8d08-4e99-a21b-5f6a9dbb47ea service neutron] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:24:29.727215 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 856/1719] 10.222.0.21 () {60 vars in 1365 bytes} [Wed May 4 07:24:29 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 229 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 07:24:29.728285 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071fbf0a-8d08-4e99-a21b-5f6a9dbb47ea service neutron] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:24:29.808909 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071fbf0a-8d08-4e99-a21b-5f6a9dbb47ea service neutron] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:24:29.814013 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e008c7-e85d-4db2-8737-15f8eb1b3a0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:24:29.814695 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e008c7-e85d-4db2-8737-15f8eb1b3a0f admin admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:24:29.814972 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e008c7-e85d-4db2-8737-15f8eb1b3a0f admin admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:24:29.815278 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e008c7-e85d-4db2-8737-15f8eb1b3a0f admin admin] PATH_INFO: `/v3/roles` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:24:29.816013 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e008c7-e85d-4db2-8737-15f8eb1b3a0f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:24:29.817787 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e008c7-e85d-4db2-8737-15f8eb1b3a0f admin admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:24:29.830679 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 857/1720] 10.222.0.21 () {58 vars in 1121 bytes} [Wed May 4 07:24:29 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 07:24:29.831575 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e008c7-e85d-4db2-8737-15f8eb1b3a0f admin admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:24:29.842592 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e008c7-e85d-4db2-8737-15f8eb1b3a0f admin admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:24:29.849312 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54914839-43d3-4417-a739-d194336d207c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:24:29.849931 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54914839-43d3-4417-a739-d194336d207c admin admin] REQUEST_METHOD: `POST` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:24:29.850217 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54914839-43d3-4417-a739-d194336d207c admin admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:24:29.850492 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54914839-43d3-4417-a739-d194336d207c admin admin] PATH_INFO: `/v3/users` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:24:29.851771 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54914839-43d3-4417-a739-d194336d207c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:24:29.853802 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54914839-43d3-4417-a739-d194336d207c admin admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:24:29.882547 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 858/1721] 10.222.0.21 () {60 vars in 1143 bytes} [Wed May 4 07:24:29 2022] POST /identity/v3/users => generated 303 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 07:24:29.883251 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54914839-43d3-4417-a739-d194336d207c admin admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:24:29.895588 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54914839-43d3-4417-a739-d194336d207c admin admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:24:29.901399 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3baba01c-7ae9-4746-932a-30306d479ea2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:24:29.902157 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3baba01c-7ae9-4746-932a-30306d479ea2 admin admin] REQUEST_METHOD: `PUT` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:24:29.902728 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3baba01c-7ae9-4746-932a-30306d479ea2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:24:29.902903 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3baba01c-7ae9-4746-932a-30306d479ea2 admin admin] PATH_INFO: `/v3/projects/4cae411097a047198aeb9b5c5aa686c8/users/f0d24432f6684af1b80f55d1a1bceb33/roles/eb54c9cea2774a25b1fe8c79724408ee` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:24:29.922111 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3baba01c-7ae9-4746-932a-30306d479ea2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4cae411097a047198aeb9b5c5aa686c8, user_id=f0d24432f6684af1b80f55d1a1bceb33, role_id=eb54c9cea2774a25b1fe8c79724408ee)` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:24:29.926056 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3baba01c-7ae9-4746-932a-30306d479ea2 admin admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:24:29.957188 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 859/1722] 10.222.0.21 () {60 vars in 1482 bytes} [Wed May 4 07:24:29 2022] PUT /identity/v3/projects/4cae411097a047198aeb9b5c5aa686c8/users/f0d24432f6684af1b80f55d1a1bceb33/roles/eb54c9cea2774a25b1fe8c79724408ee => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 07:24:29.959763 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3baba01c-7ae9-4746-932a-30306d479ea2 admin admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:24:30.076074 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3baba01c-7ae9-4746-932a-30306d479ea2 admin admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:24:30.082203 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90169610-cf93-47d5-abea-da81647a8897 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:24:30.082975 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90169610-cf93-47d5-abea-da81647a8897 admin admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:24:30.083361 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90169610-cf93-47d5-abea-da81647a8897 admin admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:24:30.083705 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90169610-cf93-47d5-abea-da81647a8897 admin admin] PATH_INFO: `/v3/roles` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:24:30.084703 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90169610-cf93-47d5-abea-da81647a8897 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:24:30.087653 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90169610-cf93-47d5-abea-da81647a8897 admin admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:24:30.105545 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 860/1723] 10.222.0.21 () {58 vars in 1121 bytes} [Wed May 4 07:24:29 2022] GET /identity/v3/roles => generated 1420 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 07:24:30.109270 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e97019-c006-4edd-9e3a-b0e4c603e594 None None] REQUEST_METHOD: `POST` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:24:30.112429 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e97019-c006-4edd-9e3a-b0e4c603e594 None None] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:24:30.121012 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e97019-c006-4edd-9e3a-b0e4c603e594 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:24:30.162134 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.auth.core [None req-b4e97019-c006-4edd-9e3a-b0e4c603e594 None None] MFA Rules not processed for user `704cdbc22849413baa4e0189947ebebc`. Rule list: `[]` (Enabled: `True`). {{(pid=79745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:24:30.164951 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.fernet_utils [None req-b4e97019-c006-4edd-9e3a-b0e4c603e594 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:24:30.207071 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7ad496-a352-4095-ba6d-e51d870f14e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:24:30.212300 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7ad496-a352-4095-ba6d-e51d870f14e5 admin admin] REQUEST_METHOD: `PUT` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:24:30.212823 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7ad496-a352-4095-ba6d-e51d870f14e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:24:30.213302 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7ad496-a352-4095-ba6d-e51d870f14e5 admin admin] PATH_INFO: `/v3/projects/36100b6dab2141749f3f2b47f476c665/users/0ca6d6283a754dbf98f1a7a6c702e866/roles/eb54c9cea2774a25b1fe8c79724408ee` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:24:30.287122 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7ad496-a352-4095-ba6d-e51d870f14e5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=36100b6dab2141749f3f2b47f476c665, user_id=0ca6d6283a754dbf98f1a7a6c702e866, role_id=eb54c9cea2774a25b1fe8c79724408ee)` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:24:30.299083 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7ad496-a352-4095-ba6d-e51d870f14e5 admin admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:24:30.310475 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 861/1724] 10.222.0.21 () {58 vars in 1009 bytes} [Wed May 4 07:24:30 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 07:24:30.311194 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e97019-c006-4edd-9e3a-b0e4c603e594 None None] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:24:30.343182 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e97019-c006-4edd-9e3a-b0e4c603e594 None None] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:24:30.354485 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 864/1725] 10.222.0.21 () {60 vars in 1482 bytes} [Wed May 4 07:24:29 2022] PUT /identity/v3/projects/36100b6dab2141749f3f2b47f476c665/users/0ca6d6283a754dbf98f1a7a6c702e866/roles/eb54c9cea2774a25b1fe8c79724408ee => generated 0 bytes in 831 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 07:24:30.359382 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7ad496-a352-4095-ba6d-e51d870f14e5 admin admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:24:30.425973 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92633c9c-9c4a-453e-9eb3-10fb59dccf58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:24:30.426664 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92633c9c-9c4a-453e-9eb3-10fb59dccf58 admin admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:24:30.426938 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92633c9c-9c4a-453e-9eb3-10fb59dccf58 admin admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:24:30.427245 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92633c9c-9c4a-453e-9eb3-10fb59dccf58 admin admin] PATH_INFO: `/v3/roles` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:24:30.427985 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92633c9c-9c4a-453e-9eb3-10fb59dccf58 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:24:30.437632 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92633c9c-9c4a-453e-9eb3-10fb59dccf58 admin admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:24:30.480320 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 862/1726] 10.222.0.21 () {58 vars in 1121 bytes} [Wed May 4 07:24:30 2022] GET /identity/v3/roles => generated 1420 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 07:24:30.480320 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92633c9c-9c4a-453e-9eb3-10fb59dccf58 admin admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:24:30.503265 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92633c9c-9c4a-453e-9eb3-10fb59dccf58 admin admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:24:30.521878 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29a9277-d251-4279-beb2-c28bf6fdac33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:24:30.522585 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29a9277-d251-4279-beb2-c28bf6fdac33 admin admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:24:30.522870 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29a9277-d251-4279-beb2-c28bf6fdac33 admin admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:24:30.523872 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29a9277-d251-4279-beb2-c28bf6fdac33 admin admin] PATH_INFO: `/v3/roles` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:24:30.524312 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29a9277-d251-4279-beb2-c28bf6fdac33 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:24:30.526057 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29a9277-d251-4279-beb2-c28bf6fdac33 admin admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:24:30.552171 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 863/1727] 10.222.0.21 () {58 vars in 1121 bytes} [Wed May 4 07:24:30 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 07:24:30.552171 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29a9277-d251-4279-beb2-c28bf6fdac33 admin admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:24:30.573400 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29a9277-d251-4279-beb2-c28bf6fdac33 admin admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:24:30.589464 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db3fea5-f621-47f4-bbd8-e53d0a624412 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:24:30.590990 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db3fea5-f621-47f4-bbd8-e53d0a624412 admin admin] REQUEST_METHOD: `PUT` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:24:30.590990 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db3fea5-f621-47f4-bbd8-e53d0a624412 admin admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:24:30.590990 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db3fea5-f621-47f4-bbd8-e53d0a624412 admin admin] PATH_INFO: `/v3/projects/4cae411097a047198aeb9b5c5aa686c8/users/f0d24432f6684af1b80f55d1a1bceb33/roles/eb54c9cea2774a25b1fe8c79724408ee` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:24:30.596042 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db3fea5-f621-47f4-bbd8-e53d0a624412 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4cae411097a047198aeb9b5c5aa686c8, user_id=f0d24432f6684af1b80f55d1a1bceb33, role_id=eb54c9cea2774a25b1fe8c79724408ee)` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:24:30.598731 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db3fea5-f621-47f4-bbd8-e53d0a624412 admin admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:24:30.633251 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 864/1728] 10.222.0.21 () {60 vars in 1482 bytes} [Wed May 4 07:24:30 2022] PUT /identity/v3/projects/4cae411097a047198aeb9b5c5aa686c8/users/f0d24432f6684af1b80f55d1a1bceb33/roles/eb54c9cea2774a25b1fe8c79724408ee => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 07:24:30.634243 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db3fea5-f621-47f4-bbd8-e53d0a624412 admin admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:24:30.705564 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7ad496-a352-4095-ba6d-e51d870f14e5 admin admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:24:30.778337 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db3fea5-f621-47f4-bbd8-e53d0a624412 admin admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:24:30.790652 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151f4c47-3dd0-42ee-9ef6-67311fb10f83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:24:30.791084 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151f4c47-3dd0-42ee-9ef6-67311fb10f83 admin admin] REQUEST_METHOD: `PUT` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:24:30.791381 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151f4c47-3dd0-42ee-9ef6-67311fb10f83 admin admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:24:30.791519 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151f4c47-3dd0-42ee-9ef6-67311fb10f83 admin admin] PATH_INFO: `/v3/projects/36100b6dab2141749f3f2b47f476c665/users/0ca6d6283a754dbf98f1a7a6c702e866/roles/eb54c9cea2774a25b1fe8c79724408ee` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:24:30.803208 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151f4c47-3dd0-42ee-9ef6-67311fb10f83 admin admin] RBAC: Authorizing `identity:create_grant(project_id=36100b6dab2141749f3f2b47f476c665, user_id=0ca6d6283a754dbf98f1a7a6c702e866, role_id=eb54c9cea2774a25b1fe8c79724408ee)` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:24:30.803208 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151f4c47-3dd0-42ee-9ef6-67311fb10f83 admin admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:24:30.826391 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532877db-082a-495a-9bf8-ef91fc716a15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:24:30.826391 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532877db-082a-495a-9bf8-ef91fc716a15 admin admin] REQUEST_METHOD: `PUT` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:24:30.826391 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532877db-082a-495a-9bf8-ef91fc716a15 admin admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:24:30.826391 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532877db-082a-495a-9bf8-ef91fc716a15 admin admin] PATH_INFO: `/v3/projects/f6dd5f666b6749e0a7c10659e0758f4c/users/7933dcc3dba845aca03eda91f004edbb/roles/eb54c9cea2774a25b1fe8c79724408ee` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:24:30.852342 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532877db-082a-495a-9bf8-ef91fc716a15 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f6dd5f666b6749e0a7c10659e0758f4c, user_id=7933dcc3dba845aca03eda91f004edbb, role_id=eb54c9cea2774a25b1fe8c79724408ee)` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:24:30.856690 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532877db-082a-495a-9bf8-ef91fc716a15 admin admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:24:30.863255 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 865/1729] 10.222.0.21 () {60 vars in 1482 bytes} [Wed May 4 07:24:30 2022] PUT /identity/v3/projects/36100b6dab2141749f3f2b47f476c665/users/0ca6d6283a754dbf98f1a7a6c702e866/roles/eb54c9cea2774a25b1fe8c79724408ee => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 07:24:30.863255 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151f4c47-3dd0-42ee-9ef6-67311fb10f83 admin admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:24:30.863779 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.fernet_utils [None req-151f4c47-3dd0-42ee-9ef6-67311fb10f83 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:24:30.902535 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 865/1730] 10.222.0.21 () {60 vars in 1482 bytes} [Wed May 4 07:24:30 2022] PUT /identity/v3/projects/f6dd5f666b6749e0a7c10659e0758f4c/users/7933dcc3dba845aca03eda91f004edbb/roles/eb54c9cea2774a25b1fe8c79724408ee => generated 0 bytes in 541 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 07:24:30.906018 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6841352-b4e2-4046-83aa-35e663830a5b None None] REQUEST_METHOD: `POST` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:24:30.906520 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6841352-b4e2-4046-83aa-35e663830a5b None None] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:24:30.906970 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6841352-b4e2-4046-83aa-35e663830a5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:24:30.983022 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.auth.core [None req-f6841352-b4e2-4046-83aa-35e663830a5b None None] MFA Rules not processed for user `0ca6d6283a754dbf98f1a7a6c702e866`. Rule list: `[]` (Enabled: `True`). {{(pid=79744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:24:30.987458 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.fernet_utils [None req-f6841352-b4e2-4046-83aa-35e663830a5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:24:31.232668 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151f4c47-3dd0-42ee-9ef6-67311fb10f83 admin admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:24:31.283336 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 866/1731] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 07:24:30 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 378 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 07:24:31.286771 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6841352-b4e2-4046-83aa-35e663830a5b None None] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:24:31.516133 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93598910-0587-436c-a60a-9092bc05ccd3 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '084c9245d1da4e698c9c3945fa089e85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9f9c44db4984653b8d4b5f6b3b949f5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:24:31.519001 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93598910-0587-436c-a60a-9092bc05ccd3 service swift] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:24:31.519549 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93598910-0587-436c-a60a-9092bc05ccd3 service swift] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:24:31.521111 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93598910-0587-436c-a60a-9092bc05ccd3 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:24:31.653253 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6841352-b4e2-4046-83aa-35e663830a5b None None] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:24:31.672738 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc038953-3653-496f-9c4d-695a07d97ac1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:24:31.675794 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc038953-3653-496f-9c4d-695a07d97ac1 admin admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:24:31.677196 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc038953-3653-496f-9c4d-695a07d97ac1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:24:31.678456 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc038953-3653-496f-9c4d-695a07d97ac1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:24:31.683732 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc038953-3653-496f-9c4d-695a07d97ac1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:24:31.687225 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc038953-3653-496f-9c4d-695a07d97ac1 admin admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:24:31.697860 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93598910-0587-436c-a60a-9092bc05ccd3 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:24:31.701467 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93598910-0587-436c-a60a-9092bc05ccd3 service swift] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:24:31.733559 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 866/1732] 10.222.0.21 () {60 vars in 1384 bytes} [Wed May 4 07:24:30 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 869 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 04 07:24:31.735542 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 867/1733] 10.222.0.21 () {58 vars in 1121 bytes} [Wed May 4 07:24:31 2022] GET /identity/v3/roles => generated 1420 bytes in 445 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 07:24:31.735833 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93598910-0587-436c-a60a-9092bc05ccd3 service swift] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:24:31.736209 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc038953-3653-496f-9c4d-695a07d97ac1 admin admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:24:31.736477 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.fernet_utils [None req-93598910-0587-436c-a60a-9092bc05ccd3 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:24:31.738223 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.fernet_utils [None req-dc038953-3653-496f-9c4d-695a07d97ac1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:24:31.796869 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93598910-0587-436c-a60a-9092bc05ccd3 service swift] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:24:31.855902 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81c359c-7a7a-49b9-9661-437c90c280c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:24:31.862957 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81c359c-7a7a-49b9-9661-437c90c280c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:24:31.862957 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81c359c-7a7a-49b9-9661-437c90c280c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:24:31.862957 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81c359c-7a7a-49b9-9661-437c90c280c5 admin admin] PATH_INFO: `/v3/users/ef6560b3988541b49295d432e0baaca4` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:24:31.870946 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81c359c-7a7a-49b9-9661-437c90c280c5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ef6560b3988541b49295d432e0baaca4)` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:24:31.873098 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81c359c-7a7a-49b9-9661-437c90c280c5 admin admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:24:31.933768 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc038953-3653-496f-9c4d-695a07d97ac1 admin admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:24:31.953002 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f36a4f-56ea-4853-9dcb-0b726ce21677 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb341257aa8246b6847561e2fe1fa385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9f9c44db4984653b8d4b5f6b3b949f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:24:31.953826 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f36a4f-56ea-4853-9dcb-0b726ce21677 service cinder] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:24:31.954189 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f36a4f-56ea-4853-9dcb-0b726ce21677 service cinder] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:24:31.954544 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f36a4f-56ea-4853-9dcb-0b726ce21677 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:24:31.972371 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-f81c359c-7a7a-49b9-9661-437c90c280c5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ef6560b3988541b49295d432e0baaca4'} {{(pid=79745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:24:31.989151 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-f81c359c-7a7a-49b9-9661-437c90c280c5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ef6560b3988541b49295d432e0baaca4'} {{(pid=79745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:24:31.990067 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-f81c359c-7a7a-49b9-9661-437c90c280c5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ef6560b3988541b49295d432e0baaca4'} {{(pid=79745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:24:31.990796 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-f81c359c-7a7a-49b9-9661-437c90c280c5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ef6560b3988541b49295d432e0baaca4'} {{(pid=79745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:24:32.000908 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-f81c359c-7a7a-49b9-9661-437c90c280c5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ef6560b3988541b49295d432e0baaca4'} {{(pid=79745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:24:32.028700 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 867/1734] 10.222.0.21 () {58 vars in 1223 bytes} [Wed May 4 07:24:31 2022] DELETE /identity/v3/users/ef6560b3988541b49295d432e0baaca4 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 07:24:32.029878 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81c359c-7a7a-49b9-9661-437c90c280c5 admin admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:24:32.032767 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.fernet_utils [None req-f81c359c-7a7a-49b9-9661-437c90c280c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:24:32.179738 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f36a4f-56ea-4853-9dcb-0b726ce21677 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:24:32.183071 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f36a4f-56ea-4853-9dcb-0b726ce21677 service cinder] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:24:32.193798 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81c359c-7a7a-49b9-9661-437c90c280c5 admin admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:24:32.201439 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29d78bb-0dee-4639-8991-1bbf3a5fa5a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:24:32.203204 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29d78bb-0dee-4639-8991-1bbf3a5fa5a4 admin admin] REQUEST_METHOD: `PUT` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:24:32.203697 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29d78bb-0dee-4639-8991-1bbf3a5fa5a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:24:32.204144 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29d78bb-0dee-4639-8991-1bbf3a5fa5a4 admin admin] PATH_INFO: `/v3/projects/f6dd5f666b6749e0a7c10659e0758f4c/users/7933dcc3dba845aca03eda91f004edbb/roles/eb54c9cea2774a25b1fe8c79724408ee` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:24:32.206615 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29d78bb-0dee-4639-8991-1bbf3a5fa5a4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f6dd5f666b6749e0a7c10659e0758f4c, user_id=7933dcc3dba845aca03eda91f004edbb, role_id=eb54c9cea2774a25b1fe8c79724408ee)` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:24:32.210400 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29d78bb-0dee-4639-8991-1bbf3a5fa5a4 admin admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:24:32.221326 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 868/1735] 10.222.0.21 () {60 vars in 1365 bytes} [Wed May 4 07:24:31 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 491 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 07:24:32.222968 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0daa95b-c2cc-486f-bdca-b496b7e30745 None None] REQUEST_METHOD: `POST` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:24:32.229748 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 868/1736] 10.222.0.21 () {60 vars in 1482 bytes} [Wed May 4 07:24:32 2022] PUT /identity/v3/projects/f6dd5f666b6749e0a7c10659e0758f4c/users/7933dcc3dba845aca03eda91f004edbb/roles/eb54c9cea2774a25b1fe8c79724408ee => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 07:24:32.231499 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d97c067-b519-4a21-9138-d1f0ce624854 None None] REQUEST_METHOD: `POST` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:24:32.236983 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d97c067-b519-4a21-9138-d1f0ce624854 None None] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:24:32.237389 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d97c067-b519-4a21-9138-d1f0ce624854 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:24:32.255536 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0daa95b-c2cc-486f-bdca-b496b7e30745 None None] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:24:32.255881 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0daa95b-c2cc-486f-bdca-b496b7e30745 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:24:32.308466 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.auth.core [None req-3d97c067-b519-4a21-9138-d1f0ce624854 None None] MFA Rules not processed for user `20497d01a7c34e2eb5a56bfabf95dced`. Rule list: `[]` (Enabled: `True`). {{(pid=79745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:24:32.309935 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.fernet_utils [None req-3d97c067-b519-4a21-9138-d1f0ce624854 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:24:32.324614 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.auth.core [None req-a0daa95b-c2cc-486f-bdca-b496b7e30745 None None] MFA Rules not processed for user `83c5e0dcb991496ea6dee38384514508`. Rule list: `[]` (Enabled: `True`). {{(pid=79744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:24:32.332884 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.fernet_utils [None req-a0daa95b-c2cc-486f-bdca-b496b7e30745 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:24:32.589885 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 869/1737] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 07:24:32 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 359 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 07:24:32.591576 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41910535-7a28-4893-973a-2ba0b887fc2a None None] REQUEST_METHOD: `POST` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:24:32.592126 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41910535-7a28-4893-973a-2ba0b887fc2a None None] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:24:32.592705 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41910535-7a28-4893-973a-2ba0b887fc2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:24:32.624885 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 869/1738] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 07:24:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 400 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 07:24:32.705262 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0daa95b-c2cc-486f-bdca-b496b7e30745 None None] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:24:32.708792 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.fernet_utils [None req-a0daa95b-c2cc-486f-bdca-b496b7e30745 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:24:32.713187 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.auth.core [None req-41910535-7a28-4893-973a-2ba0b887fc2a None None] MFA Rules not processed for user `7933dcc3dba845aca03eda91f004edbb`. Rule list: `[]` (Enabled: `True`). {{(pid=79745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:24:32.725094 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.fernet_utils [None req-41910535-7a28-4893-973a-2ba0b887fc2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:24:33.054382 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0daa95b-c2cc-486f-bdca-b496b7e30745 None None] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:24:33.074809 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e121147e-da73-4ed4-9542-178df49a7aa5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91cb92d00273402b837cb29b37325101', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9f9c44db4984653b8d4b5f6b3b949f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:24:33.082714 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e121147e-da73-4ed4-9542-178df49a7aa5 service neutron] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:24:33.084144 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e121147e-da73-4ed4-9542-178df49a7aa5 service neutron] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:24:33.084423 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e121147e-da73-4ed4-9542-178df49a7aa5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:24:33.154772 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 870/1739] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 07:24:32 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 564 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 07:24:33.167320 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41910535-7a28-4893-973a-2ba0b887fc2a None None] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:24:33.172221 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.fernet_utils [None req-41910535-7a28-4893-973a-2ba0b887fc2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:24:33.190116 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e121147e-da73-4ed4-9542-178df49a7aa5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:24:33.233503 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e121147e-da73-4ed4-9542-178df49a7aa5 service neutron] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:24:33.327741 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 870/1740] 10.222.0.21 () {60 vars in 1365 bytes} [Wed May 4 07:24:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 624 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 07:24:33.357041 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41910535-7a28-4893-973a-2ba0b887fc2a None None] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:24:33.361476 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2e9227-a85c-4fd4-8a65-8e874b7bd18c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb341257aa8246b6847561e2fe1fa385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9f9c44db4984653b8d4b5f6b3b949f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:24:33.362441 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2e9227-a85c-4fd4-8a65-8e874b7bd18c service cinder] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:24:33.362817 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2e9227-a85c-4fd4-8a65-8e874b7bd18c service cinder] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:24:33.363402 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2e9227-a85c-4fd4-8a65-8e874b7bd18c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:24:33.377917 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2e9227-a85c-4fd4-8a65-8e874b7bd18c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:24:33.396202 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2e9227-a85c-4fd4-8a65-8e874b7bd18c service cinder] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:24:33.442798 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 871/1741] 10.222.0.21 () {60 vars in 1365 bytes} [Wed May 4 07:24:33 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 277 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 07:24:33.624870 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e121147e-da73-4ed4-9542-178df49a7aa5 service neutron] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:24:33.627272 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.fernet_utils [None req-e121147e-da73-4ed4-9542-178df49a7aa5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:24:33.672420 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e121147e-da73-4ed4-9542-178df49a7aa5 service neutron] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:24:33.701774 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719bd702-2a48-46d3-8343-70d6e6181edb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb341257aa8246b6847561e2fe1fa385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9f9c44db4984653b8d4b5f6b3b949f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:24:33.705665 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719bd702-2a48-46d3-8343-70d6e6181edb service cinder] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:24:33.705958 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719bd702-2a48-46d3-8343-70d6e6181edb service cinder] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:24:33.706241 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719bd702-2a48-46d3-8343-70d6e6181edb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:24:33.716785 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.fernet_utils [None req-719bd702-2a48-46d3-8343-70d6e6181edb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:24:33.981800 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719bd702-2a48-46d3-8343-70d6e6181edb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:24:33.985044 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719bd702-2a48-46d3-8343-70d6e6181edb service cinder] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:24:34.020958 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 871/1742] 10.222.0.21 () {60 vars in 1365 bytes} [Wed May 4 07:24:33 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 398 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 07:24:35.543366 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2e9227-a85c-4fd4-8a65-8e874b7bd18c service cinder] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:24:35.546333 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.fernet_utils [None req-5e2e9227-a85c-4fd4-8a65-8e874b7bd18c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:24:35.583506 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2e9227-a85c-4fd4-8a65-8e874b7bd18c service cinder] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:24:35.598542 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09567f21-c278-427f-8d1f-8cd0797de522 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:24:35.599454 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09567f21-c278-427f-8d1f-8cd0797de522 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:24:35.599733 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09567f21-c278-427f-8d1f-8cd0797de522 admin admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:24:35.600001 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09567f21-c278-427f-8d1f-8cd0797de522 admin admin] PATH_INFO: `/v3/projects/4e22e157b88649d283774564a0d1768f` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:24:35.602214 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09567f21-c278-427f-8d1f-8cd0797de522 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4e22e157b88649d283774564a0d1768f)` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:24:35.604172 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09567f21-c278-427f-8d1f-8cd0797de522 admin admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:24:35.747004 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-09567f21-c278-427f-8d1f-8cd0797de522 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4e22e157b88649d283774564a0d1768f', 'request_id': 'req-09567f21-c278-427f-8d1f-8cd0797de522'} {{(pid=79745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:24:35.758003 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-09567f21-c278-427f-8d1f-8cd0797de522 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4e22e157b88649d283774564a0d1768f', 'request_id': 'req-09567f21-c278-427f-8d1f-8cd0797de522'} {{(pid=79745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:24:35.783936 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-09567f21-c278-427f-8d1f-8cd0797de522 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4e22e157b88649d283774564a0d1768f', 'request_id': 'req-09567f21-c278-427f-8d1f-8cd0797de522'} {{(pid=79745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:24:35.811018 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-09567f21-c278-427f-8d1f-8cd0797de522 admin admin] The token cache is being invalidate because project 4e22e157b88649d283774564a0d1768f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79745) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 07:24:35.811450 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-09567f21-c278-427f-8d1f-8cd0797de522 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:24:35.812291 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-09567f21-c278-427f-8d1f-8cd0797de522 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:24:35.813944 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 872/1743] 10.222.0.21 () {58 vars in 1232 bytes} [Wed May 4 07:24:35 2022] DELETE /identity/v3/projects/4e22e157b88649d283774564a0d1768f => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 07:24:35.820357 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45368e57-da31-4286-8bb9-25e9f3feb20f None None] REQUEST_METHOD: `POST` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:24:35.830408 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45368e57-da31-4286-8bb9-25e9f3feb20f None None] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:24:35.830870 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45368e57-da31-4286-8bb9-25e9f3feb20f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:24:35.913379 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743d0e4c-0792-47b3-9c4e-1a813a4b83a7 None None] REQUEST_METHOD: `POST` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:24:35.913826 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743d0e4c-0792-47b3-9c4e-1a813a4b83a7 None None] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:24:35.914365 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743d0e4c-0792-47b3-9c4e-1a813a4b83a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:24:35.918942 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.auth.core [None req-45368e57-da31-4286-8bb9-25e9f3feb20f None None] MFA Rules not processed for user `83c5e0dcb991496ea6dee38384514508`. Rule list: `[]` (Enabled: `True`). {{(pid=79744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:24:35.921191 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.fernet_utils [None req-45368e57-da31-4286-8bb9-25e9f3feb20f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:24:35.980721 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.auth.core [None req-743d0e4c-0792-47b3-9c4e-1a813a4b83a7 None None] MFA Rules not processed for user `f0d24432f6684af1b80f55d1a1bceb33`. Rule list: `[]` (Enabled: `True`). {{(pid=79745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:24:35.982114 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.fernet_utils [None req-743d0e4c-0792-47b3-9c4e-1a813a4b83a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:24:36.183934 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 872/1744] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 07:24:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 366 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 07:24:36.193829 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8b86f4-f197-45be-aeed-41b28d356827 None None] REQUEST_METHOD: `POST` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:24:36.194306 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8b86f4-f197-45be-aeed-41b28d356827 None None] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:24:36.194746 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8b86f4-f197-45be-aeed-41b28d356827 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:24:36.206858 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 873/1745] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 07:24:35 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 294 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 07:24:36.209214 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5575b52c-3d22-40aa-a98f-a43c215495f0 None None] REQUEST_METHOD: `POST` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:24:36.209681 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5575b52c-3d22-40aa-a98f-a43c215495f0 None None] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:24:36.210107 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5575b52c-3d22-40aa-a98f-a43c215495f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:24:36.252337 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.auth.core [None req-cb8b86f4-f197-45be-aeed-41b28d356827 None None] MFA Rules not processed for user `83c5e0dcb991496ea6dee38384514508`. Rule list: `[]` (Enabled: `True`). {{(pid=79744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:24:36.254187 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.fernet_utils [None req-cb8b86f4-f197-45be-aeed-41b28d356827 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:24:36.290902 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 873/1746] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 07:24:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 07:24:36.293739 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8b86f4-f197-45be-aeed-41b28d356827 None None] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:24:36.308147 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.auth.core [None req-5575b52c-3d22-40aa-a98f-a43c215495f0 None None] MFA Rules not processed for user `10265d473a5c49e6960740b21114fee1`. Rule list: `[]` (Enabled: `True`). {{(pid=79745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:24:36.313627 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.fernet_utils [None req-5575b52c-3d22-40aa-a98f-a43c215495f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:24:36.317418 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8b86f4-f197-45be-aeed-41b28d356827 None None] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:24:36.340246 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad1bcb8-d47c-4272-bb9e-550835b740b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:24:36.341194 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad1bcb8-d47c-4272-bb9e-550835b740b7 admin admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:24:36.341610 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad1bcb8-d47c-4272-bb9e-550835b740b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:24:36.342164 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad1bcb8-d47c-4272-bb9e-550835b740b7 admin admin] PATH_INFO: `/v3/domains` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:24:36.343072 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad1bcb8-d47c-4272-bb9e-550835b740b7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79744) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 07:24:36.343561 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad1bcb8-d47c-4272-bb9e-550835b740b7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:24:36.345324 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad1bcb8-d47c-4272-bb9e-550835b740b7 admin admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:24:36.371405 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 874/1747] 10.222.0.21 () {58 vars in 1152 bytes} [Wed May 4 07:24:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 07:24:36.372555 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad1bcb8-d47c-4272-bb9e-550835b740b7 admin admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:24:36.409799 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad1bcb8-d47c-4272-bb9e-550835b740b7 admin admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:24:36.416747 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e62c5c3-8e35-405d-bf54-b2332cdf05bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:24:36.417680 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e62c5c3-8e35-405d-bf54-b2332cdf05bd admin admin] REQUEST_METHOD: `POST` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:24:36.418033 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e62c5c3-8e35-405d-bf54-b2332cdf05bd admin admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:24:36.418428 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e62c5c3-8e35-405d-bf54-b2332cdf05bd admin admin] PATH_INFO: `/v3/projects` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:24:36.419297 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e62c5c3-8e35-405d-bf54-b2332cdf05bd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:24:36.422902 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e62c5c3-8e35-405d-bf54-b2332cdf05bd admin admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:24:36.496560 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 875/1748] 10.222.0.21 () {60 vars in 1152 bytes} [Wed May 4 07:24:36 2022] POST /identity/v3/projects => generated 367 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 07:24:36.502497 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e62c5c3-8e35-405d-bf54-b2332cdf05bd admin admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:24:36.662530 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 874/1749] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 07:24:36 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 447 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 07:24:36.673363 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e62c5c3-8e35-405d-bf54-b2332cdf05bd admin admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:24:36.675960 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c547ee-7e26-4f29-aaec-2ed680b7ccea None None] REQUEST_METHOD: `POST` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:24:36.680320 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c547ee-7e26-4f29-aaec-2ed680b7ccea None None] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:24:36.680805 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c547ee-7e26-4f29-aaec-2ed680b7ccea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:24:36.702079 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e26ab8a-162e-4b7e-af7d-8d531d19248a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:24:36.702932 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e26ab8a-162e-4b7e-af7d-8d531d19248a admin admin] REQUEST_METHOD: `POST` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:24:36.703344 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e26ab8a-162e-4b7e-af7d-8d531d19248a admin admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:24:36.703716 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e26ab8a-162e-4b7e-af7d-8d531d19248a admin admin] PATH_INFO: `/v3/users` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:24:36.704514 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e26ab8a-162e-4b7e-af7d-8d531d19248a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:24:36.707941 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e26ab8a-162e-4b7e-af7d-8d531d19248a admin admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:24:36.792422 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 876/1750] 10.222.0.21 () {60 vars in 1143 bytes} [Wed May 4 07:24:36 2022] POST /identity/v3/users => generated 284 bytes in 291 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 07:24:36.797678 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.auth.core [None req-34c547ee-7e26-4f29-aaec-2ed680b7ccea None None] MFA Rules not processed for user `91cb92d00273402b837cb29b37325101`. Rule list: `[]` (Enabled: `True`). {{(pid=79745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:24:36.799407 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.fernet_utils [None req-34c547ee-7e26-4f29-aaec-2ed680b7ccea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:24:36.801824 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e26ab8a-162e-4b7e-af7d-8d531d19248a admin admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:24:36.889634 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e26ab8a-162e-4b7e-af7d-8d531d19248a admin admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:24:36.914042 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b9583d-3bf8-477b-9c09-03a95f60613c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:24:36.915372 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b9583d-3bf8-477b-9c09-03a95f60613c admin admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:24:36.915829 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b9583d-3bf8-477b-9c09-03a95f60613c admin admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:24:36.916331 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b9583d-3bf8-477b-9c09-03a95f60613c admin admin] PATH_INFO: `/v3/roles` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:24:36.917215 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b9583d-3bf8-477b-9c09-03a95f60613c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:24:36.920068 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b9583d-3bf8-477b-9c09-03a95f60613c admin admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:24:36.984401 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 875/1751] 10.222.0.26 () {58 vars in 1015 bytes} [Wed May 4 07:24:36 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 321 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 07:24:37.012957 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 877/1752] 10.222.0.21 () {58 vars in 1121 bytes} [Wed May 4 07:24:36 2022] GET /identity/v3/roles => generated 1420 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 07:24:37.016752 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c547ee-7e26-4f29-aaec-2ed680b7ccea None None] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:24:37.035399 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c547ee-7e26-4f29-aaec-2ed680b7ccea None None] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:24:37.049785 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0bac082-dd3f-43d3-8230-0bca0c73ebf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:24:37.051022 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bac082-dd3f-43d3-8230-0bca0c73ebf0 admin admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:24:37.051489 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bac082-dd3f-43d3-8230-0bca0c73ebf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:24:37.051923 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bac082-dd3f-43d3-8230-0bca0c73ebf0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:24:37.052999 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0bac082-dd3f-43d3-8230-0bca0c73ebf0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:24:37.057651 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0bac082-dd3f-43d3-8230-0bca0c73ebf0 admin admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:24:37.076623 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 876/1753] 10.222.0.21 () {58 vars in 1121 bytes} [Wed May 4 07:24:37 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 07:24:37.081919 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b9583d-3bf8-477b-9c09-03a95f60613c admin admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:24:37.120239 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b9583d-3bf8-477b-9c09-03a95f60613c admin admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:24:37.124495 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0bac082-dd3f-43d3-8230-0bca0c73ebf0 admin admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:24:37.126592 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.fernet_utils [None req-f0bac082-dd3f-43d3-8230-0bca0c73ebf0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:24:37.136662 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0578a6c2-c2f2-4df8-8284-398901979a5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:24:37.137669 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0578a6c2-c2f2-4df8-8284-398901979a5b admin admin] REQUEST_METHOD: `PUT` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:24:37.138027 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0578a6c2-c2f2-4df8-8284-398901979a5b admin admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:24:37.138301 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0578a6c2-c2f2-4df8-8284-398901979a5b admin admin] PATH_INFO: `/v3/projects/d50d074731b643b4ac9fa2cbccb9a311/users/94b4411cf4b6488484b04f1ab59d5951/roles/9f89c07b05a14f18836116af22cba5f6` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:24:37.149425 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0bac082-dd3f-43d3-8230-0bca0c73ebf0 admin admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:24:37.159046 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0578a6c2-c2f2-4df8-8284-398901979a5b admin admin] RBAC: Authorizing `identity:create_grant(project_id=d50d074731b643b4ac9fa2cbccb9a311, user_id=94b4411cf4b6488484b04f1ab59d5951, role_id=9f89c07b05a14f18836116af22cba5f6)` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:24:37.161960 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0578a6c2-c2f2-4df8-8284-398901979a5b admin admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:24:37.169789 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e88678-9122-4a23-b464-5dee2b6c0ba3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91cb92d00273402b837cb29b37325101', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9f9c44db4984653b8d4b5f6b3b949f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:24:37.170435 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e88678-9122-4a23-b464-5dee2b6c0ba3 service neutron] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:24:37.170799 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e88678-9122-4a23-b464-5dee2b6c0ba3 service neutron] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:24:37.171190 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e88678-9122-4a23-b464-5dee2b6c0ba3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:24:37.187416 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e88678-9122-4a23-b464-5dee2b6c0ba3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:24:37.193104 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e88678-9122-4a23-b464-5dee2b6c0ba3 service neutron] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:24:37.214004 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 878/1754] 10.222.0.21 () {60 vars in 1482 bytes} [Wed May 4 07:24:37 2022] PUT /identity/v3/projects/d50d074731b643b4ac9fa2cbccb9a311/users/94b4411cf4b6488484b04f1ab59d5951/roles/9f89c07b05a14f18836116af22cba5f6 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 07:24:37.219116 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 877/1755] 10.222.0.21 () {60 vars in 1365 bytes} [Wed May 4 07:24:37 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 04 07:24:37.232788 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b834f7-3400-4e50-93ed-ac828b9bf1bb None None] REQUEST_METHOD: `POST` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:24:37.237327 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b834f7-3400-4e50-93ed-ac828b9bf1bb None None] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:24:37.237934 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b834f7-3400-4e50-93ed-ac828b9bf1bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:24:37.353019 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.auth.core [None req-52b834f7-3400-4e50-93ed-ac828b9bf1bb None None] MFA Rules not processed for user `94b4411cf4b6488484b04f1ab59d5951`. Rule list: `[]` (Enabled: `True`). {{(pid=79744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:24:37.355962 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.fernet_utils [None req-52b834f7-3400-4e50-93ed-ac828b9bf1bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:24:37.509503 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 879/1756] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 07:24:37 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 279 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 07:24:37.518638 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e88678-9122-4a23-b464-5dee2b6c0ba3 service neutron] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:24:37.520389 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.fernet_utils [None req-09e88678-9122-4a23-b464-5dee2b6c0ba3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:24:37.733662 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e88678-9122-4a23-b464-5dee2b6c0ba3 service neutron] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:24:37.887322 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2834e2-882e-40e1-bf50-07aaf52f243f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb341257aa8246b6847561e2fe1fa385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9f9c44db4984653b8d4b5f6b3b949f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:24:37.888245 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2834e2-882e-40e1-bf50-07aaf52f243f service cinder] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:24:37.888629 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2834e2-882e-40e1-bf50-07aaf52f243f service cinder] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:24:37.889130 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2834e2-882e-40e1-bf50-07aaf52f243f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:24:37.915126 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2834e2-882e-40e1-bf50-07aaf52f243f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:24:37.916410 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2834e2-882e-40e1-bf50-07aaf52f243f service cinder] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:24:37.943321 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 878/1757] 10.222.0.21 () {60 vars in 1365 bytes} [Wed May 4 07:24:37 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 425 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 07:24:39.693099 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b834f7-3400-4e50-93ed-ac828b9bf1bb None None] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:24:39.695459 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.fernet_utils [None req-52b834f7-3400-4e50-93ed-ac828b9bf1bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:24:39.879768 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b834f7-3400-4e50-93ed-ac828b9bf1bb None None] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:24:39.896865 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9142575-ac6a-4948-b1b3-f983e586cdc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:24:39.900455 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9142575-ac6a-4948-b1b3-f983e586cdc7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:24:39.901146 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9142575-ac6a-4948-b1b3-f983e586cdc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:24:39.902019 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9142575-ac6a-4948-b1b3-f983e586cdc7 admin admin] PATH_INFO: `/v3/users/c7321f8b62a749479c6722c12344808c` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:24:39.920200 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9142575-ac6a-4948-b1b3-f983e586cdc7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c7321f8b62a749479c6722c12344808c)` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:24:39.927509 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9142575-ac6a-4948-b1b3-f983e586cdc7 admin admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:24:40.087306 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-a9142575-ac6a-4948-b1b3-f983e586cdc7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c7321f8b62a749479c6722c12344808c'} {{(pid=79744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:24:40.088274 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-a9142575-ac6a-4948-b1b3-f983e586cdc7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c7321f8b62a749479c6722c12344808c'} {{(pid=79744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:24:40.105427 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-a9142575-ac6a-4948-b1b3-f983e586cdc7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c7321f8b62a749479c6722c12344808c'} {{(pid=79744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:24:40.109335 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-a9142575-ac6a-4948-b1b3-f983e586cdc7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c7321f8b62a749479c6722c12344808c'} {{(pid=79744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:24:40.134804 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-a9142575-ac6a-4948-b1b3-f983e586cdc7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c7321f8b62a749479c6722c12344808c'} {{(pid=79744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:24:40.160426 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 880/1758] 10.222.0.21 () {58 vars in 1223 bytes} [Wed May 4 07:24:39 2022] DELETE /identity/v3/users/c7321f8b62a749479c6722c12344808c => generated 0 bytes in 465 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 07:24:40.163132 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedef483-787c-4e72-9a27-f6092b50dc65 None None] REQUEST_METHOD: `POST` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:24:40.163132 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedef483-787c-4e72-9a27-f6092b50dc65 None None] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:24:40.163132 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedef483-787c-4e72-9a27-f6092b50dc65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:24:40.198409 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.auth.core [None req-eedef483-787c-4e72-9a27-f6092b50dc65 None None] MFA Rules not processed for user `83c5e0dcb991496ea6dee38384514508`. Rule list: `[]` (Enabled: `True`). {{(pid=79745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:24:40.200757 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.fernet_utils [None req-eedef483-787c-4e72-9a27-f6092b50dc65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:24:40.397987 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 879/1759] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 07:24:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 07:24:40.411774 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896bb937-e412-4db7-81c6-bd7b2f3aa63b None None] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:24:40.412100 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896bb937-e412-4db7-81c6-bd7b2f3aa63b None None] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:24:40.412340 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896bb937-e412-4db7-81c6-bd7b2f3aa63b None None] PATH_INFO: `/` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:24:40.414283 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 881/1760] 10.222.0.21 () {54 vars in 921 bytes} [Wed May 4 07:24:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 04 07:24:40.448136 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896bb937-e412-4db7-81c6-bd7b2f3aa63b None None] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:24:40.449072 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439b58e1-e418-467e-b9e2-ba0d807b767c None None] REQUEST_METHOD: `POST` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:24:40.449733 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439b58e1-e418-467e-b9e2-ba0d807b767c None None] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:24:40.449986 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439b58e1-e418-467e-b9e2-ba0d807b767c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:24:40.453265 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.fernet_utils [None req-896bb937-e412-4db7-81c6-bd7b2f3aa63b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:24:40.534168 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.auth.core [None req-439b58e1-e418-467e-b9e2-ba0d807b767c None None] MFA Rules not processed for user `1077289fedae43b6be47be7f716d573a`. Rule list: `[]` (Enabled: `True`). {{(pid=79745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:24:40.537893 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.fernet_utils [None req-439b58e1-e418-467e-b9e2-ba0d807b767c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:24:40.755601 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896bb937-e412-4db7-81c6-bd7b2f3aa63b None None] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:24:40.766444 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4ec1c4-12d4-438b-b43e-da402ba39a96 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91cb92d00273402b837cb29b37325101', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9f9c44db4984653b8d4b5f6b3b949f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:24:40.781348 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4ec1c4-12d4-438b-b43e-da402ba39a96 service neutron] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:24:40.782079 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4ec1c4-12d4-438b-b43e-da402ba39a96 service neutron] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:24:40.784872 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4ec1c4-12d4-438b-b43e-da402ba39a96 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:24:40.817308 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 880/1761] 10.222.0.21 () {58 vars in 1018 bytes} [Wed May 4 07:24:40 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 371 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 07:24:40.820283 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4ec1c4-12d4-438b-b43e-da402ba39a96 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:24:40.822144 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4ec1c4-12d4-438b-b43e-da402ba39a96 service neutron] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:24:40.825763 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439b58e1-e418-467e-b9e2-ba0d807b767c None None] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:24:40.825763 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.fernet_utils [None req-439b58e1-e418-467e-b9e2-ba0d807b767c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:24:40.854216 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 882/1762] 10.222.0.21 () {60 vars in 1365 bytes} [Wed May 4 07:24:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 408 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 07:24:40.855278 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4ec1c4-12d4-438b-b43e-da402ba39a96 service neutron] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:24:40.856815 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.fernet_utils [None req-3c4ec1c4-12d4-438b-b43e-da402ba39a96 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:24:40.880823 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439b58e1-e418-467e-b9e2-ba0d807b767c None None] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:24:40.882683 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4ec1c4-12d4-438b-b43e-da402ba39a96 service neutron] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:24:40.889019 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ed3160-7a70-4190-b0e5-cbe4211b0d98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:24:40.890438 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ed3160-7a70-4190-b0e5-cbe4211b0d98 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:24:40.891387 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ed3160-7a70-4190-b0e5-cbe4211b0d98 admin admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:24:40.891886 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ed3160-7a70-4190-b0e5-cbe4211b0d98 admin admin] PATH_INFO: `/v3/users/008e0eba2544495ebb7f0d121b5f6a37` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:24:40.893809 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ed3160-7a70-4190-b0e5-cbe4211b0d98 admin admin] RBAC: Authorizing `identity:delete_user(user_id=008e0eba2544495ebb7f0d121b5f6a37)` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:24:40.896645 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ed3160-7a70-4190-b0e5-cbe4211b0d98 admin admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:24:40.902185 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c4e2c6-626a-4cde-bdb2-493bbf248c1e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1077289fedae43b6be47be7f716d573a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9f9c44db4984653b8d4b5f6b3b949f5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:24:40.904711 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c4e2c6-626a-4cde-bdb2-493bbf248c1e service nova] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:24:40.904711 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c4e2c6-626a-4cde-bdb2-493bbf248c1e service nova] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:24:40.904711 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c4e2c6-626a-4cde-bdb2-493bbf248c1e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:24:40.937186 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c4e2c6-626a-4cde-bdb2-493bbf248c1e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:24:40.940259 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c4e2c6-626a-4cde-bdb2-493bbf248c1e service nova] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:24:40.965756 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 881/1763] 10.222.0.21 () {60 vars in 1365 bytes} [Wed May 4 07:24:40 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 07:24:40.973847 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-14ed3160-7a70-4190-b0e5-cbe4211b0d98 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '008e0eba2544495ebb7f0d121b5f6a37'} {{(pid=79744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:24:40.974614 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-14ed3160-7a70-4190-b0e5-cbe4211b0d98 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '008e0eba2544495ebb7f0d121b5f6a37'} {{(pid=79744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:24:40.989745 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-14ed3160-7a70-4190-b0e5-cbe4211b0d98 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '008e0eba2544495ebb7f0d121b5f6a37'} {{(pid=79744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:24:40.991988 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-14ed3160-7a70-4190-b0e5-cbe4211b0d98 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '008e0eba2544495ebb7f0d121b5f6a37'} {{(pid=79744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:24:41.012474 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-14ed3160-7a70-4190-b0e5-cbe4211b0d98 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '008e0eba2544495ebb7f0d121b5f6a37'} {{(pid=79744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:24:41.033486 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 883/1764] 10.222.0.21 () {58 vars in 1223 bytes} [Wed May 4 07:24:40 2022] DELETE /identity/v3/users/008e0eba2544495ebb7f0d121b5f6a37 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 07:24:41.261799 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c4e2c6-626a-4cde-bdb2-493bbf248c1e service nova] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:24:41.265854 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.fernet_utils [None req-19c4e2c6-626a-4cde-bdb2-493bbf248c1e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:24:41.304606 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c4e2c6-626a-4cde-bdb2-493bbf248c1e service nova] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:24:41.319000 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ed3160-7a70-4190-b0e5-cbe4211b0d98 admin admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:24:41.321342 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.fernet_utils [None req-14ed3160-7a70-4190-b0e5-cbe4211b0d98 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:24:41.384130 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4f75a2-fd98-4cce-8b5b-709608d74a22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:24:41.385049 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4f75a2-fd98-4cce-8b5b-709608d74a22 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:24:41.385326 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4f75a2-fd98-4cce-8b5b-709608d74a22 admin admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:24:41.385598 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4f75a2-fd98-4cce-8b5b-709608d74a22 admin admin] PATH_INFO: `/v3/projects/bd893026da4047e2bcb6a905737d4d6d` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:24:41.386840 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4f75a2-fd98-4cce-8b5b-709608d74a22 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bd893026da4047e2bcb6a905737d4d6d)` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:24:41.388809 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4f75a2-fd98-4cce-8b5b-709608d74a22 admin admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:24:41.412524 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ed3160-7a70-4190-b0e5-cbe4211b0d98 admin admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:24:41.417956 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46a3085-9cd0-411f-b63a-ceaf93f371a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:24:41.418820 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46a3085-9cd0-411f-b63a-ceaf93f371a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:24:41.419099 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46a3085-9cd0-411f-b63a-ceaf93f371a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:24:41.419404 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46a3085-9cd0-411f-b63a-ceaf93f371a9 admin admin] PATH_INFO: `/v3/projects/e6ce6db2e0f94ba1a6ea0481c2366e2b` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:24:41.420613 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46a3085-9cd0-411f-b63a-ceaf93f371a9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e6ce6db2e0f94ba1a6ea0481c2366e2b)` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:24:41.422588 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46a3085-9cd0-411f-b63a-ceaf93f371a9 admin admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:24:41.442122 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-de4f75a2-fd98-4cce-8b5b-709608d74a22 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bd893026da4047e2bcb6a905737d4d6d', 'request_id': 'req-de4f75a2-fd98-4cce-8b5b-709608d74a22'} {{(pid=79745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:24:41.453350 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-de4f75a2-fd98-4cce-8b5b-709608d74a22 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bd893026da4047e2bcb6a905737d4d6d', 'request_id': 'req-de4f75a2-fd98-4cce-8b5b-709608d74a22'} {{(pid=79745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:24:41.461628 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-de4f75a2-fd98-4cce-8b5b-709608d74a22 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bd893026da4047e2bcb6a905737d4d6d', 'request_id': 'req-de4f75a2-fd98-4cce-8b5b-709608d74a22'} {{(pid=79745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:24:41.472451 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-de4f75a2-fd98-4cce-8b5b-709608d74a22 admin admin] The token cache is being invalidate because project bd893026da4047e2bcb6a905737d4d6d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79745) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 07:24:41.472738 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-de4f75a2-fd98-4cce-8b5b-709608d74a22 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:24:41.473365 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-de4f75a2-fd98-4cce-8b5b-709608d74a22 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:24:41.474940 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 882/1765] 10.222.0.21 () {58 vars in 1232 bytes} [Wed May 4 07:24:41 2022] DELETE /identity/v3/projects/bd893026da4047e2bcb6a905737d4d6d => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 07:24:41.475115 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-d46a3085-9cd0-411f-b63a-ceaf93f371a9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e6ce6db2e0f94ba1a6ea0481c2366e2b', 'request_id': 'req-d46a3085-9cd0-411f-b63a-ceaf93f371a9'} {{(pid=79744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:24:41.479524 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4f75a2-fd98-4cce-8b5b-709608d74a22 admin admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:24:41.480842 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.fernet_utils [None req-de4f75a2-fd98-4cce-8b5b-709608d74a22 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:24:41.480981 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-d46a3085-9cd0-411f-b63a-ceaf93f371a9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e6ce6db2e0f94ba1a6ea0481c2366e2b', 'request_id': 'req-d46a3085-9cd0-411f-b63a-ceaf93f371a9'} {{(pid=79744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:24:41.488003 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-d46a3085-9cd0-411f-b63a-ceaf93f371a9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e6ce6db2e0f94ba1a6ea0481c2366e2b', 'request_id': 'req-d46a3085-9cd0-411f-b63a-ceaf93f371a9'} {{(pid=79744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:24:41.499825 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-d46a3085-9cd0-411f-b63a-ceaf93f371a9 admin admin] The token cache is being invalidate because project e6ce6db2e0f94ba1a6ea0481c2366e2b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79744) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 07:24:41.500101 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-d46a3085-9cd0-411f-b63a-ceaf93f371a9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:24:41.500885 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-d46a3085-9cd0-411f-b63a-ceaf93f371a9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:24:41.502460 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 884/1766] 10.222.0.21 () {58 vars in 1232 bytes} [Wed May 4 07:24:41 2022] DELETE /identity/v3/projects/e6ce6db2e0f94ba1a6ea0481c2366e2b => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 07:24:41.506609 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46a3085-9cd0-411f-b63a-ceaf93f371a9 admin admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:24:41.508810 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.fernet_utils [None req-d46a3085-9cd0-411f-b63a-ceaf93f371a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:24:41.553634 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4f75a2-fd98-4cce-8b5b-709608d74a22 admin admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:24:41.575917 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46a3085-9cd0-411f-b63a-ceaf93f371a9 admin admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:24:41.580635 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a69a49-301f-4b61-84ee-2c07ce557e89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:24:41.581507 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a69a49-301f-4b61-84ee-2c07ce557e89 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:24:41.581788 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a69a49-301f-4b61-84ee-2c07ce557e89 admin admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:24:41.582062 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a69a49-301f-4b61-84ee-2c07ce557e89 admin admin] PATH_INFO: `/v3/users/f0d24432f6684af1b80f55d1a1bceb33` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:24:41.583310 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a69a49-301f-4b61-84ee-2c07ce557e89 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f0d24432f6684af1b80f55d1a1bceb33)` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:24:41.585543 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a69a49-301f-4b61-84ee-2c07ce557e89 admin admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:24:41.620818 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb78bfca-c164-42a3-a068-4e3141ab5ee1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:24:41.621696 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb78bfca-c164-42a3-a068-4e3141ab5ee1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:24:41.621993 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb78bfca-c164-42a3-a068-4e3141ab5ee1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:24:41.622472 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb78bfca-c164-42a3-a068-4e3141ab5ee1 admin admin] PATH_INFO: `/v3/users/0ca6d6283a754dbf98f1a7a6c702e866` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:24:41.623983 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb78bfca-c164-42a3-a068-4e3141ab5ee1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0ca6d6283a754dbf98f1a7a6c702e866)` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:24:41.625955 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb78bfca-c164-42a3-a068-4e3141ab5ee1 admin admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:24:41.639279 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-12a69a49-301f-4b61-84ee-2c07ce557e89 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f0d24432f6684af1b80f55d1a1bceb33'} {{(pid=79744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:24:41.640031 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-12a69a49-301f-4b61-84ee-2c07ce557e89 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f0d24432f6684af1b80f55d1a1bceb33'} {{(pid=79744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:24:41.648325 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-12a69a49-301f-4b61-84ee-2c07ce557e89 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f0d24432f6684af1b80f55d1a1bceb33'} {{(pid=79744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:24:41.649340 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-12a69a49-301f-4b61-84ee-2c07ce557e89 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f0d24432f6684af1b80f55d1a1bceb33'} {{(pid=79744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:24:41.663524 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-12a69a49-301f-4b61-84ee-2c07ce557e89 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f0d24432f6684af1b80f55d1a1bceb33'} {{(pid=79744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:24:41.676439 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-cb78bfca-c164-42a3-a068-4e3141ab5ee1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0ca6d6283a754dbf98f1a7a6c702e866'} {{(pid=79745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:24:41.678172 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 885/1767] 10.222.0.21 () {58 vars in 1223 bytes} [Wed May 4 07:24:41 2022] DELETE /identity/v3/users/f0d24432f6684af1b80f55d1a1bceb33 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 07:24:41.689370 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-cb78bfca-c164-42a3-a068-4e3141ab5ee1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0ca6d6283a754dbf98f1a7a6c702e866'} {{(pid=79745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:24:41.690105 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-cb78bfca-c164-42a3-a068-4e3141ab5ee1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0ca6d6283a754dbf98f1a7a6c702e866'} {{(pid=79745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:24:41.690722 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-cb78bfca-c164-42a3-a068-4e3141ab5ee1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0ca6d6283a754dbf98f1a7a6c702e866'} {{(pid=79745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:24:41.698157 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-cb78bfca-c164-42a3-a068-4e3141ab5ee1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0ca6d6283a754dbf98f1a7a6c702e866'} {{(pid=79745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:24:41.716520 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 883/1768] 10.222.0.21 () {58 vars in 1223 bytes} [Wed May 4 07:24:41 2022] DELETE /identity/v3/users/0ca6d6283a754dbf98f1a7a6c702e866 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 07:24:41.917016 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a69a49-301f-4b61-84ee-2c07ce557e89 admin admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:24:41.918639 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.fernet_utils [None req-12a69a49-301f-4b61-84ee-2c07ce557e89 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:24:42.008771 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a69a49-301f-4b61-84ee-2c07ce557e89 admin admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:24:42.079552 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d253ba-30f2-4d6e-8bee-5f6173180ef4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:24:42.080112 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d253ba-30f2-4d6e-8bee-5f6173180ef4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:24:42.080396 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d253ba-30f2-4d6e-8bee-5f6173180ef4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:24:42.080678 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d253ba-30f2-4d6e-8bee-5f6173180ef4 admin admin] PATH_INFO: `/v3/projects/4cae411097a047198aeb9b5c5aa686c8` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:24:42.081886 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d253ba-30f2-4d6e-8bee-5f6173180ef4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4cae411097a047198aeb9b5c5aa686c8)` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:24:42.083850 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d253ba-30f2-4d6e-8bee-5f6173180ef4 admin admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:24:42.152603 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-96d253ba-30f2-4d6e-8bee-5f6173180ef4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4cae411097a047198aeb9b5c5aa686c8', 'request_id': 'req-96d253ba-30f2-4d6e-8bee-5f6173180ef4'} {{(pid=79744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:24:42.159914 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-96d253ba-30f2-4d6e-8bee-5f6173180ef4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4cae411097a047198aeb9b5c5aa686c8', 'request_id': 'req-96d253ba-30f2-4d6e-8bee-5f6173180ef4'} {{(pid=79744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:24:42.170972 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-96d253ba-30f2-4d6e-8bee-5f6173180ef4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4cae411097a047198aeb9b5c5aa686c8', 'request_id': 'req-96d253ba-30f2-4d6e-8bee-5f6173180ef4'} {{(pid=79744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:24:42.185162 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-96d253ba-30f2-4d6e-8bee-5f6173180ef4 admin admin] The token cache is being invalidate because project 4cae411097a047198aeb9b5c5aa686c8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79744) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 07:24:42.185374 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-96d253ba-30f2-4d6e-8bee-5f6173180ef4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:24:42.186025 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-96d253ba-30f2-4d6e-8bee-5f6173180ef4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:24:42.187810 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 886/1769] 10.222.0.21 () {58 vars in 1232 bytes} [Wed May 4 07:24:41 2022] DELETE /identity/v3/projects/4cae411097a047198aeb9b5c5aa686c8 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 07:24:42.193981 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111cfd3b-3e0b-43ae-9b36-7d99aaccd259 None None] REQUEST_METHOD: `POST` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:24:42.194276 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111cfd3b-3e0b-43ae-9b36-7d99aaccd259 None None] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:24:42.195184 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111cfd3b-3e0b-43ae-9b36-7d99aaccd259 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:24:42.216520 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.auth.core [None req-111cfd3b-3e0b-43ae-9b36-7d99aaccd259 None None] MFA Rules not processed for user `83c5e0dcb991496ea6dee38384514508`. Rule list: `[]` (Enabled: `True`). {{(pid=79745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:24:42.217747 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.fernet_utils [None req-111cfd3b-3e0b-43ae-9b36-7d99aaccd259 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:24:42.279275 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d253ba-30f2-4d6e-8bee-5f6173180ef4 admin admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:24:42.281142 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.fernet_utils [None req-96d253ba-30f2-4d6e-8bee-5f6173180ef4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:24:42.293696 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 884/1770] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 07:24:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 07:24:42.302448 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd3091c-9137-4908-9be2-5b3a6f219db3 None None] REQUEST_METHOD: `POST` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:24:42.302948 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd3091c-9137-4908-9be2-5b3a6f219db3 None None] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:24:42.303385 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd3091c-9137-4908-9be2-5b3a6f219db3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:24:42.326947 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.auth.core [None req-6dd3091c-9137-4908-9be2-5b3a6f219db3 None None] MFA Rules not processed for user `83c5e0dcb991496ea6dee38384514508`. Rule list: `[]` (Enabled: `True`). {{(pid=79745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:24:42.328287 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.fernet_utils [None req-6dd3091c-9137-4908-9be2-5b3a6f219db3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:24:42.336880 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 885/1771] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 07:24:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 07:24:42.341166 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd3091c-9137-4908-9be2-5b3a6f219db3 None None] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:24:42.350471 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd3091c-9137-4908-9be2-5b3a6f219db3 None None] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:24:42.358261 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60ffabb-c613-45d3-9536-fad96357b6b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:24:42.359391 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60ffabb-c613-45d3-9536-fad96357b6b8 admin admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:24:42.359809 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60ffabb-c613-45d3-9536-fad96357b6b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:24:42.360282 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60ffabb-c613-45d3-9536-fad96357b6b8 admin admin] PATH_INFO: `/v3/domains` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:24:42.361434 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60ffabb-c613-45d3-9536-fad96357b6b8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 07:24:42.361982 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60ffabb-c613-45d3-9536-fad96357b6b8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:24:42.364618 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60ffabb-c613-45d3-9536-fad96357b6b8 admin admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:24:42.373194 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d253ba-30f2-4d6e-8bee-5f6173180ef4 admin admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:24:42.380795 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7d028b-94ca-4e14-8c63-91ad3876655b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:24:42.381901 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7d028b-94ca-4e14-8c63-91ad3876655b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:24:42.382931 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7d028b-94ca-4e14-8c63-91ad3876655b admin admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:24:42.383603 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7d028b-94ca-4e14-8c63-91ad3876655b admin admin] PATH_INFO: `/v3/projects/36100b6dab2141749f3f2b47f476c665` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:24:42.384558 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7d028b-94ca-4e14-8c63-91ad3876655b admin admin] RBAC: Authorizing `identity:delete_project(project_id=36100b6dab2141749f3f2b47f476c665)` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:24:42.385092 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 886/1772] 10.222.0.21 () {58 vars in 1152 bytes} [Wed May 4 07:24:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 07:24:42.387664 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7d028b-94ca-4e14-8c63-91ad3876655b admin admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:24:42.388856 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60ffabb-c613-45d3-9536-fad96357b6b8 admin admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:24:42.409967 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60ffabb-c613-45d3-9536-fad96357b6b8 admin admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:24:42.415332 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffdf0d2-e1a5-4382-83c7-2776bed065ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:24:42.416020 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffdf0d2-e1a5-4382-83c7-2776bed065ea admin admin] REQUEST_METHOD: `POST` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:24:42.416299 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffdf0d2-e1a5-4382-83c7-2776bed065ea admin admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:24:42.416603 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffdf0d2-e1a5-4382-83c7-2776bed065ea admin admin] PATH_INFO: `/v3/projects` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:24:42.417268 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ffdf0d2-e1a5-4382-83c7-2776bed065ea admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:24:42.419241 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ffdf0d2-e1a5-4382-83c7-2776bed065ea admin admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:24:42.456605 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 887/1773] 10.222.0.21 () {60 vars in 1152 bytes} [Wed May 4 07:24:42 2022] POST /identity/v3/projects => generated 373 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 07:24:42.457354 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-fc7d028b-94ca-4e14-8c63-91ad3876655b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '36100b6dab2141749f3f2b47f476c665', 'request_id': 'req-fc7d028b-94ca-4e14-8c63-91ad3876655b'} {{(pid=79744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:24:42.460388 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffdf0d2-e1a5-4382-83c7-2776bed065ea admin admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:24:42.463542 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-fc7d028b-94ca-4e14-8c63-91ad3876655b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '36100b6dab2141749f3f2b47f476c665', 'request_id': 'req-fc7d028b-94ca-4e14-8c63-91ad3876655b'} {{(pid=79744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:24:42.471851 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-fc7d028b-94ca-4e14-8c63-91ad3876655b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '36100b6dab2141749f3f2b47f476c665', 'request_id': 'req-fc7d028b-94ca-4e14-8c63-91ad3876655b'} {{(pid=79744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:24:42.484891 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-fc7d028b-94ca-4e14-8c63-91ad3876655b admin admin] The token cache is being invalidate because project 36100b6dab2141749f3f2b47f476c665 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79744) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 07:24:42.485181 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-fc7d028b-94ca-4e14-8c63-91ad3876655b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:24:42.485887 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-fc7d028b-94ca-4e14-8c63-91ad3876655b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:24:42.487753 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 887/1774] 10.222.0.21 () {58 vars in 1232 bytes} [Wed May 4 07:24:42 2022] DELETE /identity/v3/projects/36100b6dab2141749f3f2b47f476c665 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 07:24:42.494147 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f642921d-ef31-43ac-b56f-cf43e3c61192 None None] REQUEST_METHOD: `POST` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:24:42.494439 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f642921d-ef31-43ac-b56f-cf43e3c61192 None None] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:24:42.494718 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f642921d-ef31-43ac-b56f-cf43e3c61192 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:24:42.515265 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.auth.core [None req-f642921d-ef31-43ac-b56f-cf43e3c61192 None None] MFA Rules not processed for user `83c5e0dcb991496ea6dee38384514508`. Rule list: `[]` (Enabled: `True`). {{(pid=79744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:24:42.516518 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.fernet_utils [None req-f642921d-ef31-43ac-b56f-cf43e3c61192 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:24:42.524601 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffdf0d2-e1a5-4382-83c7-2776bed065ea admin admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:24:42.529638 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2a9088-4c28-471b-aa3a-e09390bace70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:24:42.530308 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 888/1775] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 07:24:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 07:24:42.530527 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2a9088-4c28-471b-aa3a-e09390bace70 admin admin] REQUEST_METHOD: `POST` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:24:42.530680 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2a9088-4c28-471b-aa3a-e09390bace70 admin admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:24:42.530959 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2a9088-4c28-471b-aa3a-e09390bace70 admin admin] PATH_INFO: `/v3/users` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:24:42.531757 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2a9088-4c28-471b-aa3a-e09390bace70 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:24:42.538796 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2a9088-4c28-471b-aa3a-e09390bace70 admin admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:24:42.539030 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15d5ca0-5809-4833-a229-e1e54d11acba None None] REQUEST_METHOD: `POST` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:24:42.539030 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15d5ca0-5809-4833-a229-e1e54d11acba None None] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:24:42.539030 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15d5ca0-5809-4833-a229-e1e54d11acba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:24:42.560091 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 888/1776] 10.222.0.21 () {60 vars in 1143 bytes} [Wed May 4 07:24:42 2022] POST /identity/v3/users => generated 287 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 07:24:42.563821 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.auth.core [None req-a15d5ca0-5809-4833-a229-e1e54d11acba None None] MFA Rules not processed for user `83c5e0dcb991496ea6dee38384514508`. Rule list: `[]` (Enabled: `True`). {{(pid=79744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:24:42.564696 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2a9088-4c28-471b-aa3a-e09390bace70 admin admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:24:42.565037 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.fernet_utils [None req-a15d5ca0-5809-4833-a229-e1e54d11acba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:24:42.567037 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.fernet_utils [None req-dc2a9088-4c28-471b-aa3a-e09390bace70 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:24:42.574131 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 889/1777] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 07:24:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 07:24:42.578443 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15d5ca0-5809-4833-a229-e1e54d11acba None None] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:24:42.580861 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2a9088-4c28-471b-aa3a-e09390bace70 admin admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:24:42.585509 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cdcf083-31a1-4162-9544-8759994653d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:24:42.586170 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdcf083-31a1-4162-9544-8759994653d1 admin admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:24:42.586448 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdcf083-31a1-4162-9544-8759994653d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:24:42.586725 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdcf083-31a1-4162-9544-8759994653d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:24:42.587553 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cdcf083-31a1-4162-9544-8759994653d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:24:42.588071 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15d5ca0-5809-4833-a229-e1e54d11acba None None] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:24:42.589146 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cdcf083-31a1-4162-9544-8759994653d1 admin admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:24:42.592695 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c010ed56-4198-4635-9709-93b5e4b50f7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:24:42.593345 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c010ed56-4198-4635-9709-93b5e4b50f7c admin admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:24:42.593628 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c010ed56-4198-4635-9709-93b5e4b50f7c admin admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:24:42.593899 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c010ed56-4198-4635-9709-93b5e4b50f7c admin admin] PATH_INFO: `/v3/domains` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:24:42.594621 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c010ed56-4198-4635-9709-93b5e4b50f7c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79744) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 07:24:42.594922 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c010ed56-4198-4635-9709-93b5e4b50f7c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:24:42.596533 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c010ed56-4198-4635-9709-93b5e4b50f7c admin admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:24:42.599186 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 889/1778] 10.222.0.21 () {58 vars in 1121 bytes} [Wed May 4 07:24:42 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 07:24:42.604248 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cdcf083-31a1-4162-9544-8759994653d1 admin admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:24:42.615700 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 890/1779] 10.222.0.21 () {58 vars in 1152 bytes} [Wed May 4 07:24:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 07:24:42.615882 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cdcf083-31a1-4162-9544-8759994653d1 admin admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:24:42.617638 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c010ed56-4198-4635-9709-93b5e4b50f7c admin admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:24:42.622132 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6332a1d-9d25-4a68-9990-eb646799d2b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:24:42.622944 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6332a1d-9d25-4a68-9990-eb646799d2b3 admin admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:24:42.623281 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6332a1d-9d25-4a68-9990-eb646799d2b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:24:42.623567 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6332a1d-9d25-4a68-9990-eb646799d2b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:24:42.624265 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6332a1d-9d25-4a68-9990-eb646799d2b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:24:42.625844 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6332a1d-9d25-4a68-9990-eb646799d2b3 admin admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:24:42.629476 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c010ed56-4198-4635-9709-93b5e4b50f7c admin admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:24:42.634279 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eaa2b6a-3613-4445-ad32-ee76fff07d5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:24:42.634927 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eaa2b6a-3613-4445-ad32-ee76fff07d5c admin admin] REQUEST_METHOD: `POST` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:24:42.635233 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eaa2b6a-3613-4445-ad32-ee76fff07d5c admin admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:24:42.635506 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eaa2b6a-3613-4445-ad32-ee76fff07d5c admin admin] PATH_INFO: `/v3/projects` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:24:42.636187 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eaa2b6a-3613-4445-ad32-ee76fff07d5c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:24:42.636704 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 890/1780] 10.222.0.21 () {58 vars in 1121 bytes} [Wed May 4 07:24:42 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 04 07:24:42.638097 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eaa2b6a-3613-4445-ad32-ee76fff07d5c admin admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:24:42.641711 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6332a1d-9d25-4a68-9990-eb646799d2b3 admin admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:24:42.651444 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6332a1d-9d25-4a68-9990-eb646799d2b3 admin admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:24:42.656214 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b04ae3-ed2c-4721-9272-508989b5044f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:24:42.657200 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b04ae3-ed2c-4721-9272-508989b5044f admin admin] REQUEST_METHOD: `PUT` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:24:42.657476 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b04ae3-ed2c-4721-9272-508989b5044f admin admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:24:42.657742 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b04ae3-ed2c-4721-9272-508989b5044f admin admin] PATH_INFO: `/v3/projects/7f52331c913b4f5fa041337b7e614345/users/8ecd54d47c424fe0a899f463552ebd3a/roles/9f89c07b05a14f18836116af22cba5f6` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:24:42.665838 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 891/1781] 10.222.0.21 () {60 vars in 1152 bytes} [Wed May 4 07:24:42 2022] POST /identity/v3/projects => generated 377 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 07:24:42.669852 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eaa2b6a-3613-4445-ad32-ee76fff07d5c admin admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:24:42.673825 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b04ae3-ed2c-4721-9272-508989b5044f admin admin] RBAC: Authorizing `identity:create_grant(project_id=7f52331c913b4f5fa041337b7e614345, user_id=8ecd54d47c424fe0a899f463552ebd3a, role_id=9f89c07b05a14f18836116af22cba5f6)` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:24:42.676510 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b04ae3-ed2c-4721-9272-508989b5044f admin admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:24:42.692437 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 891/1782] 10.222.0.21 () {60 vars in 1482 bytes} [Wed May 4 07:24:42 2022] PUT /identity/v3/projects/7f52331c913b4f5fa041337b7e614345/users/8ecd54d47c424fe0a899f463552ebd3a/roles/9f89c07b05a14f18836116af22cba5f6 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 07:24:42.702722 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17f6eb8-3981-48a2-a517-c91253df44d7 None None] REQUEST_METHOD: `POST` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:24:42.703008 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17f6eb8-3981-48a2-a517-c91253df44d7 None None] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:24:42.703318 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17f6eb8-3981-48a2-a517-c91253df44d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:24:42.729364 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.auth.core [None req-c17f6eb8-3981-48a2-a517-c91253df44d7 None None] MFA Rules not processed for user `8ecd54d47c424fe0a899f463552ebd3a`. Rule list: `[]` (Enabled: `True`). {{(pid=79745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:24:42.730498 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.fernet_utils [None req-c17f6eb8-3981-48a2-a517-c91253df44d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:24:42.735848 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eaa2b6a-3613-4445-ad32-ee76fff07d5c admin admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:24:42.802936 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 892/1783] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 07:24:42 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 07:24:42.807974 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17f6eb8-3981-48a2-a517-c91253df44d7 None None] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:24:42.812715 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6f5c29-0d15-4c21-9d7e-870351e35085 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:24:42.813411 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6f5c29-0d15-4c21-9d7e-870351e35085 admin admin] REQUEST_METHOD: `POST` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:24:42.813873 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6f5c29-0d15-4c21-9d7e-870351e35085 admin admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:24:42.814068 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6f5c29-0d15-4c21-9d7e-870351e35085 admin admin] PATH_INFO: `/v3/users` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:24:42.814645 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6f5c29-0d15-4c21-9d7e-870351e35085 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:24:42.816703 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6f5c29-0d15-4c21-9d7e-870351e35085 admin admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:24:42.819990 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17f6eb8-3981-48a2-a517-c91253df44d7 None None] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:24:42.824736 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f6819d-11cd-4dbe-ab4d-66f85583795a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:24:42.825389 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f6819d-11cd-4dbe-ab4d-66f85583795a admin admin] REQUEST_METHOD: `POST` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:24:42.825670 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f6819d-11cd-4dbe-ab4d-66f85583795a admin admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:24:42.825941 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f6819d-11cd-4dbe-ab4d-66f85583795a admin admin] PATH_INFO: `/v3/projects` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:24:42.826652 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f6819d-11cd-4dbe-ab4d-66f85583795a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:24:42.828564 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f6819d-11cd-4dbe-ab4d-66f85583795a admin admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:24:42.849533 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 892/1784] 10.222.0.21 () {60 vars in 1143 bytes} [Wed May 4 07:24:42 2022] POST /identity/v3/users => generated 289 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 07:24:42.856421 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6f5c29-0d15-4c21-9d7e-870351e35085 admin admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:24:42.868100 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6f5c29-0d15-4c21-9d7e-870351e35085 admin admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:24:42.869190 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 893/1785] 10.222.0.21 () {60 vars in 1152 bytes} [Wed May 4 07:24:42 2022] POST /identity/v3/projects => generated 373 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 07:24:42.873306 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f6819d-11cd-4dbe-ab4d-66f85583795a admin admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:24:42.930645 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5480a22b-85e0-46fb-b6c8-c8cb222b93c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:24:42.931368 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5480a22b-85e0-46fb-b6c8-c8cb222b93c9 admin admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:24:42.931652 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5480a22b-85e0-46fb-b6c8-c8cb222b93c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:24:42.931931 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5480a22b-85e0-46fb-b6c8-c8cb222b93c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:24:42.932725 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5480a22b-85e0-46fb-b6c8-c8cb222b93c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:24:42.934369 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5480a22b-85e0-46fb-b6c8-c8cb222b93c9 admin admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:24:42.954762 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 893/1786] 10.222.0.21 () {58 vars in 1121 bytes} [Wed May 4 07:24:42 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 07:24:42.957539 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f6819d-11cd-4dbe-ab4d-66f85583795a admin admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:24:42.958542 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5480a22b-85e0-46fb-b6c8-c8cb222b93c9 admin admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:24:42.962894 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea617b7-fb81-43ae-9398-ba82b8487b06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:24:42.963635 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea617b7-fb81-43ae-9398-ba82b8487b06 admin admin] REQUEST_METHOD: `POST` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:24:42.963899 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea617b7-fb81-43ae-9398-ba82b8487b06 admin admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:24:42.964172 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea617b7-fb81-43ae-9398-ba82b8487b06 admin admin] PATH_INFO: `/v3/users` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:24:42.964867 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea617b7-fb81-43ae-9398-ba82b8487b06 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:24:42.966889 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea617b7-fb81-43ae-9398-ba82b8487b06 admin admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:24:42.969415 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5480a22b-85e0-46fb-b6c8-c8cb222b93c9 admin admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:24:42.973994 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e9d2a9-8bd9-495e-ba85-9eee07c783e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:24:42.974648 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e9d2a9-8bd9-495e-ba85-9eee07c783e1 admin admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:24:42.974925 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e9d2a9-8bd9-495e-ba85-9eee07c783e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:24:42.975238 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e9d2a9-8bd9-495e-ba85-9eee07c783e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:24:42.976240 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e9d2a9-8bd9-495e-ba85-9eee07c783e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:24:42.978472 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e9d2a9-8bd9-495e-ba85-9eee07c783e1 admin admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:24:42.994622 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 894/1787] 10.222.0.21 () {60 vars in 1143 bytes} [Wed May 4 07:24:42 2022] POST /identity/v3/users => generated 293 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 07:24:42.995306 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 894/1788] 10.222.0.21 () {58 vars in 1121 bytes} [Wed May 4 07:24:42 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 04 07:24:42.996332 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea617b7-fb81-43ae-9398-ba82b8487b06 admin admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:24:42.996451 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e9d2a9-8bd9-495e-ba85-9eee07c783e1 admin admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:24:43.009702 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea617b7-fb81-43ae-9398-ba82b8487b06 admin admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:24:43.013204 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e9d2a9-8bd9-495e-ba85-9eee07c783e1 admin admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:24:43.015566 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba873671-68da-4c42-af8b-e9185d42ba4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:24:43.016195 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba873671-68da-4c42-af8b-e9185d42ba4c admin admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:24:43.016480 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba873671-68da-4c42-af8b-e9185d42ba4c admin admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:24:43.016750 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba873671-68da-4c42-af8b-e9185d42ba4c admin admin] PATH_INFO: `/v3/roles` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:24:43.017482 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba873671-68da-4c42-af8b-e9185d42ba4c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:24:43.019250 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba873671-68da-4c42-af8b-e9185d42ba4c admin admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:24:43.020669 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b594561a-d7a0-4178-aacd-bb88184c33ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:24:43.021567 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b594561a-d7a0-4178-aacd-bb88184c33ec admin admin] REQUEST_METHOD: `PUT` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:24:43.021846 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b594561a-d7a0-4178-aacd-bb88184c33ec admin admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:24:43.022123 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b594561a-d7a0-4178-aacd-bb88184c33ec admin admin] PATH_INFO: `/v3/projects/310ece6d486b44f48ae7b72866fce5dd/users/a3f3a1a51be64906867c1561a1b944f8/roles/9f89c07b05a14f18836116af22cba5f6` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:24:43.037385 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 895/1789] 10.222.0.21 () {58 vars in 1121 bytes} [Wed May 4 07:24:42 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 07:24:43.042561 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba873671-68da-4c42-af8b-e9185d42ba4c admin admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:24:43.044772 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b594561a-d7a0-4178-aacd-bb88184c33ec admin admin] RBAC: Authorizing `identity:create_grant(project_id=310ece6d486b44f48ae7b72866fce5dd, user_id=a3f3a1a51be64906867c1561a1b944f8, role_id=9f89c07b05a14f18836116af22cba5f6)` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:24:43.048721 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b594561a-d7a0-4178-aacd-bb88184c33ec admin admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:24:43.052684 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba873671-68da-4c42-af8b-e9185d42ba4c admin admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:24:43.058473 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ede183-f105-46d8-a9df-82b866458262 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:24:43.059389 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ede183-f105-46d8-a9df-82b866458262 admin admin] REQUEST_METHOD: `PUT` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:24:43.059666 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ede183-f105-46d8-a9df-82b866458262 admin admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:24:43.059937 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ede183-f105-46d8-a9df-82b866458262 admin admin] PATH_INFO: `/v3/projects/39a5062334f2447aaa3346d08367e6b4/users/97a2be0eb5bd4caf945871bd9754c2da/roles/eb54c9cea2774a25b1fe8c79724408ee` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:24:43.064669 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 895/1790] 10.222.0.21 () {60 vars in 1482 bytes} [Wed May 4 07:24:42 2022] PUT /identity/v3/projects/310ece6d486b44f48ae7b72866fce5dd/users/a3f3a1a51be64906867c1561a1b944f8/roles/9f89c07b05a14f18836116af22cba5f6 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 07:24:43.075140 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb667faa-082d-4a4a-9cbd-3e5ea57e55ef None None] REQUEST_METHOD: `POST` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:24:43.075467 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb667faa-082d-4a4a-9cbd-3e5ea57e55ef None None] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:24:43.075733 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb667faa-082d-4a4a-9cbd-3e5ea57e55ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:24:43.077281 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ede183-f105-46d8-a9df-82b866458262 admin admin] RBAC: Authorizing `identity:create_grant(project_id=39a5062334f2447aaa3346d08367e6b4, user_id=97a2be0eb5bd4caf945871bd9754c2da, role_id=eb54c9cea2774a25b1fe8c79724408ee)` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:24:43.079954 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ede183-f105-46d8-a9df-82b866458262 admin admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:24:43.093374 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 896/1791] 10.222.0.21 () {60 vars in 1482 bytes} [Wed May 4 07:24:43 2022] PUT /identity/v3/projects/39a5062334f2447aaa3346d08367e6b4/users/97a2be0eb5bd4caf945871bd9754c2da/roles/eb54c9cea2774a25b1fe8c79724408ee => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 07:24:43.097338 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ede183-f105-46d8-a9df-82b866458262 admin admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:24:43.105060 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.auth.core [None req-cb667faa-082d-4a4a-9cbd-3e5ea57e55ef None None] MFA Rules not processed for user `a3f3a1a51be64906867c1561a1b944f8`. Rule list: `[]` (Enabled: `True`). {{(pid=79744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:24:43.106325 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.fernet_utils [None req-cb667faa-082d-4a4a-9cbd-3e5ea57e55ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:24:43.170445 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ede183-f105-46d8-a9df-82b866458262 admin admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:24:43.175180 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 896/1792] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 07:24:43 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 07:24:43.179573 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a1160b-4966-41a9-b63b-1452f8d32806 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:24:43.179754 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb667faa-082d-4a4a-9cbd-3e5ea57e55ef None None] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:24:43.180541 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a1160b-4966-41a9-b63b-1452f8d32806 admin admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:24:43.180861 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a1160b-4966-41a9-b63b-1452f8d32806 admin admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:24:43.181239 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a1160b-4966-41a9-b63b-1452f8d32806 admin admin] PATH_INFO: `/v3/roles` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:24:43.182148 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a1160b-4966-41a9-b63b-1452f8d32806 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:24:43.184308 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a1160b-4966-41a9-b63b-1452f8d32806 admin admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:24:43.196364 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb667faa-082d-4a4a-9cbd-3e5ea57e55ef None None] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:24:43.201642 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1323e629-7e2d-4c2a-9026-9b48a493882e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:24:43.202541 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1323e629-7e2d-4c2a-9026-9b48a493882e admin admin] REQUEST_METHOD: `POST` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:24:43.202828 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1323e629-7e2d-4c2a-9026-9b48a493882e admin admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:24:43.203101 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1323e629-7e2d-4c2a-9026-9b48a493882e admin admin] PATH_INFO: `/v3/projects` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:24:43.204185 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 897/1793] 10.222.0.21 () {58 vars in 1121 bytes} [Wed May 4 07:24:43 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 04 07:24:43.207062 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1323e629-7e2d-4c2a-9026-9b48a493882e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:24:43.208234 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a1160b-4966-41a9-b63b-1452f8d32806 admin admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:24:43.210800 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1323e629-7e2d-4c2a-9026-9b48a493882e admin admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:24:43.223696 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a1160b-4966-41a9-b63b-1452f8d32806 admin admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:24:43.244186 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d489a27-d1ab-4645-bb34-41514596b0a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:24:43.245623 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d489a27-d1ab-4645-bb34-41514596b0a6 admin admin] REQUEST_METHOD: `PUT` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:24:43.246006 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d489a27-d1ab-4645-bb34-41514596b0a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:24:43.246297 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d489a27-d1ab-4645-bb34-41514596b0a6 admin admin] PATH_INFO: `/v3/projects/39a5062334f2447aaa3346d08367e6b4/users/97a2be0eb5bd4caf945871bd9754c2da/roles/eb54c9cea2774a25b1fe8c79724408ee` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:24:43.248434 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d489a27-d1ab-4645-bb34-41514596b0a6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=39a5062334f2447aaa3346d08367e6b4, user_id=97a2be0eb5bd4caf945871bd9754c2da, role_id=eb54c9cea2774a25b1fe8c79724408ee)` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:24:43.251298 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d489a27-d1ab-4645-bb34-41514596b0a6 admin admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:24:43.254554 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 897/1794] 10.222.0.21 () {60 vars in 1152 bytes} [Wed May 4 07:24:43 2022] POST /identity/v3/projects => generated 375 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 07:24:43.259828 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1323e629-7e2d-4c2a-9026-9b48a493882e admin admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:24:43.266430 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 898/1795] 10.222.0.21 () {60 vars in 1482 bytes} [Wed May 4 07:24:43 2022] PUT /identity/v3/projects/39a5062334f2447aaa3346d08367e6b4/users/97a2be0eb5bd4caf945871bd9754c2da/roles/eb54c9cea2774a25b1fe8c79724408ee => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 07:24:43.278027 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134817a9-9e47-464c-bb53-b8ef59fc5c29 None None] REQUEST_METHOD: `POST` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:24:43.278417 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134817a9-9e47-464c-bb53-b8ef59fc5c29 None None] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:24:43.281939 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134817a9-9e47-464c-bb53-b8ef59fc5c29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:24:43.322405 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.auth.core [None req-134817a9-9e47-464c-bb53-b8ef59fc5c29 None None] MFA Rules not processed for user `97a2be0eb5bd4caf945871bd9754c2da`. Rule list: `[]` (Enabled: `True`). {{(pid=79745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:24:43.323722 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.fernet_utils [None req-134817a9-9e47-464c-bb53-b8ef59fc5c29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:24:43.335050 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1323e629-7e2d-4c2a-9026-9b48a493882e admin admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:24:43.415609 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 899/1796] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 07:24:43 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 07:24:43.419268 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d085d016-17cf-48e8-9cfa-0519c08bf20b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:24:43.419812 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d085d016-17cf-48e8-9cfa-0519c08bf20b admin admin] REQUEST_METHOD: `POST` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:24:43.420101 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d085d016-17cf-48e8-9cfa-0519c08bf20b admin admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:24:43.420531 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d085d016-17cf-48e8-9cfa-0519c08bf20b admin admin] PATH_INFO: `/v3/users` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:24:43.421360 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d085d016-17cf-48e8-9cfa-0519c08bf20b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:24:43.423180 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d085d016-17cf-48e8-9cfa-0519c08bf20b admin admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:24:43.428396 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134817a9-9e47-464c-bb53-b8ef59fc5c29 None None] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:24:43.431058 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.fernet_utils [None req-134817a9-9e47-464c-bb53-b8ef59fc5c29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:24:43.451731 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 898/1797] 10.222.0.21 () {60 vars in 1143 bytes} [Wed May 4 07:24:43 2022] POST /identity/v3/users => generated 288 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 07:24:43.452872 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d085d016-17cf-48e8-9cfa-0519c08bf20b admin admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:24:43.465590 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d085d016-17cf-48e8-9cfa-0519c08bf20b admin admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:24:43.470905 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cdf495d-3000-4c8d-a8f9-872395e6fff4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:24:43.471603 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdf495d-3000-4c8d-a8f9-872395e6fff4 admin admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:24:43.471880 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdf495d-3000-4c8d-a8f9-872395e6fff4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:24:43.472151 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdf495d-3000-4c8d-a8f9-872395e6fff4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:24:43.473022 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cdf495d-3000-4c8d-a8f9-872395e6fff4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:24:43.474668 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cdf495d-3000-4c8d-a8f9-872395e6fff4 admin admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:24:43.486647 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 899/1798] 10.222.0.21 () {58 vars in 1121 bytes} [Wed May 4 07:24:43 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 07:24:43.490615 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cdf495d-3000-4c8d-a8f9-872395e6fff4 admin admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:24:43.502727 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cdf495d-3000-4c8d-a8f9-872395e6fff4 admin admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:24:43.508185 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134817a9-9e47-464c-bb53-b8ef59fc5c29 None None] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:24:43.508976 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef80a795-512b-4f2f-bacc-399b0c82d98d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:24:43.509836 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef80a795-512b-4f2f-bacc-399b0c82d98d admin admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:24:43.510385 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef80a795-512b-4f2f-bacc-399b0c82d98d admin admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:24:43.510805 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef80a795-512b-4f2f-bacc-399b0c82d98d admin admin] PATH_INFO: `/v3/roles` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:24:43.511712 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef80a795-512b-4f2f-bacc-399b0c82d98d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:24:43.512444 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c292b0-d003-49ae-87d5-06892c1fcf7b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb341257aa8246b6847561e2fe1fa385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9f9c44db4984653b8d4b5f6b3b949f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:24:43.513097 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c292b0-d003-49ae-87d5-06892c1fcf7b service cinder] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:24:43.513372 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c292b0-d003-49ae-87d5-06892c1fcf7b service cinder] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:24:43.513645 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c292b0-d003-49ae-87d5-06892c1fcf7b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:24:43.513744 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef80a795-512b-4f2f-bacc-399b0c82d98d admin admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:24:43.523845 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c292b0-d003-49ae-87d5-06892c1fcf7b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:24:43.527196 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 900/1799] 10.222.0.21 () {58 vars in 1121 bytes} [Wed May 4 07:24:43 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 04 07:24:43.528205 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c292b0-d003-49ae-87d5-06892c1fcf7b service cinder] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:24:43.534587 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef80a795-512b-4f2f-bacc-399b0c82d98d admin admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:24:43.539335 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 900/1800] 10.222.0.21 () {60 vars in 1365 bytes} [Wed May 4 07:24:43 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 04 07:24:43.545731 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef80a795-512b-4f2f-bacc-399b0c82d98d admin admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:24:43.550410 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91bfc9df-3a69-4806-85df-3602159a5b9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:24:43.551325 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bfc9df-3a69-4806-85df-3602159a5b9e admin admin] REQUEST_METHOD: `PUT` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:24:43.551605 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bfc9df-3a69-4806-85df-3602159a5b9e admin admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:24:43.551875 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bfc9df-3a69-4806-85df-3602159a5b9e admin admin] PATH_INFO: `/v3/projects/97bc96e2ec274833a0bcd3dee3200078/users/b0c3f5447e604a359a99ef6257cbd653/roles/9f89c07b05a14f18836116af22cba5f6` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:24:43.570305 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91bfc9df-3a69-4806-85df-3602159a5b9e admin admin] RBAC: Authorizing `identity:create_grant(project_id=97bc96e2ec274833a0bcd3dee3200078, user_id=b0c3f5447e604a359a99ef6257cbd653, role_id=9f89c07b05a14f18836116af22cba5f6)` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:24:43.573473 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91bfc9df-3a69-4806-85df-3602159a5b9e admin admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:24:43.592618 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 901/1801] 10.222.0.21 () {60 vars in 1482 bytes} [Wed May 4 07:24:43 2022] PUT /identity/v3/projects/97bc96e2ec274833a0bcd3dee3200078/users/b0c3f5447e604a359a99ef6257cbd653/roles/9f89c07b05a14f18836116af22cba5f6 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 07:24:43.605564 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc69b03a-10c4-489d-859c-851cf6be4840 None None] REQUEST_METHOD: `POST` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:24:43.605857 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc69b03a-10c4-489d-859c-851cf6be4840 None None] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:24:43.606139 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc69b03a-10c4-489d-859c-851cf6be4840 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:24:43.627999 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91bfc9df-3a69-4806-85df-3602159a5b9e admin admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:24:43.637602 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.auth.core [None req-dc69b03a-10c4-489d-859c-851cf6be4840 None None] MFA Rules not processed for user `b0c3f5447e604a359a99ef6257cbd653`. Rule list: `[]` (Enabled: `True`). {{(pid=79745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:24:43.638897 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.fernet_utils [None req-dc69b03a-10c4-489d-859c-851cf6be4840 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:24:43.695484 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91bfc9df-3a69-4806-85df-3602159a5b9e admin admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:24:43.701645 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a75f7a-ecee-4247-8155-2002e19b2d9d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb341257aa8246b6847561e2fe1fa385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9f9c44db4984653b8d4b5f6b3b949f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:24:43.701645 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a75f7a-ecee-4247-8155-2002e19b2d9d service cinder] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:24:43.702149 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a75f7a-ecee-4247-8155-2002e19b2d9d service cinder] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:24:43.702932 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a75f7a-ecee-4247-8155-2002e19b2d9d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:24:43.722918 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 901/1802] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 07:24:43 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 07:24:43.728607 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc69b03a-10c4-489d-859c-851cf6be4840 None None] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:24:43.775333 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a75f7a-ecee-4247-8155-2002e19b2d9d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:24:43.776693 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a75f7a-ecee-4247-8155-2002e19b2d9d service cinder] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:24:43.786145 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 902/1803] 10.222.0.21 () {60 vars in 1365 bytes} [Wed May 4 07:24:43 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 04 07:24:43.808021 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc69b03a-10c4-489d-859c-851cf6be4840 None None] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:24:43.815571 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c6c961-0634-4879-aad3-05e0538b933f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:24:43.816625 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c6c961-0634-4879-aad3-05e0538b933f admin admin] REQUEST_METHOD: `POST` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:24:43.817100 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c6c961-0634-4879-aad3-05e0538b933f admin admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:24:43.817573 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c6c961-0634-4879-aad3-05e0538b933f admin admin] PATH_INFO: `/v3/projects` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:24:43.818380 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c6c961-0634-4879-aad3-05e0538b933f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:24:43.821127 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c6c961-0634-4879-aad3-05e0538b933f admin admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:24:43.863636 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 902/1804] 10.222.0.21 () {60 vars in 1152 bytes} [Wed May 4 07:24:43 2022] POST /identity/v3/projects => generated 375 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 07:24:43.865090 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a75f7a-ecee-4247-8155-2002e19b2d9d service cinder] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:24:43.877266 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a75f7a-ecee-4247-8155-2002e19b2d9d service cinder] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:24:43.985298 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5078a299-c65e-4bfe-86ac-214e92e97651 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:24:43.986264 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5078a299-c65e-4bfe-86ac-214e92e97651 admin admin] REQUEST_METHOD: `POST` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:24:43.986801 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5078a299-c65e-4bfe-86ac-214e92e97651 admin admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:24:43.987198 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5078a299-c65e-4bfe-86ac-214e92e97651 admin admin] PATH_INFO: `/v3/users` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:24:43.988095 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5078a299-c65e-4bfe-86ac-214e92e97651 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:24:43.990421 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5078a299-c65e-4bfe-86ac-214e92e97651 admin admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:24:44.024865 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 903/1805] 10.222.0.21 () {60 vars in 1143 bytes} [Wed May 4 07:24:43 2022] POST /identity/v3/users => generated 294 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 07:24:44.028907 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c6c961-0634-4879-aad3-05e0538b933f admin admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:24:44.043661 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c6c961-0634-4879-aad3-05e0538b933f admin admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:24:44.049310 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff60a07b-6ba1-4ae5-9055-81b3f39e2a16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:24:44.050089 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff60a07b-6ba1-4ae5-9055-81b3f39e2a16 admin admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:24:44.050454 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff60a07b-6ba1-4ae5-9055-81b3f39e2a16 admin admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:24:44.050822 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff60a07b-6ba1-4ae5-9055-81b3f39e2a16 admin admin] PATH_INFO: `/v3/roles` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:24:44.051688 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff60a07b-6ba1-4ae5-9055-81b3f39e2a16 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:24:44.053367 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff60a07b-6ba1-4ae5-9055-81b3f39e2a16 admin admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:24:44.068364 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 903/1806] 10.222.0.21 () {58 vars in 1121 bytes} [Wed May 4 07:24:44 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 04 07:24:44.072937 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5078a299-c65e-4bfe-86ac-214e92e97651 admin admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:24:44.093754 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5078a299-c65e-4bfe-86ac-214e92e97651 admin admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:24:44.099908 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4346bf6f-13c0-400b-bd9b-1ba1ca84336a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:24:44.101625 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4346bf6f-13c0-400b-bd9b-1ba1ca84336a admin admin] REQUEST_METHOD: `PUT` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:24:44.102026 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4346bf6f-13c0-400b-bd9b-1ba1ca84336a admin admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:24:44.102494 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4346bf6f-13c0-400b-bd9b-1ba1ca84336a admin admin] PATH_INFO: `/v3/projects/1ab00322553b427587e2a8500a826b72/users/f851a935632844ceaaf9cac3b5ba5965/roles/eb54c9cea2774a25b1fe8c79724408ee` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:24:44.128602 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4346bf6f-13c0-400b-bd9b-1ba1ca84336a admin admin] RBAC: Authorizing `identity:create_grant(project_id=1ab00322553b427587e2a8500a826b72, user_id=f851a935632844ceaaf9cac3b5ba5965, role_id=eb54c9cea2774a25b1fe8c79724408ee)` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:24:44.134178 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4346bf6f-13c0-400b-bd9b-1ba1ca84336a admin admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:24:44.155646 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 904/1807] 10.222.0.21 () {60 vars in 1482 bytes} [Wed May 4 07:24:44 2022] PUT /identity/v3/projects/1ab00322553b427587e2a8500a826b72/users/f851a935632844ceaaf9cac3b5ba5965/roles/eb54c9cea2774a25b1fe8c79724408ee => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 07:24:44.160036 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff60a07b-6ba1-4ae5-9055-81b3f39e2a16 admin admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:24:44.170849 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff60a07b-6ba1-4ae5-9055-81b3f39e2a16 admin admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:24:44.229021 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5cee5dc-612f-47cb-adf3-67a296bff630 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:24:44.229681 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cee5dc-612f-47cb-adf3-67a296bff630 admin admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:24:44.229956 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cee5dc-612f-47cb-adf3-67a296bff630 admin admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:24:44.230226 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cee5dc-612f-47cb-adf3-67a296bff630 admin admin] PATH_INFO: `/v3/roles` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:24:44.230941 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5cee5dc-612f-47cb-adf3-67a296bff630 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:24:44.232656 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5cee5dc-612f-47cb-adf3-67a296bff630 admin admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:24:44.243644 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 904/1808] 10.222.0.21 () {58 vars in 1121 bytes} [Wed May 4 07:24:44 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 07:24:44.247872 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4346bf6f-13c0-400b-bd9b-1ba1ca84336a admin admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:24:44.259316 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4346bf6f-13c0-400b-bd9b-1ba1ca84336a admin admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:24:44.264215 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e27fc42-99f9-4de2-be17-044af3e80830 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:24:44.265131 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e27fc42-99f9-4de2-be17-044af3e80830 admin admin] REQUEST_METHOD: `PUT` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:24:44.265412 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e27fc42-99f9-4de2-be17-044af3e80830 admin admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:24:44.265687 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e27fc42-99f9-4de2-be17-044af3e80830 admin admin] PATH_INFO: `/v3/projects/1ab00322553b427587e2a8500a826b72/users/f851a935632844ceaaf9cac3b5ba5965/roles/eb54c9cea2774a25b1fe8c79724408ee` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:24:44.267975 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e27fc42-99f9-4de2-be17-044af3e80830 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1ab00322553b427587e2a8500a826b72, user_id=f851a935632844ceaaf9cac3b5ba5965, role_id=eb54c9cea2774a25b1fe8c79724408ee)` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:24:44.270864 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e27fc42-99f9-4de2-be17-044af3e80830 admin admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:24:44.281999 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 905/1809] 10.222.0.21 () {60 vars in 1482 bytes} [Wed May 4 07:24:44 2022] PUT /identity/v3/projects/1ab00322553b427587e2a8500a826b72/users/f851a935632844ceaaf9cac3b5ba5965/roles/eb54c9cea2774a25b1fe8c79724408ee => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 07:24:44.293473 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de1341d-469e-43d5-b705-286ad9616073 None None] REQUEST_METHOD: `POST` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:24:44.293763 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de1341d-469e-43d5-b705-286ad9616073 None None] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:24:44.294041 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de1341d-469e-43d5-b705-286ad9616073 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:24:44.321684 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.auth.core [None req-8de1341d-469e-43d5-b705-286ad9616073 None None] MFA Rules not processed for user `f851a935632844ceaaf9cac3b5ba5965`. Rule list: `[]` (Enabled: `True`). {{(pid=79745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:24:44.322892 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.fernet_utils [None req-8de1341d-469e-43d5-b705-286ad9616073 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:24:44.412344 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 905/1810] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 07:24:44 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 07:24:44.424286 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e27fc42-99f9-4de2-be17-044af3e80830 admin admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:24:44.426095 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.fernet_utils [None req-7e27fc42-99f9-4de2-be17-044af3e80830 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:24:44.509378 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e27fc42-99f9-4de2-be17-044af3e80830 admin admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:24:44.513714 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198adf11-862d-4aeb-9f0e-73c34da07311 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb341257aa8246b6847561e2fe1fa385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9f9c44db4984653b8d4b5f6b3b949f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:24:44.514484 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198adf11-862d-4aeb-9f0e-73c34da07311 service cinder] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:24:44.514765 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198adf11-862d-4aeb-9f0e-73c34da07311 service cinder] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:24:44.515040 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198adf11-862d-4aeb-9f0e-73c34da07311 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:24:44.596383 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198adf11-862d-4aeb-9f0e-73c34da07311 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:24:44.598855 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198adf11-862d-4aeb-9f0e-73c34da07311 service cinder] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:24:44.612099 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 906/1811] 10.222.0.21 () {60 vars in 1365 bytes} [Wed May 4 07:24:44 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 04 07:24:48.283731 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de1341d-469e-43d5-b705-286ad9616073 None None] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:24:48.294338 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de1341d-469e-43d5-b705-286ad9616073 None None] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:24:48.298386 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fb5fa2-255e-4dee-a48a-fa4f3b8449df service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb341257aa8246b6847561e2fe1fa385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9f9c44db4984653b8d4b5f6b3b949f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:24:48.299324 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fb5fa2-255e-4dee-a48a-fa4f3b8449df service cinder] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:24:48.299802 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fb5fa2-255e-4dee-a48a-fa4f3b8449df service cinder] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:24:48.300257 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fb5fa2-255e-4dee-a48a-fa4f3b8449df service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:24:48.377199 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3fb5fa2-255e-4dee-a48a-fa4f3b8449df service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:24:48.379867 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3fb5fa2-255e-4dee-a48a-fa4f3b8449df service cinder] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:24:48.390828 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 906/1812] 10.222.0.21 () {60 vars in 1365 bytes} [Wed May 4 07:24:48 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 07:24:48.759217 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198adf11-862d-4aeb-9f0e-73c34da07311 service cinder] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:24:48.760380 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.fernet_utils [None req-198adf11-862d-4aeb-9f0e-73c34da07311 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:24:48.900191 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198adf11-862d-4aeb-9f0e-73c34da07311 service cinder] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:24:48.907470 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb2cc40-4f28-49f1-818d-c2a99d709011 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:24:48.908235 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb2cc40-4f28-49f1-818d-c2a99d709011 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:24:48.908526 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb2cc40-4f28-49f1-818d-c2a99d709011 admin admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:24:48.908800 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb2cc40-4f28-49f1-818d-c2a99d709011 admin admin] PATH_INFO: `/v3/users/f1fe1b17796c4acf959ddf60dee67c99` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:24:48.910323 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb2cc40-4f28-49f1-818d-c2a99d709011 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f1fe1b17796c4acf959ddf60dee67c99)` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:24:48.912606 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb2cc40-4f28-49f1-818d-c2a99d709011 admin admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:24:49.035491 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-1eb2cc40-4f28-49f1-818d-c2a99d709011 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f1fe1b17796c4acf959ddf60dee67c99'} {{(pid=79744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:24:49.037608 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-1eb2cc40-4f28-49f1-818d-c2a99d709011 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f1fe1b17796c4acf959ddf60dee67c99'} {{(pid=79744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:24:49.061217 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-1eb2cc40-4f28-49f1-818d-c2a99d709011 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f1fe1b17796c4acf959ddf60dee67c99'} {{(pid=79744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:24:49.063078 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-1eb2cc40-4f28-49f1-818d-c2a99d709011 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f1fe1b17796c4acf959ddf60dee67c99'} {{(pid=79744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:24:49.126103 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-1eb2cc40-4f28-49f1-818d-c2a99d709011 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f1fe1b17796c4acf959ddf60dee67c99'} {{(pid=79744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:24:49.155993 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 907/1813] 10.222.0.21 () {58 vars in 1223 bytes} [Wed May 4 07:24:48 2022] DELETE /identity/v3/users/f1fe1b17796c4acf959ddf60dee67c99 => generated 0 bytes in 398 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 07:24:49.160815 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c060ac5-76ce-4116-9900-6c4d5ec48986 None None] REQUEST_METHOD: `POST` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:24:49.161098 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c060ac5-76ce-4116-9900-6c4d5ec48986 None None] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:24:49.161639 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c060ac5-76ce-4116-9900-6c4d5ec48986 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:24:49.221982 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.auth.core [None req-2c060ac5-76ce-4116-9900-6c4d5ec48986 None None] MFA Rules not processed for user `83c5e0dcb991496ea6dee38384514508`. Rule list: `[]` (Enabled: `True`). {{(pid=79745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:24:49.223287 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.fernet_utils [None req-2c060ac5-76ce-4116-9900-6c4d5ec48986 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:24:49.400498 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 907/1814] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 07:24:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 07:24:49.410638 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb2cc40-4f28-49f1-818d-c2a99d709011 admin admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:24:49.412200 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.fernet_utils [None req-1eb2cc40-4f28-49f1-818d-c2a99d709011 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:24:49.462943 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c060ac5-76ce-4116-9900-6c4d5ec48986 None None] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:24:49.465329 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.fernet_utils [None req-2c060ac5-76ce-4116-9900-6c4d5ec48986 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:24:49.543962 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c060ac5-76ce-4116-9900-6c4d5ec48986 None None] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:24:49.546904 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb2cc40-4f28-49f1-818d-c2a99d709011 admin admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:24:49.548329 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f84b77-2f62-4aa1-ae6d-2e1bd7eaf288 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb341257aa8246b6847561e2fe1fa385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9f9c44db4984653b8d4b5f6b3b949f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:24:49.548993 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f84b77-2f62-4aa1-ae6d-2e1bd7eaf288 service cinder] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:24:49.549291 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f84b77-2f62-4aa1-ae6d-2e1bd7eaf288 service cinder] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:24:49.549671 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f84b77-2f62-4aa1-ae6d-2e1bd7eaf288 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:24:49.556443 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a1aa9a-6e10-46fb-ac7d-64398a1c6adf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91cb92d00273402b837cb29b37325101', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9f9c44db4984653b8d4b5f6b3b949f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:24:49.557376 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a1aa9a-6e10-46fb-ac7d-64398a1c6adf service neutron] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:24:49.557883 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a1aa9a-6e10-46fb-ac7d-64398a1c6adf service neutron] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:24:49.558300 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a1aa9a-6e10-46fb-ac7d-64398a1c6adf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:24:49.558893 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.fernet_utils [None req-66f84b77-2f62-4aa1-ae6d-2e1bd7eaf288 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:24:49.573205 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a1aa9a-6e10-46fb-ac7d-64398a1c6adf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:24:49.575107 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a1aa9a-6e10-46fb-ac7d-64398a1c6adf service neutron] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:24:49.588706 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 908/1815] 10.222.0.21 () {60 vars in 1365 bytes} [Wed May 4 07:24:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 07:24:49.646722 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f84b77-2f62-4aa1-ae6d-2e1bd7eaf288 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:24:49.649068 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f84b77-2f62-4aa1-ae6d-2e1bd7eaf288 service cinder] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:24:49.661131 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 908/1816] 10.222.0.21 () {60 vars in 1365 bytes} [Wed May 4 07:24:49 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 04 07:24:49.979015 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a1aa9a-6e10-46fb-ac7d-64398a1c6adf service neutron] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:24:49.981784 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.fernet_utils [None req-c4a1aa9a-6e10-46fb-ac7d-64398a1c6adf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:24:49.998089 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a1aa9a-6e10-46fb-ac7d-64398a1c6adf service neutron] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:24:50.002896 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7077844-adfe-46e1-95fc-22c707492740 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:24:50.005291 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7077844-adfe-46e1-95fc-22c707492740 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:24:50.005578 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7077844-adfe-46e1-95fc-22c707492740 admin admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:24:50.005851 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7077844-adfe-46e1-95fc-22c707492740 admin admin] PATH_INFO: `/v3/projects/e99d205d911a47df8eec67326748e6d4` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:24:50.007308 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7077844-adfe-46e1-95fc-22c707492740 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e99d205d911a47df8eec67326748e6d4)` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:24:50.009230 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7077844-adfe-46e1-95fc-22c707492740 admin admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:24:50.073170 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-a7077844-adfe-46e1-95fc-22c707492740 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e99d205d911a47df8eec67326748e6d4', 'request_id': 'req-a7077844-adfe-46e1-95fc-22c707492740'} {{(pid=79744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:24:50.078444 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-a7077844-adfe-46e1-95fc-22c707492740 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e99d205d911a47df8eec67326748e6d4', 'request_id': 'req-a7077844-adfe-46e1-95fc-22c707492740'} {{(pid=79744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:24:50.086523 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-a7077844-adfe-46e1-95fc-22c707492740 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e99d205d911a47df8eec67326748e6d4', 'request_id': 'req-a7077844-adfe-46e1-95fc-22c707492740'} {{(pid=79744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:24:50.097916 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-a7077844-adfe-46e1-95fc-22c707492740 admin admin] The token cache is being invalidate because project e99d205d911a47df8eec67326748e6d4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79744) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 07:24:50.098290 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-a7077844-adfe-46e1-95fc-22c707492740 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:24:50.098997 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-a7077844-adfe-46e1-95fc-22c707492740 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:24:50.101361 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 909/1817] 10.222.0.21 () {58 vars in 1232 bytes} [Wed May 4 07:24:49 2022] DELETE /identity/v3/projects/e99d205d911a47df8eec67326748e6d4 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 07:24:50.106247 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f84b77-2f62-4aa1-ae6d-2e1bd7eaf288 service cinder] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:24:50.119367 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f84b77-2f62-4aa1-ae6d-2e1bd7eaf288 service cinder] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:24:50.199094 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d91429-bf8c-4968-acc0-571cae4e7c19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:24:50.200002 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d91429-bf8c-4968-acc0-571cae4e7c19 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:24:50.200278 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d91429-bf8c-4968-acc0-571cae4e7c19 admin admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:24:50.200548 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d91429-bf8c-4968-acc0-571cae4e7c19 admin admin] PATH_INFO: `/v3/users/7933dcc3dba845aca03eda91f004edbb` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:24:50.201765 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d91429-bf8c-4968-acc0-571cae4e7c19 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7933dcc3dba845aca03eda91f004edbb)` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:24:50.203742 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d91429-bf8c-4968-acc0-571cae4e7c19 admin admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:24:50.266524 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-d4d91429-bf8c-4968-acc0-571cae4e7c19 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7933dcc3dba845aca03eda91f004edbb'} {{(pid=79745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:24:50.279614 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-d4d91429-bf8c-4968-acc0-571cae4e7c19 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7933dcc3dba845aca03eda91f004edbb'} {{(pid=79745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:24:50.280338 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-d4d91429-bf8c-4968-acc0-571cae4e7c19 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7933dcc3dba845aca03eda91f004edbb'} {{(pid=79745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:24:50.280986 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-d4d91429-bf8c-4968-acc0-571cae4e7c19 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7933dcc3dba845aca03eda91f004edbb'} {{(pid=79745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:24:50.293151 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-d4d91429-bf8c-4968-acc0-571cae4e7c19 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7933dcc3dba845aca03eda91f004edbb'} {{(pid=79745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:24:50.308561 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 909/1818] 10.222.0.21 () {58 vars in 1223 bytes} [Wed May 4 07:24:50 2022] DELETE /identity/v3/users/7933dcc3dba845aca03eda91f004edbb => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 07:24:50.628362 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7077844-adfe-46e1-95fc-22c707492740 admin admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:24:50.630057 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.fernet_utils [None req-a7077844-adfe-46e1-95fc-22c707492740 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:24:50.657827 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7077844-adfe-46e1-95fc-22c707492740 admin admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:24:50.733164 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91fb881-ce25-4d3e-8216-4a4afa28c552 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:24:50.733461 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91fb881-ce25-4d3e-8216-4a4afa28c552 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:24:50.733773 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91fb881-ce25-4d3e-8216-4a4afa28c552 admin admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:24:50.734048 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91fb881-ce25-4d3e-8216-4a4afa28c552 admin admin] PATH_INFO: `/v3/projects/f6dd5f666b6749e0a7c10659e0758f4c` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:24:50.735292 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91fb881-ce25-4d3e-8216-4a4afa28c552 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f6dd5f666b6749e0a7c10659e0758f4c)` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:24:50.737194 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91fb881-ce25-4d3e-8216-4a4afa28c552 admin admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:24:50.787900 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-f91fb881-ce25-4d3e-8216-4a4afa28c552 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f6dd5f666b6749e0a7c10659e0758f4c', 'request_id': 'req-f91fb881-ce25-4d3e-8216-4a4afa28c552'} {{(pid=79744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:24:50.796491 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-f91fb881-ce25-4d3e-8216-4a4afa28c552 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f6dd5f666b6749e0a7c10659e0758f4c', 'request_id': 'req-f91fb881-ce25-4d3e-8216-4a4afa28c552'} {{(pid=79744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:24:50.806150 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-f91fb881-ce25-4d3e-8216-4a4afa28c552 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f6dd5f666b6749e0a7c10659e0758f4c', 'request_id': 'req-f91fb881-ce25-4d3e-8216-4a4afa28c552'} {{(pid=79744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:24:50.819076 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-f91fb881-ce25-4d3e-8216-4a4afa28c552 admin admin] The token cache is being invalidate because project f6dd5f666b6749e0a7c10659e0758f4c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79744) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 07:24:50.819782 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-f91fb881-ce25-4d3e-8216-4a4afa28c552 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:24:50.820805 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-f91fb881-ce25-4d3e-8216-4a4afa28c552 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:24:50.826891 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 910/1819] 10.222.0.21 () {58 vars in 1232 bytes} [Wed May 4 07:24:50 2022] DELETE /identity/v3/projects/f6dd5f666b6749e0a7c10659e0758f4c => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 07:24:50.830290 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcb5239-c1f5-46ed-bcce-2facf22f000d None None] REQUEST_METHOD: `POST` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:24:50.830290 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcb5239-c1f5-46ed-bcce-2facf22f000d None None] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:24:50.830290 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcb5239-c1f5-46ed-bcce-2facf22f000d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:24:50.864892 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.auth.core [None req-1bcb5239-c1f5-46ed-bcce-2facf22f000d None None] MFA Rules not processed for user `83c5e0dcb991496ea6dee38384514508`. Rule list: `[]` (Enabled: `True`). {{(pid=79745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:24:50.868091 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.fernet_utils [None req-1bcb5239-c1f5-46ed-bcce-2facf22f000d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:24:50.961279 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 910/1820] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 07:24:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 07:24:50.968918 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe3088e-8bbf-45bf-b19c-88b8136e6f2b None None] REQUEST_METHOD: `POST` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:24:50.969198 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe3088e-8bbf-45bf-b19c-88b8136e6f2b None None] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:24:50.969499 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe3088e-8bbf-45bf-b19c-88b8136e6f2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:24:50.989887 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.auth.core [None req-dfe3088e-8bbf-45bf-b19c-88b8136e6f2b None None] MFA Rules not processed for user `83c5e0dcb991496ea6dee38384514508`. Rule list: `[]` (Enabled: `True`). {{(pid=79744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:24:50.991185 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.fernet_utils [None req-dfe3088e-8bbf-45bf-b19c-88b8136e6f2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:24:51.001078 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 911/1821] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 07:24:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 07:24:51.005915 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcb5239-c1f5-46ed-bcce-2facf22f000d None None] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:24:51.016168 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcb5239-c1f5-46ed-bcce-2facf22f000d None None] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:24:51.020782 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431d9992-452b-4530-9a7c-585c4df33a36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:24:51.021504 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431d9992-452b-4530-9a7c-585c4df33a36 admin admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:24:51.022208 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431d9992-452b-4530-9a7c-585c4df33a36 admin admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:24:51.022208 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431d9992-452b-4530-9a7c-585c4df33a36 admin admin] PATH_INFO: `/v3/domains` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:24:51.023551 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431d9992-452b-4530-9a7c-585c4df33a36 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 07:24:51.023551 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431d9992-452b-4530-9a7c-585c4df33a36 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:24:51.024950 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431d9992-452b-4530-9a7c-585c4df33a36 admin admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:24:51.038758 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 911/1822] 10.222.0.21 () {58 vars in 1152 bytes} [Wed May 4 07:24:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 07:24:51.042049 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe3088e-8bbf-45bf-b19c-88b8136e6f2b None None] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:24:51.051379 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe3088e-8bbf-45bf-b19c-88b8136e6f2b None None] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:24:51.057040 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432848b8-25e3-4084-b775-afa0da1eaa6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:24:51.057697 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432848b8-25e3-4084-b775-afa0da1eaa6e admin admin] REQUEST_METHOD: `POST` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:24:51.057978 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432848b8-25e3-4084-b775-afa0da1eaa6e admin admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:24:51.058247 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432848b8-25e3-4084-b775-afa0da1eaa6e admin admin] PATH_INFO: `/v3/projects` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:24:51.058940 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432848b8-25e3-4084-b775-afa0da1eaa6e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:24:51.060877 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432848b8-25e3-4084-b775-afa0da1eaa6e admin admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:24:51.089130 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 912/1823] 10.222.0.21 () {60 vars in 1152 bytes} [Wed May 4 07:24:51 2022] POST /identity/v3/projects => generated 381 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 07:24:51.093332 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431d9992-452b-4530-9a7c-585c4df33a36 admin admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:24:51.103795 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431d9992-452b-4530-9a7c-585c4df33a36 admin admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:24:51.165558 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc889346-513f-4ab5-b931-650f5e7d7fd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:24:51.166220 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc889346-513f-4ab5-b931-650f5e7d7fd1 admin admin] REQUEST_METHOD: `POST` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:24:51.166496 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc889346-513f-4ab5-b931-650f5e7d7fd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:24:51.166766 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc889346-513f-4ab5-b931-650f5e7d7fd1 admin admin] PATH_INFO: `/v3/users` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:24:51.167478 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc889346-513f-4ab5-b931-650f5e7d7fd1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:24:51.169388 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc889346-513f-4ab5-b931-650f5e7d7fd1 admin admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:24:51.195244 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 912/1824] 10.222.0.21 () {60 vars in 1143 bytes} [Wed May 4 07:24:51 2022] POST /identity/v3/users => generated 291 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 07:24:51.196548 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432848b8-25e3-4084-b775-afa0da1eaa6e admin admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:24:51.207258 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432848b8-25e3-4084-b775-afa0da1eaa6e admin admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:24:51.212758 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923bf2b4-0295-45dd-906f-9f3170f83cbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:24:51.213351 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923bf2b4-0295-45dd-906f-9f3170f83cbe admin admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:24:51.213627 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923bf2b4-0295-45dd-906f-9f3170f83cbe admin admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:24:51.213908 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923bf2b4-0295-45dd-906f-9f3170f83cbe admin admin] PATH_INFO: `/v3/roles` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:24:51.214633 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923bf2b4-0295-45dd-906f-9f3170f83cbe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:24:51.216275 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923bf2b4-0295-45dd-906f-9f3170f83cbe admin admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:24:51.229313 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 913/1825] 10.222.0.21 () {58 vars in 1121 bytes} [Wed May 4 07:24:51 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 07:24:51.233751 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc889346-513f-4ab5-b931-650f5e7d7fd1 admin admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:24:51.244042 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc889346-513f-4ab5-b931-650f5e7d7fd1 admin admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:24:51.255095 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17139db0-743a-4ce0-a929-d3f05a413dfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:24:51.255805 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17139db0-743a-4ce0-a929-d3f05a413dfd admin admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:24:51.256080 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17139db0-743a-4ce0-a929-d3f05a413dfd admin admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:24:51.256349 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17139db0-743a-4ce0-a929-d3f05a413dfd admin admin] PATH_INFO: `/v3/roles` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:24:51.257225 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17139db0-743a-4ce0-a929-d3f05a413dfd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:24:51.258916 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17139db0-743a-4ce0-a929-d3f05a413dfd admin admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:24:51.280645 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 913/1826] 10.222.0.21 () {58 vars in 1121 bytes} [Wed May 4 07:24:51 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 07:24:51.281059 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923bf2b4-0295-45dd-906f-9f3170f83cbe admin admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:24:51.291900 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923bf2b4-0295-45dd-906f-9f3170f83cbe admin admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:24:51.296933 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b22a09-8f20-40bf-a74d-34e8c2efe5f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:24:51.297822 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b22a09-8f20-40bf-a74d-34e8c2efe5f1 admin admin] REQUEST_METHOD: `PUT` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:24:51.298097 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b22a09-8f20-40bf-a74d-34e8c2efe5f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:24:51.298365 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b22a09-8f20-40bf-a74d-34e8c2efe5f1 admin admin] PATH_INFO: `/v3/projects/558473f9215a496f9e70a46cf779f2ee/users/0f81daadaec9420fb6eab0ec9550a21e/roles/9f89c07b05a14f18836116af22cba5f6` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:24:51.313342 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b22a09-8f20-40bf-a74d-34e8c2efe5f1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=558473f9215a496f9e70a46cf779f2ee, user_id=0f81daadaec9420fb6eab0ec9550a21e, role_id=9f89c07b05a14f18836116af22cba5f6)` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:24:51.316043 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b22a09-8f20-40bf-a74d-34e8c2efe5f1 admin admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:24:51.329697 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 914/1827] 10.222.0.21 () {60 vars in 1482 bytes} [Wed May 4 07:24:51 2022] PUT /identity/v3/projects/558473f9215a496f9e70a46cf779f2ee/users/0f81daadaec9420fb6eab0ec9550a21e/roles/9f89c07b05a14f18836116af22cba5f6 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 07:24:51.340853 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71683b76-4e0c-474f-a544-e784ed86d6e7 None None] REQUEST_METHOD: `POST` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:24:51.341144 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71683b76-4e0c-474f-a544-e784ed86d6e7 None None] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:24:51.341424 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71683b76-4e0c-474f-a544-e784ed86d6e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:24:51.370803 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.auth.core [None req-71683b76-4e0c-474f-a544-e784ed86d6e7 None None] MFA Rules not processed for user `0f81daadaec9420fb6eab0ec9550a21e`. Rule list: `[]` (Enabled: `True`). {{(pid=79745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:24:51.372046 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.fernet_utils [None req-71683b76-4e0c-474f-a544-e784ed86d6e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:24:51.434483 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 914/1828] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 07:24:51 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 07:24:51.439360 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b22a09-8f20-40bf-a74d-34e8c2efe5f1 admin admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:24:51.501170 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b22a09-8f20-40bf-a74d-34e8c2efe5f1 admin admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:24:51.506338 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dcd8097-3d7c-4e78-8fa1-fd4e821d6ac3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:24:51.507773 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcd8097-3d7c-4e78-8fa1-fd4e821d6ac3 admin admin] REQUEST_METHOD: `POST` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:24:51.508174 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcd8097-3d7c-4e78-8fa1-fd4e821d6ac3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:24:51.508519 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcd8097-3d7c-4e78-8fa1-fd4e821d6ac3 admin admin] PATH_INFO: `/v3/projects` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:24:51.509247 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dcd8097-3d7c-4e78-8fa1-fd4e821d6ac3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:24:51.511168 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dcd8097-3d7c-4e78-8fa1-fd4e821d6ac3 admin admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:24:51.538375 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 915/1829] 10.222.0.21 () {60 vars in 1152 bytes} [Wed May 4 07:24:51 2022] POST /identity/v3/projects => generated 381 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 07:24:51.542330 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71683b76-4e0c-474f-a544-e784ed86d6e7 None None] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:24:51.552983 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71683b76-4e0c-474f-a544-e784ed86d6e7 None None] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:24:51.610315 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1320d651-4e31-44dc-9d7c-263827e3ea67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:24:51.610976 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1320d651-4e31-44dc-9d7c-263827e3ea67 admin admin] REQUEST_METHOD: `POST` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:24:51.611295 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1320d651-4e31-44dc-9d7c-263827e3ea67 admin admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:24:51.611572 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1320d651-4e31-44dc-9d7c-263827e3ea67 admin admin] PATH_INFO: `/v3/users` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:24:51.612275 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1320d651-4e31-44dc-9d7c-263827e3ea67 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:24:51.614220 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1320d651-4e31-44dc-9d7c-263827e3ea67 admin admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:24:51.638019 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 915/1830] 10.222.0.21 () {60 vars in 1143 bytes} [Wed May 4 07:24:51 2022] POST /identity/v3/users => generated 297 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 07:24:51.643552 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dcd8097-3d7c-4e78-8fa1-fd4e821d6ac3 admin admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:24:51.654700 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dcd8097-3d7c-4e78-8fa1-fd4e821d6ac3 admin admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:24:51.659484 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f085113-1aee-4127-9c7b-6dc09de53fc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:24:51.660146 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f085113-1aee-4127-9c7b-6dc09de53fc3 admin admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:24:51.660429 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f085113-1aee-4127-9c7b-6dc09de53fc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:24:51.660700 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f085113-1aee-4127-9c7b-6dc09de53fc3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:24:51.661424 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f085113-1aee-4127-9c7b-6dc09de53fc3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:24:51.663053 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f085113-1aee-4127-9c7b-6dc09de53fc3 admin admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:24:51.674114 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 916/1831] 10.222.0.21 () {58 vars in 1121 bytes} [Wed May 4 07:24:51 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 07:24:51.678362 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1320d651-4e31-44dc-9d7c-263827e3ea67 admin admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:24:51.689084 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1320d651-4e31-44dc-9d7c-263827e3ea67 admin admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:24:51.693760 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b32d78-3de0-4760-a225-174c42ef23f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:24:51.695538 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b32d78-3de0-4760-a225-174c42ef23f8 admin admin] REQUEST_METHOD: `PUT` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:24:51.695782 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b32d78-3de0-4760-a225-174c42ef23f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:24:51.696052 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b32d78-3de0-4760-a225-174c42ef23f8 admin admin] PATH_INFO: `/v3/projects/c7750edded1948738a3b9907b3d3fc49/users/84f980a2d9944db1b9cc627de17fdd7f/roles/eb54c9cea2774a25b1fe8c79724408ee` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:24:51.712829 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b32d78-3de0-4760-a225-174c42ef23f8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c7750edded1948738a3b9907b3d3fc49, user_id=84f980a2d9944db1b9cc627de17fdd7f, role_id=eb54c9cea2774a25b1fe8c79724408ee)` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:24:51.715949 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b32d78-3de0-4760-a225-174c42ef23f8 admin admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:24:51.730263 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 916/1832] 10.222.0.21 () {60 vars in 1482 bytes} [Wed May 4 07:24:51 2022] PUT /identity/v3/projects/c7750edded1948738a3b9907b3d3fc49/users/84f980a2d9944db1b9cc627de17fdd7f/roles/eb54c9cea2774a25b1fe8c79724408ee => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 07:24:51.734083 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f085113-1aee-4127-9c7b-6dc09de53fc3 admin admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:24:51.744386 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f085113-1aee-4127-9c7b-6dc09de53fc3 admin admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:24:51.802891 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c4b0b2-0b05-4e30-ae03-57c3f0a9b85b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:24:51.803700 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c4b0b2-0b05-4e30-ae03-57c3f0a9b85b admin admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:24:51.803991 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c4b0b2-0b05-4e30-ae03-57c3f0a9b85b admin admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:24:51.804361 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c4b0b2-0b05-4e30-ae03-57c3f0a9b85b admin admin] PATH_INFO: `/v3/roles` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:24:51.805105 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c4b0b2-0b05-4e30-ae03-57c3f0a9b85b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:24:51.806724 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c4b0b2-0b05-4e30-ae03-57c3f0a9b85b admin admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:24:51.821649 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 917/1833] 10.222.0.21 () {58 vars in 1121 bytes} [Wed May 4 07:24:51 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 07:24:51.825788 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b32d78-3de0-4760-a225-174c42ef23f8 admin admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:24:51.837812 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b32d78-3de0-4760-a225-174c42ef23f8 admin admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:24:51.842489 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55fee2a6-a29e-47d9-aea4-cd3ec1648923 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:24:51.843564 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fee2a6-a29e-47d9-aea4-cd3ec1648923 admin admin] REQUEST_METHOD: `PUT` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:24:51.843841 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fee2a6-a29e-47d9-aea4-cd3ec1648923 admin admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:24:51.844112 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fee2a6-a29e-47d9-aea4-cd3ec1648923 admin admin] PATH_INFO: `/v3/projects/c7750edded1948738a3b9907b3d3fc49/users/84f980a2d9944db1b9cc627de17fdd7f/roles/eb54c9cea2774a25b1fe8c79724408ee` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:24:51.846058 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55fee2a6-a29e-47d9-aea4-cd3ec1648923 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c7750edded1948738a3b9907b3d3fc49, user_id=84f980a2d9944db1b9cc627de17fdd7f, role_id=eb54c9cea2774a25b1fe8c79724408ee)` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:24:51.848711 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55fee2a6-a29e-47d9-aea4-cd3ec1648923 admin admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:24:51.859292 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 917/1834] 10.222.0.21 () {60 vars in 1482 bytes} [Wed May 4 07:24:51 2022] PUT /identity/v3/projects/c7750edded1948738a3b9907b3d3fc49/users/84f980a2d9944db1b9cc627de17fdd7f/roles/eb54c9cea2774a25b1fe8c79724408ee => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 07:24:51.871026 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf363c6-f180-424e-923e-99fbbf897a9d None None] REQUEST_METHOD: `POST` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:24:51.871349 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf363c6-f180-424e-923e-99fbbf897a9d None None] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:24:51.871633 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf363c6-f180-424e-923e-99fbbf897a9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:24:51.909293 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.auth.core [None req-edf363c6-f180-424e-923e-99fbbf897a9d None None] MFA Rules not processed for user `84f980a2d9944db1b9cc627de17fdd7f`. Rule list: `[]` (Enabled: `True`). {{(pid=79744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:24:51.910494 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.fernet_utils [None req-edf363c6-f180-424e-923e-99fbbf897a9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:24:51.995540 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 918/1835] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 07:24:51 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 07:24:52.003046 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55fee2a6-a29e-47d9-aea4-cd3ec1648923 admin admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:24:52.005702 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.fernet_utils [None req-55fee2a6-a29e-47d9-aea4-cd3ec1648923 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:24:52.065944 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55fee2a6-a29e-47d9-aea4-cd3ec1648923 admin admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:24:52.070399 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63561488-787e-4090-bf1f-b9d08e488e2c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb341257aa8246b6847561e2fe1fa385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9f9c44db4984653b8d4b5f6b3b949f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:24:52.071039 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63561488-787e-4090-bf1f-b9d08e488e2c service cinder] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:24:52.071354 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63561488-787e-4090-bf1f-b9d08e488e2c service cinder] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:24:52.071625 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63561488-787e-4090-bf1f-b9d08e488e2c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:24:52.080682 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63561488-787e-4090-bf1f-b9d08e488e2c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:24:52.082170 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63561488-787e-4090-bf1f-b9d08e488e2c service cinder] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:24:52.092199 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 918/1836] 10.222.0.21 () {60 vars in 1365 bytes} [Wed May 4 07:24:52 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 07:24:52.193962 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf363c6-f180-424e-923e-99fbbf897a9d None None] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:24:52.204854 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf363c6-f180-424e-923e-99fbbf897a9d None None] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:24:52.208755 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836cf37f-cf7c-41ee-b087-bb297623ab59 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb341257aa8246b6847561e2fe1fa385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9f9c44db4984653b8d4b5f6b3b949f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:24:52.209411 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836cf37f-cf7c-41ee-b087-bb297623ab59 service cinder] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:24:52.209693 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836cf37f-cf7c-41ee-b087-bb297623ab59 service cinder] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:24:52.210152 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836cf37f-cf7c-41ee-b087-bb297623ab59 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:24:52.279214 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836cf37f-cf7c-41ee-b087-bb297623ab59 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:24:52.280648 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836cf37f-cf7c-41ee-b087-bb297623ab59 service cinder] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:24:52.291985 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 919/1837] 10.222.0.21 () {60 vars in 1365 bytes} [Wed May 4 07:24:52 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 07:25:01.276295 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96caac4-c077-4c82-b1f9-fd4233cd84c0 None None] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:25:01.277140 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96caac4-c077-4c82-b1f9-fd4233cd84c0 None None] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:25:01.277140 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96caac4-c077-4c82-b1f9-fd4233cd84c0 None None] PATH_INFO: `/` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:25:01.279417 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 919/1838] 10.222.0.21 () {54 vars in 921 bytes} [Wed May 4 07:25:01 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 07:25:01.319303 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffdeba5-b2b6-4ada-8d11-9841616cd135 None None] REQUEST_METHOD: `POST` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:25:01.320694 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffdeba5-b2b6-4ada-8d11-9841616cd135 None None] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:25:01.321384 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffdeba5-b2b6-4ada-8d11-9841616cd135 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:25:01.357596 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.auth.core [None req-bffdeba5-b2b6-4ada-8d11-9841616cd135 None None] MFA Rules not processed for user `1077289fedae43b6be47be7f716d573a`. Rule list: `[]` (Enabled: `True`). {{(pid=79744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:25:01.360444 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.fernet_utils [None req-bffdeba5-b2b6-4ada-8d11-9841616cd135 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:25:01.510148 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 920/1839] 10.222.0.21 () {58 vars in 1018 bytes} [Wed May 4 07:25:01 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 07:25:02.005563 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96caac4-c077-4c82-b1f9-fd4233cd84c0 None None] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:25:02.009194 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.fernet_utils [None req-b96caac4-c077-4c82-b1f9-fd4233cd84c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:25:02.057458 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96caac4-c077-4c82-b1f9-fd4233cd84c0 None None] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:25:02.066841 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e4d865-fe46-4ba0-b8e5-ca65d2f6a5b8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1077289fedae43b6be47be7f716d573a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9f9c44db4984653b8d4b5f6b3b949f5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:25:02.067893 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e4d865-fe46-4ba0-b8e5-ca65d2f6a5b8 service nova] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:25:02.068171 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e4d865-fe46-4ba0-b8e5-ca65d2f6a5b8 service nova] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:25:02.068456 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e4d865-fe46-4ba0-b8e5-ca65d2f6a5b8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:25:02.085296 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e4d865-fe46-4ba0-b8e5-ca65d2f6a5b8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:25:02.088139 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e4d865-fe46-4ba0-b8e5-ca65d2f6a5b8 service nova] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:25:02.117498 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 920/1840] 10.222.0.21 () {60 vars in 1365 bytes} [Wed May 4 07:25:02 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 07:25:03.729760 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffdeba5-b2b6-4ada-8d11-9841616cd135 None None] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:25:03.797139 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffdeba5-b2b6-4ada-8d11-9841616cd135 None None] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:25:03.801847 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a93043-f830-4bfc-8973-7050446117b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:25:03.802741 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a93043-f830-4bfc-8973-7050446117b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:25:03.803022 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a93043-f830-4bfc-8973-7050446117b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:25:03.803335 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a93043-f830-4bfc-8973-7050446117b0 admin admin] PATH_INFO: `/v3/users/0f81daadaec9420fb6eab0ec9550a21e` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:25:03.804618 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a93043-f830-4bfc-8973-7050446117b0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0f81daadaec9420fb6eab0ec9550a21e)` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:25:03.806569 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a93043-f830-4bfc-8973-7050446117b0 admin admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:25:03.858049 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-68a93043-f830-4bfc-8973-7050446117b0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0f81daadaec9420fb6eab0ec9550a21e'} {{(pid=79744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:25:03.858837 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-68a93043-f830-4bfc-8973-7050446117b0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0f81daadaec9420fb6eab0ec9550a21e'} {{(pid=79744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:25:03.867505 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-68a93043-f830-4bfc-8973-7050446117b0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0f81daadaec9420fb6eab0ec9550a21e'} {{(pid=79744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:25:03.868241 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-68a93043-f830-4bfc-8973-7050446117b0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0f81daadaec9420fb6eab0ec9550a21e'} {{(pid=79744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:25:03.880279 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-68a93043-f830-4bfc-8973-7050446117b0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0f81daadaec9420fb6eab0ec9550a21e'} {{(pid=79744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:25:03.896123 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 921/1841] 10.222.0.21 () {58 vars in 1223 bytes} [Wed May 4 07:25:03 2022] DELETE /identity/v3/users/0f81daadaec9420fb6eab0ec9550a21e => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 07:25:03.900871 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bc33d1-cea3-42f8-8fd3-0d1de8df6dde None None] REQUEST_METHOD: `POST` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:25:03.901463 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bc33d1-cea3-42f8-8fd3-0d1de8df6dde None None] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:25:03.901601 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bc33d1-cea3-42f8-8fd3-0d1de8df6dde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:25:03.920721 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.auth.core [None req-93bc33d1-cea3-42f8-8fd3-0d1de8df6dde None None] MFA Rules not processed for user `83c5e0dcb991496ea6dee38384514508`. Rule list: `[]` (Enabled: `True`). {{(pid=79745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:25:03.921984 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.fernet_utils [None req-93bc33d1-cea3-42f8-8fd3-0d1de8df6dde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:25:03.986909 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 921/1842] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 07:25:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 07:25:03.997401 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a93043-f830-4bfc-8973-7050446117b0 admin admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:25:03.998839 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.fernet_utils [None req-68a93043-f830-4bfc-8973-7050446117b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:25:04.060945 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a93043-f830-4bfc-8973-7050446117b0 admin admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:25:04.064911 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe5fcfc-08cf-46f1-a45b-d89ad7e19a6e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91cb92d00273402b837cb29b37325101', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9f9c44db4984653b8d4b5f6b3b949f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:25:04.065575 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe5fcfc-08cf-46f1-a45b-d89ad7e19a6e service neutron] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:25:04.065885 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe5fcfc-08cf-46f1-a45b-d89ad7e19a6e service neutron] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:25:04.066114 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe5fcfc-08cf-46f1-a45b-d89ad7e19a6e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:25:04.076717 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe5fcfc-08cf-46f1-a45b-d89ad7e19a6e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:25:04.078200 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe5fcfc-08cf-46f1-a45b-d89ad7e19a6e service neutron] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:25:04.088908 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 922/1843] 10.222.0.21 () {60 vars in 1365 bytes} [Wed May 4 07:25:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 07:25:04.612441 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93bc33d1-cea3-42f8-8fd3-0d1de8df6dde None None] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:25:04.614141 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.fernet_utils [None req-93bc33d1-cea3-42f8-8fd3-0d1de8df6dde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:25:04.627578 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93bc33d1-cea3-42f8-8fd3-0d1de8df6dde None None] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:25:04.634495 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f70edbb-8c92-4fde-b37d-1e4e176f1e81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:25:04.635435 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f70edbb-8c92-4fde-b37d-1e4e176f1e81 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:25:04.635714 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f70edbb-8c92-4fde-b37d-1e4e176f1e81 admin admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:25:04.635987 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f70edbb-8c92-4fde-b37d-1e4e176f1e81 admin admin] PATH_INFO: `/v3/projects/558473f9215a496f9e70a46cf779f2ee` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:25:04.637327 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f70edbb-8c92-4fde-b37d-1e4e176f1e81 admin admin] RBAC: Authorizing `identity:delete_project(project_id=558473f9215a496f9e70a46cf779f2ee)` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:25:04.639357 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f70edbb-8c92-4fde-b37d-1e4e176f1e81 admin admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:25:04.699969 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-2f70edbb-8c92-4fde-b37d-1e4e176f1e81 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '558473f9215a496f9e70a46cf779f2ee', 'request_id': 'req-2f70edbb-8c92-4fde-b37d-1e4e176f1e81'} {{(pid=79745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:25:04.707953 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-2f70edbb-8c92-4fde-b37d-1e4e176f1e81 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '558473f9215a496f9e70a46cf779f2ee', 'request_id': 'req-2f70edbb-8c92-4fde-b37d-1e4e176f1e81'} {{(pid=79745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:25:04.720409 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-2f70edbb-8c92-4fde-b37d-1e4e176f1e81 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '558473f9215a496f9e70a46cf779f2ee', 'request_id': 'req-2f70edbb-8c92-4fde-b37d-1e4e176f1e81'} {{(pid=79745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:25:04.734516 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-2f70edbb-8c92-4fde-b37d-1e4e176f1e81 admin admin] The token cache is being invalidate because project 558473f9215a496f9e70a46cf779f2ee was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79745) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 07:25:04.734791 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-2f70edbb-8c92-4fde-b37d-1e4e176f1e81 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:25:04.735539 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-2f70edbb-8c92-4fde-b37d-1e4e176f1e81 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:25:04.737393 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 922/1844] 10.222.0.21 () {58 vars in 1232 bytes} [Wed May 4 07:25:04 2022] DELETE /identity/v3/projects/558473f9215a496f9e70a46cf779f2ee => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 07:25:04.742223 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe5fcfc-08cf-46f1-a45b-d89ad7e19a6e service neutron] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:25:04.752635 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe5fcfc-08cf-46f1-a45b-d89ad7e19a6e service neutron] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:25:04.824907 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5742e2d5-b1b0-4b56-9e3e-83d1ad43c571 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:25:04.825809 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5742e2d5-b1b0-4b56-9e3e-83d1ad43c571 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:25:04.826091 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5742e2d5-b1b0-4b56-9e3e-83d1ad43c571 admin admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:25:04.826370 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5742e2d5-b1b0-4b56-9e3e-83d1ad43c571 admin admin] PATH_INFO: `/v3/users/84f980a2d9944db1b9cc627de17fdd7f` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:25:04.827713 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5742e2d5-b1b0-4b56-9e3e-83d1ad43c571 admin admin] RBAC: Authorizing `identity:delete_user(user_id=84f980a2d9944db1b9cc627de17fdd7f)` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:25:04.829660 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5742e2d5-b1b0-4b56-9e3e-83d1ad43c571 admin admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:25:04.881548 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-5742e2d5-b1b0-4b56-9e3e-83d1ad43c571 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '84f980a2d9944db1b9cc627de17fdd7f'} {{(pid=79744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:25:04.882257 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-5742e2d5-b1b0-4b56-9e3e-83d1ad43c571 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '84f980a2d9944db1b9cc627de17fdd7f'} {{(pid=79744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:25:04.889635 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-5742e2d5-b1b0-4b56-9e3e-83d1ad43c571 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '84f980a2d9944db1b9cc627de17fdd7f'} {{(pid=79744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:25:04.890395 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-5742e2d5-b1b0-4b56-9e3e-83d1ad43c571 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '84f980a2d9944db1b9cc627de17fdd7f'} {{(pid=79744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:25:04.902923 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-5742e2d5-b1b0-4b56-9e3e-83d1ad43c571 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '84f980a2d9944db1b9cc627de17fdd7f'} {{(pid=79744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:25:04.917819 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 923/1845] 10.222.0.21 () {58 vars in 1223 bytes} [Wed May 4 07:25:04 2022] DELETE /identity/v3/users/84f980a2d9944db1b9cc627de17fdd7f => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 07:25:05.208470 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f70edbb-8c92-4fde-b37d-1e4e176f1e81 admin admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:25:05.212094 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.fernet_utils [None req-2f70edbb-8c92-4fde-b37d-1e4e176f1e81 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:25:05.230395 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f70edbb-8c92-4fde-b37d-1e4e176f1e81 admin admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:25:05.305138 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4063b800-e397-4a9d-87d0-c53099aef9a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:25:05.306648 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4063b800-e397-4a9d-87d0-c53099aef9a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:25:05.307183 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4063b800-e397-4a9d-87d0-c53099aef9a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:25:05.307915 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4063b800-e397-4a9d-87d0-c53099aef9a4 admin admin] PATH_INFO: `/v3/projects/c7750edded1948738a3b9907b3d3fc49` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:25:05.310189 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4063b800-e397-4a9d-87d0-c53099aef9a4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c7750edded1948738a3b9907b3d3fc49)` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:25:05.312741 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4063b800-e397-4a9d-87d0-c53099aef9a4 admin admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:25:05.389344 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-4063b800-e397-4a9d-87d0-c53099aef9a4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c7750edded1948738a3b9907b3d3fc49', 'request_id': 'req-4063b800-e397-4a9d-87d0-c53099aef9a4'} {{(pid=79745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:25:05.401035 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-4063b800-e397-4a9d-87d0-c53099aef9a4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c7750edded1948738a3b9907b3d3fc49', 'request_id': 'req-4063b800-e397-4a9d-87d0-c53099aef9a4'} {{(pid=79745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:25:05.410193 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-4063b800-e397-4a9d-87d0-c53099aef9a4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c7750edded1948738a3b9907b3d3fc49', 'request_id': 'req-4063b800-e397-4a9d-87d0-c53099aef9a4'} {{(pid=79745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:25:05.422185 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-4063b800-e397-4a9d-87d0-c53099aef9a4 admin admin] The token cache is being invalidate because project c7750edded1948738a3b9907b3d3fc49 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79745) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 07:25:05.422445 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-4063b800-e397-4a9d-87d0-c53099aef9a4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:25:05.423181 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-4063b800-e397-4a9d-87d0-c53099aef9a4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:25:05.424780 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 923/1846] 10.222.0.21 () {58 vars in 1232 bytes} [Wed May 4 07:25:05 2022] DELETE /identity/v3/projects/c7750edded1948738a3b9907b3d3fc49 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 07:25:05.432698 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037529ab-c748-4867-9ce3-79be1a82b33e None None] REQUEST_METHOD: `POST` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:25:05.433006 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037529ab-c748-4867-9ce3-79be1a82b33e None None] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:25:05.433271 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037529ab-c748-4867-9ce3-79be1a82b33e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:25:05.452992 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.auth.core [None req-037529ab-c748-4867-9ce3-79be1a82b33e None None] MFA Rules not processed for user `83c5e0dcb991496ea6dee38384514508`. Rule list: `[]` (Enabled: `True`). {{(pid=79744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:25:05.454203 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.fernet_utils [None req-037529ab-c748-4867-9ce3-79be1a82b33e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:25:05.516484 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 924/1847] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 07:25:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 07:25:05.525076 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718e9c9f-4731-4b24-a73c-842bffead8a3 None None] REQUEST_METHOD: `POST` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:25:05.525469 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718e9c9f-4731-4b24-a73c-842bffead8a3 None None] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:25:05.525917 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718e9c9f-4731-4b24-a73c-842bffead8a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:25:05.548617 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.auth.core [None req-718e9c9f-4731-4b24-a73c-842bffead8a3 None None] MFA Rules not processed for user `83c5e0dcb991496ea6dee38384514508`. Rule list: `[]` (Enabled: `True`). {{(pid=79745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:25:05.549763 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.fernet_utils [None req-718e9c9f-4731-4b24-a73c-842bffead8a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:25:05.558029 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 924/1848] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 07:25:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 07:25:05.562718 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037529ab-c748-4867-9ce3-79be1a82b33e None None] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:25:05.581725 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037529ab-c748-4867-9ce3-79be1a82b33e None None] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:25:05.590246 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b49482f-870e-4c65-99bf-f054d39e88e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:25:05.592474 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b49482f-870e-4c65-99bf-f054d39e88e4 admin admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:25:05.592474 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b49482f-870e-4c65-99bf-f054d39e88e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:25:05.592750 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b49482f-870e-4c65-99bf-f054d39e88e4 admin admin] PATH_INFO: `/v3/domains` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:25:05.594164 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b49482f-870e-4c65-99bf-f054d39e88e4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79744) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 07:25:05.594715 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b49482f-870e-4c65-99bf-f054d39e88e4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:25:05.597779 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b49482f-870e-4c65-99bf-f054d39e88e4 admin admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:25:05.617531 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 925/1849] 10.222.0.21 () {58 vars in 1152 bytes} [Wed May 4 07:25:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 07:25:05.619634 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718e9c9f-4731-4b24-a73c-842bffead8a3 None None] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:25:05.630699 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718e9c9f-4731-4b24-a73c-842bffead8a3 None None] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:25:05.636592 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e75e017-9eb4-4f7a-b5fa-b32cdf12adba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:25:05.637498 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e75e017-9eb4-4f7a-b5fa-b32cdf12adba admin admin] REQUEST_METHOD: `POST` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:25:05.637887 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e75e017-9eb4-4f7a-b5fa-b32cdf12adba admin admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:25:05.638261 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e75e017-9eb4-4f7a-b5fa-b32cdf12adba admin admin] PATH_INFO: `/v3/projects` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:25:05.639228 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e75e017-9eb4-4f7a-b5fa-b32cdf12adba admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:25:05.641327 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e75e017-9eb4-4f7a-b5fa-b32cdf12adba admin admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:25:05.685143 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 925/1850] 10.222.0.21 () {60 vars in 1152 bytes} [Wed May 4 07:25:05 2022] POST /identity/v3/projects => generated 387 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 07:25:05.686263 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b49482f-870e-4c65-99bf-f054d39e88e4 admin admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:25:05.697889 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b49482f-870e-4c65-99bf-f054d39e88e4 admin admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:25:05.763308 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb6c2af-d5ff-4d60-b6a3-d114f5cb517c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:25:05.764002 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb6c2af-d5ff-4d60-b6a3-d114f5cb517c admin admin] REQUEST_METHOD: `POST` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:25:05.764285 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb6c2af-d5ff-4d60-b6a3-d114f5cb517c admin admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:25:05.764551 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb6c2af-d5ff-4d60-b6a3-d114f5cb517c admin admin] PATH_INFO: `/v3/users` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:25:05.765287 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb6c2af-d5ff-4d60-b6a3-d114f5cb517c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:25:05.767481 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb6c2af-d5ff-4d60-b6a3-d114f5cb517c admin admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:25:05.795192 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 926/1851] 10.222.0.21 () {60 vars in 1143 bytes} [Wed May 4 07:25:05 2022] POST /identity/v3/users => generated 294 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 07:25:05.796960 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e75e017-9eb4-4f7a-b5fa-b32cdf12adba admin admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:25:05.808020 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e75e017-9eb4-4f7a-b5fa-b32cdf12adba admin admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:25:05.812793 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02536fb4-9d8d-49f9-8919-425a98db3342 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:25:05.813656 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02536fb4-9d8d-49f9-8919-425a98db3342 admin admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:25:05.813888 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02536fb4-9d8d-49f9-8919-425a98db3342 admin admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:25:05.814115 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02536fb4-9d8d-49f9-8919-425a98db3342 admin admin] PATH_INFO: `/v3/roles` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:25:05.814845 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02536fb4-9d8d-49f9-8919-425a98db3342 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:25:05.816475 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02536fb4-9d8d-49f9-8919-425a98db3342 admin admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:25:05.830102 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 926/1852] 10.222.0.21 () {58 vars in 1121 bytes} [Wed May 4 07:25:05 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 07:25:05.834352 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb6c2af-d5ff-4d60-b6a3-d114f5cb517c admin admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:25:05.845735 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb6c2af-d5ff-4d60-b6a3-d114f5cb517c admin admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:25:05.850548 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392db542-2e95-41de-a3e0-5111396a59b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:25:05.851346 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392db542-2e95-41de-a3e0-5111396a59b4 admin admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:25:05.851631 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392db542-2e95-41de-a3e0-5111396a59b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:25:05.851908 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392db542-2e95-41de-a3e0-5111396a59b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:25:05.852637 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392db542-2e95-41de-a3e0-5111396a59b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:25:05.854225 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392db542-2e95-41de-a3e0-5111396a59b4 admin admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:25:05.864758 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 927/1853] 10.222.0.21 () {58 vars in 1121 bytes} [Wed May 4 07:25:05 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 04 07:25:05.869631 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02536fb4-9d8d-49f9-8919-425a98db3342 admin admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:25:05.880880 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02536fb4-9d8d-49f9-8919-425a98db3342 admin admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:25:05.886625 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1d8fbd-002f-4b53-9911-99a8a6dd3dfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:25:05.887652 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1d8fbd-002f-4b53-9911-99a8a6dd3dfc admin admin] REQUEST_METHOD: `PUT` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:25:05.887969 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1d8fbd-002f-4b53-9911-99a8a6dd3dfc admin admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:25:05.888243 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1d8fbd-002f-4b53-9911-99a8a6dd3dfc admin admin] PATH_INFO: `/v3/projects/84f3d78d14824b949abcfe8fc94b8c7c/users/6960dbadf8514631884d09768c854d3c/roles/9f89c07b05a14f18836116af22cba5f6` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:25:05.905893 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1d8fbd-002f-4b53-9911-99a8a6dd3dfc admin admin] RBAC: Authorizing `identity:create_grant(project_id=84f3d78d14824b949abcfe8fc94b8c7c, user_id=6960dbadf8514631884d09768c854d3c, role_id=9f89c07b05a14f18836116af22cba5f6)` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:25:05.908866 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1d8fbd-002f-4b53-9911-99a8a6dd3dfc admin admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:25:05.923388 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 927/1854] 10.222.0.21 () {60 vars in 1482 bytes} [Wed May 4 07:25:05 2022] PUT /identity/v3/projects/84f3d78d14824b949abcfe8fc94b8c7c/users/6960dbadf8514631884d09768c854d3c/roles/9f89c07b05a14f18836116af22cba5f6 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 07:25:05.936406 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d74bd9-d9cb-43a4-a2b0-91c62f283402 None None] REQUEST_METHOD: `POST` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:25:05.936799 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d74bd9-d9cb-43a4-a2b0-91c62f283402 None None] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:25:05.937116 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d74bd9-d9cb-43a4-a2b0-91c62f283402 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:25:05.968570 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.auth.core [None req-31d74bd9-d9cb-43a4-a2b0-91c62f283402 None None] MFA Rules not processed for user `6960dbadf8514631884d09768c854d3c`. Rule list: `[]` (Enabled: `True`). {{(pid=79744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:25:05.969778 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.fernet_utils [None req-31d74bd9-d9cb-43a4-a2b0-91c62f283402 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:25:06.036333 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 928/1855] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 07:25:05 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 07:25:06.041746 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1d8fbd-002f-4b53-9911-99a8a6dd3dfc admin admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:25:06.116768 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1d8fbd-002f-4b53-9911-99a8a6dd3dfc admin admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:25:06.122738 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc691911-6789-437c-b77d-27df1dd31b3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:25:06.123446 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc691911-6789-437c-b77d-27df1dd31b3f admin admin] REQUEST_METHOD: `POST` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:25:06.123732 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc691911-6789-437c-b77d-27df1dd31b3f admin admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:25:06.124015 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc691911-6789-437c-b77d-27df1dd31b3f admin admin] PATH_INFO: `/v3/projects` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:25:06.124715 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc691911-6789-437c-b77d-27df1dd31b3f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:25:06.126632 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc691911-6789-437c-b77d-27df1dd31b3f admin admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:25:06.155767 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 928/1856] 10.222.0.21 () {60 vars in 1152 bytes} [Wed May 4 07:25:06 2022] POST /identity/v3/projects => generated 387 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 07:25:06.160535 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d74bd9-d9cb-43a4-a2b0-91c62f283402 None None] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:25:06.172009 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d74bd9-d9cb-43a4-a2b0-91c62f283402 None None] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:25:06.229799 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09bca6d9-a12a-4989-8998-cc599417b289 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:25:06.230479 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bca6d9-a12a-4989-8998-cc599417b289 admin admin] REQUEST_METHOD: `POST` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:25:06.230761 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bca6d9-a12a-4989-8998-cc599417b289 admin admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:25:06.231036 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bca6d9-a12a-4989-8998-cc599417b289 admin admin] PATH_INFO: `/v3/users` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:25:06.231780 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09bca6d9-a12a-4989-8998-cc599417b289 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:25:06.234056 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09bca6d9-a12a-4989-8998-cc599417b289 admin admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:25:06.258394 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 929/1857] 10.222.0.21 () {60 vars in 1143 bytes} [Wed May 4 07:25:06 2022] POST /identity/v3/users => generated 300 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 07:25:06.262154 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc691911-6789-437c-b77d-27df1dd31b3f admin admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:25:06.272572 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc691911-6789-437c-b77d-27df1dd31b3f admin admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:25:06.277503 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3b7d34-9c25-4ff7-bc93-47e28db26cd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:25:06.278193 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3b7d34-9c25-4ff7-bc93-47e28db26cd1 admin admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:25:06.278494 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3b7d34-9c25-4ff7-bc93-47e28db26cd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:25:06.278764 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3b7d34-9c25-4ff7-bc93-47e28db26cd1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:25:06.279510 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3b7d34-9c25-4ff7-bc93-47e28db26cd1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:25:06.281144 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3b7d34-9c25-4ff7-bc93-47e28db26cd1 admin admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:25:06.291941 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 929/1858] 10.222.0.21 () {58 vars in 1121 bytes} [Wed May 4 07:25:06 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 07:25:06.296581 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09bca6d9-a12a-4989-8998-cc599417b289 admin admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:25:06.308426 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09bca6d9-a12a-4989-8998-cc599417b289 admin admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:25:06.314271 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea77cef8-6071-4dd6-89f4-dcbac2a6fc09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:25:06.315183 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea77cef8-6071-4dd6-89f4-dcbac2a6fc09 admin admin] REQUEST_METHOD: `PUT` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:25:06.315473 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea77cef8-6071-4dd6-89f4-dcbac2a6fc09 admin admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:25:06.315749 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea77cef8-6071-4dd6-89f4-dcbac2a6fc09 admin admin] PATH_INFO: `/v3/projects/dc929cf3d8f242c2889468419ec4a9ea/users/c11741dcdb0e4bf797f09fa2e7ed3766/roles/eb54c9cea2774a25b1fe8c79724408ee` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:25:06.332336 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea77cef8-6071-4dd6-89f4-dcbac2a6fc09 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dc929cf3d8f242c2889468419ec4a9ea, user_id=c11741dcdb0e4bf797f09fa2e7ed3766, role_id=eb54c9cea2774a25b1fe8c79724408ee)` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:25:06.335408 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea77cef8-6071-4dd6-89f4-dcbac2a6fc09 admin admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:25:06.348263 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 930/1859] 10.222.0.21 () {60 vars in 1482 bytes} [Wed May 4 07:25:06 2022] PUT /identity/v3/projects/dc929cf3d8f242c2889468419ec4a9ea/users/c11741dcdb0e4bf797f09fa2e7ed3766/roles/eb54c9cea2774a25b1fe8c79724408ee => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 07:25:06.352177 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3b7d34-9c25-4ff7-bc93-47e28db26cd1 admin admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:25:06.362253 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3b7d34-9c25-4ff7-bc93-47e28db26cd1 admin admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:25:06.417117 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f500e911-2f05-484f-bf6f-ae733c3e3075 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:25:06.417693 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f500e911-2f05-484f-bf6f-ae733c3e3075 admin admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:25:06.417992 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f500e911-2f05-484f-bf6f-ae733c3e3075 admin admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:25:06.418247 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f500e911-2f05-484f-bf6f-ae733c3e3075 admin admin] PATH_INFO: `/v3/roles` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:25:06.419075 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f500e911-2f05-484f-bf6f-ae733c3e3075 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:25:06.420860 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f500e911-2f05-484f-bf6f-ae733c3e3075 admin admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:25:06.431195 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 930/1860] 10.222.0.21 () {58 vars in 1121 bytes} [Wed May 4 07:25:06 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 07:25:06.435385 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea77cef8-6071-4dd6-89f4-dcbac2a6fc09 admin admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:25:06.447277 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea77cef8-6071-4dd6-89f4-dcbac2a6fc09 admin admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:25:06.452451 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66ae70d-afba-4dd9-9a00-121eb2613cff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:25:06.453344 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66ae70d-afba-4dd9-9a00-121eb2613cff admin admin] REQUEST_METHOD: `PUT` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:25:06.453625 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66ae70d-afba-4dd9-9a00-121eb2613cff admin admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:25:06.453898 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66ae70d-afba-4dd9-9a00-121eb2613cff admin admin] PATH_INFO: `/v3/projects/dc929cf3d8f242c2889468419ec4a9ea/users/c11741dcdb0e4bf797f09fa2e7ed3766/roles/eb54c9cea2774a25b1fe8c79724408ee` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:25:06.455924 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66ae70d-afba-4dd9-9a00-121eb2613cff admin admin] RBAC: Authorizing `identity:create_grant(project_id=dc929cf3d8f242c2889468419ec4a9ea, user_id=c11741dcdb0e4bf797f09fa2e7ed3766, role_id=eb54c9cea2774a25b1fe8c79724408ee)` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:25:06.458589 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66ae70d-afba-4dd9-9a00-121eb2613cff admin admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:25:06.469339 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 931/1861] 10.222.0.21 () {60 vars in 1482 bytes} [Wed May 4 07:25:06 2022] PUT /identity/v3/projects/dc929cf3d8f242c2889468419ec4a9ea/users/c11741dcdb0e4bf797f09fa2e7ed3766/roles/eb54c9cea2774a25b1fe8c79724408ee => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 07:25:06.480019 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6144bc-d1a7-47ad-a17d-1a6539199b83 None None] REQUEST_METHOD: `POST` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:25:06.480306 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6144bc-d1a7-47ad-a17d-1a6539199b83 None None] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:25:06.480607 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6144bc-d1a7-47ad-a17d-1a6539199b83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:25:06.512660 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.auth.core [None req-9b6144bc-d1a7-47ad-a17d-1a6539199b83 None None] MFA Rules not processed for user `c11741dcdb0e4bf797f09fa2e7ed3766`. Rule list: `[]` (Enabled: `True`). {{(pid=79745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:25:06.513884 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.fernet_utils [None req-9b6144bc-d1a7-47ad-a17d-1a6539199b83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:25:06.593030 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 931/1862] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 07:25:06 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 07:25:06.604379 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66ae70d-afba-4dd9-9a00-121eb2613cff admin admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:25:06.606321 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.fernet_utils [None req-f66ae70d-afba-4dd9-9a00-121eb2613cff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:25:06.685085 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66ae70d-afba-4dd9-9a00-121eb2613cff admin admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:25:06.690887 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6018a085-96c7-4fe8-8cb3-06fae1e0c11b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb341257aa8246b6847561e2fe1fa385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9f9c44db4984653b8d4b5f6b3b949f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:25:06.691884 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6018a085-96c7-4fe8-8cb3-06fae1e0c11b service cinder] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:25:06.692331 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6018a085-96c7-4fe8-8cb3-06fae1e0c11b service cinder] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:25:06.692816 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6018a085-96c7-4fe8-8cb3-06fae1e0c11b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:25:06.707583 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6018a085-96c7-4fe8-8cb3-06fae1e0c11b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:25:06.709402 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6018a085-96c7-4fe8-8cb3-06fae1e0c11b service cinder] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:25:06.720241 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 932/1863] 10.222.0.21 () {60 vars in 1365 bytes} [Wed May 4 07:25:06 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 07:25:07.365593 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6144bc-d1a7-47ad-a17d-1a6539199b83 None None] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:25:07.428579 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6144bc-d1a7-47ad-a17d-1a6539199b83 None None] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:25:07.433177 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c00214-b9c7-4cfe-b904-9a147bcff350 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:25:07.434042 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c00214-b9c7-4cfe-b904-9a147bcff350 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:25:07.434321 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c00214-b9c7-4cfe-b904-9a147bcff350 admin admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:25:07.434619 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c00214-b9c7-4cfe-b904-9a147bcff350 admin admin] PATH_INFO: `/v3/users/6960dbadf8514631884d09768c854d3c` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:25:07.435833 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c00214-b9c7-4cfe-b904-9a147bcff350 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6960dbadf8514631884d09768c854d3c)` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:25:07.437842 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c00214-b9c7-4cfe-b904-9a147bcff350 admin admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:25:07.484590 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-99c00214-b9c7-4cfe-b904-9a147bcff350 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6960dbadf8514631884d09768c854d3c'} {{(pid=79745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:25:07.495901 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-99c00214-b9c7-4cfe-b904-9a147bcff350 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6960dbadf8514631884d09768c854d3c'} {{(pid=79745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:25:07.496613 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-99c00214-b9c7-4cfe-b904-9a147bcff350 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6960dbadf8514631884d09768c854d3c'} {{(pid=79745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:25:07.497213 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-99c00214-b9c7-4cfe-b904-9a147bcff350 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6960dbadf8514631884d09768c854d3c'} {{(pid=79745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:25:07.503826 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-99c00214-b9c7-4cfe-b904-9a147bcff350 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6960dbadf8514631884d09768c854d3c'} {{(pid=79745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:25:07.517825 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 932/1864] 10.222.0.21 () {58 vars in 1223 bytes} [Wed May 4 07:25:07 2022] DELETE /identity/v3/users/6960dbadf8514631884d09768c854d3c => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 07:25:07.523435 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab5964c-c336-422d-a130-050b4d60194f None None] REQUEST_METHOD: `POST` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:25:07.523915 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab5964c-c336-422d-a130-050b4d60194f None None] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:25:07.524000 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab5964c-c336-422d-a130-050b4d60194f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:25:07.541069 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.auth.core [None req-0ab5964c-c336-422d-a130-050b4d60194f None None] MFA Rules not processed for user `83c5e0dcb991496ea6dee38384514508`. Rule list: `[]` (Enabled: `True`). {{(pid=79744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:25:07.542256 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.fernet_utils [None req-0ab5964c-c336-422d-a130-050b4d60194f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:25:07.607710 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 933/1865] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 07:25:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 07:25:07.617969 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c00214-b9c7-4cfe-b904-9a147bcff350 admin admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:25:07.619419 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.fernet_utils [None req-99c00214-b9c7-4cfe-b904-9a147bcff350 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:25:07.676523 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c00214-b9c7-4cfe-b904-9a147bcff350 admin admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:25:07.682041 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f5350b-7059-4637-b72a-8a4f65421a05 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91cb92d00273402b837cb29b37325101', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9f9c44db4984653b8d4b5f6b3b949f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:25:07.682667 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f5350b-7059-4637-b72a-8a4f65421a05 service neutron] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:25:07.682950 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f5350b-7059-4637-b72a-8a4f65421a05 service neutron] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:25:07.683512 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f5350b-7059-4637-b72a-8a4f65421a05 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:25:07.693213 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f5350b-7059-4637-b72a-8a4f65421a05 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:25:07.696342 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f5350b-7059-4637-b72a-8a4f65421a05 service neutron] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:25:07.706520 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 933/1866] 10.222.0.21 () {60 vars in 1365 bytes} [Wed May 4 07:25:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 07:25:08.183756 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab5964c-c336-422d-a130-050b4d60194f None None] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:25:08.185391 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.fernet_utils [None req-0ab5964c-c336-422d-a130-050b4d60194f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:25:08.199224 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab5964c-c336-422d-a130-050b4d60194f None None] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:25:08.204114 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366c552c-23af-452c-b38d-d0eed241653f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:25:08.204995 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366c552c-23af-452c-b38d-d0eed241653f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:25:08.205272 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366c552c-23af-452c-b38d-d0eed241653f admin admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:25:08.205563 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366c552c-23af-452c-b38d-d0eed241653f admin admin] PATH_INFO: `/v3/projects/84f3d78d14824b949abcfe8fc94b8c7c` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:25:08.206750 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366c552c-23af-452c-b38d-d0eed241653f admin admin] RBAC: Authorizing `identity:delete_project(project_id=84f3d78d14824b949abcfe8fc94b8c7c)` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:25:08.208683 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366c552c-23af-452c-b38d-d0eed241653f admin admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:25:08.260490 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-366c552c-23af-452c-b38d-d0eed241653f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '84f3d78d14824b949abcfe8fc94b8c7c', 'request_id': 'req-366c552c-23af-452c-b38d-d0eed241653f'} {{(pid=79744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:25:08.266383 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-366c552c-23af-452c-b38d-d0eed241653f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '84f3d78d14824b949abcfe8fc94b8c7c', 'request_id': 'req-366c552c-23af-452c-b38d-d0eed241653f'} {{(pid=79744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:25:08.282669 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-366c552c-23af-452c-b38d-d0eed241653f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '84f3d78d14824b949abcfe8fc94b8c7c', 'request_id': 'req-366c552c-23af-452c-b38d-d0eed241653f'} {{(pid=79744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:25:08.294965 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-366c552c-23af-452c-b38d-d0eed241653f admin admin] The token cache is being invalidate because project 84f3d78d14824b949abcfe8fc94b8c7c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79744) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 07:25:08.295253 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-366c552c-23af-452c-b38d-d0eed241653f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:25:08.295928 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-366c552c-23af-452c-b38d-d0eed241653f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:25:08.297480 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 934/1867] 10.222.0.21 () {58 vars in 1232 bytes} [Wed May 4 07:25:08 2022] DELETE /identity/v3/projects/84f3d78d14824b949abcfe8fc94b8c7c => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 07:25:08.301674 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f5350b-7059-4637-b72a-8a4f65421a05 service neutron] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:25:08.311862 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f5350b-7059-4637-b72a-8a4f65421a05 service neutron] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:25:08.373891 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17606517-40ab-4c26-8bf2-5595bd9004cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:25:08.374965 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17606517-40ab-4c26-8bf2-5595bd9004cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:25:08.375122 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17606517-40ab-4c26-8bf2-5595bd9004cf admin admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:25:08.375305 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17606517-40ab-4c26-8bf2-5595bd9004cf admin admin] PATH_INFO: `/v3/users/c11741dcdb0e4bf797f09fa2e7ed3766` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:25:08.376573 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17606517-40ab-4c26-8bf2-5595bd9004cf admin admin] RBAC: Authorizing `identity:delete_user(user_id=c11741dcdb0e4bf797f09fa2e7ed3766)` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:25:08.378474 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17606517-40ab-4c26-8bf2-5595bd9004cf admin admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:25:08.430284 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-17606517-40ab-4c26-8bf2-5595bd9004cf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c11741dcdb0e4bf797f09fa2e7ed3766'} {{(pid=79745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:25:08.442143 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-17606517-40ab-4c26-8bf2-5595bd9004cf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c11741dcdb0e4bf797f09fa2e7ed3766'} {{(pid=79745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:25:08.442846 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-17606517-40ab-4c26-8bf2-5595bd9004cf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c11741dcdb0e4bf797f09fa2e7ed3766'} {{(pid=79745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:25:08.443475 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-17606517-40ab-4c26-8bf2-5595bd9004cf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c11741dcdb0e4bf797f09fa2e7ed3766'} {{(pid=79745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:25:08.451472 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-17606517-40ab-4c26-8bf2-5595bd9004cf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c11741dcdb0e4bf797f09fa2e7ed3766'} {{(pid=79745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:25:08.468941 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 934/1868] 10.222.0.21 () {58 vars in 1223 bytes} [Wed May 4 07:25:08 2022] DELETE /identity/v3/users/c11741dcdb0e4bf797f09fa2e7ed3766 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 07:25:08.768566 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366c552c-23af-452c-b38d-d0eed241653f admin admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:25:08.770020 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.fernet_utils [None req-366c552c-23af-452c-b38d-d0eed241653f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:25:08.784018 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366c552c-23af-452c-b38d-d0eed241653f admin admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:25:08.847418 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30230ef-ce73-40f8-afe5-cc00710472fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:25:08.848318 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30230ef-ce73-40f8-afe5-cc00710472fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:25:08.848590 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30230ef-ce73-40f8-afe5-cc00710472fc admin admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:25:08.848862 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30230ef-ce73-40f8-afe5-cc00710472fc admin admin] PATH_INFO: `/v3/projects/dc929cf3d8f242c2889468419ec4a9ea` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:25:08.850302 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30230ef-ce73-40f8-afe5-cc00710472fc admin admin] RBAC: Authorizing `identity:delete_project(project_id=dc929cf3d8f242c2889468419ec4a9ea)` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:25:08.852996 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30230ef-ce73-40f8-afe5-cc00710472fc admin admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:25:08.911884 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-e30230ef-ce73-40f8-afe5-cc00710472fc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dc929cf3d8f242c2889468419ec4a9ea', 'request_id': 'req-e30230ef-ce73-40f8-afe5-cc00710472fc'} {{(pid=79744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:25:08.918760 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-e30230ef-ce73-40f8-afe5-cc00710472fc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dc929cf3d8f242c2889468419ec4a9ea', 'request_id': 'req-e30230ef-ce73-40f8-afe5-cc00710472fc'} {{(pid=79744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:25:08.926141 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-e30230ef-ce73-40f8-afe5-cc00710472fc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dc929cf3d8f242c2889468419ec4a9ea', 'request_id': 'req-e30230ef-ce73-40f8-afe5-cc00710472fc'} {{(pid=79744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:25:08.940725 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-e30230ef-ce73-40f8-afe5-cc00710472fc admin admin] The token cache is being invalidate because project dc929cf3d8f242c2889468419ec4a9ea was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79744) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 07:25:08.941069 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-e30230ef-ce73-40f8-afe5-cc00710472fc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:25:08.942153 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-e30230ef-ce73-40f8-afe5-cc00710472fc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:25:08.945030 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 935/1869] 10.222.0.21 () {58 vars in 1232 bytes} [Wed May 4 07:25:08 2022] DELETE /identity/v3/projects/dc929cf3d8f242c2889468419ec4a9ea => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 07:25:08.950323 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5b50fd-58e1-432f-beb4-1d033af27282 None None] REQUEST_METHOD: `POST` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:25:08.950749 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5b50fd-58e1-432f-beb4-1d033af27282 None None] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:25:08.951170 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5b50fd-58e1-432f-beb4-1d033af27282 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:25:08.981909 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.auth.core [None req-2f5b50fd-58e1-432f-beb4-1d033af27282 None None] MFA Rules not processed for user `83c5e0dcb991496ea6dee38384514508`. Rule list: `[]` (Enabled: `True`). {{(pid=79745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:25:08.982642 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.fernet_utils [None req-2f5b50fd-58e1-432f-beb4-1d033af27282 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:25:09.060336 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 935/1870] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 07:25:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 07:25:09.064201 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52c542d-dded-401d-8c27-f95433dc482b None None] REQUEST_METHOD: `POST` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:25:09.064835 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52c542d-dded-401d-8c27-f95433dc482b None None] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:25:09.065453 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52c542d-dded-401d-8c27-f95433dc482b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:25:09.087498 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.auth.core [None req-a52c542d-dded-401d-8c27-f95433dc482b None None] MFA Rules not processed for user `83c5e0dcb991496ea6dee38384514508`. Rule list: `[]` (Enabled: `True`). {{(pid=79744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:25:09.088680 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.fernet_utils [None req-a52c542d-dded-401d-8c27-f95433dc482b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:25:09.096975 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 936/1871] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 07:25:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 07:25:09.101450 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5b50fd-58e1-432f-beb4-1d033af27282 None None] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:25:09.111771 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5b50fd-58e1-432f-beb4-1d033af27282 None None] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:25:09.117746 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1df327f-0921-4812-8b96-70e58ba6a3fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:25:09.118513 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1df327f-0921-4812-8b96-70e58ba6a3fd admin admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:25:09.118817 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1df327f-0921-4812-8b96-70e58ba6a3fd admin admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:25:09.119119 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1df327f-0921-4812-8b96-70e58ba6a3fd admin admin] PATH_INFO: `/v3/domains` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:25:09.119972 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1df327f-0921-4812-8b96-70e58ba6a3fd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 07:25:09.120385 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1df327f-0921-4812-8b96-70e58ba6a3fd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:25:09.122106 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1df327f-0921-4812-8b96-70e58ba6a3fd admin admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:25:09.137318 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 936/1872] 10.222.0.21 () {58 vars in 1152 bytes} [Wed May 4 07:25:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 07:25:09.142056 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52c542d-dded-401d-8c27-f95433dc482b None None] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:25:09.152152 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52c542d-dded-401d-8c27-f95433dc482b None None] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:25:09.156905 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd9d939-c828-4f16-9560-dea27f0a09ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:25:09.157568 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd9d939-c828-4f16-9560-dea27f0a09ed admin admin] REQUEST_METHOD: `POST` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:25:09.158214 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd9d939-c828-4f16-9560-dea27f0a09ed admin admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:25:09.158214 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd9d939-c828-4f16-9560-dea27f0a09ed admin admin] PATH_INFO: `/v3/projects` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:25:09.161727 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd9d939-c828-4f16-9560-dea27f0a09ed admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:25:09.162415 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd9d939-c828-4f16-9560-dea27f0a09ed admin admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:25:09.197452 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 937/1873] 10.222.0.21 () {60 vars in 1152 bytes} [Wed May 4 07:25:09 2022] POST /identity/v3/projects => generated 381 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 07:25:09.201846 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1df327f-0921-4812-8b96-70e58ba6a3fd admin admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:25:09.216206 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1df327f-0921-4812-8b96-70e58ba6a3fd admin admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:25:09.288874 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b23863-d71c-44fc-aea0-9cfd5ece0d6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:25:09.289717 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b23863-d71c-44fc-aea0-9cfd5ece0d6d admin admin] REQUEST_METHOD: `POST` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:25:09.290116 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b23863-d71c-44fc-aea0-9cfd5ece0d6d admin admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:25:09.290218 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b23863-d71c-44fc-aea0-9cfd5ece0d6d admin admin] PATH_INFO: `/v3/users` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:25:09.291290 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b23863-d71c-44fc-aea0-9cfd5ece0d6d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:25:09.292891 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b23863-d71c-44fc-aea0-9cfd5ece0d6d admin admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:25:09.322746 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 937/1874] 10.222.0.21 () {60 vars in 1143 bytes} [Wed May 4 07:25:09 2022] POST /identity/v3/users => generated 291 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 07:25:09.326919 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd9d939-c828-4f16-9560-dea27f0a09ed admin admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:25:09.343210 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd9d939-c828-4f16-9560-dea27f0a09ed admin admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:25:09.358363 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddedf0f3-981f-4072-95b6-a57f2f23df55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:25:09.359234 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddedf0f3-981f-4072-95b6-a57f2f23df55 admin admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:25:09.359518 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddedf0f3-981f-4072-95b6-a57f2f23df55 admin admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:25:09.359944 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddedf0f3-981f-4072-95b6-a57f2f23df55 admin admin] PATH_INFO: `/v3/roles` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:25:09.361309 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddedf0f3-981f-4072-95b6-a57f2f23df55 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:25:09.364032 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddedf0f3-981f-4072-95b6-a57f2f23df55 admin admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:25:09.377197 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 938/1875] 10.222.0.21 () {58 vars in 1121 bytes} [Wed May 4 07:25:09 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 07:25:09.381021 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b23863-d71c-44fc-aea0-9cfd5ece0d6d admin admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:25:09.392804 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b23863-d71c-44fc-aea0-9cfd5ece0d6d admin admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:25:09.398878 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3662b7e4-a071-4552-80c5-f6173c7ef217 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:25:09.399702 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3662b7e4-a071-4552-80c5-f6173c7ef217 admin admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:25:09.399987 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3662b7e4-a071-4552-80c5-f6173c7ef217 admin admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:25:09.400261 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3662b7e4-a071-4552-80c5-f6173c7ef217 admin admin] PATH_INFO: `/v3/roles` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:25:09.400990 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3662b7e4-a071-4552-80c5-f6173c7ef217 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:25:09.402624 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3662b7e4-a071-4552-80c5-f6173c7ef217 admin admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:25:09.414014 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 938/1876] 10.222.0.21 () {58 vars in 1121 bytes} [Wed May 4 07:25:09 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 07:25:09.418064 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddedf0f3-981f-4072-95b6-a57f2f23df55 admin admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:25:09.431034 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddedf0f3-981f-4072-95b6-a57f2f23df55 admin admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:25:09.437535 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70602c0b-81df-427b-a04a-57c1d421011b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:25:09.438761 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70602c0b-81df-427b-a04a-57c1d421011b admin admin] REQUEST_METHOD: `PUT` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:25:09.439131 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70602c0b-81df-427b-a04a-57c1d421011b admin admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:25:09.439664 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70602c0b-81df-427b-a04a-57c1d421011b admin admin] PATH_INFO: `/v3/projects/56d36d7542cf4a3bbb32f5e5e8db7748/users/0bf82237af184df4aaed7f7dfc59595c/roles/9f89c07b05a14f18836116af22cba5f6` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:25:09.462523 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70602c0b-81df-427b-a04a-57c1d421011b admin admin] RBAC: Authorizing `identity:create_grant(project_id=56d36d7542cf4a3bbb32f5e5e8db7748, user_id=0bf82237af184df4aaed7f7dfc59595c, role_id=9f89c07b05a14f18836116af22cba5f6)` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:25:09.465372 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70602c0b-81df-427b-a04a-57c1d421011b admin admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:25:09.483596 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 939/1877] 10.222.0.21 () {60 vars in 1482 bytes} [Wed May 4 07:25:09 2022] PUT /identity/v3/projects/56d36d7542cf4a3bbb32f5e5e8db7748/users/0bf82237af184df4aaed7f7dfc59595c/roles/9f89c07b05a14f18836116af22cba5f6 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 07:25:09.496188 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9882a9ea-a801-4189-9b81-711970d2e108 None None] REQUEST_METHOD: `POST` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:25:09.497701 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9882a9ea-a801-4189-9b81-711970d2e108 None None] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:25:09.497701 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9882a9ea-a801-4189-9b81-711970d2e108 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:25:09.533483 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.auth.core [None req-9882a9ea-a801-4189-9b81-711970d2e108 None None] MFA Rules not processed for user `0bf82237af184df4aaed7f7dfc59595c`. Rule list: `[]` (Enabled: `True`). {{(pid=79745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:25:09.535057 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.fernet_utils [None req-9882a9ea-a801-4189-9b81-711970d2e108 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:25:09.616441 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 939/1878] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 07:25:09 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 07:25:09.621238 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70602c0b-81df-427b-a04a-57c1d421011b admin admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:25:09.706365 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70602c0b-81df-427b-a04a-57c1d421011b admin admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:25:09.711873 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc205a0-4e3a-4dfd-9b21-400477fbb4f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:25:09.712545 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc205a0-4e3a-4dfd-9b21-400477fbb4f1 admin admin] REQUEST_METHOD: `POST` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:25:09.712829 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc205a0-4e3a-4dfd-9b21-400477fbb4f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:25:09.713123 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc205a0-4e3a-4dfd-9b21-400477fbb4f1 admin admin] PATH_INFO: `/v3/projects` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:25:09.713829 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc205a0-4e3a-4dfd-9b21-400477fbb4f1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:25:09.715786 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc205a0-4e3a-4dfd-9b21-400477fbb4f1 admin admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:25:09.751651 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 940/1879] 10.222.0.21 () {60 vars in 1152 bytes} [Wed May 4 07:25:09 2022] POST /identity/v3/projects => generated 379 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 07:25:09.752658 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9882a9ea-a801-4189-9b81-711970d2e108 None None] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:25:09.789073 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9882a9ea-a801-4189-9b81-711970d2e108 None None] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:25:09.877197 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fdbdab6-e4f6-49ec-9161-d2d531d82bd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:25:09.878701 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdbdab6-e4f6-49ec-9161-d2d531d82bd5 admin admin] REQUEST_METHOD: `POST` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:25:09.879659 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdbdab6-e4f6-49ec-9161-d2d531d82bd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:25:09.880478 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdbdab6-e4f6-49ec-9161-d2d531d82bd5 admin admin] PATH_INFO: `/v3/users` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:25:09.882801 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fdbdab6-e4f6-49ec-9161-d2d531d82bd5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:25:09.886827 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fdbdab6-e4f6-49ec-9161-d2d531d82bd5 admin admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:25:09.923903 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 940/1880] 10.222.0.21 () {60 vars in 1143 bytes} [Wed May 4 07:25:09 2022] POST /identity/v3/users => generated 296 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 07:25:09.925026 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc205a0-4e3a-4dfd-9b21-400477fbb4f1 admin admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:25:09.943904 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc205a0-4e3a-4dfd-9b21-400477fbb4f1 admin admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:25:09.949791 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c69487c-2a80-4730-acf9-301feb68ceaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:25:09.950467 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c69487c-2a80-4730-acf9-301feb68ceaa admin admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:25:09.950748 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c69487c-2a80-4730-acf9-301feb68ceaa admin admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:25:09.951042 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c69487c-2a80-4730-acf9-301feb68ceaa admin admin] PATH_INFO: `/v3/roles` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:25:09.952045 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c69487c-2a80-4730-acf9-301feb68ceaa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:25:09.953469 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c69487c-2a80-4730-acf9-301feb68ceaa admin admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:25:09.967176 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 941/1881] 10.222.0.21 () {58 vars in 1121 bytes} [Wed May 4 07:25:09 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 07:25:09.971607 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fdbdab6-e4f6-49ec-9161-d2d531d82bd5 admin admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:25:09.982621 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fdbdab6-e4f6-49ec-9161-d2d531d82bd5 admin admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:25:09.987352 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abad8f77-842d-4ab1-8f0c-fdc01a57cc75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:25:09.988259 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abad8f77-842d-4ab1-8f0c-fdc01a57cc75 admin admin] REQUEST_METHOD: `PUT` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:25:09.988541 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abad8f77-842d-4ab1-8f0c-fdc01a57cc75 admin admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:25:09.988812 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abad8f77-842d-4ab1-8f0c-fdc01a57cc75 admin admin] PATH_INFO: `/v3/projects/70c2a8807f2a4c8391ad495c55aa6445/users/4d66100b4b654e99a5a2acf7955ee39c/roles/eb54c9cea2774a25b1fe8c79724408ee` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:25:10.007115 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abad8f77-842d-4ab1-8f0c-fdc01a57cc75 admin admin] RBAC: Authorizing `identity:create_grant(project_id=70c2a8807f2a4c8391ad495c55aa6445, user_id=4d66100b4b654e99a5a2acf7955ee39c, role_id=eb54c9cea2774a25b1fe8c79724408ee)` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:25:10.009846 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abad8f77-842d-4ab1-8f0c-fdc01a57cc75 admin admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:25:10.024184 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 941/1882] 10.222.0.21 () {60 vars in 1482 bytes} [Wed May 4 07:25:09 2022] PUT /identity/v3/projects/70c2a8807f2a4c8391ad495c55aa6445/users/4d66100b4b654e99a5a2acf7955ee39c/roles/eb54c9cea2774a25b1fe8c79724408ee => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 07:25:10.028241 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c69487c-2a80-4730-acf9-301feb68ceaa admin admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:25:10.038786 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c69487c-2a80-4730-acf9-301feb68ceaa admin admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:25:10.105726 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04bbfa5d-b252-42c4-8abf-9c7e707b099e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:25:10.106404 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bbfa5d-b252-42c4-8abf-9c7e707b099e admin admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:25:10.106714 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bbfa5d-b252-42c4-8abf-9c7e707b099e admin admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:25:10.107133 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bbfa5d-b252-42c4-8abf-9c7e707b099e admin admin] PATH_INFO: `/v3/roles` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:25:10.107892 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04bbfa5d-b252-42c4-8abf-9c7e707b099e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:25:10.109698 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04bbfa5d-b252-42c4-8abf-9c7e707b099e admin admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:25:10.122581 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 942/1883] 10.222.0.21 () {58 vars in 1121 bytes} [Wed May 4 07:25:10 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 07:25:10.126657 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abad8f77-842d-4ab1-8f0c-fdc01a57cc75 admin admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:25:10.137565 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abad8f77-842d-4ab1-8f0c-fdc01a57cc75 admin admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:25:10.143097 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176cc86d-f865-496a-b86b-061bb347d3aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:25:10.144308 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176cc86d-f865-496a-b86b-061bb347d3aa admin admin] REQUEST_METHOD: `PUT` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:25:10.144308 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176cc86d-f865-496a-b86b-061bb347d3aa admin admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:25:10.144549 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176cc86d-f865-496a-b86b-061bb347d3aa admin admin] PATH_INFO: `/v3/projects/70c2a8807f2a4c8391ad495c55aa6445/users/4d66100b4b654e99a5a2acf7955ee39c/roles/eb54c9cea2774a25b1fe8c79724408ee` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:25:10.146582 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176cc86d-f865-496a-b86b-061bb347d3aa admin admin] RBAC: Authorizing `identity:create_grant(project_id=70c2a8807f2a4c8391ad495c55aa6445, user_id=4d66100b4b654e99a5a2acf7955ee39c, role_id=eb54c9cea2774a25b1fe8c79724408ee)` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:25:10.149955 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176cc86d-f865-496a-b86b-061bb347d3aa admin admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:25:10.160672 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 942/1884] 10.222.0.21 () {60 vars in 1482 bytes} [Wed May 4 07:25:10 2022] PUT /identity/v3/projects/70c2a8807f2a4c8391ad495c55aa6445/users/4d66100b4b654e99a5a2acf7955ee39c/roles/eb54c9cea2774a25b1fe8c79724408ee => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 07:25:10.171023 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7a8c15-5df4-45a4-a7b1-dda88d83e64e None None] REQUEST_METHOD: `POST` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:25:10.171346 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7a8c15-5df4-45a4-a7b1-dda88d83e64e None None] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:25:10.171625 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7a8c15-5df4-45a4-a7b1-dda88d83e64e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:25:10.204297 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.auth.core [None req-ca7a8c15-5df4-45a4-a7b1-dda88d83e64e None None] MFA Rules not processed for user `4d66100b4b654e99a5a2acf7955ee39c`. Rule list: `[]` (Enabled: `True`). {{(pid=79744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:25:10.205526 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.fernet_utils [None req-ca7a8c15-5df4-45a4-a7b1-dda88d83e64e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:25:10.314062 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 943/1885] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 07:25:10 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 07:25:10.373806 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176cc86d-f865-496a-b86b-061bb347d3aa admin admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:25:10.375344 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.fernet_utils [None req-176cc86d-f865-496a-b86b-061bb347d3aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:25:10.578358 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176cc86d-f865-496a-b86b-061bb347d3aa admin admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:25:10.588127 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47492225-1884-418d-8a9c-5dbe550d57ba service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb341257aa8246b6847561e2fe1fa385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9f9c44db4984653b8d4b5f6b3b949f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:25:10.588972 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47492225-1884-418d-8a9c-5dbe550d57ba service cinder] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:25:10.591907 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47492225-1884-418d-8a9c-5dbe550d57ba service cinder] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:25:10.592471 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47492225-1884-418d-8a9c-5dbe550d57ba service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:25:10.617455 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47492225-1884-418d-8a9c-5dbe550d57ba service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:25:10.618955 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47492225-1884-418d-8a9c-5dbe550d57ba service cinder] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:25:10.646243 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 943/1886] 10.222.0.21 () {60 vars in 1365 bytes} [Wed May 4 07:25:10 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 273 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 07:25:10.785143 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7a8c15-5df4-45a4-a7b1-dda88d83e64e None None] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:25:10.787186 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.fernet_utils [None req-ca7a8c15-5df4-45a4-a7b1-dda88d83e64e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:25:10.971068 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7a8c15-5df4-45a4-a7b1-dda88d83e64e None None] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:25:10.980658 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d022f66d-03be-492e-991a-d4589100e3d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:25:10.981617 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d022f66d-03be-492e-991a-d4589100e3d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:25:10.982056 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d022f66d-03be-492e-991a-d4589100e3d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:25:10.982664 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d022f66d-03be-492e-991a-d4589100e3d8 admin admin] PATH_INFO: `/v3/users/94b4411cf4b6488484b04f1ab59d5951` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:25:10.985481 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d022f66d-03be-492e-991a-d4589100e3d8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=94b4411cf4b6488484b04f1ab59d5951)` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:25:10.988009 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d022f66d-03be-492e-991a-d4589100e3d8 admin admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:25:11.041082 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47492225-1884-418d-8a9c-5dbe550d57ba service cinder] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:25:11.043541 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.fernet_utils [None req-47492225-1884-418d-8a9c-5dbe550d57ba service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:25:11.071750 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47492225-1884-418d-8a9c-5dbe550d57ba service cinder] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:25:11.077327 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3853f464-d259-4253-94ec-b3873d86e629 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:25:11.078397 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3853f464-d259-4253-94ec-b3873d86e629 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:25:11.078822 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3853f464-d259-4253-94ec-b3873d86e629 admin admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:25:11.079433 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3853f464-d259-4253-94ec-b3873d86e629 admin admin] PATH_INFO: `/v3/users/a3f3a1a51be64906867c1561a1b944f8` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:25:11.080873 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3853f464-d259-4253-94ec-b3873d86e629 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a3f3a1a51be64906867c1561a1b944f8)` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:25:11.082911 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3853f464-d259-4253-94ec-b3873d86e629 admin admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:25:11.086708 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-d022f66d-03be-492e-991a-d4589100e3d8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '94b4411cf4b6488484b04f1ab59d5951'} {{(pid=79744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:25:11.087726 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-d022f66d-03be-492e-991a-d4589100e3d8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '94b4411cf4b6488484b04f1ab59d5951'} {{(pid=79744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:25:11.098412 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-d022f66d-03be-492e-991a-d4589100e3d8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '94b4411cf4b6488484b04f1ab59d5951'} {{(pid=79744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:25:11.099137 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-d022f66d-03be-492e-991a-d4589100e3d8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '94b4411cf4b6488484b04f1ab59d5951'} {{(pid=79744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:25:11.112368 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-d022f66d-03be-492e-991a-d4589100e3d8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '94b4411cf4b6488484b04f1ab59d5951'} {{(pid=79744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:25:11.143903 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 944/1887] 10.222.0.21 () {58 vars in 1223 bytes} [Wed May 4 07:25:10 2022] DELETE /identity/v3/users/94b4411cf4b6488484b04f1ab59d5951 => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 07:25:11.148175 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f834482e-a391-4833-8248-2b91d1312b3d None None] REQUEST_METHOD: `POST` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:25:11.149035 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f834482e-a391-4833-8248-2b91d1312b3d None None] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:25:11.149653 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f834482e-a391-4833-8248-2b91d1312b3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:25:11.181984 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.auth.core [None req-f834482e-a391-4833-8248-2b91d1312b3d None None] MFA Rules not processed for user `83c5e0dcb991496ea6dee38384514508`. Rule list: `[]` (Enabled: `True`). {{(pid=79744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:25:11.183448 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.fernet_utils [None req-f834482e-a391-4833-8248-2b91d1312b3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:25:11.186731 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-3853f464-d259-4253-94ec-b3873d86e629 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a3f3a1a51be64906867c1561a1b944f8'} {{(pid=79745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:25:11.203563 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-3853f464-d259-4253-94ec-b3873d86e629 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a3f3a1a51be64906867c1561a1b944f8'} {{(pid=79745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:25:11.204923 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-3853f464-d259-4253-94ec-b3873d86e629 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a3f3a1a51be64906867c1561a1b944f8'} {{(pid=79745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:25:11.205543 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-3853f464-d259-4253-94ec-b3873d86e629 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a3f3a1a51be64906867c1561a1b944f8'} {{(pid=79745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:25:11.222670 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-3853f464-d259-4253-94ec-b3873d86e629 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a3f3a1a51be64906867c1561a1b944f8'} {{(pid=79745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:25:11.248185 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 944/1888] 10.222.0.21 () {58 vars in 1223 bytes} [Wed May 4 07:25:11 2022] DELETE /identity/v3/users/a3f3a1a51be64906867c1561a1b944f8 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 07:25:11.252779 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ed0b40-7dcf-43c2-b679-58586f456fbc None None] REQUEST_METHOD: `POST` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:25:11.253077 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ed0b40-7dcf-43c2-b679-58586f456fbc None None] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:25:11.253357 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ed0b40-7dcf-43c2-b679-58586f456fbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:25:11.281562 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.auth.core [None req-d4ed0b40-7dcf-43c2-b679-58586f456fbc None None] MFA Rules not processed for user `83c5e0dcb991496ea6dee38384514508`. Rule list: `[]` (Enabled: `True`). {{(pid=79745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:25:11.284001 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.fernet_utils [None req-d4ed0b40-7dcf-43c2-b679-58586f456fbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:25:11.285801 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 945/1889] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 07:25:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 07:25:11.298546 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f834482e-a391-4833-8248-2b91d1312b3d None None] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:25:11.300550 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.fernet_utils [None req-f834482e-a391-4833-8248-2b91d1312b3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:25:11.379051 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f834482e-a391-4833-8248-2b91d1312b3d None None] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:25:11.399717 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 945/1890] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 07:25:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 07:25:11.407455 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ed0b40-7dcf-43c2-b679-58586f456fbc None None] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:25:11.479315 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c841d6-229c-49cb-962f-8cce16054141 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91cb92d00273402b837cb29b37325101', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9f9c44db4984653b8d4b5f6b3b949f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:25:11.479865 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c841d6-229c-49cb-962f-8cce16054141 service neutron] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:25:11.480260 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c841d6-229c-49cb-962f-8cce16054141 service neutron] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:25:11.480541 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c841d6-229c-49cb-962f-8cce16054141 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:25:11.495742 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c841d6-229c-49cb-962f-8cce16054141 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:25:11.498132 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c841d6-229c-49cb-962f-8cce16054141 service neutron] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:25:11.517254 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 946/1891] 10.222.0.21 () {60 vars in 1365 bytes} [Wed May 4 07:25:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 219 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 04 07:25:11.530808 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ed0b40-7dcf-43c2-b679-58586f456fbc None None] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:25:11.535548 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3213e09d-3352-4eba-8770-60f9e9f4e4ad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91cb92d00273402b837cb29b37325101', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9f9c44db4984653b8d4b5f6b3b949f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:25:11.536558 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3213e09d-3352-4eba-8770-60f9e9f4e4ad service neutron] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:25:11.536926 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3213e09d-3352-4eba-8770-60f9e9f4e4ad service neutron] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:25:11.538160 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3213e09d-3352-4eba-8770-60f9e9f4e4ad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:25:11.549854 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3213e09d-3352-4eba-8770-60f9e9f4e4ad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:25:11.551424 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3213e09d-3352-4eba-8770-60f9e9f4e4ad service neutron] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:25:11.562941 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 946/1892] 10.222.0.21 () {60 vars in 1365 bytes} [Wed May 4 07:25:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 04 07:25:11.612744 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c841d6-229c-49cb-962f-8cce16054141 service neutron] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:25:11.614183 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.fernet_utils [None req-39c841d6-229c-49cb-962f-8cce16054141 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:25:11.627992 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c841d6-229c-49cb-962f-8cce16054141 service neutron] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:25:11.633258 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea51c8e3-4989-49a2-98da-cb450da89c0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:25:11.634149 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea51c8e3-4989-49a2-98da-cb450da89c0f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:25:11.634427 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea51c8e3-4989-49a2-98da-cb450da89c0f admin admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:25:11.634694 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea51c8e3-4989-49a2-98da-cb450da89c0f admin admin] PATH_INFO: `/v3/users/0bf82237af184df4aaed7f7dfc59595c` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:25:11.635971 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea51c8e3-4989-49a2-98da-cb450da89c0f admin admin] RBAC: Authorizing `identity:delete_user(user_id=0bf82237af184df4aaed7f7dfc59595c)` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:25:11.637892 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea51c8e3-4989-49a2-98da-cb450da89c0f admin admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:25:11.692837 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-ea51c8e3-4989-49a2-98da-cb450da89c0f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0bf82237af184df4aaed7f7dfc59595c'} {{(pid=79744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:25:11.694140 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-ea51c8e3-4989-49a2-98da-cb450da89c0f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0bf82237af184df4aaed7f7dfc59595c'} {{(pid=79744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:25:11.702280 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-ea51c8e3-4989-49a2-98da-cb450da89c0f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0bf82237af184df4aaed7f7dfc59595c'} {{(pid=79744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:25:11.703019 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-ea51c8e3-4989-49a2-98da-cb450da89c0f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0bf82237af184df4aaed7f7dfc59595c'} {{(pid=79744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:25:11.715318 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-ea51c8e3-4989-49a2-98da-cb450da89c0f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0bf82237af184df4aaed7f7dfc59595c'} {{(pid=79744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:25:11.742522 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 947/1893] 10.222.0.21 () {58 vars in 1223 bytes} [Wed May 4 07:25:11 2022] DELETE /identity/v3/users/0bf82237af184df4aaed7f7dfc59595c => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 07:25:11.750438 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bf6ce5-3ccc-4006-b371-c0440436ada8 None None] REQUEST_METHOD: `POST` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:25:11.751040 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bf6ce5-3ccc-4006-b371-c0440436ada8 None None] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:25:11.751796 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bf6ce5-3ccc-4006-b371-c0440436ada8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:25:11.790826 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.auth.core [None req-93bf6ce5-3ccc-4006-b371-c0440436ada8 None None] MFA Rules not processed for user `83c5e0dcb991496ea6dee38384514508`. Rule list: `[]` (Enabled: `True`). {{(pid=79745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:25:11.794508 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.fernet_utils [None req-93bf6ce5-3ccc-4006-b371-c0440436ada8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:25:11.936176 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 947/1894] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 07:25:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 07:25:11.961875 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea51c8e3-4989-49a2-98da-cb450da89c0f admin admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:25:11.964532 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.fernet_utils [None req-ea51c8e3-4989-49a2-98da-cb450da89c0f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:25:12.041166 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93bf6ce5-3ccc-4006-b371-c0440436ada8 None None] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:25:12.042405 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.fernet_utils [None req-93bf6ce5-3ccc-4006-b371-c0440436ada8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:25:12.068478 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93bf6ce5-3ccc-4006-b371-c0440436ada8 None None] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:25:12.079736 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e62237-27ee-4c60-aba0-9f480158e23b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:25:12.095120 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e62237-27ee-4c60-aba0-9f480158e23b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:25:12.095624 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e62237-27ee-4c60-aba0-9f480158e23b admin admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:25:12.096126 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e62237-27ee-4c60-aba0-9f480158e23b admin admin] PATH_INFO: `/v3/projects/d50d074731b643b4ac9fa2cbccb9a311` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:25:12.100455 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e62237-27ee-4c60-aba0-9f480158e23b admin admin] RBAC: Authorizing `identity:delete_project(project_id=d50d074731b643b4ac9fa2cbccb9a311)` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:25:12.104187 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e62237-27ee-4c60-aba0-9f480158e23b admin admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:25:12.109124 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea51c8e3-4989-49a2-98da-cb450da89c0f admin admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:25:12.117228 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e1b02c-f725-4e5b-9664-7c3f980f67d8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91cb92d00273402b837cb29b37325101', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9f9c44db4984653b8d4b5f6b3b949f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:25:12.118214 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e1b02c-f725-4e5b-9664-7c3f980f67d8 service neutron] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:25:12.118734 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e1b02c-f725-4e5b-9664-7c3f980f67d8 service neutron] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:25:12.119282 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e1b02c-f725-4e5b-9664-7c3f980f67d8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:25:12.137741 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e1b02c-f725-4e5b-9664-7c3f980f67d8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:25:12.140533 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e1b02c-f725-4e5b-9664-7c3f980f67d8 service neutron] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:25:12.158608 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 948/1895] 10.222.0.21 () {60 vars in 1365 bytes} [Wed May 4 07:25:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 07:25:12.170102 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-72e62237-27ee-4c60-aba0-9f480158e23b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd50d074731b643b4ac9fa2cbccb9a311', 'request_id': 'req-72e62237-27ee-4c60-aba0-9f480158e23b'} {{(pid=79745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:25:12.177407 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-72e62237-27ee-4c60-aba0-9f480158e23b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd50d074731b643b4ac9fa2cbccb9a311', 'request_id': 'req-72e62237-27ee-4c60-aba0-9f480158e23b'} {{(pid=79745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:25:12.185672 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-72e62237-27ee-4c60-aba0-9f480158e23b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd50d074731b643b4ac9fa2cbccb9a311', 'request_id': 'req-72e62237-27ee-4c60-aba0-9f480158e23b'} {{(pid=79745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:25:12.202330 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-72e62237-27ee-4c60-aba0-9f480158e23b admin admin] The token cache is being invalidate because project d50d074731b643b4ac9fa2cbccb9a311 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79745) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 07:25:12.202710 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-72e62237-27ee-4c60-aba0-9f480158e23b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:25:12.203594 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-72e62237-27ee-4c60-aba0-9f480158e23b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:25:12.210203 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 948/1896] 10.222.0.21 () {58 vars in 1232 bytes} [Wed May 4 07:25:12 2022] DELETE /identity/v3/projects/d50d074731b643b4ac9fa2cbccb9a311 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 07:25:12.215765 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1affb534-8c69-4960-903e-143746e57537 None None] REQUEST_METHOD: `POST` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:25:12.216056 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1affb534-8c69-4960-903e-143746e57537 None None] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:25:12.216335 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1affb534-8c69-4960-903e-143746e57537 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:25:12.235517 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e62237-27ee-4c60-aba0-9f480158e23b admin admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:25:12.237359 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.fernet_utils [None req-72e62237-27ee-4c60-aba0-9f480158e23b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:25:12.240600 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.auth.core [None req-1affb534-8c69-4960-903e-143746e57537 None None] MFA Rules not processed for user `83c5e0dcb991496ea6dee38384514508`. Rule list: `[]` (Enabled: `True`). {{(pid=79744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:25:12.242066 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.fernet_utils [None req-1affb534-8c69-4960-903e-143746e57537 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:25:12.323188 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 949/1897] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 07:25:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 07:25:12.331803 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d50ae10-06ad-4b47-bf56-cfc4f1d8e316 None None] REQUEST_METHOD: `POST` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:25:12.331995 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d50ae10-06ad-4b47-bf56-cfc4f1d8e316 None None] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:25:12.332254 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d50ae10-06ad-4b47-bf56-cfc4f1d8e316 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:25:12.342544 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e62237-27ee-4c60-aba0-9f480158e23b admin admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:25:12.347757 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87f1abd-5f4d-47e5-a724-cd98155e12a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:25:12.348625 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87f1abd-5f4d-47e5-a724-cd98155e12a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:25:12.348900 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87f1abd-5f4d-47e5-a724-cd98155e12a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:25:12.349170 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87f1abd-5f4d-47e5-a724-cd98155e12a7 admin admin] PATH_INFO: `/v3/projects/310ece6d486b44f48ae7b72866fce5dd` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:25:12.350497 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87f1abd-5f4d-47e5-a724-cd98155e12a7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=310ece6d486b44f48ae7b72866fce5dd)` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:25:12.352515 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.auth.core [None req-9d50ae10-06ad-4b47-bf56-cfc4f1d8e316 None None] MFA Rules not processed for user `83c5e0dcb991496ea6dee38384514508`. Rule list: `[]` (Enabled: `True`). {{(pid=79744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:25:12.352664 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87f1abd-5f4d-47e5-a724-cd98155e12a7 admin admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:25:12.354005 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.fernet_utils [None req-9d50ae10-06ad-4b47-bf56-cfc4f1d8e316 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:25:12.368341 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 950/1898] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 07:25:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 07:25:12.371776 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d50ae10-06ad-4b47-bf56-cfc4f1d8e316 None None] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:25:12.383340 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d50ae10-06ad-4b47-bf56-cfc4f1d8e316 None None] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:25:12.391132 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881fa9a0-68e4-4f88-bf24-5072918a2f8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:25:12.391934 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881fa9a0-68e4-4f88-bf24-5072918a2f8d admin admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:25:12.392252 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881fa9a0-68e4-4f88-bf24-5072918a2f8d admin admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:25:12.392796 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881fa9a0-68e4-4f88-bf24-5072918a2f8d admin admin] PATH_INFO: `/v3/domains` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:25:12.393423 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881fa9a0-68e4-4f88-bf24-5072918a2f8d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79744) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 07:25:12.393736 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881fa9a0-68e4-4f88-bf24-5072918a2f8d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:25:12.395531 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881fa9a0-68e4-4f88-bf24-5072918a2f8d admin admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:25:12.412260 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 951/1899] 10.222.0.21 () {58 vars in 1152 bytes} [Wed May 4 07:25:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 07:25:12.415914 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-d87f1abd-5f4d-47e5-a724-cd98155e12a7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '310ece6d486b44f48ae7b72866fce5dd', 'request_id': 'req-d87f1abd-5f4d-47e5-a724-cd98155e12a7'} {{(pid=79745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:25:12.416638 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881fa9a0-68e4-4f88-bf24-5072918a2f8d admin admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:25:12.424519 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-d87f1abd-5f4d-47e5-a724-cd98155e12a7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '310ece6d486b44f48ae7b72866fce5dd', 'request_id': 'req-d87f1abd-5f4d-47e5-a724-cd98155e12a7'} {{(pid=79745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:25:12.431527 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881fa9a0-68e4-4f88-bf24-5072918a2f8d admin admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:25:12.441581 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-d87f1abd-5f4d-47e5-a724-cd98155e12a7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '310ece6d486b44f48ae7b72866fce5dd', 'request_id': 'req-d87f1abd-5f4d-47e5-a724-cd98155e12a7'} {{(pid=79745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:25:12.456918 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-d87f1abd-5f4d-47e5-a724-cd98155e12a7 admin admin] The token cache is being invalidate because project 310ece6d486b44f48ae7b72866fce5dd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79745) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 07:25:12.457438 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-d87f1abd-5f4d-47e5-a724-cd98155e12a7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:25:12.458439 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-d87f1abd-5f4d-47e5-a724-cd98155e12a7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:25:12.464643 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 949/1900] 10.222.0.21 () {58 vars in 1232 bytes} [Wed May 4 07:25:12 2022] DELETE /identity/v3/projects/310ece6d486b44f48ae7b72866fce5dd => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 07:25:12.466033 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87f1abd-5f4d-47e5-a724-cd98155e12a7 admin admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:25:12.468864 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.fernet_utils [None req-d87f1abd-5f4d-47e5-a724-cd98155e12a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:25:12.522040 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9d062d-fe10-40bc-8d2b-4b7b059dee60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:25:12.522719 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9d062d-fe10-40bc-8d2b-4b7b059dee60 admin admin] REQUEST_METHOD: `POST` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:25:12.523179 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9d062d-fe10-40bc-8d2b-4b7b059dee60 admin admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:25:12.523461 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9d062d-fe10-40bc-8d2b-4b7b059dee60 admin admin] PATH_INFO: `/v3/projects` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:25:12.524236 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9d062d-fe10-40bc-8d2b-4b7b059dee60 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:25:12.526069 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9d062d-fe10-40bc-8d2b-4b7b059dee60 admin admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:25:12.609090 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 952/1901] 10.222.0.21 () {60 vars in 1152 bytes} [Wed May 4 07:25:12 2022] POST /identity/v3/projects => generated 363 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 07:25:12.617560 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9d062d-fe10-40bc-8d2b-4b7b059dee60 admin admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:25:12.624220 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.fernet_utils [None req-3f9d062d-fe10-40bc-8d2b-4b7b059dee60 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:25:12.644175 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87f1abd-5f4d-47e5-a724-cd98155e12a7 admin admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:25:12.715870 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9d062d-fe10-40bc-8d2b-4b7b059dee60 admin admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:25:12.726490 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58900ea9-4e58-4951-b55a-42d845ed642d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:25:12.727417 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58900ea9-4e58-4951-b55a-42d845ed642d admin admin] REQUEST_METHOD: `POST` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:25:12.727696 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58900ea9-4e58-4951-b55a-42d845ed642d admin admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:25:12.730366 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58900ea9-4e58-4951-b55a-42d845ed642d admin admin] PATH_INFO: `/v3/users` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:25:12.736930 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58900ea9-4e58-4951-b55a-42d845ed642d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:25:12.740144 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58900ea9-4e58-4951-b55a-42d845ed642d admin admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:25:12.755128 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c9400b-2f4c-494f-82fa-d145e652694a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:25:12.756609 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c9400b-2f4c-494f-82fa-d145e652694a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:25:12.756899 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c9400b-2f4c-494f-82fa-d145e652694a admin admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:25:12.757263 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c9400b-2f4c-494f-82fa-d145e652694a admin admin] PATH_INFO: `/v3/users/b0c3f5447e604a359a99ef6257cbd653` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:25:12.758879 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c9400b-2f4c-494f-82fa-d145e652694a admin admin] RBAC: Authorizing `identity:delete_user(user_id=b0c3f5447e604a359a99ef6257cbd653)` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:25:12.761423 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c9400b-2f4c-494f-82fa-d145e652694a admin admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:25:12.767701 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 953/1902] 10.222.0.21 () {60 vars in 1143 bytes} [Wed May 4 07:25:12 2022] POST /identity/v3/users => generated 282 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 07:25:12.772062 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58900ea9-4e58-4951-b55a-42d845ed642d admin admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:25:12.785496 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58900ea9-4e58-4951-b55a-42d845ed642d admin admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:25:12.792038 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f78a7c0-4604-4fac-8122-814721563af9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:25:12.792738 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f78a7c0-4604-4fac-8122-814721563af9 admin admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:25:12.793090 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f78a7c0-4604-4fac-8122-814721563af9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:25:12.793269 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f78a7c0-4604-4fac-8122-814721563af9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:25:12.794934 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f78a7c0-4604-4fac-8122-814721563af9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:25:12.797322 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f78a7c0-4604-4fac-8122-814721563af9 admin admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:25:12.809939 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 954/1903] 10.222.0.21 () {58 vars in 1121 bytes} [Wed May 4 07:25:12 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 07:25:12.814230 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f78a7c0-4604-4fac-8122-814721563af9 admin admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:25:12.830040 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f78a7c0-4604-4fac-8122-814721563af9 admin admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:25:12.837197 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db65d017-e62a-4b3f-9f3e-7b5426fa0ba7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:25:12.838219 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db65d017-e62a-4b3f-9f3e-7b5426fa0ba7 admin admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:25:12.838647 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db65d017-e62a-4b3f-9f3e-7b5426fa0ba7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:25:12.839110 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db65d017-e62a-4b3f-9f3e-7b5426fa0ba7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:25:12.840102 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db65d017-e62a-4b3f-9f3e-7b5426fa0ba7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:25:12.842343 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db65d017-e62a-4b3f-9f3e-7b5426fa0ba7 admin admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:25:12.842702 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-59c9400b-2f4c-494f-82fa-d145e652694a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b0c3f5447e604a359a99ef6257cbd653'} {{(pid=79745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:25:12.860230 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 955/1904] 10.222.0.21 () {58 vars in 1121 bytes} [Wed May 4 07:25:12 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 04 07:25:12.864770 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db65d017-e62a-4b3f-9f3e-7b5426fa0ba7 admin admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:25:12.880426 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db65d017-e62a-4b3f-9f3e-7b5426fa0ba7 admin admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:25:12.887930 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b2a21f-ddfc-4d2e-ae19-1864ffc9aa83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:25:12.889006 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b2a21f-ddfc-4d2e-ae19-1864ffc9aa83 admin admin] REQUEST_METHOD: `PUT` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:25:12.889346 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b2a21f-ddfc-4d2e-ae19-1864ffc9aa83 admin admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:25:12.889991 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b2a21f-ddfc-4d2e-ae19-1864ffc9aa83 admin admin] PATH_INFO: `/v3/projects/6c2fdb2e64ca46cb9d2af9126c9a71bc/users/b3d2d333cc7d4228bf1ee0886c65b7ce/roles/9f89c07b05a14f18836116af22cba5f6` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:25:12.901332 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-59c9400b-2f4c-494f-82fa-d145e652694a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b0c3f5447e604a359a99ef6257cbd653'} {{(pid=79745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:25:12.903807 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-59c9400b-2f4c-494f-82fa-d145e652694a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b0c3f5447e604a359a99ef6257cbd653'} {{(pid=79745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:25:12.904613 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-59c9400b-2f4c-494f-82fa-d145e652694a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b0c3f5447e604a359a99ef6257cbd653'} {{(pid=79745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:25:12.907643 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b2a21f-ddfc-4d2e-ae19-1864ffc9aa83 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6c2fdb2e64ca46cb9d2af9126c9a71bc, user_id=b3d2d333cc7d4228bf1ee0886c65b7ce, role_id=9f89c07b05a14f18836116af22cba5f6)` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:25:12.910780 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b2a21f-ddfc-4d2e-ae19-1864ffc9aa83 admin admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:25:12.926030 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-59c9400b-2f4c-494f-82fa-d145e652694a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b0c3f5447e604a359a99ef6257cbd653'} {{(pid=79745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:25:12.933672 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 956/1905] 10.222.0.21 () {60 vars in 1482 bytes} [Wed May 4 07:25:12 2022] PUT /identity/v3/projects/6c2fdb2e64ca46cb9d2af9126c9a71bc/users/b3d2d333cc7d4228bf1ee0886c65b7ce/roles/9f89c07b05a14f18836116af22cba5f6 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 07:25:12.944983 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 950/1906] 10.222.0.21 () {58 vars in 1223 bytes} [Wed May 4 07:25:12 2022] DELETE /identity/v3/users/b0c3f5447e604a359a99ef6257cbd653 => generated 0 bytes in 479 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 07:25:12.947019 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de07621-efe2-4cb8-b9a6-a2eebcb70167 None None] REQUEST_METHOD: `POST` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:25:12.947831 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de07621-efe2-4cb8-b9a6-a2eebcb70167 None None] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:25:12.949310 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de07621-efe2-4cb8-b9a6-a2eebcb70167 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:25:12.984062 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.auth.core [None req-5de07621-efe2-4cb8-b9a6-a2eebcb70167 None None] MFA Rules not processed for user `b3d2d333cc7d4228bf1ee0886c65b7ce`. Rule list: `[]` (Enabled: `True`). {{(pid=79744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:25:12.986803 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.fernet_utils [None req-5de07621-efe2-4cb8-b9a6-a2eebcb70167 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:25:13.056676 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c9400b-2f4c-494f-82fa-d145e652694a admin admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:25:13.059763 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.fernet_utils [None req-59c9400b-2f4c-494f-82fa-d145e652694a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:25:13.141304 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 957/1907] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 07:25:12 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 07:25:13.147018 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de07621-efe2-4cb8-b9a6-a2eebcb70167 None None] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:25:13.151301 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.fernet_utils [None req-5de07621-efe2-4cb8-b9a6-a2eebcb70167 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:25:13.202885 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c9400b-2f4c-494f-82fa-d145e652694a admin admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:25:13.208414 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad471070-0482-4e86-81e0-6f8ed2747842 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:25:13.209517 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad471070-0482-4e86-81e0-6f8ed2747842 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:25:13.209896 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad471070-0482-4e86-81e0-6f8ed2747842 admin admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:25:13.210272 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad471070-0482-4e86-81e0-6f8ed2747842 admin admin] PATH_INFO: `/v3/projects/56d36d7542cf4a3bbb32f5e5e8db7748` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:25:13.211693 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad471070-0482-4e86-81e0-6f8ed2747842 admin admin] RBAC: Authorizing `identity:delete_project(project_id=56d36d7542cf4a3bbb32f5e5e8db7748)` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:25:13.213916 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad471070-0482-4e86-81e0-6f8ed2747842 admin admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:25:13.234292 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de07621-efe2-4cb8-b9a6-a2eebcb70167 None None] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:25:13.239475 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09958be6-d856-498c-9a6c-6a2e567bdac6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:25:13.241129 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09958be6-d856-498c-9a6c-6a2e567bdac6 admin admin] REQUEST_METHOD: `POST` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:25:13.241404 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09958be6-d856-498c-9a6c-6a2e567bdac6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:25:13.241676 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09958be6-d856-498c-9a6c-6a2e567bdac6 admin admin] PATH_INFO: `/v3/projects` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:25:13.242471 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09958be6-d856-498c-9a6c-6a2e567bdac6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:25:13.244444 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09958be6-d856-498c-9a6c-6a2e567bdac6 admin admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:25:13.309605 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 958/1908] 10.222.0.21 () {60 vars in 1152 bytes} [Wed May 4 07:25:13 2022] POST /identity/v3/projects => generated 365 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 07:25:13.309934 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-ad471070-0482-4e86-81e0-6f8ed2747842 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '56d36d7542cf4a3bbb32f5e5e8db7748', 'request_id': 'req-ad471070-0482-4e86-81e0-6f8ed2747842'} {{(pid=79745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:25:13.313566 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09958be6-d856-498c-9a6c-6a2e567bdac6 admin admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:25:13.320489 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-ad471070-0482-4e86-81e0-6f8ed2747842 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '56d36d7542cf4a3bbb32f5e5e8db7748', 'request_id': 'req-ad471070-0482-4e86-81e0-6f8ed2747842'} {{(pid=79745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:25:13.331418 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-ad471070-0482-4e86-81e0-6f8ed2747842 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '56d36d7542cf4a3bbb32f5e5e8db7748', 'request_id': 'req-ad471070-0482-4e86-81e0-6f8ed2747842'} {{(pid=79745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:25:13.351659 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-ad471070-0482-4e86-81e0-6f8ed2747842 admin admin] The token cache is being invalidate because project 56d36d7542cf4a3bbb32f5e5e8db7748 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79745) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 07:25:13.351957 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-ad471070-0482-4e86-81e0-6f8ed2747842 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:25:13.352749 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-ad471070-0482-4e86-81e0-6f8ed2747842 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:25:13.357821 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 951/1909] 10.222.0.21 () {58 vars in 1232 bytes} [Wed May 4 07:25:13 2022] DELETE /identity/v3/projects/56d36d7542cf4a3bbb32f5e5e8db7748 => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 07:25:13.371706 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad471070-0482-4e86-81e0-6f8ed2747842 admin admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:25:13.378073 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.fernet_utils [None req-ad471070-0482-4e86-81e0-6f8ed2747842 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:25:13.453755 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09958be6-d856-498c-9a6c-6a2e567bdac6 admin admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:25:13.465888 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1715911d-523d-4f52-8af2-632555d6ce27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:25:13.466750 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1715911d-523d-4f52-8af2-632555d6ce27 admin admin] REQUEST_METHOD: `POST` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:25:13.467160 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1715911d-523d-4f52-8af2-632555d6ce27 admin admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:25:13.468403 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1715911d-523d-4f52-8af2-632555d6ce27 admin admin] PATH_INFO: `/v3/users` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:25:13.469190 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1715911d-523d-4f52-8af2-632555d6ce27 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:25:13.473051 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1715911d-523d-4f52-8af2-632555d6ce27 admin admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:25:13.478747 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad471070-0482-4e86-81e0-6f8ed2747842 admin admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:25:13.484648 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7903c599-d98e-4736-9f4e-473ff0bc2335 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:25:13.485907 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7903c599-d98e-4736-9f4e-473ff0bc2335 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:25:13.486728 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7903c599-d98e-4736-9f4e-473ff0bc2335 admin admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:25:13.487009 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7903c599-d98e-4736-9f4e-473ff0bc2335 admin admin] PATH_INFO: `/v3/users/4d66100b4b654e99a5a2acf7955ee39c` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:25:13.488960 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7903c599-d98e-4736-9f4e-473ff0bc2335 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4d66100b4b654e99a5a2acf7955ee39c)` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:25:13.492215 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7903c599-d98e-4736-9f4e-473ff0bc2335 admin admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:25:13.523135 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 959/1910] 10.222.0.21 () {60 vars in 1143 bytes} [Wed May 4 07:25:13 2022] POST /identity/v3/users => generated 289 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 07:25:13.524777 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1715911d-523d-4f52-8af2-632555d6ce27 admin admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:25:13.527377 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.fernet_utils [None req-1715911d-523d-4f52-8af2-632555d6ce27 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:25:13.558926 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1715911d-523d-4f52-8af2-632555d6ce27 admin admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:25:13.571181 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-7903c599-d98e-4736-9f4e-473ff0bc2335 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4d66100b4b654e99a5a2acf7955ee39c'} {{(pid=79745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:25:13.573399 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddc0f72-3966-4366-b342-22a446a26b8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:25:13.574100 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddc0f72-3966-4366-b342-22a446a26b8e admin admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:25:13.574380 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddc0f72-3966-4366-b342-22a446a26b8e admin admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:25:13.574656 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddc0f72-3966-4366-b342-22a446a26b8e admin admin] PATH_INFO: `/v3/roles` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:25:13.575410 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fddc0f72-3966-4366-b342-22a446a26b8e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:25:13.579334 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fddc0f72-3966-4366-b342-22a446a26b8e admin admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:25:13.588413 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-7903c599-d98e-4736-9f4e-473ff0bc2335 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4d66100b4b654e99a5a2acf7955ee39c'} {{(pid=79745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:25:13.589301 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-7903c599-d98e-4736-9f4e-473ff0bc2335 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4d66100b4b654e99a5a2acf7955ee39c'} {{(pid=79745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:25:13.590030 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-7903c599-d98e-4736-9f4e-473ff0bc2335 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4d66100b4b654e99a5a2acf7955ee39c'} {{(pid=79745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:25:13.606313 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-7903c599-d98e-4736-9f4e-473ff0bc2335 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4d66100b4b654e99a5a2acf7955ee39c'} {{(pid=79745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:25:13.614335 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 960/1911] 10.222.0.21 () {58 vars in 1121 bytes} [Wed May 4 07:25:13 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 07:25:13.619767 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddc0f72-3966-4366-b342-22a446a26b8e admin admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:25:13.624125 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.fernet_utils [None req-fddc0f72-3966-4366-b342-22a446a26b8e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:25:13.630280 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 952/1912] 10.222.0.21 () {58 vars in 1223 bytes} [Wed May 4 07:25:13 2022] DELETE /identity/v3/users/4d66100b4b654e99a5a2acf7955ee39c => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 07:25:13.646414 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddc0f72-3966-4366-b342-22a446a26b8e admin admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:25:13.665297 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7903c599-d98e-4736-9f4e-473ff0bc2335 admin admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:25:13.668740 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.fernet_utils [None req-7903c599-d98e-4736-9f4e-473ff0bc2335 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:25:13.779541 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2f8b94-d27a-4ed4-b1b5-5bf75ecd6667 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:25:13.780679 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2f8b94-d27a-4ed4-b1b5-5bf75ecd6667 admin admin] REQUEST_METHOD: `PUT` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:25:13.781035 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2f8b94-d27a-4ed4-b1b5-5bf75ecd6667 admin admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:25:13.781382 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2f8b94-d27a-4ed4-b1b5-5bf75ecd6667 admin admin] PATH_INFO: `/v3/projects/50f72c487d4e46f7b3244e1786756527/users/d5fa6085b83d4bebb1eb524e24ef830b/roles/eb54c9cea2774a25b1fe8c79724408ee` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:25:13.808947 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7903c599-d98e-4736-9f4e-473ff0bc2335 admin admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:25:13.815353 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2f8b94-d27a-4ed4-b1b5-5bf75ecd6667 admin admin] RBAC: Authorizing `identity:create_grant(project_id=50f72c487d4e46f7b3244e1786756527, user_id=d5fa6085b83d4bebb1eb524e24ef830b, role_id=eb54c9cea2774a25b1fe8c79724408ee)` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:25:13.815585 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58f3f8c-b77c-44c2-90f3-0ac52a577130 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:25:13.816317 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58f3f8c-b77c-44c2-90f3-0ac52a577130 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:25:13.816605 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58f3f8c-b77c-44c2-90f3-0ac52a577130 admin admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:25:13.816882 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58f3f8c-b77c-44c2-90f3-0ac52a577130 admin admin] PATH_INFO: `/v3/projects/97bc96e2ec274833a0bcd3dee3200078` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:25:13.819251 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58f3f8c-b77c-44c2-90f3-0ac52a577130 admin admin] RBAC: Authorizing `identity:delete_project(project_id=97bc96e2ec274833a0bcd3dee3200078)` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:25:13.821597 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58f3f8c-b77c-44c2-90f3-0ac52a577130 admin admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:25:13.823886 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2f8b94-d27a-4ed4-b1b5-5bf75ecd6667 admin admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:25:13.846057 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 961/1913] 10.222.0.21 () {60 vars in 1482 bytes} [Wed May 4 07:25:13 2022] PUT /identity/v3/projects/50f72c487d4e46f7b3244e1786756527/users/d5fa6085b83d4bebb1eb524e24ef830b/roles/eb54c9cea2774a25b1fe8c79724408ee => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 07:25:13.848311 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c83f23-491b-4ff2-8142-1aee7b331491 None None] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:25:13.848755 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c83f23-491b-4ff2-8142-1aee7b331491 None None] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:25:13.849138 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c83f23-491b-4ff2-8142-1aee7b331491 None None] PATH_INFO: `/` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:25:13.852535 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 962/1914] 10.222.0.21 () {54 vars in 921 bytes} [Wed May 4 07:25:13 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 07:25:13.853456 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c83f23-491b-4ff2-8142-1aee7b331491 None None] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:25:13.855686 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.fernet_utils [None req-07c83f23-491b-4ff2-8142-1aee7b331491 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:25:13.898958 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-b58f3f8c-b77c-44c2-90f3-0ac52a577130 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '97bc96e2ec274833a0bcd3dee3200078', 'request_id': 'req-b58f3f8c-b77c-44c2-90f3-0ac52a577130'} {{(pid=79745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:25:13.910731 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-b58f3f8c-b77c-44c2-90f3-0ac52a577130 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '97bc96e2ec274833a0bcd3dee3200078', 'request_id': 'req-b58f3f8c-b77c-44c2-90f3-0ac52a577130'} {{(pid=79745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:25:13.935254 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-b58f3f8c-b77c-44c2-90f3-0ac52a577130 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '97bc96e2ec274833a0bcd3dee3200078', 'request_id': 'req-b58f3f8c-b77c-44c2-90f3-0ac52a577130'} {{(pid=79745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:25:13.952827 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c83f23-491b-4ff2-8142-1aee7b331491 None None] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:25:13.953882 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-b58f3f8c-b77c-44c2-90f3-0ac52a577130 admin admin] The token cache is being invalidate because project 97bc96e2ec274833a0bcd3dee3200078 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79745) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 07:25:13.954440 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-b58f3f8c-b77c-44c2-90f3-0ac52a577130 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:25:13.955837 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-b58f3f8c-b77c-44c2-90f3-0ac52a577130 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:25:13.961680 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 953/1915] 10.222.0.21 () {58 vars in 1232 bytes} [Wed May 4 07:25:13 2022] DELETE /identity/v3/projects/97bc96e2ec274833a0bcd3dee3200078 => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 07:25:13.961680 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58f3f8c-b77c-44c2-90f3-0ac52a577130 admin admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:25:13.964217 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.fernet_utils [None req-b58f3f8c-b77c-44c2-90f3-0ac52a577130 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:25:14.056518 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820d245a-17df-49d9-87ab-3d697c525890 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:25:14.057619 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820d245a-17df-49d9-87ab-3d697c525890 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:25:14.058092 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820d245a-17df-49d9-87ab-3d697c525890 admin admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:25:14.058788 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820d245a-17df-49d9-87ab-3d697c525890 admin admin] PATH_INFO: `/v3/users/a3a8add267e0435fa6e61eb3e65257de` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:25:14.061766 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820d245a-17df-49d9-87ab-3d697c525890 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a3a8add267e0435fa6e61eb3e65257de)` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:25:14.063886 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820d245a-17df-49d9-87ab-3d697c525890 admin admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:25:14.077335 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58f3f8c-b77c-44c2-90f3-0ac52a577130 admin admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:25:14.085053 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed8f458-68a9-4f87-a330-7ad391a17909 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:25:14.086218 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed8f458-68a9-4f87-a330-7ad391a17909 admin admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:25:14.086859 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed8f458-68a9-4f87-a330-7ad391a17909 admin admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:25:14.087373 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed8f458-68a9-4f87-a330-7ad391a17909 admin admin] PATH_INFO: `/v3/roles` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:25:14.089681 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed8f458-68a9-4f87-a330-7ad391a17909 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:25:14.092614 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed8f458-68a9-4f87-a330-7ad391a17909 admin admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:25:14.113307 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 954/1916] 10.222.0.21 () {58 vars in 1121 bytes} [Wed May 4 07:25:13 2022] GET /identity/v3/roles => generated 1420 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 07:25:14.121064 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695f1dec-994f-47e2-b6c4-a2b4dc5a330e None None] REQUEST_METHOD: `POST` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:25:14.121487 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695f1dec-994f-47e2-b6c4-a2b4dc5a330e None None] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:25:14.122508 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695f1dec-994f-47e2-b6c4-a2b4dc5a330e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:25:14.158494 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.auth.core [None req-695f1dec-994f-47e2-b6c4-a2b4dc5a330e None None] MFA Rules not processed for user `1077289fedae43b6be47be7f716d573a`. Rule list: `[]` (Enabled: `True`). {{(pid=79745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:25:14.160442 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.fernet_utils [None req-695f1dec-994f-47e2-b6c4-a2b4dc5a330e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:25:14.180688 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-820d245a-17df-49d9-87ab-3d697c525890 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a3a8add267e0435fa6e61eb3e65257de'} {{(pid=79744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:25:14.182643 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-820d245a-17df-49d9-87ab-3d697c525890 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a3a8add267e0435fa6e61eb3e65257de'} {{(pid=79744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:25:14.194458 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-820d245a-17df-49d9-87ab-3d697c525890 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a3a8add267e0435fa6e61eb3e65257de'} {{(pid=79744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:25:14.195250 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-820d245a-17df-49d9-87ab-3d697c525890 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a3a8add267e0435fa6e61eb3e65257de'} {{(pid=79744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:25:14.210276 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-820d245a-17df-49d9-87ab-3d697c525890 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a3a8add267e0435fa6e61eb3e65257de'} {{(pid=79744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:25:14.231826 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 963/1917] 10.222.0.21 () {58 vars in 1223 bytes} [Wed May 4 07:25:13 2022] DELETE /identity/v3/users/a3a8add267e0435fa6e61eb3e65257de => generated 0 bytes in 375 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 07:25:14.231826 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820d245a-17df-49d9-87ab-3d697c525890 admin admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:25:14.231826 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.fernet_utils [None req-820d245a-17df-49d9-87ab-3d697c525890 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:25:14.264813 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 955/1918] 10.222.0.21 () {58 vars in 1018 bytes} [Wed May 4 07:25:14 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 07:25:14.266057 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695f1dec-994f-47e2-b6c4-a2b4dc5a330e None None] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:25:14.268040 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.fernet_utils [None req-695f1dec-994f-47e2-b6c4-a2b4dc5a330e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:25:14.295784 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695f1dec-994f-47e2-b6c4-a2b4dc5a330e None None] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:25:14.322350 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820d245a-17df-49d9-87ab-3d697c525890 admin admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:25:14.327285 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6072a744-3c01-4f28-9254-4ff73c80f32f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:25:14.328162 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6072a744-3c01-4f28-9254-4ff73c80f32f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:25:14.328435 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6072a744-3c01-4f28-9254-4ff73c80f32f admin admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:25:14.328700 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6072a744-3c01-4f28-9254-4ff73c80f32f admin admin] PATH_INFO: `/v3/users/f851a935632844ceaaf9cac3b5ba5965` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:25:14.330176 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6072a744-3c01-4f28-9254-4ff73c80f32f admin admin] RBAC: Authorizing `identity:delete_user(user_id=f851a935632844ceaaf9cac3b5ba5965)` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:25:14.332395 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6072a744-3c01-4f28-9254-4ff73c80f32f admin admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:25:14.359924 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf31e7ce-baff-4876-b33e-098ca360fb41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:25:14.361354 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf31e7ce-baff-4876-b33e-098ca360fb41 admin admin] REQUEST_METHOD: `PUT` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:25:14.361587 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf31e7ce-baff-4876-b33e-098ca360fb41 admin admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:25:14.361858 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf31e7ce-baff-4876-b33e-098ca360fb41 admin admin] PATH_INFO: `/v3/projects/50f72c487d4e46f7b3244e1786756527/users/d5fa6085b83d4bebb1eb524e24ef830b/roles/eb54c9cea2774a25b1fe8c79724408ee` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:25:14.364833 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf31e7ce-baff-4876-b33e-098ca360fb41 admin admin] RBAC: Authorizing `identity:create_grant(project_id=50f72c487d4e46f7b3244e1786756527, user_id=d5fa6085b83d4bebb1eb524e24ef830b, role_id=eb54c9cea2774a25b1fe8c79724408ee)` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:25:14.368108 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf31e7ce-baff-4876-b33e-098ca360fb41 admin admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:25:14.394186 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 956/1919] 10.222.0.21 () {60 vars in 1482 bytes} [Wed May 4 07:25:14 2022] PUT /identity/v3/projects/50f72c487d4e46f7b3244e1786756527/users/d5fa6085b83d4bebb1eb524e24ef830b/roles/eb54c9cea2774a25b1fe8c79724408ee => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 07:25:14.395261 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf31e7ce-baff-4876-b33e-098ca360fb41 admin admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:25:14.398550 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.fernet_utils [None req-cf31e7ce-baff-4876-b33e-098ca360fb41 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:25:14.399088 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-6072a744-3c01-4f28-9254-4ff73c80f32f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f851a935632844ceaaf9cac3b5ba5965'} {{(pid=79744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:25:14.399942 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-6072a744-3c01-4f28-9254-4ff73c80f32f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f851a935632844ceaaf9cac3b5ba5965'} {{(pid=79744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:25:14.411514 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-6072a744-3c01-4f28-9254-4ff73c80f32f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f851a935632844ceaaf9cac3b5ba5965'} {{(pid=79744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:25:14.412948 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-6072a744-3c01-4f28-9254-4ff73c80f32f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f851a935632844ceaaf9cac3b5ba5965'} {{(pid=79744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:25:14.428054 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-6072a744-3c01-4f28-9254-4ff73c80f32f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f851a935632844ceaaf9cac3b5ba5965'} {{(pid=79744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:25:14.477490 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 964/1920] 10.222.0.21 () {58 vars in 1223 bytes} [Wed May 4 07:25:14 2022] DELETE /identity/v3/users/f851a935632844ceaaf9cac3b5ba5965 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 07:25:14.479710 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87539f6-7efd-4acf-960f-86fdfd04b5e0 None None] REQUEST_METHOD: `POST` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:25:14.480259 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87539f6-7efd-4acf-960f-86fdfd04b5e0 None None] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:25:14.480747 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87539f6-7efd-4acf-960f-86fdfd04b5e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:25:14.497370 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf31e7ce-baff-4876-b33e-098ca360fb41 admin admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:25:14.502813 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.auth.core [None req-f87539f6-7efd-4acf-960f-86fdfd04b5e0 None None] MFA Rules not processed for user `83c5e0dcb991496ea6dee38384514508`. Rule list: `[]` (Enabled: `True`). {{(pid=79744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:25:14.504828 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.fernet_utils [None req-f87539f6-7efd-4acf-960f-86fdfd04b5e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:25:14.570793 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09f2440-de60-46c6-be2f-4235393a953e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:25:14.571942 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09f2440-de60-46c6-be2f-4235393a953e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:25:14.572318 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09f2440-de60-46c6-be2f-4235393a953e admin admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:25:14.572620 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09f2440-de60-46c6-be2f-4235393a953e admin admin] PATH_INFO: `/v3/projects/70c2a8807f2a4c8391ad495c55aa6445` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:25:14.575530 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09f2440-de60-46c6-be2f-4235393a953e admin admin] RBAC: Authorizing `identity:delete_project(project_id=70c2a8807f2a4c8391ad495c55aa6445)` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:25:14.579960 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 965/1921] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 07:25:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 07:25:14.580227 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09f2440-de60-46c6-be2f-4235393a953e admin admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:25:14.580320 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87539f6-7efd-4acf-960f-86fdfd04b5e0 None None] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:25:14.585367 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.fernet_utils [None req-f87539f6-7efd-4acf-960f-86fdfd04b5e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:25:14.638691 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-e09f2440-de60-46c6-be2f-4235393a953e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '70c2a8807f2a4c8391ad495c55aa6445', 'request_id': 'req-e09f2440-de60-46c6-be2f-4235393a953e'} {{(pid=79745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:25:14.646228 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-e09f2440-de60-46c6-be2f-4235393a953e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '70c2a8807f2a4c8391ad495c55aa6445', 'request_id': 'req-e09f2440-de60-46c6-be2f-4235393a953e'} {{(pid=79745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:25:14.658726 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-e09f2440-de60-46c6-be2f-4235393a953e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '70c2a8807f2a4c8391ad495c55aa6445', 'request_id': 'req-e09f2440-de60-46c6-be2f-4235393a953e'} {{(pid=79745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:25:14.681068 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87539f6-7efd-4acf-960f-86fdfd04b5e0 None None] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:25:14.691043 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-e09f2440-de60-46c6-be2f-4235393a953e admin admin] The token cache is being invalidate because project 70c2a8807f2a4c8391ad495c55aa6445 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79745) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 07:25:14.691443 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-e09f2440-de60-46c6-be2f-4235393a953e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:25:14.692166 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-e09f2440-de60-46c6-be2f-4235393a953e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:25:14.698553 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 957/1922] 10.222.0.21 () {58 vars in 1232 bytes} [Wed May 4 07:25:14 2022] DELETE /identity/v3/projects/70c2a8807f2a4c8391ad495c55aa6445 => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 07:25:14.698553 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3996c72e-8687-4795-b9d7-a2561efe7673 None None] REQUEST_METHOD: `POST` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:25:14.698553 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3996c72e-8687-4795-b9d7-a2561efe7673 None None] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:25:14.698553 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3996c72e-8687-4795-b9d7-a2561efe7673 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:25:14.733272 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.auth.core [None req-3996c72e-8687-4795-b9d7-a2561efe7673 None None] MFA Rules not processed for user `d5fa6085b83d4bebb1eb524e24ef830b`. Rule list: `[]` (Enabled: `True`). {{(pid=79745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:25:14.734634 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.fernet_utils [None req-3996c72e-8687-4795-b9d7-a2561efe7673 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:25:14.775090 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503eb49c-313c-457a-b60a-b60d07fe99b5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1077289fedae43b6be47be7f716d573a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9f9c44db4984653b8d4b5f6b3b949f5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:25:14.775883 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503eb49c-313c-457a-b60a-b60d07fe99b5 service nova] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:25:14.776249 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503eb49c-313c-457a-b60a-b60d07fe99b5 service nova] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:25:14.776588 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503eb49c-313c-457a-b60a-b60d07fe99b5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:25:14.778916 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.fernet_utils [None req-503eb49c-313c-457a-b60a-b60d07fe99b5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:25:14.796007 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503eb49c-313c-457a-b60a-b60d07fe99b5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:25:14.797689 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503eb49c-313c-457a-b60a-b60d07fe99b5 service nova] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:25:14.810317 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 966/1923] 10.222.0.21 () {60 vars in 1365 bytes} [Wed May 4 07:25:14 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 233 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 07:25:14.812095 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503eb49c-313c-457a-b60a-b60d07fe99b5 service nova] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:25:14.813913 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.fernet_utils [None req-503eb49c-313c-457a-b60a-b60d07fe99b5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:25:14.847774 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 958/1924] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 07:25:14 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 07:25:14.853891 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700882ef-8391-4828-a6a5-67a433d20ec5 None None] REQUEST_METHOD: `POST` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:25:14.854472 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700882ef-8391-4828-a6a5-67a433d20ec5 None None] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:25:14.854472 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700882ef-8391-4828-a6a5-67a433d20ec5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:25:14.875966 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.auth.core [None req-700882ef-8391-4828-a6a5-67a433d20ec5 None None] MFA Rules not processed for user `83c5e0dcb991496ea6dee38384514508`. Rule list: `[]` (Enabled: `True`). {{(pid=79745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:25:14.878432 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.fernet_utils [None req-700882ef-8391-4828-a6a5-67a433d20ec5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:25:14.924180 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503eb49c-313c-457a-b60a-b60d07fe99b5 service nova] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:25:14.930837 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee8744f-b184-445e-a9a1-e63185de1f94 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91cb92d00273402b837cb29b37325101', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9f9c44db4984653b8d4b5f6b3b949f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:25:14.931658 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee8744f-b184-445e-a9a1-e63185de1f94 service neutron] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:25:14.932107 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee8744f-b184-445e-a9a1-e63185de1f94 service neutron] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:25:14.932567 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee8744f-b184-445e-a9a1-e63185de1f94 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:25:14.935362 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.fernet_utils [None req-cee8744f-b184-445e-a9a1-e63185de1f94 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:25:14.974973 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 959/1925] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 07:25:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 07:25:14.975922 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700882ef-8391-4828-a6a5-67a433d20ec5 None None] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:25:14.978181 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.fernet_utils [None req-700882ef-8391-4828-a6a5-67a433d20ec5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:25:15.022743 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee8744f-b184-445e-a9a1-e63185de1f94 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:25:15.025062 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee8744f-b184-445e-a9a1-e63185de1f94 service neutron] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:25:15.034769 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 967/1926] 10.222.0.21 () {60 vars in 1365 bytes} [Wed May 4 07:25:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 224 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 07:25:15.035750 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee8744f-b184-445e-a9a1-e63185de1f94 service neutron] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:25:15.037253 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.fernet_utils [None req-cee8744f-b184-445e-a9a1-e63185de1f94 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:25:15.048868 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700882ef-8391-4828-a6a5-67a433d20ec5 None None] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:25:15.049505 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee8744f-b184-445e-a9a1-e63185de1f94 service neutron] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:25:15.053026 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e02d93-ea2a-4f91-a9a1-be7611510235 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb341257aa8246b6847561e2fe1fa385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9f9c44db4984653b8d4b5f6b3b949f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:25:15.053784 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e02d93-ea2a-4f91-a9a1-be7611510235 service cinder] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:25:15.054006 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7054c339-db6c-4530-bed3-7173c48cb7bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:25:15.054384 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e02d93-ea2a-4f91-a9a1-be7611510235 service cinder] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:25:15.054751 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e02d93-ea2a-4f91-a9a1-be7611510235 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:25:15.055034 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7054c339-db6c-4530-bed3-7173c48cb7bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:25:15.055351 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7054c339-db6c-4530-bed3-7173c48cb7bd admin admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:25:15.055648 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7054c339-db6c-4530-bed3-7173c48cb7bd admin admin] PATH_INFO: `/v3/projects/1ab00322553b427587e2a8500a826b72` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:25:15.056985 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7054c339-db6c-4530-bed3-7173c48cb7bd admin admin] RBAC: Authorizing `identity:delete_project(project_id=1ab00322553b427587e2a8500a826b72)` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:25:15.058874 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7054c339-db6c-4530-bed3-7173c48cb7bd admin admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:25:15.066886 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e02d93-ea2a-4f91-a9a1-be7611510235 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:25:15.068370 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e02d93-ea2a-4f91-a9a1-be7611510235 service cinder] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:25:15.079528 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 960/1927] 10.222.0.21 () {60 vars in 1365 bytes} [Wed May 4 07:25:14 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 07:25:15.080839 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc04ea08-f6b4-4263-9739-5cbaad941ab1 None None] REQUEST_METHOD: `POST` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:25:15.081130 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc04ea08-f6b4-4263-9739-5cbaad941ab1 None None] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:25:15.081405 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc04ea08-f6b4-4263-9739-5cbaad941ab1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:25:15.118292 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.auth.core [None req-bc04ea08-f6b4-4263-9739-5cbaad941ab1 None None] MFA Rules not processed for user `83c5e0dcb991496ea6dee38384514508`. Rule list: `[]` (Enabled: `True`). {{(pid=79745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:25:15.120187 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.fernet_utils [None req-bc04ea08-f6b4-4263-9739-5cbaad941ab1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:25:15.133764 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 961/1928] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 07:25:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 07:25:15.139985 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc04ea08-f6b4-4263-9739-5cbaad941ab1 None None] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:25:15.151674 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc04ea08-f6b4-4263-9739-5cbaad941ab1 None None] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:25:15.165808 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-7054c339-db6c-4530-bed3-7173c48cb7bd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1ab00322553b427587e2a8500a826b72', 'request_id': 'req-7054c339-db6c-4530-bed3-7173c48cb7bd'} {{(pid=79744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:25:15.179968 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-7054c339-db6c-4530-bed3-7173c48cb7bd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1ab00322553b427587e2a8500a826b72', 'request_id': 'req-7054c339-db6c-4530-bed3-7173c48cb7bd'} {{(pid=79744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:25:15.189527 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-7054c339-db6c-4530-bed3-7173c48cb7bd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1ab00322553b427587e2a8500a826b72', 'request_id': 'req-7054c339-db6c-4530-bed3-7173c48cb7bd'} {{(pid=79744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:25:15.205053 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-7054c339-db6c-4530-bed3-7173c48cb7bd admin admin] The token cache is being invalidate because project 1ab00322553b427587e2a8500a826b72 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79744) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 07:25:15.205353 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-7054c339-db6c-4530-bed3-7173c48cb7bd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:25:15.206739 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-7054c339-db6c-4530-bed3-7173c48cb7bd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:25:15.208711 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 968/1929] 10.222.0.21 () {58 vars in 1232 bytes} [Wed May 4 07:25:15 2022] DELETE /identity/v3/projects/1ab00322553b427587e2a8500a826b72 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 07:25:15.209753 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7054c339-db6c-4530-bed3-7173c48cb7bd admin admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:25:15.211851 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.fernet_utils [None req-7054c339-db6c-4530-bed3-7173c48cb7bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:25:15.230211 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62680f07-ee0c-4848-b10b-afccaf41e44d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:25:15.231510 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62680f07-ee0c-4848-b10b-afccaf41e44d admin admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:25:15.231858 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62680f07-ee0c-4848-b10b-afccaf41e44d admin admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:25:15.232561 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62680f07-ee0c-4848-b10b-afccaf41e44d admin admin] PATH_INFO: `/v3/domains` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:25:15.233846 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62680f07-ee0c-4848-b10b-afccaf41e44d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 07:25:15.234163 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62680f07-ee0c-4848-b10b-afccaf41e44d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:25:15.236783 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62680f07-ee0c-4848-b10b-afccaf41e44d admin admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:25:15.269520 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 962/1930] 10.222.0.21 () {58 vars in 1152 bytes} [Wed May 4 07:25:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 07:25:15.269520 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3311f634-c8f3-4ba1-8344-394e8aa4528b None None] REQUEST_METHOD: `POST` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:25:15.269520 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3311f634-c8f3-4ba1-8344-394e8aa4528b None None] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:25:15.269520 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3311f634-c8f3-4ba1-8344-394e8aa4528b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:25:15.295952 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.auth.core [None req-3311f634-c8f3-4ba1-8344-394e8aa4528b None None] MFA Rules not processed for user `83c5e0dcb991496ea6dee38384514508`. Rule list: `[]` (Enabled: `True`). {{(pid=79745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:25:15.297153 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.fernet_utils [None req-3311f634-c8f3-4ba1-8344-394e8aa4528b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:25:15.313901 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 963/1931] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 07:25:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 07:25:15.313901 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3311f634-c8f3-4ba1-8344-394e8aa4528b None None] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:25:15.314208 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7054c339-db6c-4530-bed3-7173c48cb7bd admin admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:25:15.314289 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.fernet_utils [None req-3311f634-c8f3-4ba1-8344-394e8aa4528b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:25:15.314360 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912465f3-7cbe-442e-8e66-ce25951568ae service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb341257aa8246b6847561e2fe1fa385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9f9c44db4984653b8d4b5f6b3b949f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:25:15.314461 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912465f3-7cbe-442e-8e66-ce25951568ae service cinder] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:25:15.315343 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912465f3-7cbe-442e-8e66-ce25951568ae service cinder] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:25:15.315343 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912465f3-7cbe-442e-8e66-ce25951568ae service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:25:15.317755 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.fernet_utils [None req-912465f3-7cbe-442e-8e66-ce25951568ae service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:25:15.323302 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3311f634-c8f3-4ba1-8344-394e8aa4528b None None] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:25:15.329559 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ab5ccf-4d93-494c-8772-ac58cbbcf11a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:25:15.330510 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ab5ccf-4d93-494c-8772-ac58cbbcf11a admin admin] REQUEST_METHOD: `POST` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:25:15.331069 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ab5ccf-4d93-494c-8772-ac58cbbcf11a admin admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:25:15.331386 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ab5ccf-4d93-494c-8772-ac58cbbcf11a admin admin] PATH_INFO: `/v3/projects` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:25:15.332082 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ab5ccf-4d93-494c-8772-ac58cbbcf11a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:25:15.333998 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ab5ccf-4d93-494c-8772-ac58cbbcf11a admin admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:25:15.372961 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 964/1932] 10.222.0.21 () {60 vars in 1152 bytes} [Wed May 4 07:25:15 2022] POST /identity/v3/projects => generated 385 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 07:25:15.372961 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4585d9da-be75-4b03-b4ae-968b0e6cdf97 None None] REQUEST_METHOD: `POST` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:25:15.372961 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4585d9da-be75-4b03-b4ae-968b0e6cdf97 None None] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:25:15.372961 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4585d9da-be75-4b03-b4ae-968b0e6cdf97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:25:15.394498 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.auth.core [None req-4585d9da-be75-4b03-b4ae-968b0e6cdf97 None None] MFA Rules not processed for user `83c5e0dcb991496ea6dee38384514508`. Rule list: `[]` (Enabled: `True`). {{(pid=79745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:25:15.396393 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.fernet_utils [None req-4585d9da-be75-4b03-b4ae-968b0e6cdf97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:25:15.409892 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912465f3-7cbe-442e-8e66-ce25951568ae service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:25:15.411364 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912465f3-7cbe-442e-8e66-ce25951568ae service cinder] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:25:15.435356 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 969/1933] 10.222.0.21 () {60 vars in 1365 bytes} [Wed May 4 07:25:15 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 226 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 07:25:15.436554 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912465f3-7cbe-442e-8e66-ce25951568ae service cinder] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:25:15.449512 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912465f3-7cbe-442e-8e66-ce25951568ae service cinder] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:25:15.503946 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 965/1934] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 07:25:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 07:25:15.504989 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4585d9da-be75-4b03-b4ae-968b0e6cdf97 None None] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:25:15.509313 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.fernet_utils [None req-4585d9da-be75-4b03-b4ae-968b0e6cdf97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:25:15.524691 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4585d9da-be75-4b03-b4ae-968b0e6cdf97 None None] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:25:15.534980 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c251c1-5c02-450c-bec4-79f89b6829ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:25:15.536060 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c251c1-5c02-450c-bec4-79f89b6829ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:25:15.536347 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c251c1-5c02-450c-bec4-79f89b6829ea admin admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:25:15.536807 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c251c1-5c02-450c-bec4-79f89b6829ea admin admin] PATH_INFO: `/v3/projects/2fc5d661ed384c7bacc40c58b18c0b8b` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:25:15.539193 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c251c1-5c02-450c-bec4-79f89b6829ea admin admin] RBAC: Authorizing `identity:delete_project(project_id=2fc5d661ed384c7bacc40c58b18c0b8b)` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:25:15.541548 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c251c1-5c02-450c-bec4-79f89b6829ea admin admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:25:15.560228 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637d323c-e4c4-47d0-96f2-f4994926dc65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:25:15.560228 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637d323c-e4c4-47d0-96f2-f4994926dc65 admin admin] REQUEST_METHOD: `POST` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:25:15.560228 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637d323c-e4c4-47d0-96f2-f4994926dc65 admin admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:25:15.560228 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637d323c-e4c4-47d0-96f2-f4994926dc65 admin admin] PATH_INFO: `/v3/users` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:25:15.560621 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637d323c-e4c4-47d0-96f2-f4994926dc65 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:25:15.560621 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637d323c-e4c4-47d0-96f2-f4994926dc65 admin admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:25:15.587658 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 970/1935] 10.222.0.21 () {60 vars in 1143 bytes} [Wed May 4 07:25:15 2022] POST /identity/v3/users => generated 293 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 07:25:15.587658 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637d323c-e4c4-47d0-96f2-f4994926dc65 admin admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:25:15.600191 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637d323c-e4c4-47d0-96f2-f4994926dc65 admin admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:25:15.603376 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-58c251c1-5c02-450c-bec4-79f89b6829ea admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2fc5d661ed384c7bacc40c58b18c0b8b', 'request_id': 'req-58c251c1-5c02-450c-bec4-79f89b6829ea'} {{(pid=79745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:25:15.609951 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-58c251c1-5c02-450c-bec4-79f89b6829ea admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2fc5d661ed384c7bacc40c58b18c0b8b', 'request_id': 'req-58c251c1-5c02-450c-bec4-79f89b6829ea'} {{(pid=79745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:25:15.651024 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-58c251c1-5c02-450c-bec4-79f89b6829ea admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2fc5d661ed384c7bacc40c58b18c0b8b', 'request_id': 'req-58c251c1-5c02-450c-bec4-79f89b6829ea'} {{(pid=79745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:25:15.697860 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-58c251c1-5c02-450c-bec4-79f89b6829ea admin admin] The token cache is being invalidate because project 2fc5d661ed384c7bacc40c58b18c0b8b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79745) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 07:25:15.698117 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-58c251c1-5c02-450c-bec4-79f89b6829ea admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:25:15.702646 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-58c251c1-5c02-450c-bec4-79f89b6829ea admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:25:15.706048 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7a1816-4c7c-4baa-bc7f-4d46b4b7aed2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:25:15.706232 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 966/1936] 10.222.0.21 () {58 vars in 1232 bytes} [Wed May 4 07:25:15 2022] DELETE /identity/v3/projects/2fc5d661ed384c7bacc40c58b18c0b8b => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 07:25:15.707039 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7a1816-4c7c-4baa-bc7f-4d46b4b7aed2 admin admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:25:15.707540 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7a1816-4c7c-4baa-bc7f-4d46b4b7aed2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:25:15.707773 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c251c1-5c02-450c-bec4-79f89b6829ea admin admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:25:15.708115 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7a1816-4c7c-4baa-bc7f-4d46b4b7aed2 admin admin] PATH_INFO: `/v3/domains` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:25:15.709847 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7a1816-4c7c-4baa-bc7f-4d46b4b7aed2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79744) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 07:25:15.710346 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7a1816-4c7c-4baa-bc7f-4d46b4b7aed2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:25:15.711883 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.fernet_utils [None req-58c251c1-5c02-450c-bec4-79f89b6829ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:25:15.712482 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7a1816-4c7c-4baa-bc7f-4d46b4b7aed2 admin admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:25:15.731993 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c251c1-5c02-450c-bec4-79f89b6829ea admin admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:25:15.739033 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86956563-e026-4238-8110-b57391987e89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:25:15.739889 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86956563-e026-4238-8110-b57391987e89 admin admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:25:15.740466 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86956563-e026-4238-8110-b57391987e89 admin admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:25:15.740992 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86956563-e026-4238-8110-b57391987e89 admin admin] PATH_INFO: `/v3/roles` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:25:15.742291 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86956563-e026-4238-8110-b57391987e89 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:25:15.744310 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86956563-e026-4238-8110-b57391987e89 admin admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:25:15.749755 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 971/1937] 10.222.0.21 () {58 vars in 1152 bytes} [Wed May 4 07:25:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 07:25:15.750742 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7a1816-4c7c-4baa-bc7f-4d46b4b7aed2 admin admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:25:15.753362 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.fernet_utils [None req-af7a1816-4c7c-4baa-bc7f-4d46b4b7aed2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:25:15.778654 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 967/1938] 10.222.0.21 () {58 vars in 1121 bytes} [Wed May 4 07:25:15 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 07:25:15.779603 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86956563-e026-4238-8110-b57391987e89 admin admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:25:15.785333 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.fernet_utils [None req-86956563-e026-4238-8110-b57391987e89 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:25:15.786719 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7a1816-4c7c-4baa-bc7f-4d46b4b7aed2 admin admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:25:15.792793 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5315b43e-4e9e-4aa8-bf1a-cc040291d3f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:25:15.793755 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5315b43e-4e9e-4aa8-bf1a-cc040291d3f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:25:15.794044 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5315b43e-4e9e-4aa8-bf1a-cc040291d3f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:25:15.794577 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5315b43e-4e9e-4aa8-bf1a-cc040291d3f3 admin admin] PATH_INFO: `/v3/users/a288b1ec473e46b38c2fe2ee8ede7ae8` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:25:15.796169 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5315b43e-4e9e-4aa8-bf1a-cc040291d3f3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a288b1ec473e46b38c2fe2ee8ede7ae8)` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:25:15.798903 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5315b43e-4e9e-4aa8-bf1a-cc040291d3f3 admin admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:25:15.810597 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86956563-e026-4238-8110-b57391987e89 admin admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:25:15.824119 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c418da-7cd3-4349-8da2-0f9771e9e065 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:25:15.825898 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c418da-7cd3-4349-8da2-0f9771e9e065 admin admin] REQUEST_METHOD: `POST` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:25:15.826181 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c418da-7cd3-4349-8da2-0f9771e9e065 admin admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:25:15.826457 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c418da-7cd3-4349-8da2-0f9771e9e065 admin admin] PATH_INFO: `/v3/projects` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:25:15.827315 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c418da-7cd3-4349-8da2-0f9771e9e065 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:25:15.834911 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c418da-7cd3-4349-8da2-0f9771e9e065 admin admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:25:15.866258 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-5315b43e-4e9e-4aa8-bf1a-cc040291d3f3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a288b1ec473e46b38c2fe2ee8ede7ae8'} {{(pid=79744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:25:15.867117 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-5315b43e-4e9e-4aa8-bf1a-cc040291d3f3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a288b1ec473e46b38c2fe2ee8ede7ae8'} {{(pid=79744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:25:15.876103 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-5315b43e-4e9e-4aa8-bf1a-cc040291d3f3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a288b1ec473e46b38c2fe2ee8ede7ae8'} {{(pid=79744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:25:15.876899 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-5315b43e-4e9e-4aa8-bf1a-cc040291d3f3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a288b1ec473e46b38c2fe2ee8ede7ae8'} {{(pid=79744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:25:15.882133 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 968/1939] 10.222.0.21 () {60 vars in 1152 bytes} [Wed May 4 07:25:15 2022] POST /identity/v3/projects => generated 363 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 07:25:15.883539 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c418da-7cd3-4349-8da2-0f9771e9e065 admin admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:25:15.887677 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.fernet_utils [None req-a9c418da-7cd3-4349-8da2-0f9771e9e065 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:25:15.899834 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-5315b43e-4e9e-4aa8-bf1a-cc040291d3f3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a288b1ec473e46b38c2fe2ee8ede7ae8'} {{(pid=79744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:25:15.941671 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 972/1940] 10.222.0.21 () {58 vars in 1223 bytes} [Wed May 4 07:25:15 2022] DELETE /identity/v3/users/a288b1ec473e46b38c2fe2ee8ede7ae8 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 07:25:15.943035 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5315b43e-4e9e-4aa8-bf1a-cc040291d3f3 admin admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:25:15.945060 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.fernet_utils [None req-5315b43e-4e9e-4aa8-bf1a-cc040291d3f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:25:15.976163 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c418da-7cd3-4349-8da2-0f9771e9e065 admin admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:25:16.112801 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad9580a-a7d8-4028-b21d-2deb2cf31fb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:25:16.113501 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad9580a-a7d8-4028-b21d-2deb2cf31fb6 admin admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:25:16.113843 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad9580a-a7d8-4028-b21d-2deb2cf31fb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:25:16.114246 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad9580a-a7d8-4028-b21d-2deb2cf31fb6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:25:16.117543 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad9580a-a7d8-4028-b21d-2deb2cf31fb6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:25:16.120516 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad9580a-a7d8-4028-b21d-2deb2cf31fb6 admin admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:25:16.130564 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5315b43e-4e9e-4aa8-bf1a-cc040291d3f3 admin admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:25:16.144450 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 969/1941] 10.222.0.21 () {58 vars in 1121 bytes} [Wed May 4 07:25:15 2022] GET /identity/v3/roles => generated 1420 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 07:25:16.144637 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad9580a-a7d8-4028-b21d-2deb2cf31fb6 admin admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:25:16.146553 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5588a5f4-d87d-4869-b11c-b6084c484a0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:25:16.148442 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5588a5f4-d87d-4869-b11c-b6084c484a0f admin admin] REQUEST_METHOD: `POST` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:25:16.151035 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5588a5f4-d87d-4869-b11c-b6084c484a0f admin admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:25:16.151849 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5588a5f4-d87d-4869-b11c-b6084c484a0f admin admin] PATH_INFO: `/v3/users` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:25:16.152908 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5588a5f4-d87d-4869-b11c-b6084c484a0f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:25:16.163962 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5588a5f4-d87d-4869-b11c-b6084c484a0f admin admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:25:16.171184 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad9580a-a7d8-4028-b21d-2deb2cf31fb6 admin admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:25:16.187303 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e8e222-8bc9-4607-8c37-14ce91726ce3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:25:16.188496 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e8e222-8bc9-4607-8c37-14ce91726ce3 admin admin] REQUEST_METHOD: `PUT` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:25:16.188791 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e8e222-8bc9-4607-8c37-14ce91726ce3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:25:16.189734 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e8e222-8bc9-4607-8c37-14ce91726ce3 admin admin] PATH_INFO: `/v3/projects/1e575fd13541441d9e87473864301c65/users/aafb56bc6a204b57afba78a29f0e7c75/roles/9f89c07b05a14f18836116af22cba5f6` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:25:16.211661 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 973/1942] 10.222.0.21 () {60 vars in 1143 bytes} [Wed May 4 07:25:15 2022] POST /identity/v3/users => generated 282 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 07:25:16.215355 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5588a5f4-d87d-4869-b11c-b6084c484a0f admin admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:25:16.226432 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5588a5f4-d87d-4869-b11c-b6084c484a0f admin admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:25:16.227387 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e8e222-8bc9-4607-8c37-14ce91726ce3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1e575fd13541441d9e87473864301c65, user_id=aafb56bc6a204b57afba78a29f0e7c75, role_id=9f89c07b05a14f18836116af22cba5f6)` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:25:16.231323 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e8e222-8bc9-4607-8c37-14ce91726ce3 admin admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:25:16.231969 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c16053f-3f53-459f-9a87-af63a4a72500 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:25:16.232655 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c16053f-3f53-459f-9a87-af63a4a72500 admin admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:25:16.233008 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c16053f-3f53-459f-9a87-af63a4a72500 admin admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:25:16.233356 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c16053f-3f53-459f-9a87-af63a4a72500 admin admin] PATH_INFO: `/v3/roles` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:25:16.234358 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c16053f-3f53-459f-9a87-af63a4a72500 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:25:16.236126 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c16053f-3f53-459f-9a87-af63a4a72500 admin admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:25:16.252692 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 970/1943] 10.222.0.21 () {60 vars in 1482 bytes} [Wed May 4 07:25:16 2022] PUT /identity/v3/projects/1e575fd13541441d9e87473864301c65/users/aafb56bc6a204b57afba78a29f0e7c75/roles/9f89c07b05a14f18836116af22cba5f6 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 07:25:16.256047 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 974/1944] 10.222.0.21 () {58 vars in 1121 bytes} [Wed May 4 07:25:16 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 04 07:25:16.259879 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e8e222-8bc9-4607-8c37-14ce91726ce3 admin admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:25:16.264147 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b963f8b0-772a-4478-aac8-bf4a57353c58 None None] REQUEST_METHOD: `POST` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:25:16.264442 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b963f8b0-772a-4478-aac8-bf4a57353c58 None None] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:25:16.264718 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b963f8b0-772a-4478-aac8-bf4a57353c58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:25:16.305076 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.auth.core [None req-b963f8b0-772a-4478-aac8-bf4a57353c58 None None] MFA Rules not processed for user `aafb56bc6a204b57afba78a29f0e7c75`. Rule list: `[]` (Enabled: `True`). {{(pid=79744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:25:16.306530 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.fernet_utils [None req-b963f8b0-772a-4478-aac8-bf4a57353c58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:25:16.338624 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e8e222-8bc9-4607-8c37-14ce91726ce3 admin admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:25:16.345356 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c9acc4-e429-4809-aea1-2ec5113f3606 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:25:16.346200 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c9acc4-e429-4809-aea1-2ec5113f3606 admin admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:25:16.346550 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c9acc4-e429-4809-aea1-2ec5113f3606 admin admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:25:16.346947 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c9acc4-e429-4809-aea1-2ec5113f3606 admin admin] PATH_INFO: `/v3/roles` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:25:16.347828 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c9acc4-e429-4809-aea1-2ec5113f3606 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:25:16.350354 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c9acc4-e429-4809-aea1-2ec5113f3606 admin admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:25:16.368158 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 971/1945] 10.222.0.21 () {58 vars in 1121 bytes} [Wed May 4 07:25:16 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 04 07:25:16.369703 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c9acc4-e429-4809-aea1-2ec5113f3606 admin admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:25:16.380122 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c9acc4-e429-4809-aea1-2ec5113f3606 admin admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:25:16.386232 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6cb6c51-64f3-460a-91c0-da5e0bc5cc6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:25:16.387361 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cb6c51-64f3-460a-91c0-da5e0bc5cc6f admin admin] REQUEST_METHOD: `PUT` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:25:16.387629 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cb6c51-64f3-460a-91c0-da5e0bc5cc6f admin admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:25:16.387908 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cb6c51-64f3-460a-91c0-da5e0bc5cc6f admin admin] PATH_INFO: `/v3/projects/f971bd19417b4f1ba9cfc546419b9f15/users/5074d1dc23a54562a9c79a377b052817/roles/9f89c07b05a14f18836116af22cba5f6` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:25:16.409402 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 975/1946] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 07:25:16 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 07:25:16.415443 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b963f8b0-772a-4478-aac8-bf4a57353c58 None None] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:25:16.418897 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6cb6c51-64f3-460a-91c0-da5e0bc5cc6f admin admin] RBAC: Authorizing `identity:create_grant(project_id=f971bd19417b4f1ba9cfc546419b9f15, user_id=5074d1dc23a54562a9c79a377b052817, role_id=9f89c07b05a14f18836116af22cba5f6)` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:25:16.422329 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6cb6c51-64f3-460a-91c0-da5e0bc5cc6f admin admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:25:16.433400 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b963f8b0-772a-4478-aac8-bf4a57353c58 None None] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:25:16.451658 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 972/1947] 10.222.0.21 () {60 vars in 1482 bytes} [Wed May 4 07:25:16 2022] PUT /identity/v3/projects/f971bd19417b4f1ba9cfc546419b9f15/users/5074d1dc23a54562a9c79a377b052817/roles/9f89c07b05a14f18836116af22cba5f6 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 07:25:16.456989 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cc16fb-2e2b-479d-9cec-434ac72c1dab None None] REQUEST_METHOD: `POST` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:25:16.457761 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cc16fb-2e2b-479d-9cec-434ac72c1dab None None] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:25:16.458567 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cc16fb-2e2b-479d-9cec-434ac72c1dab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:25:16.507012 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.auth.core [None req-f4cc16fb-2e2b-479d-9cec-434ac72c1dab None None] MFA Rules not processed for user `5074d1dc23a54562a9c79a377b052817`. Rule list: `[]` (Enabled: `True`). {{(pid=79745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:25:16.508300 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.fernet_utils [None req-f4cc16fb-2e2b-479d-9cec-434ac72c1dab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:25:16.530972 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467a7f86-de8d-4f3f-be96-748476b22ece admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:25:16.531763 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467a7f86-de8d-4f3f-be96-748476b22ece admin admin] REQUEST_METHOD: `POST` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:25:16.532044 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467a7f86-de8d-4f3f-be96-748476b22ece admin admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:25:16.532317 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467a7f86-de8d-4f3f-be96-748476b22ece admin admin] PATH_INFO: `/v3/projects` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:25:16.533298 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467a7f86-de8d-4f3f-be96-748476b22ece admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:25:16.538562 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467a7f86-de8d-4f3f-be96-748476b22ece admin admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:25:16.594145 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 976/1948] 10.222.0.21 () {60 vars in 1152 bytes} [Wed May 4 07:25:16 2022] POST /identity/v3/projects => generated 385 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 07:25:16.599021 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467a7f86-de8d-4f3f-be96-748476b22ece admin admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:25:16.610640 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 973/1949] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 07:25:16 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 07:25:16.628225 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4cc16fb-2e2b-479d-9cec-434ac72c1dab None None] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:25:16.632554 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.fernet_utils [None req-f4cc16fb-2e2b-479d-9cec-434ac72c1dab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:25:16.691311 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467a7f86-de8d-4f3f-be96-748476b22ece admin admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:25:16.697039 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01881415-f9ad-4381-b554-c56d12e32546 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:25:16.697967 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01881415-f9ad-4381-b554-c56d12e32546 admin admin] REQUEST_METHOD: `POST` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:25:16.698549 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01881415-f9ad-4381-b554-c56d12e32546 admin admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:25:16.699134 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01881415-f9ad-4381-b554-c56d12e32546 admin admin] PATH_INFO: `/v3/users` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:25:16.700328 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01881415-f9ad-4381-b554-c56d12e32546 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:25:16.702859 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01881415-f9ad-4381-b554-c56d12e32546 admin admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:25:16.732277 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4cc16fb-2e2b-479d-9cec-434ac72c1dab None None] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:25:16.738684 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 977/1950] 10.222.0.21 () {60 vars in 1143 bytes} [Wed May 4 07:25:16 2022] POST /identity/v3/users => generated 293 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 07:25:16.743301 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01881415-f9ad-4381-b554-c56d12e32546 admin admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:25:16.772772 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01881415-f9ad-4381-b554-c56d12e32546 admin admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:25:16.779173 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df8f0e9-9de4-4605-adc1-c2fcce3cd322 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:25:16.781913 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df8f0e9-9de4-4605-adc1-c2fcce3cd322 admin admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:25:16.782206 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df8f0e9-9de4-4605-adc1-c2fcce3cd322 admin admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:25:16.783643 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df8f0e9-9de4-4605-adc1-c2fcce3cd322 admin admin] PATH_INFO: `/v3/roles` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:25:16.784044 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df8f0e9-9de4-4605-adc1-c2fcce3cd322 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:25:16.790593 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df8f0e9-9de4-4605-adc1-c2fcce3cd322 admin admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:25:16.819353 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 978/1951] 10.222.0.21 () {58 vars in 1121 bytes} [Wed May 4 07:25:16 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 07:25:16.830126 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df8f0e9-9de4-4605-adc1-c2fcce3cd322 admin admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:25:16.847896 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5eaaf2-ff08-4bd6-8810-c03ac72a7d2e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb341257aa8246b6847561e2fe1fa385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9f9c44db4984653b8d4b5f6b3b949f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:25:16.849164 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5eaaf2-ff08-4bd6-8810-c03ac72a7d2e service cinder] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:25:16.849164 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5eaaf2-ff08-4bd6-8810-c03ac72a7d2e service cinder] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:25:16.849361 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5eaaf2-ff08-4bd6-8810-c03ac72a7d2e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:25:16.853649 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df8f0e9-9de4-4605-adc1-c2fcce3cd322 admin admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:25:16.862402 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc973c61-1935-4443-b379-4a6d569fa9a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:25:16.863571 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc973c61-1935-4443-b379-4a6d569fa9a4 admin admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:25:16.863978 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc973c61-1935-4443-b379-4a6d569fa9a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:25:16.864535 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc973c61-1935-4443-b379-4a6d569fa9a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:25:16.866048 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc973c61-1935-4443-b379-4a6d569fa9a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:25:16.868258 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc973c61-1935-4443-b379-4a6d569fa9a4 admin admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:25:16.887918 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 979/1952] 10.222.0.21 () {58 vars in 1121 bytes} [Wed May 4 07:25:16 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 07:25:16.892205 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc973c61-1935-4443-b379-4a6d569fa9a4 admin admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:25:16.919590 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc973c61-1935-4443-b379-4a6d569fa9a4 admin admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:25:16.930379 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb7164f-e792-443f-96d7-d432fbb815ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:25:16.931995 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb7164f-e792-443f-96d7-d432fbb815ed admin admin] REQUEST_METHOD: `PUT` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:25:16.933295 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb7164f-e792-443f-96d7-d432fbb815ed admin admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:25:16.933410 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb7164f-e792-443f-96d7-d432fbb815ed admin admin] PATH_INFO: `/v3/projects/819b9f3893fc4a39a0b77aa941b3bcc4/users/7018ac662dfc4d09b5db11b4e90c3cec/roles/9f89c07b05a14f18836116af22cba5f6` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:25:16.952350 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb7164f-e792-443f-96d7-d432fbb815ed admin admin] RBAC: Authorizing `identity:create_grant(project_id=819b9f3893fc4a39a0b77aa941b3bcc4, user_id=7018ac662dfc4d09b5db11b4e90c3cec, role_id=9f89c07b05a14f18836116af22cba5f6)` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:25:16.954995 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb7164f-e792-443f-96d7-d432fbb815ed admin admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:25:16.979238 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 980/1953] 10.222.0.21 () {60 vars in 1482 bytes} [Wed May 4 07:25:16 2022] PUT /identity/v3/projects/819b9f3893fc4a39a0b77aa941b3bcc4/users/7018ac662dfc4d09b5db11b4e90c3cec/roles/9f89c07b05a14f18836116af22cba5f6 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 07:25:16.981629 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb7164f-e792-443f-96d7-d432fbb815ed admin admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:25:16.984242 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.fernet_utils [None req-afb7164f-e792-443f-96d7-d432fbb815ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:25:16.984601 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5eaaf2-ff08-4bd6-8810-c03ac72a7d2e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:25:16.987117 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5eaaf2-ff08-4bd6-8810-c03ac72a7d2e service cinder] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:25:17.005634 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 974/1954] 10.222.0.21 () {60 vars in 1365 bytes} [Wed May 4 07:25:16 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 04 07:25:17.007943 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0b6ca1-1f81-45e6-aeba-430be16bb2bb None None] REQUEST_METHOD: `POST` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:25:17.008407 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0b6ca1-1f81-45e6-aeba-430be16bb2bb None None] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:25:17.009745 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0b6ca1-1f81-45e6-aeba-430be16bb2bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:25:17.070100 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.auth.core [None req-fb0b6ca1-1f81-45e6-aeba-430be16bb2bb None None] MFA Rules not processed for user `7018ac662dfc4d09b5db11b4e90c3cec`. Rule list: `[]` (Enabled: `True`). {{(pid=79745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:25:17.074494 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.fernet_utils [None req-fb0b6ca1-1f81-45e6-aeba-430be16bb2bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:25:17.077187 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb7164f-e792-443f-96d7-d432fbb815ed admin admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:25:17.087837 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843a49be-3580-4753-8ada-cc5580578603 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:25:17.088860 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843a49be-3580-4753-8ada-cc5580578603 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:25:17.089192 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843a49be-3580-4753-8ada-cc5580578603 admin admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:25:17.089702 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843a49be-3580-4753-8ada-cc5580578603 admin admin] PATH_INFO: `/v3/projects/ade60cc96c3c4a33a053475a74d6a50f` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:25:17.091249 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843a49be-3580-4753-8ada-cc5580578603 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ade60cc96c3c4a33a053475a74d6a50f)` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:25:17.093279 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843a49be-3580-4753-8ada-cc5580578603 admin admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:25:17.176792 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-843a49be-3580-4753-8ada-cc5580578603 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ade60cc96c3c4a33a053475a74d6a50f', 'request_id': 'req-843a49be-3580-4753-8ada-cc5580578603'} {{(pid=79744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:25:17.187127 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-843a49be-3580-4753-8ada-cc5580578603 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ade60cc96c3c4a33a053475a74d6a50f', 'request_id': 'req-843a49be-3580-4753-8ada-cc5580578603'} {{(pid=79744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:25:17.200702 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-843a49be-3580-4753-8ada-cc5580578603 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ade60cc96c3c4a33a053475a74d6a50f', 'request_id': 'req-843a49be-3580-4753-8ada-cc5580578603'} {{(pid=79744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:25:17.221103 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-843a49be-3580-4753-8ada-cc5580578603 admin admin] The token cache is being invalidate because project ade60cc96c3c4a33a053475a74d6a50f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79744) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 07:25:17.222157 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-843a49be-3580-4753-8ada-cc5580578603 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:25:17.223938 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-843a49be-3580-4753-8ada-cc5580578603 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:25:17.227520 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 981/1955] 10.222.0.21 () {58 vars in 1232 bytes} [Wed May 4 07:25:16 2022] DELETE /identity/v3/projects/ade60cc96c3c4a33a053475a74d6a50f => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 07:25:17.233102 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0244826-49e5-4649-b2b1-5cb30f2844f9 None None] REQUEST_METHOD: `POST` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:25:17.233102 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0244826-49e5-4649-b2b1-5cb30f2844f9 None None] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:25:17.233102 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0244826-49e5-4649-b2b1-5cb30f2844f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:25:17.257353 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.auth.core [None req-a0244826-49e5-4649-b2b1-5cb30f2844f9 None None] MFA Rules not processed for user `83c5e0dcb991496ea6dee38384514508`. Rule list: `[]` (Enabled: `True`). {{(pid=79744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:25:17.258581 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.fernet_utils [None req-a0244826-49e5-4649-b2b1-5cb30f2844f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:25:17.261259 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 975/1956] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 07:25:17 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 07:25:17.266254 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0b6ca1-1f81-45e6-aeba-430be16bb2bb None None] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:25:17.280884 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0b6ca1-1f81-45e6-aeba-430be16bb2bb None None] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:25:17.402157 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 982/1957] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 07:25:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 07:25:17.412015 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8a4d81-e0a9-4f2f-a040-e0091db54ed6 None None] REQUEST_METHOD: `POST` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:25:17.413684 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8a4d81-e0a9-4f2f-a040-e0091db54ed6 None None] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:25:17.414387 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8a4d81-e0a9-4f2f-a040-e0091db54ed6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:25:17.421541 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8d8a2b-18b0-41f0-a573-fbb0f3b8d4c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:25:17.422360 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8d8a2b-18b0-41f0-a573-fbb0f3b8d4c8 admin admin] REQUEST_METHOD: `POST` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:25:17.422791 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8d8a2b-18b0-41f0-a573-fbb0f3b8d4c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:25:17.423191 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8d8a2b-18b0-41f0-a573-fbb0f3b8d4c8 admin admin] PATH_INFO: `/v3/projects` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:25:17.424748 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8d8a2b-18b0-41f0-a573-fbb0f3b8d4c8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:25:17.427023 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8d8a2b-18b0-41f0-a573-fbb0f3b8d4c8 admin admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:25:17.455114 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.auth.core [None req-6b8a4d81-e0a9-4f2f-a040-e0091db54ed6 None None] MFA Rules not processed for user `83c5e0dcb991496ea6dee38384514508`. Rule list: `[]` (Enabled: `True`). {{(pid=79744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:25:17.456407 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.fernet_utils [None req-6b8a4d81-e0a9-4f2f-a040-e0091db54ed6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:25:17.472678 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 983/1958] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 07:25:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 07:25:17.473696 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8a4d81-e0a9-4f2f-a040-e0091db54ed6 None None] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:25:17.488329 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 976/1959] 10.222.0.21 () {60 vars in 1152 bytes} [Wed May 4 07:25:17 2022] POST /identity/v3/projects => generated 385 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 07:25:17.492095 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8d8a2b-18b0-41f0-a573-fbb0f3b8d4c8 admin admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:25:17.493798 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.fernet_utils [None req-8c8d8a2b-18b0-41f0-a573-fbb0f3b8d4c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:25:17.495107 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8a4d81-e0a9-4f2f-a040-e0091db54ed6 None None] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:25:17.652699 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8d8a2b-18b0-41f0-a573-fbb0f3b8d4c8 admin admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:25:17.667360 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0bc4911-2399-4eea-a802-8a739e83168e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:25:17.668065 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bc4911-2399-4eea-a802-8a739e83168e admin admin] REQUEST_METHOD: `POST` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:25:17.668323 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bc4911-2399-4eea-a802-8a739e83168e admin admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:25:17.668595 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bc4911-2399-4eea-a802-8a739e83168e admin admin] PATH_INFO: `/v3/users` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:25:17.681443 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0bc4911-2399-4eea-a802-8a739e83168e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:25:17.683900 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff64e4e-0336-4339-9f07-ddf8cbe61852 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:25:17.684699 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff64e4e-0336-4339-9f07-ddf8cbe61852 admin admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:25:17.685126 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff64e4e-0336-4339-9f07-ddf8cbe61852 admin admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:25:17.685500 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff64e4e-0336-4339-9f07-ddf8cbe61852 admin admin] PATH_INFO: `/v3/domains` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:25:17.686547 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff64e4e-0336-4339-9f07-ddf8cbe61852 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79744) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 07:25:17.688255 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0bc4911-2399-4eea-a802-8a739e83168e admin admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:25:17.689775 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff64e4e-0336-4339-9f07-ddf8cbe61852 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:25:17.695988 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff64e4e-0336-4339-9f07-ddf8cbe61852 admin admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:25:17.735625 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 984/1960] 10.222.0.21 () {58 vars in 1152 bytes} [Wed May 4 07:25:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 07:25:17.741161 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff64e4e-0336-4339-9f07-ddf8cbe61852 admin admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:25:17.759800 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 977/1961] 10.222.0.21 () {60 vars in 1143 bytes} [Wed May 4 07:25:17 2022] POST /identity/v3/users => generated 299 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 07:25:17.762422 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0bc4911-2399-4eea-a802-8a739e83168e admin admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:25:17.772886 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff64e4e-0336-4339-9f07-ddf8cbe61852 admin admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:25:17.793167 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0bc4911-2399-4eea-a802-8a739e83168e admin admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:25:17.796946 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124d5bce-8ed0-4553-a24a-5cb3b60d28f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:25:17.797466 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124d5bce-8ed0-4553-a24a-5cb3b60d28f8 admin admin] REQUEST_METHOD: `POST` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:25:17.797966 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124d5bce-8ed0-4553-a24a-5cb3b60d28f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:25:17.798328 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124d5bce-8ed0-4553-a24a-5cb3b60d28f8 admin admin] PATH_INFO: `/v3/projects` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:25:17.800150 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124d5bce-8ed0-4553-a24a-5cb3b60d28f8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:25:17.802393 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124d5bce-8ed0-4553-a24a-5cb3b60d28f8 admin admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:25:17.811901 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bee3f85-1ad8-4798-b78a-61fce163b2d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:25:17.813178 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bee3f85-1ad8-4798-b78a-61fce163b2d2 admin admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:25:17.813823 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bee3f85-1ad8-4798-b78a-61fce163b2d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:25:17.814219 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bee3f85-1ad8-4798-b78a-61fce163b2d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:25:17.815459 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bee3f85-1ad8-4798-b78a-61fce163b2d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:25:17.820773 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bee3f85-1ad8-4798-b78a-61fce163b2d2 admin admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:25:17.846064 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 978/1962] 10.222.0.21 () {58 vars in 1121 bytes} [Wed May 4 07:25:17 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 07:25:17.850604 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bee3f85-1ad8-4798-b78a-61fce163b2d2 admin admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:25:17.851534 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 985/1963] 10.222.0.21 () {60 vars in 1152 bytes} [Wed May 4 07:25:17 2022] POST /identity/v3/projects => generated 401 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 07:25:17.855569 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124d5bce-8ed0-4553-a24a-5cb3b60d28f8 admin admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:25:17.863838 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bee3f85-1ad8-4798-b78a-61fce163b2d2 admin admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:25:17.924924 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124d5bce-8ed0-4553-a24a-5cb3b60d28f8 admin admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:25:17.931936 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e17faf-e813-47b6-b09b-ac8b1b47f39f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:25:17.932613 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e17faf-e813-47b6-b09b-ac8b1b47f39f admin admin] REQUEST_METHOD: `POST` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:25:17.932968 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e17faf-e813-47b6-b09b-ac8b1b47f39f admin admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:25:17.933241 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e17faf-e813-47b6-b09b-ac8b1b47f39f admin admin] PATH_INFO: `/v3/users` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:25:17.933933 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e17faf-e813-47b6-b09b-ac8b1b47f39f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:25:17.936099 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e17faf-e813-47b6-b09b-ac8b1b47f39f admin admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:25:17.940942 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbc6829-3e9d-499b-b12b-396a52792abb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:25:17.941837 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbc6829-3e9d-499b-b12b-396a52792abb admin admin] REQUEST_METHOD: `PUT` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:25:17.942865 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbc6829-3e9d-499b-b12b-396a52792abb admin admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:25:17.942865 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbc6829-3e9d-499b-b12b-396a52792abb admin admin] PATH_INFO: `/v3/projects/536bacee92ba4db2ae5cd68d6709b7e7/users/1db50bb9b63041e7808134c4db955433/roles/eb54c9cea2774a25b1fe8c79724408ee` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:25:17.959852 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 986/1964] 10.222.0.21 () {60 vars in 1143 bytes} [Wed May 4 07:25:17 2022] POST /identity/v3/users => generated 301 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 07:25:17.960057 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cbc6829-3e9d-499b-b12b-396a52792abb admin admin] RBAC: Authorizing `identity:create_grant(project_id=536bacee92ba4db2ae5cd68d6709b7e7, user_id=1db50bb9b63041e7808134c4db955433, role_id=eb54c9cea2774a25b1fe8c79724408ee)` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:25:17.962789 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cbc6829-3e9d-499b-b12b-396a52792abb admin admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:25:17.963818 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e17faf-e813-47b6-b09b-ac8b1b47f39f admin admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:25:17.975533 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e17faf-e813-47b6-b09b-ac8b1b47f39f admin admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:25:17.977259 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 979/1965] 10.222.0.21 () {60 vars in 1482 bytes} [Wed May 4 07:25:17 2022] PUT /identity/v3/projects/536bacee92ba4db2ae5cd68d6709b7e7/users/1db50bb9b63041e7808134c4db955433/roles/eb54c9cea2774a25b1fe8c79724408ee => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 07:25:17.981143 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbc6829-3e9d-499b-b12b-396a52792abb admin admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:25:18.036436 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f22b617-01bb-4aec-92c8-865398475501 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:25:18.037255 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f22b617-01bb-4aec-92c8-865398475501 admin admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:25:18.037816 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f22b617-01bb-4aec-92c8-865398475501 admin admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:25:18.038211 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f22b617-01bb-4aec-92c8-865398475501 admin admin] PATH_INFO: `/v3/roles` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:25:18.038959 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f22b617-01bb-4aec-92c8-865398475501 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:25:18.040668 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f22b617-01bb-4aec-92c8-865398475501 admin admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:25:18.042575 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbc6829-3e9d-499b-b12b-396a52792abb admin admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:25:18.047306 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd5cc58-7846-492e-93c4-76e9144b10b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:25:18.048099 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd5cc58-7846-492e-93c4-76e9144b10b2 admin admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:25:18.048271 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd5cc58-7846-492e-93c4-76e9144b10b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:25:18.048597 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd5cc58-7846-492e-93c4-76e9144b10b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:25:18.049353 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd5cc58-7846-492e-93c4-76e9144b10b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:25:18.050991 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd5cc58-7846-492e-93c4-76e9144b10b2 admin admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:25:18.051232 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 987/1966] 10.222.0.21 () {58 vars in 1121 bytes} [Wed May 4 07:25:17 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 04 07:25:18.055568 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f22b617-01bb-4aec-92c8-865398475501 admin admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:25:18.064767 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 980/1967] 10.222.0.21 () {58 vars in 1121 bytes} [Wed May 4 07:25:17 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 04 07:25:18.065593 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd5cc58-7846-492e-93c4-76e9144b10b2 admin admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:25:18.065696 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f22b617-01bb-4aec-92c8-865398475501 admin admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:25:18.071763 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550d70b3-a18b-40a0-a9f1-4fbdabc4094b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:25:18.072474 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550d70b3-a18b-40a0-a9f1-4fbdabc4094b admin admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:25:18.072755 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550d70b3-a18b-40a0-a9f1-4fbdabc4094b admin admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:25:18.073027 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550d70b3-a18b-40a0-a9f1-4fbdabc4094b admin admin] PATH_INFO: `/v3/roles` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:25:18.074432 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550d70b3-a18b-40a0-a9f1-4fbdabc4094b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:25:18.076043 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd5cc58-7846-492e-93c4-76e9144b10b2 admin admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:25:18.076203 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550d70b3-a18b-40a0-a9f1-4fbdabc4094b admin admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:25:18.081040 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5a3694-0ad0-4e84-8c17-7e91f02db628 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:25:18.081917 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5a3694-0ad0-4e84-8c17-7e91f02db628 admin admin] REQUEST_METHOD: `PUT` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:25:18.082195 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5a3694-0ad0-4e84-8c17-7e91f02db628 admin admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:25:18.082465 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5a3694-0ad0-4e84-8c17-7e91f02db628 admin admin] PATH_INFO: `/v3/projects/536bacee92ba4db2ae5cd68d6709b7e7/users/1db50bb9b63041e7808134c4db955433/roles/eb54c9cea2774a25b1fe8c79724408ee` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:25:18.085249 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5a3694-0ad0-4e84-8c17-7e91f02db628 admin admin] RBAC: Authorizing `identity:create_grant(project_id=536bacee92ba4db2ae5cd68d6709b7e7, user_id=1db50bb9b63041e7808134c4db955433, role_id=eb54c9cea2774a25b1fe8c79724408ee)` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:25:18.086995 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 988/1968] 10.222.0.21 () {58 vars in 1121 bytes} [Wed May 4 07:25:18 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 07:25:18.088082 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5a3694-0ad0-4e84-8c17-7e91f02db628 admin admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:25:18.091057 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550d70b3-a18b-40a0-a9f1-4fbdabc4094b admin admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:25:18.098870 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 981/1969] 10.222.0.21 () {60 vars in 1482 bytes} [Wed May 4 07:25:18 2022] PUT /identity/v3/projects/536bacee92ba4db2ae5cd68d6709b7e7/users/1db50bb9b63041e7808134c4db955433/roles/eb54c9cea2774a25b1fe8c79724408ee => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 07:25:18.100789 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550d70b3-a18b-40a0-a9f1-4fbdabc4094b admin admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:25:18.110446 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142e00a8-9f69-4992-ac72-3dd005c852ec None None] REQUEST_METHOD: `POST` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:25:18.110716 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142e00a8-9f69-4992-ac72-3dd005c852ec None None] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:25:18.110860 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142e00a8-9f69-4992-ac72-3dd005c852ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:25:18.154014 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.auth.core [None req-142e00a8-9f69-4992-ac72-3dd005c852ec None None] MFA Rules not processed for user `1db50bb9b63041e7808134c4db955433`. Rule list: `[]` (Enabled: `True`). {{(pid=79745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:25:18.159171 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.fernet_utils [None req-142e00a8-9f69-4992-ac72-3dd005c852ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:25:18.169893 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5841d03b-906f-45e5-bf84-dcc4593d0f90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:25:18.170802 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5841d03b-906f-45e5-bf84-dcc4593d0f90 admin admin] REQUEST_METHOD: `PUT` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:25:18.171088 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5841d03b-906f-45e5-bf84-dcc4593d0f90 admin admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:25:18.171397 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5841d03b-906f-45e5-bf84-dcc4593d0f90 admin admin] PATH_INFO: `/v3/projects/004e21e065ae4f9da30ffbe49c85d3f3/users/e907053a699044f9a032e3227f1aff1a/roles/9f89c07b05a14f18836116af22cba5f6` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:25:18.189867 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5841d03b-906f-45e5-bf84-dcc4593d0f90 admin admin] RBAC: Authorizing `identity:create_grant(project_id=004e21e065ae4f9da30ffbe49c85d3f3, user_id=e907053a699044f9a032e3227f1aff1a, role_id=9f89c07b05a14f18836116af22cba5f6)` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:25:18.192721 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5841d03b-906f-45e5-bf84-dcc4593d0f90 admin admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:25:18.206553 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 989/1970] 10.222.0.21 () {60 vars in 1482 bytes} [Wed May 4 07:25:18 2022] PUT /identity/v3/projects/004e21e065ae4f9da30ffbe49c85d3f3/users/e907053a699044f9a032e3227f1aff1a/roles/9f89c07b05a14f18836116af22cba5f6 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 07:25:18.219088 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d97bc95-3320-4cba-abea-a779285aa356 None None] REQUEST_METHOD: `POST` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:25:18.219408 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d97bc95-3320-4cba-abea-a779285aa356 None None] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:25:18.219687 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d97bc95-3320-4cba-abea-a779285aa356 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:25:18.234711 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 982/1971] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 07:25:18 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 07:25:18.246222 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142e00a8-9f69-4992-ac72-3dd005c852ec None None] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:25:18.247742 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.fernet_utils [None req-142e00a8-9f69-4992-ac72-3dd005c852ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:25:18.248223 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.auth.core [None req-7d97bc95-3320-4cba-abea-a779285aa356 None None] MFA Rules not processed for user `e907053a699044f9a032e3227f1aff1a`. Rule list: `[]` (Enabled: `True`). {{(pid=79744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:25:18.249436 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.fernet_utils [None req-7d97bc95-3320-4cba-abea-a779285aa356 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:25:18.308841 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142e00a8-9f69-4992-ac72-3dd005c852ec None None] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:25:18.315548 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 990/1972] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 07:25:18 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 07:25:18.320869 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d97bc95-3320-4cba-abea-a779285aa356 None None] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:25:18.357789 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8b5d4b-4810-4d3d-8a40-1b04bec809c3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb341257aa8246b6847561e2fe1fa385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9f9c44db4984653b8d4b5f6b3b949f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:25:18.358442 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8b5d4b-4810-4d3d-8a40-1b04bec809c3 service cinder] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:25:18.358725 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8b5d4b-4810-4d3d-8a40-1b04bec809c3 service cinder] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:25:18.359003 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8b5d4b-4810-4d3d-8a40-1b04bec809c3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:25:18.360868 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.fernet_utils [None req-ba8b5d4b-4810-4d3d-8a40-1b04bec809c3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:25:18.394399 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d97bc95-3320-4cba-abea-a779285aa356 None None] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:25:18.399426 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a4ef3e-6ba2-4272-bcfe-0d8358af7393 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:25:18.400089 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a4ef3e-6ba2-4272-bcfe-0d8358af7393 admin admin] REQUEST_METHOD: `POST` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:25:18.400371 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a4ef3e-6ba2-4272-bcfe-0d8358af7393 admin admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:25:18.400645 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a4ef3e-6ba2-4272-bcfe-0d8358af7393 admin admin] PATH_INFO: `/v3/projects` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:25:18.401336 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a4ef3e-6ba2-4272-bcfe-0d8358af7393 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:25:18.403286 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a4ef3e-6ba2-4272-bcfe-0d8358af7393 admin admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:25:18.421139 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8b5d4b-4810-4d3d-8a40-1b04bec809c3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:25:18.422692 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8b5d4b-4810-4d3d-8a40-1b04bec809c3 service cinder] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:25:18.428825 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 991/1973] 10.222.0.21 () {60 vars in 1152 bytes} [Wed May 4 07:25:18 2022] POST /identity/v3/projects => generated 401 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 07:25:18.432649 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a4ef3e-6ba2-4272-bcfe-0d8358af7393 admin admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:25:18.432869 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 983/1974] 10.222.0.21 () {60 vars in 1365 bytes} [Wed May 4 07:25:18 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 04 07:25:18.504829 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a4ef3e-6ba2-4272-bcfe-0d8358af7393 admin admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:25:18.510117 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59e1a36-262e-42ef-88ee-c681b14846e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:25:18.510794 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59e1a36-262e-42ef-88ee-c681b14846e9 admin admin] REQUEST_METHOD: `POST` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:25:18.511071 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59e1a36-262e-42ef-88ee-c681b14846e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:25:18.511543 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59e1a36-262e-42ef-88ee-c681b14846e9 admin admin] PATH_INFO: `/v3/users` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:25:18.512240 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59e1a36-262e-42ef-88ee-c681b14846e9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:25:18.514408 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59e1a36-262e-42ef-88ee-c681b14846e9 admin admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:25:18.563195 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 992/1975] 10.222.0.21 () {60 vars in 1143 bytes} [Wed May 4 07:25:18 2022] POST /identity/v3/users => generated 307 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 07:25:18.568507 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8b5d4b-4810-4d3d-8a40-1b04bec809c3 service cinder] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:25:18.580522 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8b5d4b-4810-4d3d-8a40-1b04bec809c3 service cinder] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:25:18.586290 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1133473-f415-4de3-bbeb-5822e009df42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:25:18.587032 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1133473-f415-4de3-bbeb-5822e009df42 admin admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:25:18.587464 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1133473-f415-4de3-bbeb-5822e009df42 admin admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:25:18.587817 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1133473-f415-4de3-bbeb-5822e009df42 admin admin] PATH_INFO: `/v3/roles` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:25:18.588547 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1133473-f415-4de3-bbeb-5822e009df42 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:25:18.590268 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1133473-f415-4de3-bbeb-5822e009df42 admin admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:25:18.606767 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 984/1976] 10.222.0.21 () {58 vars in 1121 bytes} [Wed May 4 07:25:18 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 07:25:18.608627 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59e1a36-262e-42ef-88ee-c681b14846e9 admin admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:25:18.621436 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59e1a36-262e-42ef-88ee-c681b14846e9 admin admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:25:18.628452 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db40fb5f-091a-4c22-b19a-1d1ac09f2df5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:25:18.629847 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db40fb5f-091a-4c22-b19a-1d1ac09f2df5 admin admin] REQUEST_METHOD: `PUT` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:25:18.630259 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db40fb5f-091a-4c22-b19a-1d1ac09f2df5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:25:18.630712 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db40fb5f-091a-4c22-b19a-1d1ac09f2df5 admin admin] PATH_INFO: `/v3/projects/af00c2881d4d4c10a698af14fa2c8370/users/3c7110cd45954497891a52723af2714e/roles/eb54c9cea2774a25b1fe8c79724408ee` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:25:18.653474 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db40fb5f-091a-4c22-b19a-1d1ac09f2df5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=af00c2881d4d4c10a698af14fa2c8370, user_id=3c7110cd45954497891a52723af2714e, role_id=eb54c9cea2774a25b1fe8c79724408ee)` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:25:18.656244 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db40fb5f-091a-4c22-b19a-1d1ac09f2df5 admin admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:25:18.672884 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 993/1977] 10.222.0.21 () {60 vars in 1482 bytes} [Wed May 4 07:25:18 2022] PUT /identity/v3/projects/af00c2881d4d4c10a698af14fa2c8370/users/3c7110cd45954497891a52723af2714e/roles/eb54c9cea2774a25b1fe8c79724408ee => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 07:25:18.679412 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1133473-f415-4de3-bbeb-5822e009df42 admin admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:25:18.690185 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1133473-f415-4de3-bbeb-5822e009df42 admin admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:25:18.773863 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba67914-3068-44e5-a276-53b99c426c0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:25:18.775006 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba67914-3068-44e5-a276-53b99c426c0c admin admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:25:18.775796 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba67914-3068-44e5-a276-53b99c426c0c admin admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:25:18.776242 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba67914-3068-44e5-a276-53b99c426c0c admin admin] PATH_INFO: `/v3/roles` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:25:18.777639 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba67914-3068-44e5-a276-53b99c426c0c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:25:18.779361 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba67914-3068-44e5-a276-53b99c426c0c admin admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:25:18.804392 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 985/1978] 10.222.0.21 () {58 vars in 1121 bytes} [Wed May 4 07:25:18 2022] GET /identity/v3/roles => generated 1420 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 07:25:18.815240 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db40fb5f-091a-4c22-b19a-1d1ac09f2df5 admin admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:25:18.837710 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db40fb5f-091a-4c22-b19a-1d1ac09f2df5 admin admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:25:18.847207 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b73da0d-7f70-43bb-a411-e69a27155eb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:25:18.848442 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b73da0d-7f70-43bb-a411-e69a27155eb1 admin admin] REQUEST_METHOD: `PUT` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:25:18.849052 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b73da0d-7f70-43bb-a411-e69a27155eb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:25:18.849465 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b73da0d-7f70-43bb-a411-e69a27155eb1 admin admin] PATH_INFO: `/v3/projects/af00c2881d4d4c10a698af14fa2c8370/users/3c7110cd45954497891a52723af2714e/roles/eb54c9cea2774a25b1fe8c79724408ee` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:25:18.856621 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b73da0d-7f70-43bb-a411-e69a27155eb1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=af00c2881d4d4c10a698af14fa2c8370, user_id=3c7110cd45954497891a52723af2714e, role_id=eb54c9cea2774a25b1fe8c79724408ee)` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:25:18.859439 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b73da0d-7f70-43bb-a411-e69a27155eb1 admin admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:25:18.874443 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 994/1979] 10.222.0.21 () {60 vars in 1482 bytes} [Wed May 4 07:25:18 2022] PUT /identity/v3/projects/af00c2881d4d4c10a698af14fa2c8370/users/3c7110cd45954497891a52723af2714e/roles/eb54c9cea2774a25b1fe8c79724408ee => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 07:25:18.886952 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f248387d-5ec3-445a-8cb3-e3c044cb46ba None None] REQUEST_METHOD: `POST` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:25:18.887480 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f248387d-5ec3-445a-8cb3-e3c044cb46ba None None] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:25:18.887835 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f248387d-5ec3-445a-8cb3-e3c044cb46ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:25:18.969831 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.auth.core [None req-f248387d-5ec3-445a-8cb3-e3c044cb46ba None None] MFA Rules not processed for user `3c7110cd45954497891a52723af2714e`. Rule list: `[]` (Enabled: `True`). {{(pid=79745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:25:18.971044 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.fernet_utils [None req-f248387d-5ec3-445a-8cb3-e3c044cb46ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:25:19.076415 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 986/1980] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 07:25:18 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 07:25:19.095610 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b73da0d-7f70-43bb-a411-e69a27155eb1 admin admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:25:19.099531 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f248387d-5ec3-445a-8cb3-e3c044cb46ba None None] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:25:19.102664 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.fernet_utils [None req-7b73da0d-7f70-43bb-a411-e69a27155eb1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:25:19.182987 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b73da0d-7f70-43bb-a411-e69a27155eb1 admin admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:25:19.183958 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f248387d-5ec3-445a-8cb3-e3c044cb46ba None None] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:25:19.187979 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8dada7-ec01-4296-b6af-ae76164da8ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:25:19.188366 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c700ac-ee73-4360-bd56-b9ad753b771d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb341257aa8246b6847561e2fe1fa385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9f9c44db4984653b8d4b5f6b3b949f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:25:19.188866 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8dada7-ec01-4296-b6af-ae76164da8ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:25:19.189032 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c700ac-ee73-4360-bd56-b9ad753b771d service cinder] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:25:19.189136 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8dada7-ec01-4296-b6af-ae76164da8ad admin admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:25:19.189293 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c700ac-ee73-4360-bd56-b9ad753b771d service cinder] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:25:19.189403 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8dada7-ec01-4296-b6af-ae76164da8ad admin admin] PATH_INFO: `/v3/users/b3d2d333cc7d4228bf1ee0886c65b7ce` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:25:19.189569 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c700ac-ee73-4360-bd56-b9ad753b771d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:25:19.190562 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8dada7-ec01-4296-b6af-ae76164da8ad admin admin] RBAC: Authorizing `identity:delete_user(user_id=b3d2d333cc7d4228bf1ee0886c65b7ce)` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:25:19.192501 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8dada7-ec01-4296-b6af-ae76164da8ad admin admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:25:19.200591 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c700ac-ee73-4360-bd56-b9ad753b771d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:25:19.202367 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c700ac-ee73-4360-bd56-b9ad753b771d service cinder] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:25:19.219337 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 987/1981] 10.222.0.21 () {60 vars in 1365 bytes} [Wed May 4 07:25:19 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 04 07:25:19.248918 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-8d8dada7-ec01-4296-b6af-ae76164da8ad admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b3d2d333cc7d4228bf1ee0886c65b7ce'} {{(pid=79744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:25:19.249868 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-8d8dada7-ec01-4296-b6af-ae76164da8ad admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b3d2d333cc7d4228bf1ee0886c65b7ce'} {{(pid=79744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:25:19.259627 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-8d8dada7-ec01-4296-b6af-ae76164da8ad admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b3d2d333cc7d4228bf1ee0886c65b7ce'} {{(pid=79744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:25:19.260355 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-8d8dada7-ec01-4296-b6af-ae76164da8ad admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b3d2d333cc7d4228bf1ee0886c65b7ce'} {{(pid=79744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:25:19.273388 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-8d8dada7-ec01-4296-b6af-ae76164da8ad admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b3d2d333cc7d4228bf1ee0886c65b7ce'} {{(pid=79744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:25:19.288195 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 995/1982] 10.222.0.21 () {58 vars in 1223 bytes} [Wed May 4 07:25:19 2022] DELETE /identity/v3/users/b3d2d333cc7d4228bf1ee0886c65b7ce => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 07:25:19.292641 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74f1d92-0d79-4b60-9eb9-789c580afa67 None None] REQUEST_METHOD: `POST` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:25:19.292925 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74f1d92-0d79-4b60-9eb9-789c580afa67 None None] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:25:19.293195 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74f1d92-0d79-4b60-9eb9-789c580afa67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:25:19.311660 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8dada7-ec01-4296-b6af-ae76164da8ad admin admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:25:19.312383 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.auth.core [None req-c74f1d92-0d79-4b60-9eb9-789c580afa67 None None] MFA Rules not processed for user `83c5e0dcb991496ea6dee38384514508`. Rule list: `[]` (Enabled: `True`). {{(pid=79745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:25:19.313263 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.fernet_utils [None req-8d8dada7-ec01-4296-b6af-ae76164da8ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:25:19.313561 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.fernet_utils [None req-c74f1d92-0d79-4b60-9eb9-789c580afa67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:25:19.407634 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 988/1983] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 07:25:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 07:25:19.413442 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8dada7-ec01-4296-b6af-ae76164da8ad admin admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:25:19.417176 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9623d8-1469-4ff9-bf4e-8919cb93fcb0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb341257aa8246b6847561e2fe1fa385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9f9c44db4984653b8d4b5f6b3b949f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:25:19.417839 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9623d8-1469-4ff9-bf4e-8919cb93fcb0 service cinder] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:25:19.418114 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9623d8-1469-4ff9-bf4e-8919cb93fcb0 service cinder] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:25:19.418754 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9623d8-1469-4ff9-bf4e-8919cb93fcb0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:25:19.420700 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.fernet_utils [None req-bf9623d8-1469-4ff9-bf4e-8919cb93fcb0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:25:19.424219 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74f1d92-0d79-4b60-9eb9-789c580afa67 None None] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:25:19.425815 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.fernet_utils [None req-c74f1d92-0d79-4b60-9eb9-789c580afa67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:25:19.526304 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74f1d92-0d79-4b60-9eb9-789c580afa67 None None] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:25:19.528237 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9623d8-1469-4ff9-bf4e-8919cb93fcb0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:25:19.530216 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9623d8-1469-4ff9-bf4e-8919cb93fcb0 service cinder] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:25:19.537393 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161f26a8-f6d6-495c-8841-41129a4617f9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91cb92d00273402b837cb29b37325101', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9f9c44db4984653b8d4b5f6b3b949f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:25:19.538376 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161f26a8-f6d6-495c-8841-41129a4617f9 service neutron] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:25:19.538687 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161f26a8-f6d6-495c-8841-41129a4617f9 service neutron] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:25:19.538986 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161f26a8-f6d6-495c-8841-41129a4617f9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:25:19.551244 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 996/1984] 10.222.0.21 () {60 vars in 1365 bytes} [Wed May 4 07:25:19 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 240 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 07:25:19.562444 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-161f26a8-f6d6-495c-8841-41129a4617f9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:25:19.564070 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-161f26a8-f6d6-495c-8841-41129a4617f9 service neutron] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:25:19.589977 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 989/1985] 10.222.0.21 () {60 vars in 1365 bytes} [Wed May 4 07:25:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 04 07:25:19.971833 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9623d8-1469-4ff9-bf4e-8919cb93fcb0 service cinder] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:25:19.973886 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.fernet_utils [None req-bf9623d8-1469-4ff9-bf4e-8919cb93fcb0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:25:19.991854 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9623d8-1469-4ff9-bf4e-8919cb93fcb0 service cinder] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:25:19.998017 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16305847-a649-47be-83ba-9880a236035f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:25:19.998953 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16305847-a649-47be-83ba-9880a236035f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:25:19.999345 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16305847-a649-47be-83ba-9880a236035f admin admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:25:19.999682 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16305847-a649-47be-83ba-9880a236035f admin admin] PATH_INFO: `/v3/projects/6c2fdb2e64ca46cb9d2af9126c9a71bc` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:25:20.001141 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16305847-a649-47be-83ba-9880a236035f admin admin] RBAC: Authorizing `identity:delete_project(project_id=6c2fdb2e64ca46cb9d2af9126c9a71bc)` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:25:20.003774 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16305847-a649-47be-83ba-9880a236035f admin admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:25:20.055691 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-16305847-a649-47be-83ba-9880a236035f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6c2fdb2e64ca46cb9d2af9126c9a71bc', 'request_id': 'req-16305847-a649-47be-83ba-9880a236035f'} {{(pid=79744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:25:20.061172 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-16305847-a649-47be-83ba-9880a236035f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6c2fdb2e64ca46cb9d2af9126c9a71bc', 'request_id': 'req-16305847-a649-47be-83ba-9880a236035f'} {{(pid=79744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:25:20.071792 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-16305847-a649-47be-83ba-9880a236035f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6c2fdb2e64ca46cb9d2af9126c9a71bc', 'request_id': 'req-16305847-a649-47be-83ba-9880a236035f'} {{(pid=79744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:25:20.083269 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-16305847-a649-47be-83ba-9880a236035f admin admin] The token cache is being invalidate because project 6c2fdb2e64ca46cb9d2af9126c9a71bc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79744) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 07:25:20.083557 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-16305847-a649-47be-83ba-9880a236035f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:25:20.084893 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-16305847-a649-47be-83ba-9880a236035f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:25:20.086486 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 997/1986] 10.222.0.21 () {58 vars in 1232 bytes} [Wed May 4 07:25:19 2022] DELETE /identity/v3/projects/6c2fdb2e64ca46cb9d2af9126c9a71bc => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 07:25:20.090679 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161f26a8-f6d6-495c-8841-41129a4617f9 service neutron] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:25:20.101481 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161f26a8-f6d6-495c-8841-41129a4617f9 service neutron] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:25:20.107833 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16305847-a649-47be-83ba-9880a236035f admin admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:25:20.109208 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.fernet_utils [None req-16305847-a649-47be-83ba-9880a236035f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:25:20.205904 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16305847-a649-47be-83ba-9880a236035f admin admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:25:20.214704 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e979944-fdc2-4e87-88bc-18f631fb6ee8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb341257aa8246b6847561e2fe1fa385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9f9c44db4984653b8d4b5f6b3b949f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:25:20.215421 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e979944-fdc2-4e87-88bc-18f631fb6ee8 service cinder] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:25:20.215706 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e979944-fdc2-4e87-88bc-18f631fb6ee8 service cinder] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:25:20.217673 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e979944-fdc2-4e87-88bc-18f631fb6ee8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:25:20.218893 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7063c95d-de77-42c5-9c5d-9c1e802c98c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:25:20.219895 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7063c95d-de77-42c5-9c5d-9c1e802c98c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:25:20.220206 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7063c95d-de77-42c5-9c5d-9c1e802c98c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:25:20.220507 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7063c95d-de77-42c5-9c5d-9c1e802c98c0 admin admin] PATH_INFO: `/v3/users/d5fa6085b83d4bebb1eb524e24ef830b` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:25:20.222210 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7063c95d-de77-42c5-9c5d-9c1e802c98c0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d5fa6085b83d4bebb1eb524e24ef830b)` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:25:20.225254 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.fernet_utils [None req-5e979944-fdc2-4e87-88bc-18f631fb6ee8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:25:20.229069 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7063c95d-de77-42c5-9c5d-9c1e802c98c0 admin admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:25:20.357257 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e979944-fdc2-4e87-88bc-18f631fb6ee8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:25:20.357990 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-7063c95d-de77-42c5-9c5d-9c1e802c98c0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd5fa6085b83d4bebb1eb524e24ef830b'} {{(pid=79745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:25:20.358746 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e979944-fdc2-4e87-88bc-18f631fb6ee8 service cinder] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:25:20.369267 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 998/1987] 10.222.0.21 () {60 vars in 1365 bytes} [Wed May 4 07:25:20 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 263 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 04 07:25:20.383657 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-7063c95d-de77-42c5-9c5d-9c1e802c98c0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd5fa6085b83d4bebb1eb524e24ef830b'} {{(pid=79745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:25:20.384481 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-7063c95d-de77-42c5-9c5d-9c1e802c98c0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd5fa6085b83d4bebb1eb524e24ef830b'} {{(pid=79745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:25:20.385117 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-7063c95d-de77-42c5-9c5d-9c1e802c98c0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd5fa6085b83d4bebb1eb524e24ef830b'} {{(pid=79745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:25:20.393924 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-7063c95d-de77-42c5-9c5d-9c1e802c98c0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd5fa6085b83d4bebb1eb524e24ef830b'} {{(pid=79745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:25:20.417216 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 990/1988] 10.222.0.21 () {58 vars in 1223 bytes} [Wed May 4 07:25:20 2022] DELETE /identity/v3/users/d5fa6085b83d4bebb1eb524e24ef830b => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 07:25:20.848033 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e979944-fdc2-4e87-88bc-18f631fb6ee8 service cinder] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:25:20.850417 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.fernet_utils [None req-5e979944-fdc2-4e87-88bc-18f631fb6ee8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:25:20.869007 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e979944-fdc2-4e87-88bc-18f631fb6ee8 service cinder] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:25:20.933331 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ac910a-4ee4-486a-93d4-ea6d5bad8d8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:25:20.934310 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ac910a-4ee4-486a-93d4-ea6d5bad8d8b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:25:20.934606 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ac910a-4ee4-486a-93d4-ea6d5bad8d8b admin admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:25:20.934905 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ac910a-4ee4-486a-93d4-ea6d5bad8d8b admin admin] PATH_INFO: `/v3/projects/50f72c487d4e46f7b3244e1786756527` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:25:20.936201 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ac910a-4ee4-486a-93d4-ea6d5bad8d8b admin admin] RBAC: Authorizing `identity:delete_project(project_id=50f72c487d4e46f7b3244e1786756527)` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:25:20.938114 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ac910a-4ee4-486a-93d4-ea6d5bad8d8b admin admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:25:20.987805 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-36ac910a-4ee4-486a-93d4-ea6d5bad8d8b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '50f72c487d4e46f7b3244e1786756527', 'request_id': 'req-36ac910a-4ee4-486a-93d4-ea6d5bad8d8b'} {{(pid=79744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:25:20.993699 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-36ac910a-4ee4-486a-93d4-ea6d5bad8d8b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '50f72c487d4e46f7b3244e1786756527', 'request_id': 'req-36ac910a-4ee4-486a-93d4-ea6d5bad8d8b'} {{(pid=79744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:25:21.001707 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-36ac910a-4ee4-486a-93d4-ea6d5bad8d8b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '50f72c487d4e46f7b3244e1786756527', 'request_id': 'req-36ac910a-4ee4-486a-93d4-ea6d5bad8d8b'} {{(pid=79744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:25:21.014292 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7063c95d-de77-42c5-9c5d-9c1e802c98c0 admin admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:25:21.014488 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-36ac910a-4ee4-486a-93d4-ea6d5bad8d8b admin admin] The token cache is being invalidate because project 50f72c487d4e46f7b3244e1786756527 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79744) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 07:25:21.014659 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-36ac910a-4ee4-486a-93d4-ea6d5bad8d8b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:25:21.015347 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-36ac910a-4ee4-486a-93d4-ea6d5bad8d8b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:25:21.015806 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.fernet_utils [None req-7063c95d-de77-42c5-9c5d-9c1e802c98c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:25:21.017198 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 999/1989] 10.222.0.21 () {58 vars in 1232 bytes} [Wed May 4 07:25:20 2022] DELETE /identity/v3/projects/50f72c487d4e46f7b3244e1786756527 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 07:25:21.021748 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436217ac-d089-464e-8dc6-654429593fc3 None None] REQUEST_METHOD: `POST` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:25:21.022430 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436217ac-d089-464e-8dc6-654429593fc3 None None] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:25:21.022430 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436217ac-d089-464e-8dc6-654429593fc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:25:21.041970 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.auth.core [None req-436217ac-d089-464e-8dc6-654429593fc3 None None] MFA Rules not processed for user `83c5e0dcb991496ea6dee38384514508`. Rule list: `[]` (Enabled: `True`). {{(pid=79744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:25:21.043736 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.fernet_utils [None req-436217ac-d089-464e-8dc6-654429593fc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:25:21.081139 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7063c95d-de77-42c5-9c5d-9c1e802c98c0 admin admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:25:21.108778 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 1000/1990] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 07:25:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 07:25:21.117347 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d26989-9329-4e35-a64c-47ca7ac7f91e None None] REQUEST_METHOD: `POST` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:25:21.117885 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d26989-9329-4e35-a64c-47ca7ac7f91e None None] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:25:21.118391 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d26989-9329-4e35-a64c-47ca7ac7f91e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:25:21.142166 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.auth.core [None req-33d26989-9329-4e35-a64c-47ca7ac7f91e None None] MFA Rules not processed for user `83c5e0dcb991496ea6dee38384514508`. Rule list: `[]` (Enabled: `True`). {{(pid=79744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:25:21.144014 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.fernet_utils [None req-33d26989-9329-4e35-a64c-47ca7ac7f91e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:25:21.148045 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918f1aa3-cf76-45ec-8427-e108e0c498be service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb341257aa8246b6847561e2fe1fa385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9f9c44db4984653b8d4b5f6b3b949f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:25:21.148735 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918f1aa3-cf76-45ec-8427-e108e0c498be service cinder] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:25:21.149019 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918f1aa3-cf76-45ec-8427-e108e0c498be service cinder] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:25:21.149325 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918f1aa3-cf76-45ec-8427-e108e0c498be service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:25:21.151305 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.fernet_utils [None req-918f1aa3-cf76-45ec-8427-e108e0c498be service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:25:21.155986 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 1001/1991] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 07:25:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 07:25:21.161227 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d26989-9329-4e35-a64c-47ca7ac7f91e None None] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:25:21.177623 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d26989-9329-4e35-a64c-47ca7ac7f91e None None] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:25:21.183971 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de42ddf1-1651-4cd0-a56d-30206e611faf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:25:21.184613 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de42ddf1-1651-4cd0-a56d-30206e611faf admin admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:25:21.184891 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de42ddf1-1651-4cd0-a56d-30206e611faf admin admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:25:21.185157 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de42ddf1-1651-4cd0-a56d-30206e611faf admin admin] PATH_INFO: `/v3/domains` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:25:21.186307 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de42ddf1-1651-4cd0-a56d-30206e611faf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79744) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 07:25:21.186654 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de42ddf1-1651-4cd0-a56d-30206e611faf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:25:21.188565 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de42ddf1-1651-4cd0-a56d-30206e611faf admin admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:25:21.206788 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 1002/1992] 10.222.0.21 () {58 vars in 1152 bytes} [Wed May 4 07:25:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 07:25:21.208182 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de42ddf1-1651-4cd0-a56d-30206e611faf admin admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:25:21.219770 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de42ddf1-1651-4cd0-a56d-30206e611faf admin admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:25:21.225113 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b31e5a-acf9-42bf-93c5-289db92fcde5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:25:21.225781 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b31e5a-acf9-42bf-93c5-289db92fcde5 admin admin] REQUEST_METHOD: `POST` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:25:21.226060 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b31e5a-acf9-42bf-93c5-289db92fcde5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:25:21.226331 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b31e5a-acf9-42bf-93c5-289db92fcde5 admin admin] PATH_INFO: `/v3/projects` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:25:21.227139 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b31e5a-acf9-42bf-93c5-289db92fcde5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:25:21.229087 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b31e5a-acf9-42bf-93c5-289db92fcde5 admin admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:25:21.235006 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918f1aa3-cf76-45ec-8427-e108e0c498be service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:25:21.236563 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918f1aa3-cf76-45ec-8427-e108e0c498be service cinder] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:25:21.248546 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 991/1993] 10.222.0.21 () {60 vars in 1365 bytes} [Wed May 4 07:25:21 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 235 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 04 07:25:21.268838 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 1003/1994] 10.222.0.21 () {60 vars in 1152 bytes} [Wed May 4 07:25:21 2022] POST /identity/v3/projects => generated 367 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 07:25:21.275178 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918f1aa3-cf76-45ec-8427-e108e0c498be service cinder] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:25:21.286014 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918f1aa3-cf76-45ec-8427-e108e0c498be service cinder] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:25:21.384545 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e84165b-40d0-4e88-a0b9-0b5f3b5e7879 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:25:21.386348 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e84165b-40d0-4e88-a0b9-0b5f3b5e7879 admin admin] REQUEST_METHOD: `POST` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:25:21.386626 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e84165b-40d0-4e88-a0b9-0b5f3b5e7879 admin admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:25:21.386898 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e84165b-40d0-4e88-a0b9-0b5f3b5e7879 admin admin] PATH_INFO: `/v3/users` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:25:21.387696 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e84165b-40d0-4e88-a0b9-0b5f3b5e7879 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:25:21.389668 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e84165b-40d0-4e88-a0b9-0b5f3b5e7879 admin admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:25:21.426267 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 992/1995] 10.222.0.21 () {60 vars in 1143 bytes} [Wed May 4 07:25:21 2022] POST /identity/v3/users => generated 284 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 07:25:21.431756 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b31e5a-acf9-42bf-93c5-289db92fcde5 admin admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:25:21.445120 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b31e5a-acf9-42bf-93c5-289db92fcde5 admin admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:25:21.459699 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91a7522-1370-4961-bd96-8823ba5cc57c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:25:21.460947 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91a7522-1370-4961-bd96-8823ba5cc57c admin admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:25:21.461367 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91a7522-1370-4961-bd96-8823ba5cc57c admin admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:25:21.462763 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91a7522-1370-4961-bd96-8823ba5cc57c admin admin] PATH_INFO: `/v3/roles` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:25:21.464613 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91a7522-1370-4961-bd96-8823ba5cc57c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:25:21.466720 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91a7522-1370-4961-bd96-8823ba5cc57c admin admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:25:21.484725 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 1004/1996] 10.222.0.21 () {58 vars in 1121 bytes} [Wed May 4 07:25:21 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 07:25:21.489604 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e84165b-40d0-4e88-a0b9-0b5f3b5e7879 admin admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:25:21.510067 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e84165b-40d0-4e88-a0b9-0b5f3b5e7879 admin admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:25:21.518650 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019082ec-d5f9-450c-b9bd-4e26a543da0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:25:21.519423 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019082ec-d5f9-450c-b9bd-4e26a543da0f admin admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:25:21.519892 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019082ec-d5f9-450c-b9bd-4e26a543da0f admin admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:25:21.520180 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019082ec-d5f9-450c-b9bd-4e26a543da0f admin admin] PATH_INFO: `/v3/roles` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:25:21.520922 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019082ec-d5f9-450c-b9bd-4e26a543da0f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:25:21.523592 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019082ec-d5f9-450c-b9bd-4e26a543da0f admin admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:25:21.540077 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 993/1997] 10.222.0.21 () {58 vars in 1121 bytes} [Wed May 4 07:25:21 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 07:25:21.541526 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91a7522-1370-4961-bd96-8823ba5cc57c admin admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:25:21.577339 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91a7522-1370-4961-bd96-8823ba5cc57c admin admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:25:21.583654 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c94fbce-fd64-4be4-90df-501678e24bea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:25:21.584720 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c94fbce-fd64-4be4-90df-501678e24bea admin admin] REQUEST_METHOD: `PUT` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:25:21.584909 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c94fbce-fd64-4be4-90df-501678e24bea admin admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:25:21.585179 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c94fbce-fd64-4be4-90df-501678e24bea admin admin] PATH_INFO: `/v3/projects/bc8dbf9c7df04cf3bddb912b4c560659/users/d90ac3e409254d1d87b1b6e237fc5541/roles/9f89c07b05a14f18836116af22cba5f6` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:25:21.610819 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c94fbce-fd64-4be4-90df-501678e24bea admin admin] RBAC: Authorizing `identity:create_grant(project_id=bc8dbf9c7df04cf3bddb912b4c560659, user_id=d90ac3e409254d1d87b1b6e237fc5541, role_id=9f89c07b05a14f18836116af22cba5f6)` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:25:21.614522 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c94fbce-fd64-4be4-90df-501678e24bea admin admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:25:21.632863 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 1005/1998] 10.222.0.21 () {60 vars in 1482 bytes} [Wed May 4 07:25:21 2022] PUT /identity/v3/projects/bc8dbf9c7df04cf3bddb912b4c560659/users/d90ac3e409254d1d87b1b6e237fc5541/roles/9f89c07b05a14f18836116af22cba5f6 => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 07:25:21.643093 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c005ac12-e979-466d-8530-319c5f8dcc31 None None] REQUEST_METHOD: `POST` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:25:21.643419 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c005ac12-e979-466d-8530-319c5f8dcc31 None None] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:25:21.643699 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c005ac12-e979-466d-8530-319c5f8dcc31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:25:21.683289 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.auth.core [None req-c005ac12-e979-466d-8530-319c5f8dcc31 None None] MFA Rules not processed for user `d90ac3e409254d1d87b1b6e237fc5541`. Rule list: `[]` (Enabled: `True`). {{(pid=79745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:25:21.684538 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.fernet_utils [None req-c005ac12-e979-466d-8530-319c5f8dcc31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:25:21.764631 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 994/1999] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 07:25:21 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 07:25:21.771240 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c94fbce-fd64-4be4-90df-501678e24bea admin admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:25:21.843613 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c94fbce-fd64-4be4-90df-501678e24bea admin admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:25:21.849798 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa64dea-9bce-45c2-b3d1-02c0eb35e5f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:25:21.850460 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa64dea-9bce-45c2-b3d1-02c0eb35e5f0 admin admin] REQUEST_METHOD: `POST` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:25:21.850737 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa64dea-9bce-45c2-b3d1-02c0eb35e5f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:25:21.851006 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa64dea-9bce-45c2-b3d1-02c0eb35e5f0 admin admin] PATH_INFO: `/v3/projects` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:25:21.851733 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa64dea-9bce-45c2-b3d1-02c0eb35e5f0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:25:21.853650 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa64dea-9bce-45c2-b3d1-02c0eb35e5f0 admin admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:25:21.885990 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 1006/2000] 10.222.0.21 () {60 vars in 1152 bytes} [Wed May 4 07:25:21 2022] POST /identity/v3/projects => generated 369 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 07:25:21.887129 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c005ac12-e979-466d-8530-319c5f8dcc31 None None] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:25:21.898415 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c005ac12-e979-466d-8530-319c5f8dcc31 None None] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:25:21.956801 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591344f2-1e39-41a5-9aa1-7d9319809d2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:25:21.957483 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591344f2-1e39-41a5-9aa1-7d9319809d2a admin admin] REQUEST_METHOD: `POST` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:25:21.957796 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591344f2-1e39-41a5-9aa1-7d9319809d2a admin admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:25:21.958078 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591344f2-1e39-41a5-9aa1-7d9319809d2a admin admin] PATH_INFO: `/v3/users` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:25:21.959538 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591344f2-1e39-41a5-9aa1-7d9319809d2a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:25:21.961468 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591344f2-1e39-41a5-9aa1-7d9319809d2a admin admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:25:21.992752 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 995/2001] 10.222.0.21 () {60 vars in 1143 bytes} [Wed May 4 07:25:21 2022] POST /identity/v3/users => generated 291 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 07:25:21.996821 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa64dea-9bce-45c2-b3d1-02c0eb35e5f0 admin admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:25:22.007647 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa64dea-9bce-45c2-b3d1-02c0eb35e5f0 admin admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:25:22.012458 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9760565f-db74-472e-92f3-10fb5bff353d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:25:22.013124 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9760565f-db74-472e-92f3-10fb5bff353d admin admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:25:22.013430 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9760565f-db74-472e-92f3-10fb5bff353d admin admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:25:22.013698 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9760565f-db74-472e-92f3-10fb5bff353d admin admin] PATH_INFO: `/v3/roles` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:25:22.014418 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9760565f-db74-472e-92f3-10fb5bff353d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:25:22.016030 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9760565f-db74-472e-92f3-10fb5bff353d admin admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:25:22.028253 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 1007/2002] 10.222.0.21 () {58 vars in 1121 bytes} [Wed May 4 07:25:21 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 07:25:22.031676 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591344f2-1e39-41a5-9aa1-7d9319809d2a admin admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:25:22.042447 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591344f2-1e39-41a5-9aa1-7d9319809d2a admin admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:25:22.052109 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff01bcf-98e3-48a6-9008-3086c6101206 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:25:22.052109 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff01bcf-98e3-48a6-9008-3086c6101206 admin admin] REQUEST_METHOD: `PUT` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:25:22.052109 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff01bcf-98e3-48a6-9008-3086c6101206 admin admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:25:22.052109 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff01bcf-98e3-48a6-9008-3086c6101206 admin admin] PATH_INFO: `/v3/projects/f7ec0591786744db9dee4eafa2b48533/users/2a49895bcf144ddd81e924e80cf65211/roles/eb54c9cea2774a25b1fe8c79724408ee` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:25:22.069641 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff01bcf-98e3-48a6-9008-3086c6101206 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f7ec0591786744db9dee4eafa2b48533, user_id=2a49895bcf144ddd81e924e80cf65211, role_id=eb54c9cea2774a25b1fe8c79724408ee)` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:25:22.072511 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff01bcf-98e3-48a6-9008-3086c6101206 admin admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:25:22.087711 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 996/2003] 10.222.0.21 () {60 vars in 1482 bytes} [Wed May 4 07:25:22 2022] PUT /identity/v3/projects/f7ec0591786744db9dee4eafa2b48533/users/2a49895bcf144ddd81e924e80cf65211/roles/eb54c9cea2774a25b1fe8c79724408ee => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 07:25:22.092225 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9760565f-db74-472e-92f3-10fb5bff353d admin admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:25:22.105986 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9760565f-db74-472e-92f3-10fb5bff353d admin admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:25:22.169144 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5dde4dd-95cd-4255-a1e1-7f2db7be30a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:25:22.169819 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5dde4dd-95cd-4255-a1e1-7f2db7be30a7 admin admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:25:22.170111 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5dde4dd-95cd-4255-a1e1-7f2db7be30a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:25:22.170377 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5dde4dd-95cd-4255-a1e1-7f2db7be30a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:25:22.171159 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5dde4dd-95cd-4255-a1e1-7f2db7be30a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:25:22.172881 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5dde4dd-95cd-4255-a1e1-7f2db7be30a7 admin admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:25:22.186529 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 1008/2004] 10.222.0.21 () {58 vars in 1121 bytes} [Wed May 4 07:25:22 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 07:25:22.187994 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff01bcf-98e3-48a6-9008-3086c6101206 admin admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:25:22.199238 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff01bcf-98e3-48a6-9008-3086c6101206 admin admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:25:22.204168 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d96201a-fb80-4cdd-9d3d-3b9e2b4438e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:25:22.205051 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d96201a-fb80-4cdd-9d3d-3b9e2b4438e0 admin admin] REQUEST_METHOD: `PUT` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:25:22.205641 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d96201a-fb80-4cdd-9d3d-3b9e2b4438e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:25:22.205641 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d96201a-fb80-4cdd-9d3d-3b9e2b4438e0 admin admin] PATH_INFO: `/v3/projects/f7ec0591786744db9dee4eafa2b48533/users/2a49895bcf144ddd81e924e80cf65211/roles/eb54c9cea2774a25b1fe8c79724408ee` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:25:22.207671 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d96201a-fb80-4cdd-9d3d-3b9e2b4438e0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f7ec0591786744db9dee4eafa2b48533, user_id=2a49895bcf144ddd81e924e80cf65211, role_id=eb54c9cea2774a25b1fe8c79724408ee)` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:25:22.211294 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d96201a-fb80-4cdd-9d3d-3b9e2b4438e0 admin admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:25:22.226175 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 997/2005] 10.222.0.21 () {60 vars in 1482 bytes} [Wed May 4 07:25:22 2022] PUT /identity/v3/projects/f7ec0591786744db9dee4eafa2b48533/users/2a49895bcf144ddd81e924e80cf65211/roles/eb54c9cea2774a25b1fe8c79724408ee => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 07:25:22.238702 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9df6b8-dc8c-46ec-a767-5989c422f8b4 None None] REQUEST_METHOD: `POST` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:25:22.238998 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9df6b8-dc8c-46ec-a767-5989c422f8b4 None None] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:25:22.240200 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9df6b8-dc8c-46ec-a767-5989c422f8b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:25:22.275666 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.auth.core [None req-fe9df6b8-dc8c-46ec-a767-5989c422f8b4 None None] MFA Rules not processed for user `2a49895bcf144ddd81e924e80cf65211`. Rule list: `[]` (Enabled: `True`). {{(pid=79744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:25:22.276991 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.fernet_utils [None req-fe9df6b8-dc8c-46ec-a767-5989c422f8b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:25:22.379337 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 1009/2006] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 07:25:22 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 07:25:22.389449 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d96201a-fb80-4cdd-9d3d-3b9e2b4438e0 admin admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:25:22.392400 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.fernet_utils [None req-2d96201a-fb80-4cdd-9d3d-3b9e2b4438e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:25:22.466274 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d96201a-fb80-4cdd-9d3d-3b9e2b4438e0 admin admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:25:22.471177 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba221c2-c19b-4d03-b8d8-b987b318a7c9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb341257aa8246b6847561e2fe1fa385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9f9c44db4984653b8d4b5f6b3b949f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:25:22.472173 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba221c2-c19b-4d03-b8d8-b987b318a7c9 service cinder] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:25:22.472764 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba221c2-c19b-4d03-b8d8-b987b318a7c9 service cinder] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:25:22.473194 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba221c2-c19b-4d03-b8d8-b987b318a7c9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:25:22.486733 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba221c2-c19b-4d03-b8d8-b987b318a7c9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:25:22.488984 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba221c2-c19b-4d03-b8d8-b987b318a7c9 service cinder] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:25:22.499959 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 998/2007] 10.222.0.21 () {60 vars in 1365 bytes} [Wed May 4 07:25:22 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 07:25:22.713483 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9df6b8-dc8c-46ec-a767-5989c422f8b4 None None] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:25:22.715301 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.fernet_utils [None req-fe9df6b8-dc8c-46ec-a767-5989c422f8b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:25:22.731365 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9df6b8-dc8c-46ec-a767-5989c422f8b4 None None] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:25:22.736711 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fcb7db4-e5df-4c8a-8ae0-12f757c074bb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb341257aa8246b6847561e2fe1fa385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9f9c44db4984653b8d4b5f6b3b949f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:25:22.737684 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcb7db4-e5df-4c8a-8ae0-12f757c074bb service cinder] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:25:22.738249 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcb7db4-e5df-4c8a-8ae0-12f757c074bb service cinder] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:25:22.738249 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcb7db4-e5df-4c8a-8ae0-12f757c074bb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:25:22.822417 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fcb7db4-e5df-4c8a-8ae0-12f757c074bb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:25:22.824572 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fcb7db4-e5df-4c8a-8ae0-12f757c074bb service cinder] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:25:22.836317 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 1010/2008] 10.222.0.21 () {60 vars in 1365 bytes} [Wed May 4 07:25:22 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 07:25:26.402332 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba221c2-c19b-4d03-b8d8-b987b318a7c9 service cinder] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:25:26.472254 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba221c2-c19b-4d03-b8d8-b987b318a7c9 service cinder] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:25:26.480183 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f876c8-bde0-41a7-9497-b54f620bfafc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:25:26.481773 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f876c8-bde0-41a7-9497-b54f620bfafc admin admin] REQUEST_METHOD: `DELETE` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:25:26.481773 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f876c8-bde0-41a7-9497-b54f620bfafc admin admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:25:26.481970 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f876c8-bde0-41a7-9497-b54f620bfafc admin admin] PATH_INFO: `/v3/users/d90ac3e409254d1d87b1b6e237fc5541` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:25:26.483179 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f876c8-bde0-41a7-9497-b54f620bfafc admin admin] RBAC: Authorizing `identity:delete_user(user_id=d90ac3e409254d1d87b1b6e237fc5541)` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:25:26.485135 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f876c8-bde0-41a7-9497-b54f620bfafc admin admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:25:26.539605 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-04f876c8-bde0-41a7-9497-b54f620bfafc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd90ac3e409254d1d87b1b6e237fc5541'} {{(pid=79745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:25:26.551090 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-04f876c8-bde0-41a7-9497-b54f620bfafc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd90ac3e409254d1d87b1b6e237fc5541'} {{(pid=79745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:25:26.551751 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-04f876c8-bde0-41a7-9497-b54f620bfafc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd90ac3e409254d1d87b1b6e237fc5541'} {{(pid=79745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:25:26.552369 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-04f876c8-bde0-41a7-9497-b54f620bfafc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd90ac3e409254d1d87b1b6e237fc5541'} {{(pid=79745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:25:26.559094 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-04f876c8-bde0-41a7-9497-b54f620bfafc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd90ac3e409254d1d87b1b6e237fc5541'} {{(pid=79745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:25:26.572541 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 999/2009] 10.222.0.21 () {58 vars in 1223 bytes} [Wed May 4 07:25:26 2022] DELETE /identity/v3/users/d90ac3e409254d1d87b1b6e237fc5541 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 07:25:26.577000 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33ca7f7-f0be-4fcc-8058-7143ee7daa1b None None] REQUEST_METHOD: `POST` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:25:26.577513 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33ca7f7-f0be-4fcc-8058-7143ee7daa1b None None] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:25:26.577603 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33ca7f7-f0be-4fcc-8058-7143ee7daa1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:25:26.596269 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.auth.core [None req-b33ca7f7-f0be-4fcc-8058-7143ee7daa1b None None] MFA Rules not processed for user `83c5e0dcb991496ea6dee38384514508`. Rule list: `[]` (Enabled: `True`). {{(pid=79744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:25:26.597509 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.fernet_utils [None req-b33ca7f7-f0be-4fcc-8058-7143ee7daa1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:25:26.661363 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 1011/2010] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 07:25:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 07:25:26.671898 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f876c8-bde0-41a7-9497-b54f620bfafc admin admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:25:26.673342 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.fernet_utils [None req-04f876c8-bde0-41a7-9497-b54f620bfafc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:25:26.735093 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f876c8-bde0-41a7-9497-b54f620bfafc admin admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:25:26.738735 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f8a541-7f2a-4c49-b2ef-dc8573237ffc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91cb92d00273402b837cb29b37325101', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9f9c44db4984653b8d4b5f6b3b949f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:25:26.739412 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f8a541-7f2a-4c49-b2ef-dc8573237ffc service neutron] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:25:26.739724 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f8a541-7f2a-4c49-b2ef-dc8573237ffc service neutron] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:25:26.739998 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f8a541-7f2a-4c49-b2ef-dc8573237ffc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:25:26.752131 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f8a541-7f2a-4c49-b2ef-dc8573237ffc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:25:26.753586 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f8a541-7f2a-4c49-b2ef-dc8573237ffc service neutron] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:25:26.764646 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 1000/2011] 10.222.0.21 () {60 vars in 1365 bytes} [Wed May 4 07:25:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 07:25:27.040024 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33ca7f7-f0be-4fcc-8058-7143ee7daa1b None None] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:25:27.041442 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.fernet_utils [None req-b33ca7f7-f0be-4fcc-8058-7143ee7daa1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:25:27.054463 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33ca7f7-f0be-4fcc-8058-7143ee7daa1b None None] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:25:27.060738 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a347ee-52a2-4bc7-b6d5-433888fb11bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:25:27.061656 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a347ee-52a2-4bc7-b6d5-433888fb11bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:25:27.061940 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a347ee-52a2-4bc7-b6d5-433888fb11bb admin admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:25:27.062212 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a347ee-52a2-4bc7-b6d5-433888fb11bb admin admin] PATH_INFO: `/v3/projects/bc8dbf9c7df04cf3bddb912b4c560659` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:25:27.063516 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a347ee-52a2-4bc7-b6d5-433888fb11bb admin admin] RBAC: Authorizing `identity:delete_project(project_id=bc8dbf9c7df04cf3bddb912b4c560659)` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:25:27.065371 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a347ee-52a2-4bc7-b6d5-433888fb11bb admin admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:25:27.119299 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-35a347ee-52a2-4bc7-b6d5-433888fb11bb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bc8dbf9c7df04cf3bddb912b4c560659', 'request_id': 'req-35a347ee-52a2-4bc7-b6d5-433888fb11bb'} {{(pid=79744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:25:27.124611 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-35a347ee-52a2-4bc7-b6d5-433888fb11bb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bc8dbf9c7df04cf3bddb912b4c560659', 'request_id': 'req-35a347ee-52a2-4bc7-b6d5-433888fb11bb'} {{(pid=79744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:25:27.132925 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-35a347ee-52a2-4bc7-b6d5-433888fb11bb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bc8dbf9c7df04cf3bddb912b4c560659', 'request_id': 'req-35a347ee-52a2-4bc7-b6d5-433888fb11bb'} {{(pid=79744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:25:27.144507 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-35a347ee-52a2-4bc7-b6d5-433888fb11bb admin admin] The token cache is being invalidate because project bc8dbf9c7df04cf3bddb912b4c560659 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79744) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 07:25:27.144789 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-35a347ee-52a2-4bc7-b6d5-433888fb11bb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:25:27.145423 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-35a347ee-52a2-4bc7-b6d5-433888fb11bb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:25:27.146995 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 1012/2012] 10.222.0.21 () {58 vars in 1232 bytes} [Wed May 4 07:25:27 2022] DELETE /identity/v3/projects/bc8dbf9c7df04cf3bddb912b4c560659 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 07:25:27.151305 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f8a541-7f2a-4c49-b2ef-dc8573237ffc service neutron] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:25:27.160989 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f8a541-7f2a-4c49-b2ef-dc8573237ffc service neutron] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:25:27.217239 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c6419c-17ff-42d4-bc68-7d9bcd09ecc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:25:27.218164 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c6419c-17ff-42d4-bc68-7d9bcd09ecc7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:25:27.218459 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c6419c-17ff-42d4-bc68-7d9bcd09ecc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:25:27.218727 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c6419c-17ff-42d4-bc68-7d9bcd09ecc7 admin admin] PATH_INFO: `/v3/users/2a49895bcf144ddd81e924e80cf65211` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:25:27.219937 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c6419c-17ff-42d4-bc68-7d9bcd09ecc7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2a49895bcf144ddd81e924e80cf65211)` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:25:27.221875 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c6419c-17ff-42d4-bc68-7d9bcd09ecc7 admin admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:25:27.271674 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-e2c6419c-17ff-42d4-bc68-7d9bcd09ecc7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2a49895bcf144ddd81e924e80cf65211'} {{(pid=79745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:25:27.284109 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-e2c6419c-17ff-42d4-bc68-7d9bcd09ecc7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2a49895bcf144ddd81e924e80cf65211'} {{(pid=79745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:25:27.284843 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-e2c6419c-17ff-42d4-bc68-7d9bcd09ecc7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2a49895bcf144ddd81e924e80cf65211'} {{(pid=79745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:25:27.285450 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-e2c6419c-17ff-42d4-bc68-7d9bcd09ecc7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2a49895bcf144ddd81e924e80cf65211'} {{(pid=79745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:25:27.294484 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-e2c6419c-17ff-42d4-bc68-7d9bcd09ecc7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2a49895bcf144ddd81e924e80cf65211'} {{(pid=79745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:25:27.308019 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 1001/2013] 10.222.0.21 () {58 vars in 1223 bytes} [Wed May 4 07:25:27 2022] DELETE /identity/v3/users/2a49895bcf144ddd81e924e80cf65211 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 07:25:27.652577 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a347ee-52a2-4bc7-b6d5-433888fb11bb admin admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:25:27.655944 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.fernet_utils [None req-35a347ee-52a2-4bc7-b6d5-433888fb11bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:25:27.677890 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a347ee-52a2-4bc7-b6d5-433888fb11bb admin admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:25:27.758503 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53a5761-3464-4621-bf18-d3461b0354c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:25:27.759787 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53a5761-3464-4621-bf18-d3461b0354c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:25:27.760098 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53a5761-3464-4621-bf18-d3461b0354c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:25:27.760371 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53a5761-3464-4621-bf18-d3461b0354c9 admin admin] PATH_INFO: `/v3/projects/f7ec0591786744db9dee4eafa2b48533` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:25:27.761635 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53a5761-3464-4621-bf18-d3461b0354c9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f7ec0591786744db9dee4eafa2b48533)` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:25:27.763986 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53a5761-3464-4621-bf18-d3461b0354c9 admin admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:25:27.813766 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-f53a5761-3464-4621-bf18-d3461b0354c9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f7ec0591786744db9dee4eafa2b48533', 'request_id': 'req-f53a5761-3464-4621-bf18-d3461b0354c9'} {{(pid=79744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:25:27.820674 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-f53a5761-3464-4621-bf18-d3461b0354c9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f7ec0591786744db9dee4eafa2b48533', 'request_id': 'req-f53a5761-3464-4621-bf18-d3461b0354c9'} {{(pid=79744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:25:27.828751 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-f53a5761-3464-4621-bf18-d3461b0354c9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f7ec0591786744db9dee4eafa2b48533', 'request_id': 'req-f53a5761-3464-4621-bf18-d3461b0354c9'} {{(pid=79744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:25:27.841457 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-f53a5761-3464-4621-bf18-d3461b0354c9 admin admin] The token cache is being invalidate because project f7ec0591786744db9dee4eafa2b48533 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79744) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 07:25:27.841745 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-f53a5761-3464-4621-bf18-d3461b0354c9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:25:27.842649 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-f53a5761-3464-4621-bf18-d3461b0354c9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:25:27.844270 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 1013/2014] 10.222.0.21 () {58 vars in 1232 bytes} [Wed May 4 07:25:27 2022] DELETE /identity/v3/projects/f7ec0591786744db9dee4eafa2b48533 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 07:25:27.849145 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4d68dd-0707-4d30-8c7b-b5bdd747139a None None] REQUEST_METHOD: `POST` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:25:27.849590 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4d68dd-0707-4d30-8c7b-b5bdd747139a None None] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:25:27.849590 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4d68dd-0707-4d30-8c7b-b5bdd747139a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:25:27.875590 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.auth.core [None req-7f4d68dd-0707-4d30-8c7b-b5bdd747139a None None] MFA Rules not processed for user `83c5e0dcb991496ea6dee38384514508`. Rule list: `[]` (Enabled: `True`). {{(pid=79745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:25:27.876634 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.fernet_utils [None req-7f4d68dd-0707-4d30-8c7b-b5bdd747139a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:25:27.953998 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 1002/2015] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 07:25:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 07:25:27.964215 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fa2433-4f20-47e9-9e85-b6c880ee5ab8 None None] REQUEST_METHOD: `POST` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:25:27.964506 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fa2433-4f20-47e9-9e85-b6c880ee5ab8 None None] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:25:27.964789 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fa2433-4f20-47e9-9e85-b6c880ee5ab8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:25:27.986503 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.auth.core [None req-53fa2433-4f20-47e9-9e85-b6c880ee5ab8 None None] MFA Rules not processed for user `83c5e0dcb991496ea6dee38384514508`. Rule list: `[]` (Enabled: `True`). {{(pid=79744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:25:27.987744 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.fernet_utils [None req-53fa2433-4f20-47e9-9e85-b6c880ee5ab8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:25:27.996263 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 1014/2016] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 07:25:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 07:25:28.000743 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4d68dd-0707-4d30-8c7b-b5bdd747139a None None] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:25:28.011494 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4d68dd-0707-4d30-8c7b-b5bdd747139a None None] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:25:28.019839 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593819b8-8eb1-4c64-8577-e137c9534fce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:25:28.020973 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593819b8-8eb1-4c64-8577-e137c9534fce admin admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:25:28.021467 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593819b8-8eb1-4c64-8577-e137c9534fce admin admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:25:28.021958 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593819b8-8eb1-4c64-8577-e137c9534fce admin admin] PATH_INFO: `/v3/domains` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:25:28.023865 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593819b8-8eb1-4c64-8577-e137c9534fce admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 07:25:28.024424 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593819b8-8eb1-4c64-8577-e137c9534fce admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:25:28.026944 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593819b8-8eb1-4c64-8577-e137c9534fce admin admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:25:28.040037 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 1003/2017] 10.222.0.21 () {58 vars in 1152 bytes} [Wed May 4 07:25:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 07:25:28.044563 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fa2433-4f20-47e9-9e85-b6c880ee5ab8 None None] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:25:28.053930 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fa2433-4f20-47e9-9e85-b6c880ee5ab8 None None] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:25:28.058631 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f66989-d36f-485b-b69f-502183c794c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:25:28.059388 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f66989-d36f-485b-b69f-502183c794c6 admin admin] REQUEST_METHOD: `POST` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:25:28.059710 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f66989-d36f-485b-b69f-502183c794c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:25:28.059980 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f66989-d36f-485b-b69f-502183c794c6 admin admin] PATH_INFO: `/v3/projects` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:25:28.060670 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f66989-d36f-485b-b69f-502183c794c6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:25:28.062584 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f66989-d36f-485b-b69f-502183c794c6 admin admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:25:28.090834 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 1015/2018] 10.222.0.21 () {60 vars in 1152 bytes} [Wed May 4 07:25:28 2022] POST /identity/v3/projects => generated 385 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 07:25:28.094717 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593819b8-8eb1-4c64-8577-e137c9534fce admin admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:25:28.105901 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593819b8-8eb1-4c64-8577-e137c9534fce admin admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:25:28.171479 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7954c4e3-973b-4a8c-86fb-9ac7291a3854 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:25:28.172189 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7954c4e3-973b-4a8c-86fb-9ac7291a3854 admin admin] REQUEST_METHOD: `POST` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:25:28.172466 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7954c4e3-973b-4a8c-86fb-9ac7291a3854 admin admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:25:28.172738 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7954c4e3-973b-4a8c-86fb-9ac7291a3854 admin admin] PATH_INFO: `/v3/users` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:25:28.173429 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7954c4e3-973b-4a8c-86fb-9ac7291a3854 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:25:28.175381 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7954c4e3-973b-4a8c-86fb-9ac7291a3854 admin admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:25:28.197365 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 1004/2019] 10.222.0.21 () {60 vars in 1143 bytes} [Wed May 4 07:25:28 2022] POST /identity/v3/users => generated 293 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 07:25:28.201504 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f66989-d36f-485b-b69f-502183c794c6 admin admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:25:28.213589 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f66989-d36f-485b-b69f-502183c794c6 admin admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:25:28.218428 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbed6a9-4c2d-4fb3-b77d-de357c49781f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:25:28.219100 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbed6a9-4c2d-4fb3-b77d-de357c49781f admin admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:25:28.219409 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbed6a9-4c2d-4fb3-b77d-de357c49781f admin admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:25:28.219682 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbed6a9-4c2d-4fb3-b77d-de357c49781f admin admin] PATH_INFO: `/v3/roles` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:25:28.220414 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fbed6a9-4c2d-4fb3-b77d-de357c49781f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:25:28.222039 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fbed6a9-4c2d-4fb3-b77d-de357c49781f admin admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:25:28.236353 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 1016/2020] 10.222.0.21 () {58 vars in 1121 bytes} [Wed May 4 07:25:28 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 07:25:28.238383 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7954c4e3-973b-4a8c-86fb-9ac7291a3854 admin admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:25:28.249271 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7954c4e3-973b-4a8c-86fb-9ac7291a3854 admin admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:25:28.255224 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba20ff46-46fb-4065-abea-423e7d1a29e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:25:28.255906 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba20ff46-46fb-4065-abea-423e7d1a29e8 admin admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:25:28.256190 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba20ff46-46fb-4065-abea-423e7d1a29e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:25:28.257264 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba20ff46-46fb-4065-abea-423e7d1a29e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:25:28.257977 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba20ff46-46fb-4065-abea-423e7d1a29e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:25:28.259703 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba20ff46-46fb-4065-abea-423e7d1a29e8 admin admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:25:28.270597 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 1005/2021] 10.222.0.21 () {58 vars in 1121 bytes} [Wed May 4 07:25:28 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 07:25:28.275475 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbed6a9-4c2d-4fb3-b77d-de357c49781f admin admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:25:28.285974 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbed6a9-4c2d-4fb3-b77d-de357c49781f admin admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:25:28.291452 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0107ba9-571b-49bb-8925-de09ac43d6fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:25:28.292372 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0107ba9-571b-49bb-8925-de09ac43d6fa admin admin] REQUEST_METHOD: `PUT` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:25:28.292664 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0107ba9-571b-49bb-8925-de09ac43d6fa admin admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:25:28.292946 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0107ba9-571b-49bb-8925-de09ac43d6fa admin admin] PATH_INFO: `/v3/projects/2dd9a853da594e50a152bee95eec5c18/users/4e98cd339a3b49fd81c6bdef05085df1/roles/9f89c07b05a14f18836116af22cba5f6` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:25:28.326405 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0107ba9-571b-49bb-8925-de09ac43d6fa admin admin] RBAC: Authorizing `identity:create_grant(project_id=2dd9a853da594e50a152bee95eec5c18, user_id=4e98cd339a3b49fd81c6bdef05085df1, role_id=9f89c07b05a14f18836116af22cba5f6)` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:25:28.330077 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0107ba9-571b-49bb-8925-de09ac43d6fa admin admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:25:28.355168 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 1017/2022] 10.222.0.21 () {60 vars in 1482 bytes} [Wed May 4 07:25:28 2022] PUT /identity/v3/projects/2dd9a853da594e50a152bee95eec5c18/users/4e98cd339a3b49fd81c6bdef05085df1/roles/9f89c07b05a14f18836116af22cba5f6 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 07:25:28.357546 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abdd843-6fc0-4d43-ae9c-c2b5b1d17e7c None None] REQUEST_METHOD: `POST` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:25:28.357782 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abdd843-6fc0-4d43-ae9c-c2b5b1d17e7c None None] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:25:28.358065 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abdd843-6fc0-4d43-ae9c-c2b5b1d17e7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:25:28.389167 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.auth.core [None req-7abdd843-6fc0-4d43-ae9c-c2b5b1d17e7c None None] MFA Rules not processed for user `4e98cd339a3b49fd81c6bdef05085df1`. Rule list: `[]` (Enabled: `True`). {{(pid=79745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:25:28.390272 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.fernet_utils [None req-7abdd843-6fc0-4d43-ae9c-c2b5b1d17e7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:25:28.461668 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 1006/2023] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 07:25:28 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 07:25:28.465930 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0107ba9-571b-49bb-8925-de09ac43d6fa admin admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:25:28.531267 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0107ba9-571b-49bb-8925-de09ac43d6fa admin admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:25:28.537168 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6b83c2-c421-48e8-9bfa-30d04410f800 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:25:28.538436 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6b83c2-c421-48e8-9bfa-30d04410f800 admin admin] REQUEST_METHOD: `POST` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:25:28.538620 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6b83c2-c421-48e8-9bfa-30d04410f800 admin admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:25:28.539029 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6b83c2-c421-48e8-9bfa-30d04410f800 admin admin] PATH_INFO: `/v3/projects` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:25:28.540168 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6b83c2-c421-48e8-9bfa-30d04410f800 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:25:28.543295 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6b83c2-c421-48e8-9bfa-30d04410f800 admin admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:25:28.582013 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 1018/2024] 10.222.0.21 () {60 vars in 1152 bytes} [Wed May 4 07:25:28 2022] POST /identity/v3/projects => generated 385 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 07:25:28.583187 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abdd843-6fc0-4d43-ae9c-c2b5b1d17e7c None None] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:25:28.594025 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abdd843-6fc0-4d43-ae9c-c2b5b1d17e7c None None] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:25:28.659389 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb4f1b9-69b9-46c5-82b8-90843dd0581e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:25:28.660093 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb4f1b9-69b9-46c5-82b8-90843dd0581e admin admin] REQUEST_METHOD: `POST` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:25:28.660371 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb4f1b9-69b9-46c5-82b8-90843dd0581e admin admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:25:28.660643 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb4f1b9-69b9-46c5-82b8-90843dd0581e admin admin] PATH_INFO: `/v3/users` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:25:28.661337 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb4f1b9-69b9-46c5-82b8-90843dd0581e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:25:28.663322 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb4f1b9-69b9-46c5-82b8-90843dd0581e admin admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:25:28.683982 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 1007/2025] 10.222.0.21 () {60 vars in 1143 bytes} [Wed May 4 07:25:28 2022] POST /identity/v3/users => generated 299 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 07:25:28.688022 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6b83c2-c421-48e8-9bfa-30d04410f800 admin admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:25:28.699660 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6b83c2-c421-48e8-9bfa-30d04410f800 admin admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:25:28.704498 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944c6b91-d35b-4c9c-af93-b419b46a97c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:25:28.705152 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944c6b91-d35b-4c9c-af93-b419b46a97c0 admin admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:25:28.705423 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944c6b91-d35b-4c9c-af93-b419b46a97c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:25:28.705695 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944c6b91-d35b-4c9c-af93-b419b46a97c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:25:28.706413 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944c6b91-d35b-4c9c-af93-b419b46a97c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:25:28.708371 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944c6b91-d35b-4c9c-af93-b419b46a97c0 admin admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:25:28.719861 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 1019/2026] 10.222.0.21 () {58 vars in 1121 bytes} [Wed May 4 07:25:28 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 07:25:28.724014 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb4f1b9-69b9-46c5-82b8-90843dd0581e admin admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:25:28.734221 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb4f1b9-69b9-46c5-82b8-90843dd0581e admin admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:25:28.739942 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f9a967-9b92-43fd-8cd2-39bd80d1ab51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:25:28.741379 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f9a967-9b92-43fd-8cd2-39bd80d1ab51 admin admin] REQUEST_METHOD: `PUT` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:25:28.741656 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f9a967-9b92-43fd-8cd2-39bd80d1ab51 admin admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:25:28.741925 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f9a967-9b92-43fd-8cd2-39bd80d1ab51 admin admin] PATH_INFO: `/v3/projects/3b86482c9bd645b88b09ff06ee2f1894/users/9177095330e84ac78a98ea1ecf6c7893/roles/eb54c9cea2774a25b1fe8c79724408ee` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:25:28.758619 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f9a967-9b92-43fd-8cd2-39bd80d1ab51 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3b86482c9bd645b88b09ff06ee2f1894, user_id=9177095330e84ac78a98ea1ecf6c7893, role_id=eb54c9cea2774a25b1fe8c79724408ee)` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:25:28.764105 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f9a967-9b92-43fd-8cd2-39bd80d1ab51 admin admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:25:28.778901 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 1008/2027] 10.222.0.21 () {60 vars in 1482 bytes} [Wed May 4 07:25:28 2022] PUT /identity/v3/projects/3b86482c9bd645b88b09ff06ee2f1894/users/9177095330e84ac78a98ea1ecf6c7893/roles/eb54c9cea2774a25b1fe8c79724408ee => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 07:25:28.784854 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944c6b91-d35b-4c9c-af93-b419b46a97c0 admin admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:25:28.801304 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944c6b91-d35b-4c9c-af93-b419b46a97c0 admin admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:25:28.896139 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f36727d-6bc4-4a4a-aa56-fc6f1a39875f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:25:28.897304 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f36727d-6bc4-4a4a-aa56-fc6f1a39875f admin admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:25:28.897584 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f36727d-6bc4-4a4a-aa56-fc6f1a39875f admin admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:25:28.897880 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f36727d-6bc4-4a4a-aa56-fc6f1a39875f admin admin] PATH_INFO: `/v3/roles` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:25:28.898599 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f36727d-6bc4-4a4a-aa56-fc6f1a39875f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:25:28.901214 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f36727d-6bc4-4a4a-aa56-fc6f1a39875f admin admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:25:28.914971 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 1020/2028] 10.222.0.21 () {58 vars in 1121 bytes} [Wed May 4 07:25:28 2022] GET /identity/v3/roles => generated 1420 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 07:25:28.919316 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f9a967-9b92-43fd-8cd2-39bd80d1ab51 admin admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:25:28.930389 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f9a967-9b92-43fd-8cd2-39bd80d1ab51 admin admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:25:28.935756 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2b9754-6682-486f-9b42-a57024324a4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:25:28.936703 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2b9754-6682-486f-9b42-a57024324a4b admin admin] REQUEST_METHOD: `PUT` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:25:28.936986 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2b9754-6682-486f-9b42-a57024324a4b admin admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:25:28.937276 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2b9754-6682-486f-9b42-a57024324a4b admin admin] PATH_INFO: `/v3/projects/3b86482c9bd645b88b09ff06ee2f1894/users/9177095330e84ac78a98ea1ecf6c7893/roles/eb54c9cea2774a25b1fe8c79724408ee` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:25:28.939534 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2b9754-6682-486f-9b42-a57024324a4b admin admin] RBAC: Authorizing `identity:create_grant(project_id=3b86482c9bd645b88b09ff06ee2f1894, user_id=9177095330e84ac78a98ea1ecf6c7893, role_id=eb54c9cea2774a25b1fe8c79724408ee)` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:25:28.941924 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2b9754-6682-486f-9b42-a57024324a4b admin admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:25:28.953142 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 1009/2029] 10.222.0.21 () {60 vars in 1482 bytes} [Wed May 4 07:25:28 2022] PUT /identity/v3/projects/3b86482c9bd645b88b09ff06ee2f1894/users/9177095330e84ac78a98ea1ecf6c7893/roles/eb54c9cea2774a25b1fe8c79724408ee => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 07:25:28.963691 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e931c8c-ebe8-48c7-8170-4f8734f2100d None None] REQUEST_METHOD: `POST` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:25:28.964002 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e931c8c-ebe8-48c7-8170-4f8734f2100d None None] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:25:28.964275 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e931c8c-ebe8-48c7-8170-4f8734f2100d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:25:28.993272 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.auth.core [None req-3e931c8c-ebe8-48c7-8170-4f8734f2100d None None] MFA Rules not processed for user `9177095330e84ac78a98ea1ecf6c7893`. Rule list: `[]` (Enabled: `True`). {{(pid=79744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:25:28.994349 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.fernet_utils [None req-3e931c8c-ebe8-48c7-8170-4f8734f2100d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:25:29.070289 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 1021/2030] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 07:25:28 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 07:25:29.083690 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2b9754-6682-486f-9b42-a57024324a4b admin admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:25:29.085862 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.fernet_utils [None req-5c2b9754-6682-486f-9b42-a57024324a4b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:25:29.150721 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2b9754-6682-486f-9b42-a57024324a4b admin admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:25:29.155410 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4bbbfd-5332-4370-9f13-d1fc4ce12d17 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb341257aa8246b6847561e2fe1fa385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9f9c44db4984653b8d4b5f6b3b949f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:25:29.156483 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4bbbfd-5332-4370-9f13-d1fc4ce12d17 service cinder] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:25:29.156952 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4bbbfd-5332-4370-9f13-d1fc4ce12d17 service cinder] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:25:29.157392 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4bbbfd-5332-4370-9f13-d1fc4ce12d17 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:25:29.167949 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4bbbfd-5332-4370-9f13-d1fc4ce12d17 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:25:29.169399 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4bbbfd-5332-4370-9f13-d1fc4ce12d17 service cinder] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:25:29.180077 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 1010/2031] 10.222.0.21 () {60 vars in 1365 bytes} [Wed May 4 07:25:29 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 07:25:29.249091 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e931c8c-ebe8-48c7-8170-4f8734f2100d None None] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:25:29.316136 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e931c8c-ebe8-48c7-8170-4f8734f2100d None None] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:25:29.321707 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9249fbff-68f1-4eb0-b763-5cba4996227a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:25:29.322590 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9249fbff-68f1-4eb0-b763-5cba4996227a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:25:29.322868 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9249fbff-68f1-4eb0-b763-5cba4996227a admin admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:25:29.323137 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9249fbff-68f1-4eb0-b763-5cba4996227a admin admin] PATH_INFO: `/v3/users/4e98cd339a3b49fd81c6bdef05085df1` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:25:29.324359 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9249fbff-68f1-4eb0-b763-5cba4996227a admin admin] RBAC: Authorizing `identity:delete_user(user_id=4e98cd339a3b49fd81c6bdef05085df1)` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:25:29.326271 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9249fbff-68f1-4eb0-b763-5cba4996227a admin admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:25:29.375788 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-9249fbff-68f1-4eb0-b763-5cba4996227a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4e98cd339a3b49fd81c6bdef05085df1'} {{(pid=79744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:25:29.376448 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-9249fbff-68f1-4eb0-b763-5cba4996227a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4e98cd339a3b49fd81c6bdef05085df1'} {{(pid=79744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:25:29.384047 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-9249fbff-68f1-4eb0-b763-5cba4996227a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4e98cd339a3b49fd81c6bdef05085df1'} {{(pid=79744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:25:29.384723 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-9249fbff-68f1-4eb0-b763-5cba4996227a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4e98cd339a3b49fd81c6bdef05085df1'} {{(pid=79744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:25:29.399666 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-9249fbff-68f1-4eb0-b763-5cba4996227a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4e98cd339a3b49fd81c6bdef05085df1'} {{(pid=79744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:25:29.412508 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 1022/2032] 10.222.0.21 () {58 vars in 1223 bytes} [Wed May 4 07:25:29 2022] DELETE /identity/v3/users/4e98cd339a3b49fd81c6bdef05085df1 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 07:25:29.417674 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b76002-2e44-4500-b876-9d4ef2c048a3 None None] REQUEST_METHOD: `POST` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:25:29.417959 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b76002-2e44-4500-b876-9d4ef2c048a3 None None] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:25:29.418233 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b76002-2e44-4500-b876-9d4ef2c048a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:25:29.438982 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.auth.core [None req-35b76002-2e44-4500-b876-9d4ef2c048a3 None None] MFA Rules not processed for user `83c5e0dcb991496ea6dee38384514508`. Rule list: `[]` (Enabled: `True`). {{(pid=79745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:25:29.440310 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.fernet_utils [None req-35b76002-2e44-4500-b876-9d4ef2c048a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:25:29.504003 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 1011/2033] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 07:25:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 07:25:29.514458 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9249fbff-68f1-4eb0-b763-5cba4996227a admin admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:25:29.515910 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.fernet_utils [None req-9249fbff-68f1-4eb0-b763-5cba4996227a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:25:29.594405 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9249fbff-68f1-4eb0-b763-5cba4996227a admin admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:25:29.599595 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9796d8d4-d7a1-457d-8b24-6cbb1c2e16b1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91cb92d00273402b837cb29b37325101', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9f9c44db4984653b8d4b5f6b3b949f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:25:29.600315 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9796d8d4-d7a1-457d-8b24-6cbb1c2e16b1 service neutron] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:25:29.600594 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9796d8d4-d7a1-457d-8b24-6cbb1c2e16b1 service neutron] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:25:29.600866 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9796d8d4-d7a1-457d-8b24-6cbb1c2e16b1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:25:29.611031 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9796d8d4-d7a1-457d-8b24-6cbb1c2e16b1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:25:29.612504 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9796d8d4-d7a1-457d-8b24-6cbb1c2e16b1 service neutron] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:25:29.623248 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 1023/2034] 10.222.0.21 () {60 vars in 1365 bytes} [Wed May 4 07:25:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 07:25:29.901614 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b76002-2e44-4500-b876-9d4ef2c048a3 None None] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:25:29.903051 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.fernet_utils [None req-35b76002-2e44-4500-b876-9d4ef2c048a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:25:29.929120 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b76002-2e44-4500-b876-9d4ef2c048a3 None None] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:25:29.935280 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05962d22-69a0-4f31-8dab-438df4f38ef0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:25:29.936073 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05962d22-69a0-4f31-8dab-438df4f38ef0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:25:29.936391 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05962d22-69a0-4f31-8dab-438df4f38ef0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:25:29.936660 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05962d22-69a0-4f31-8dab-438df4f38ef0 admin admin] PATH_INFO: `/v3/projects/2dd9a853da594e50a152bee95eec5c18` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:25:29.938017 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05962d22-69a0-4f31-8dab-438df4f38ef0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2dd9a853da594e50a152bee95eec5c18)` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:25:29.939948 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05962d22-69a0-4f31-8dab-438df4f38ef0 admin admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:25:30.004737 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-05962d22-69a0-4f31-8dab-438df4f38ef0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2dd9a853da594e50a152bee95eec5c18', 'request_id': 'req-05962d22-69a0-4f31-8dab-438df4f38ef0'} {{(pid=79745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:25:30.011627 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-05962d22-69a0-4f31-8dab-438df4f38ef0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2dd9a853da594e50a152bee95eec5c18', 'request_id': 'req-05962d22-69a0-4f31-8dab-438df4f38ef0'} {{(pid=79745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:25:30.022486 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-05962d22-69a0-4f31-8dab-438df4f38ef0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2dd9a853da594e50a152bee95eec5c18', 'request_id': 'req-05962d22-69a0-4f31-8dab-438df4f38ef0'} {{(pid=79745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:25:30.034609 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-05962d22-69a0-4f31-8dab-438df4f38ef0 admin admin] The token cache is being invalidate because project 2dd9a853da594e50a152bee95eec5c18 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79745) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 07:25:30.034899 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-05962d22-69a0-4f31-8dab-438df4f38ef0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:25:30.035771 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-05962d22-69a0-4f31-8dab-438df4f38ef0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:25:30.038240 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 1012/2035] 10.222.0.21 () {58 vars in 1232 bytes} [Wed May 4 07:25:29 2022] DELETE /identity/v3/projects/2dd9a853da594e50a152bee95eec5c18 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 07:25:30.042214 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9796d8d4-d7a1-457d-8b24-6cbb1c2e16b1 service neutron] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:25:30.054095 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9796d8d4-d7a1-457d-8b24-6cbb1c2e16b1 service neutron] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:25:30.119898 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8445dd38-4d81-40af-9e4e-5ee6c47cc455 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:25:30.120781 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8445dd38-4d81-40af-9e4e-5ee6c47cc455 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:25:30.121068 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8445dd38-4d81-40af-9e4e-5ee6c47cc455 admin admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:25:30.121340 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8445dd38-4d81-40af-9e4e-5ee6c47cc455 admin admin] PATH_INFO: `/v3/users/9177095330e84ac78a98ea1ecf6c7893` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:25:30.122587 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8445dd38-4d81-40af-9e4e-5ee6c47cc455 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9177095330e84ac78a98ea1ecf6c7893)` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:25:30.124624 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8445dd38-4d81-40af-9e4e-5ee6c47cc455 admin admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:25:30.176526 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-8445dd38-4d81-40af-9e4e-5ee6c47cc455 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9177095330e84ac78a98ea1ecf6c7893'} {{(pid=79744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:25:30.177171 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-8445dd38-4d81-40af-9e4e-5ee6c47cc455 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9177095330e84ac78a98ea1ecf6c7893'} {{(pid=79744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:25:30.188145 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-8445dd38-4d81-40af-9e4e-5ee6c47cc455 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9177095330e84ac78a98ea1ecf6c7893'} {{(pid=79744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:25:30.188876 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-8445dd38-4d81-40af-9e4e-5ee6c47cc455 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9177095330e84ac78a98ea1ecf6c7893'} {{(pid=79744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:25:30.200977 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-8445dd38-4d81-40af-9e4e-5ee6c47cc455 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9177095330e84ac78a98ea1ecf6c7893'} {{(pid=79744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:25:30.216924 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 1024/2036] 10.222.0.21 () {58 vars in 1223 bytes} [Wed May 4 07:25:30 2022] DELETE /identity/v3/users/9177095330e84ac78a98ea1ecf6c7893 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 07:25:30.679682 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05962d22-69a0-4f31-8dab-438df4f38ef0 admin admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:25:30.681155 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.fernet_utils [None req-05962d22-69a0-4f31-8dab-438df4f38ef0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:25:30.696499 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05962d22-69a0-4f31-8dab-438df4f38ef0 admin admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:25:30.764174 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f38334-240a-4995-8471-b57b6f511560 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:25:30.765051 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f38334-240a-4995-8471-b57b6f511560 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:25:30.765329 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f38334-240a-4995-8471-b57b6f511560 admin admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:25:30.765601 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f38334-240a-4995-8471-b57b6f511560 admin admin] PATH_INFO: `/v3/projects/3b86482c9bd645b88b09ff06ee2f1894` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:25:30.766804 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f38334-240a-4995-8471-b57b6f511560 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3b86482c9bd645b88b09ff06ee2f1894)` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:25:30.768797 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f38334-240a-4995-8471-b57b6f511560 admin admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:25:30.818673 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-a5f38334-240a-4995-8471-b57b6f511560 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3b86482c9bd645b88b09ff06ee2f1894', 'request_id': 'req-a5f38334-240a-4995-8471-b57b6f511560'} {{(pid=79745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:25:30.825978 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-a5f38334-240a-4995-8471-b57b6f511560 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3b86482c9bd645b88b09ff06ee2f1894', 'request_id': 'req-a5f38334-240a-4995-8471-b57b6f511560'} {{(pid=79745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:25:30.833669 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-a5f38334-240a-4995-8471-b57b6f511560 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3b86482c9bd645b88b09ff06ee2f1894', 'request_id': 'req-a5f38334-240a-4995-8471-b57b6f511560'} {{(pid=79745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:25:30.844728 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-a5f38334-240a-4995-8471-b57b6f511560 admin admin] The token cache is being invalidate because project 3b86482c9bd645b88b09ff06ee2f1894 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79745) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 07:25:30.845009 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-a5f38334-240a-4995-8471-b57b6f511560 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:25:30.845689 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-a5f38334-240a-4995-8471-b57b6f511560 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:25:30.847274 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 1013/2037] 10.222.0.21 () {58 vars in 1232 bytes} [Wed May 4 07:25:30 2022] DELETE /identity/v3/projects/3b86482c9bd645b88b09ff06ee2f1894 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 07:25:30.852592 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae741a0-a9b9-4a47-9f82-08e32aed0f12 None None] REQUEST_METHOD: `POST` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:25:30.852923 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae741a0-a9b9-4a47-9f82-08e32aed0f12 None None] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:25:30.853261 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae741a0-a9b9-4a47-9f82-08e32aed0f12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:25:30.871787 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.auth.core [None req-3ae741a0-a9b9-4a47-9f82-08e32aed0f12 None None] MFA Rules not processed for user `83c5e0dcb991496ea6dee38384514508`. Rule list: `[]` (Enabled: `True`). {{(pid=79744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:25:30.873001 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.fernet_utils [None req-3ae741a0-a9b9-4a47-9f82-08e32aed0f12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:25:30.937191 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 1025/2038] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 07:25:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 07:25:30.947026 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91bcec1-5d0a-4da7-aae6-d7c4c583ea6c None None] REQUEST_METHOD: `POST` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:25:30.947524 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91bcec1-5d0a-4da7-aae6-d7c4c583ea6c None None] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:25:30.947717 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91bcec1-5d0a-4da7-aae6-d7c4c583ea6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:25:30.968188 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.auth.core [None req-f91bcec1-5d0a-4da7-aae6-d7c4c583ea6c None None] MFA Rules not processed for user `83c5e0dcb991496ea6dee38384514508`. Rule list: `[]` (Enabled: `True`). {{(pid=79745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:25:30.969385 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.fernet_utils [None req-f91bcec1-5d0a-4da7-aae6-d7c4c583ea6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:25:30.977510 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 1014/2039] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 07:25:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 07:25:30.982073 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae741a0-a9b9-4a47-9f82-08e32aed0f12 None None] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:25:30.992297 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae741a0-a9b9-4a47-9f82-08e32aed0f12 None None] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:25:30.996841 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41dc0e8-92c4-4c67-8761-23bd3fe0bb88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:25:30.997491 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41dc0e8-92c4-4c67-8761-23bd3fe0bb88 admin admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:25:30.997772 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41dc0e8-92c4-4c67-8761-23bd3fe0bb88 admin admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:25:30.998067 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41dc0e8-92c4-4c67-8761-23bd3fe0bb88 admin admin] PATH_INFO: `/v3/domains` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:25:30.998794 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41dc0e8-92c4-4c67-8761-23bd3fe0bb88 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79744) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 07:25:30.999099 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41dc0e8-92c4-4c67-8761-23bd3fe0bb88 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:25:31.000757 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41dc0e8-92c4-4c67-8761-23bd3fe0bb88 admin admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:25:31.015033 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 1026/2040] 10.222.0.21 () {58 vars in 1152 bytes} [Wed May 4 07:25:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 07:25:31.019242 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91bcec1-5d0a-4da7-aae6-d7c4c583ea6c None None] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:25:31.028601 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91bcec1-5d0a-4da7-aae6-d7c4c583ea6c None None] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:25:31.033508 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2ceb4d-a445-414a-974a-3598d0364cfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:25:31.034173 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2ceb4d-a445-414a-974a-3598d0364cfa admin admin] REQUEST_METHOD: `POST` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:25:31.034494 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2ceb4d-a445-414a-974a-3598d0364cfa admin admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:25:31.034714 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2ceb4d-a445-414a-974a-3598d0364cfa admin admin] PATH_INFO: `/v3/projects` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:25:31.035450 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2ceb4d-a445-414a-974a-3598d0364cfa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:25:31.037387 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2ceb4d-a445-414a-974a-3598d0364cfa admin admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:25:31.064061 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 1015/2041] 10.222.0.21 () {60 vars in 1152 bytes} [Wed May 4 07:25:31 2022] POST /identity/v3/projects => generated 367 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 07:25:31.068291 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41dc0e8-92c4-4c67-8761-23bd3fe0bb88 admin admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:25:31.080415 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41dc0e8-92c4-4c67-8761-23bd3fe0bb88 admin admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:25:31.139708 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751b019c-42a0-41bd-9ab2-616df87f94e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:25:31.140389 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751b019c-42a0-41bd-9ab2-616df87f94e5 admin admin] REQUEST_METHOD: `POST` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:25:31.140668 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751b019c-42a0-41bd-9ab2-616df87f94e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:25:31.140938 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751b019c-42a0-41bd-9ab2-616df87f94e5 admin admin] PATH_INFO: `/v3/users` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:25:31.141634 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751b019c-42a0-41bd-9ab2-616df87f94e5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:25:31.143642 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751b019c-42a0-41bd-9ab2-616df87f94e5 admin admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:25:31.170728 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 1027/2042] 10.222.0.21 () {60 vars in 1143 bytes} [Wed May 4 07:25:31 2022] POST /identity/v3/users => generated 284 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 07:25:31.172198 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2ceb4d-a445-414a-974a-3598d0364cfa admin admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:25:31.183684 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2ceb4d-a445-414a-974a-3598d0364cfa admin admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:25:31.188495 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f71085-d895-468e-931d-1db70b647349 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:25:31.189169 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f71085-d895-468e-931d-1db70b647349 admin admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:25:31.189451 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f71085-d895-468e-931d-1db70b647349 admin admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:25:31.189728 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f71085-d895-468e-931d-1db70b647349 admin admin] PATH_INFO: `/v3/roles` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:25:31.190464 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f71085-d895-468e-931d-1db70b647349 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:25:31.192137 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f71085-d895-468e-931d-1db70b647349 admin admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:25:31.203732 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 1016/2043] 10.222.0.21 () {58 vars in 1121 bytes} [Wed May 4 07:25:31 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 07:25:31.207744 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751b019c-42a0-41bd-9ab2-616df87f94e5 admin admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:25:31.218438 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751b019c-42a0-41bd-9ab2-616df87f94e5 admin admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:25:31.229181 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47aa4227-f1f9-448a-96ba-9da1f6dbdea9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:25:31.230411 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47aa4227-f1f9-448a-96ba-9da1f6dbdea9 admin admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:25:31.230768 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47aa4227-f1f9-448a-96ba-9da1f6dbdea9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:25:31.231114 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47aa4227-f1f9-448a-96ba-9da1f6dbdea9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:25:31.232893 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47aa4227-f1f9-448a-96ba-9da1f6dbdea9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:25:31.235007 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47aa4227-f1f9-448a-96ba-9da1f6dbdea9 admin admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:25:31.247797 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 1028/2044] 10.222.0.21 () {58 vars in 1121 bytes} [Wed May 4 07:25:31 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 07:25:31.252128 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f71085-d895-468e-931d-1db70b647349 admin admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:25:31.262969 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f71085-d895-468e-931d-1db70b647349 admin admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:25:31.267796 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c34f6d-fe2d-4e19-9e54-74a582cb32de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:25:31.268727 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c34f6d-fe2d-4e19-9e54-74a582cb32de admin admin] REQUEST_METHOD: `PUT` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:25:31.269009 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c34f6d-fe2d-4e19-9e54-74a582cb32de admin admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:25:31.269285 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c34f6d-fe2d-4e19-9e54-74a582cb32de admin admin] PATH_INFO: `/v3/projects/02e376ab4eb84d9e9c96767cd3f5fc17/users/74eff6d608bb4611bcaad61f001adfa9/roles/9f89c07b05a14f18836116af22cba5f6` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:25:31.284575 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c34f6d-fe2d-4e19-9e54-74a582cb32de admin admin] RBAC: Authorizing `identity:create_grant(project_id=02e376ab4eb84d9e9c96767cd3f5fc17, user_id=74eff6d608bb4611bcaad61f001adfa9, role_id=9f89c07b05a14f18836116af22cba5f6)` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:25:31.287286 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c34f6d-fe2d-4e19-9e54-74a582cb32de admin admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:25:31.303031 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 1017/2045] 10.222.0.21 () {60 vars in 1482 bytes} [Wed May 4 07:25:31 2022] PUT /identity/v3/projects/02e376ab4eb84d9e9c96767cd3f5fc17/users/74eff6d608bb4611bcaad61f001adfa9/roles/9f89c07b05a14f18836116af22cba5f6 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 07:25:31.316312 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7768051b-2a77-4280-8a74-a1fd22dbc00a None None] REQUEST_METHOD: `POST` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:25:31.316630 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7768051b-2a77-4280-8a74-a1fd22dbc00a None None] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:25:31.316980 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7768051b-2a77-4280-8a74-a1fd22dbc00a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:25:31.344859 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.auth.core [None req-7768051b-2a77-4280-8a74-a1fd22dbc00a None None] MFA Rules not processed for user `74eff6d608bb4611bcaad61f001adfa9`. Rule list: `[]` (Enabled: `True`). {{(pid=79744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:25:31.346079 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.fernet_utils [None req-7768051b-2a77-4280-8a74-a1fd22dbc00a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:25:31.416913 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 1029/2046] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 07:25:31 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 07:25:31.421445 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c34f6d-fe2d-4e19-9e54-74a582cb32de admin admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:25:31.486971 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c34f6d-fe2d-4e19-9e54-74a582cb32de admin admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:25:31.492411 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8221ee7a-d59e-417b-8b4f-1d2dc42e8a28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:25:31.493065 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8221ee7a-d59e-417b-8b4f-1d2dc42e8a28 admin admin] REQUEST_METHOD: `POST` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:25:31.493343 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8221ee7a-d59e-417b-8b4f-1d2dc42e8a28 admin admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:25:31.493618 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8221ee7a-d59e-417b-8b4f-1d2dc42e8a28 admin admin] PATH_INFO: `/v3/projects` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:25:31.494443 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8221ee7a-d59e-417b-8b4f-1d2dc42e8a28 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:25:31.496671 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8221ee7a-d59e-417b-8b4f-1d2dc42e8a28 admin admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:25:31.525671 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 1018/2047] 10.222.0.21 () {60 vars in 1152 bytes} [Wed May 4 07:25:31 2022] POST /identity/v3/projects => generated 367 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 07:25:31.530031 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7768051b-2a77-4280-8a74-a1fd22dbc00a None None] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:25:31.541633 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7768051b-2a77-4280-8a74-a1fd22dbc00a None None] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:25:31.599174 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbaa808-3029-4d4d-9867-be1f01763f65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:25:31.599893 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbaa808-3029-4d4d-9867-be1f01763f65 admin admin] REQUEST_METHOD: `POST` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:25:31.600373 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbaa808-3029-4d4d-9867-be1f01763f65 admin admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:25:31.600698 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbaa808-3029-4d4d-9867-be1f01763f65 admin admin] PATH_INFO: `/v3/users` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:25:31.601405 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcbaa808-3029-4d4d-9867-be1f01763f65 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:25:31.603879 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcbaa808-3029-4d4d-9867-be1f01763f65 admin admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:25:31.628575 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 1030/2048] 10.222.0.21 () {60 vars in 1143 bytes} [Wed May 4 07:25:31 2022] POST /identity/v3/users => generated 290 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 07:25:31.629995 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8221ee7a-d59e-417b-8b4f-1d2dc42e8a28 admin admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:25:31.641622 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8221ee7a-d59e-417b-8b4f-1d2dc42e8a28 admin admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:25:31.646551 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bdbe0b4-ef9b-4c32-9d85-ee9f361f93cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:25:31.647822 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdbe0b4-ef9b-4c32-9d85-ee9f361f93cc admin admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:25:31.648154 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdbe0b4-ef9b-4c32-9d85-ee9f361f93cc admin admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:25:31.648431 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdbe0b4-ef9b-4c32-9d85-ee9f361f93cc admin admin] PATH_INFO: `/v3/roles` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:25:31.649280 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bdbe0b4-ef9b-4c32-9d85-ee9f361f93cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:25:31.650915 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bdbe0b4-ef9b-4c32-9d85-ee9f361f93cc admin admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:25:31.662052 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 1019/2049] 10.222.0.21 () {58 vars in 1121 bytes} [Wed May 4 07:25:31 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 07:25:31.667077 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbaa808-3029-4d4d-9867-be1f01763f65 admin admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:25:31.677847 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbaa808-3029-4d4d-9867-be1f01763f65 admin admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:25:31.683365 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8211fa34-755f-454c-854d-8719424604a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:25:31.684275 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8211fa34-755f-454c-854d-8719424604a1 admin admin] REQUEST_METHOD: `PUT` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:25:31.684552 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8211fa34-755f-454c-854d-8719424604a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:25:31.684820 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8211fa34-755f-454c-854d-8719424604a1 admin admin] PATH_INFO: `/v3/projects/85c766d967f94fd48b5fe101387d226c/users/a1f42b32a9684d6b899dd50d8ffb4a30/roles/eb54c9cea2774a25b1fe8c79724408ee` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:25:31.700109 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8211fa34-755f-454c-854d-8719424604a1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=85c766d967f94fd48b5fe101387d226c, user_id=a1f42b32a9684d6b899dd50d8ffb4a30, role_id=eb54c9cea2774a25b1fe8c79724408ee)` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:25:31.702768 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8211fa34-755f-454c-854d-8719424604a1 admin admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:25:31.717494 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 1031/2050] 10.222.0.21 () {60 vars in 1482 bytes} [Wed May 4 07:25:31 2022] PUT /identity/v3/projects/85c766d967f94fd48b5fe101387d226c/users/a1f42b32a9684d6b899dd50d8ffb4a30/roles/eb54c9cea2774a25b1fe8c79724408ee => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 07:25:31.721514 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bdbe0b4-ef9b-4c32-9d85-ee9f361f93cc admin admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:25:31.732256 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bdbe0b4-ef9b-4c32-9d85-ee9f361f93cc admin admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:25:31.788432 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c28c706-783f-42b0-813b-53e5b6d36597 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:25:31.789111 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c28c706-783f-42b0-813b-53e5b6d36597 admin admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:25:31.789396 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c28c706-783f-42b0-813b-53e5b6d36597 admin admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:25:31.789673 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c28c706-783f-42b0-813b-53e5b6d36597 admin admin] PATH_INFO: `/v3/roles` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:25:31.790433 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c28c706-783f-42b0-813b-53e5b6d36597 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:25:31.792078 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c28c706-783f-42b0-813b-53e5b6d36597 admin admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:25:31.805833 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 1020/2051] 10.222.0.21 () {58 vars in 1121 bytes} [Wed May 4 07:25:31 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 07:25:31.807190 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8211fa34-755f-454c-854d-8719424604a1 admin admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:25:31.824121 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8211fa34-755f-454c-854d-8719424604a1 admin admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:25:31.828815 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b68c55-eea8-4b97-8dd7-c314905e1dc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:25:31.829691 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b68c55-eea8-4b97-8dd7-c314905e1dc7 admin admin] REQUEST_METHOD: `PUT` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:25:31.829969 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b68c55-eea8-4b97-8dd7-c314905e1dc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:25:31.830237 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b68c55-eea8-4b97-8dd7-c314905e1dc7 admin admin] PATH_INFO: `/v3/projects/85c766d967f94fd48b5fe101387d226c/users/a1f42b32a9684d6b899dd50d8ffb4a30/roles/eb54c9cea2774a25b1fe8c79724408ee` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:25:31.832250 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b68c55-eea8-4b97-8dd7-c314905e1dc7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=85c766d967f94fd48b5fe101387d226c, user_id=a1f42b32a9684d6b899dd50d8ffb4a30, role_id=eb54c9cea2774a25b1fe8c79724408ee)` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:25:31.835653 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b68c55-eea8-4b97-8dd7-c314905e1dc7 admin admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:25:31.846513 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 1032/2052] 10.222.0.21 () {60 vars in 1482 bytes} [Wed May 4 07:25:31 2022] PUT /identity/v3/projects/85c766d967f94fd48b5fe101387d226c/users/a1f42b32a9684d6b899dd50d8ffb4a30/roles/eb54c9cea2774a25b1fe8c79724408ee => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 07:25:31.858443 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4e3f1e-6bf8-45cb-a772-796a93b4400e None None] REQUEST_METHOD: `POST` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:25:31.858729 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4e3f1e-6bf8-45cb-a772-796a93b4400e None None] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:25:31.859009 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4e3f1e-6bf8-45cb-a772-796a93b4400e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:25:31.886682 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.auth.core [None req-6f4e3f1e-6bf8-45cb-a772-796a93b4400e None None] MFA Rules not processed for user `a1f42b32a9684d6b899dd50d8ffb4a30`. Rule list: `[]` (Enabled: `True`). {{(pid=79745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:25:31.887935 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.fernet_utils [None req-6f4e3f1e-6bf8-45cb-a772-796a93b4400e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:25:31.956506 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 1021/2053] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 07:25:31 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 07:25:31.968590 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b68c55-eea8-4b97-8dd7-c314905e1dc7 admin admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:25:31.970333 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.fernet_utils [None req-a2b68c55-eea8-4b97-8dd7-c314905e1dc7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:25:32.032068 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b68c55-eea8-4b97-8dd7-c314905e1dc7 admin admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:25:32.036468 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8440bd79-5d90-4284-a1b6-7f165dcc95b4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb341257aa8246b6847561e2fe1fa385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9f9c44db4984653b8d4b5f6b3b949f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:25:32.037119 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8440bd79-5d90-4284-a1b6-7f165dcc95b4 service cinder] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:25:32.037394 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8440bd79-5d90-4284-a1b6-7f165dcc95b4 service cinder] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:25:32.038076 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8440bd79-5d90-4284-a1b6-7f165dcc95b4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:25:32.048041 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8440bd79-5d90-4284-a1b6-7f165dcc95b4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:25:32.049468 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8440bd79-5d90-4284-a1b6-7f165dcc95b4 service cinder] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:25:32.060805 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 1033/2054] 10.222.0.21 () {60 vars in 1365 bytes} [Wed May 4 07:25:31 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 07:25:32.158622 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4e3f1e-6bf8-45cb-a772-796a93b4400e None None] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:25:32.166074 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4e3f1e-6bf8-45cb-a772-796a93b4400e None None] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:25:32.170135 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023f67f6-134a-478d-bca8-bed4b6c1fcd1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb341257aa8246b6847561e2fe1fa385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9f9c44db4984653b8d4b5f6b3b949f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:25:32.170787 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023f67f6-134a-478d-bca8-bed4b6c1fcd1 service cinder] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:25:32.171068 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023f67f6-134a-478d-bca8-bed4b6c1fcd1 service cinder] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:25:32.171376 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023f67f6-134a-478d-bca8-bed4b6c1fcd1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:25:32.229912 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023f67f6-134a-478d-bca8-bed4b6c1fcd1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:25:32.231316 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023f67f6-134a-478d-bca8-bed4b6c1fcd1 service cinder] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:25:32.240593 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 1022/2055] 10.222.0.21 () {60 vars in 1365 bytes} [Wed May 4 07:25:32 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 07:25:35.071927 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8440bd79-5d90-4284-a1b6-7f165dcc95b4 service cinder] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:25:35.073387 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.fernet_utils [None req-8440bd79-5d90-4284-a1b6-7f165dcc95b4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:25:35.255593 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8440bd79-5d90-4284-a1b6-7f165dcc95b4 service cinder] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:25:35.261538 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28733a06-9ca0-4bea-a539-cc40f3d32cd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:25:35.262435 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28733a06-9ca0-4bea-a539-cc40f3d32cd9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:25:35.262715 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28733a06-9ca0-4bea-a539-cc40f3d32cd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:25:35.263035 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28733a06-9ca0-4bea-a539-cc40f3d32cd9 admin admin] PATH_INFO: `/v3/users/aafb56bc6a204b57afba78a29f0e7c75` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:25:35.264365 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28733a06-9ca0-4bea-a539-cc40f3d32cd9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=aafb56bc6a204b57afba78a29f0e7c75)` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:25:35.266484 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28733a06-9ca0-4bea-a539-cc40f3d32cd9 admin admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:25:35.331381 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-28733a06-9ca0-4bea-a539-cc40f3d32cd9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aafb56bc6a204b57afba78a29f0e7c75'} {{(pid=79744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:25:35.332050 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-28733a06-9ca0-4bea-a539-cc40f3d32cd9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aafb56bc6a204b57afba78a29f0e7c75'} {{(pid=79744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:25:35.340615 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-28733a06-9ca0-4bea-a539-cc40f3d32cd9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aafb56bc6a204b57afba78a29f0e7c75'} {{(pid=79744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:25:35.341366 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-28733a06-9ca0-4bea-a539-cc40f3d32cd9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aafb56bc6a204b57afba78a29f0e7c75'} {{(pid=79744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:25:35.358308 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-28733a06-9ca0-4bea-a539-cc40f3d32cd9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aafb56bc6a204b57afba78a29f0e7c75'} {{(pid=79744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:25:35.375619 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 1034/2056] 10.222.0.21 () {58 vars in 1223 bytes} [Wed May 4 07:25:35 2022] DELETE /identity/v3/users/aafb56bc6a204b57afba78a29f0e7c75 => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 07:25:35.380376 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee64229-e688-4c46-b07e-0b7580fd1b4e None None] REQUEST_METHOD: `POST` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:25:35.380887 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee64229-e688-4c46-b07e-0b7580fd1b4e None None] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:25:35.380965 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee64229-e688-4c46-b07e-0b7580fd1b4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:25:35.400513 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.auth.core [None req-fee64229-e688-4c46-b07e-0b7580fd1b4e None None] MFA Rules not processed for user `83c5e0dcb991496ea6dee38384514508`. Rule list: `[]` (Enabled: `True`). {{(pid=79745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:25:35.401715 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.fernet_utils [None req-fee64229-e688-4c46-b07e-0b7580fd1b4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:25:35.481739 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 1023/2057] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 07:25:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 07:25:35.497030 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28733a06-9ca0-4bea-a539-cc40f3d32cd9 admin admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:25:35.498768 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.fernet_utils [None req-28733a06-9ca0-4bea-a539-cc40f3d32cd9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:25:35.613625 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28733a06-9ca0-4bea-a539-cc40f3d32cd9 admin admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:25:35.621822 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ee7f2a-de80-4178-bf52-586fed71a351 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91cb92d00273402b837cb29b37325101', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9f9c44db4984653b8d4b5f6b3b949f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:25:35.623116 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ee7f2a-de80-4178-bf52-586fed71a351 service neutron] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:25:35.623835 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ee7f2a-de80-4178-bf52-586fed71a351 service neutron] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:25:35.624715 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ee7f2a-de80-4178-bf52-586fed71a351 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:25:35.644185 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ee7f2a-de80-4178-bf52-586fed71a351 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:25:35.647406 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ee7f2a-de80-4178-bf52-586fed71a351 service neutron] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:25:35.677476 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 1035/2058] 10.222.0.21 () {60 vars in 1365 bytes} [Wed May 4 07:25:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 07:25:36.065268 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee64229-e688-4c46-b07e-0b7580fd1b4e None None] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:25:36.067919 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.fernet_utils [None req-fee64229-e688-4c46-b07e-0b7580fd1b4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:25:36.089795 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee64229-e688-4c46-b07e-0b7580fd1b4e None None] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:25:36.099525 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e80efbd-87d8-457b-a166-e516e369902b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:25:36.102158 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e80efbd-87d8-457b-a166-e516e369902b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:25:36.102717 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e80efbd-87d8-457b-a166-e516e369902b admin admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:25:36.103114 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e80efbd-87d8-457b-a166-e516e369902b admin admin] PATH_INFO: `/v3/projects/1e575fd13541441d9e87473864301c65` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:25:36.105662 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e80efbd-87d8-457b-a166-e516e369902b admin admin] RBAC: Authorizing `identity:delete_project(project_id=1e575fd13541441d9e87473864301c65)` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:25:36.107633 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e80efbd-87d8-457b-a166-e516e369902b admin admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:25:36.136430 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ee7f2a-de80-4178-bf52-586fed71a351 service neutron] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:25:36.138055 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.fernet_utils [None req-c7ee7f2a-de80-4178-bf52-586fed71a351 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:25:36.151924 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ee7f2a-de80-4178-bf52-586fed71a351 service neutron] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:25:36.162324 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13208239-90f7-4aed-9053-b1ded6c861a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:25:36.164325 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13208239-90f7-4aed-9053-b1ded6c861a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:25:36.165354 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13208239-90f7-4aed-9053-b1ded6c861a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:25:36.165878 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13208239-90f7-4aed-9053-b1ded6c861a1 admin admin] PATH_INFO: `/v3/users/e907053a699044f9a032e3227f1aff1a` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:25:36.167520 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13208239-90f7-4aed-9053-b1ded6c861a1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e907053a699044f9a032e3227f1aff1a)` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:25:36.170186 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13208239-90f7-4aed-9053-b1ded6c861a1 admin admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:25:36.181583 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-2e80efbd-87d8-457b-a166-e516e369902b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1e575fd13541441d9e87473864301c65', 'request_id': 'req-2e80efbd-87d8-457b-a166-e516e369902b'} {{(pid=79745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:25:36.189319 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-2e80efbd-87d8-457b-a166-e516e369902b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1e575fd13541441d9e87473864301c65', 'request_id': 'req-2e80efbd-87d8-457b-a166-e516e369902b'} {{(pid=79745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:25:36.206888 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-2e80efbd-87d8-457b-a166-e516e369902b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1e575fd13541441d9e87473864301c65', 'request_id': 'req-2e80efbd-87d8-457b-a166-e516e369902b'} {{(pid=79745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:25:36.222401 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-2e80efbd-87d8-457b-a166-e516e369902b admin admin] The token cache is being invalidate because project 1e575fd13541441d9e87473864301c65 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79745) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 07:25:36.222693 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-2e80efbd-87d8-457b-a166-e516e369902b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:25:36.223631 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-2e80efbd-87d8-457b-a166-e516e369902b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:25:36.226200 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 1024/2059] 10.222.0.21 () {58 vars in 1232 bytes} [Wed May 4 07:25:36 2022] DELETE /identity/v3/projects/1e575fd13541441d9e87473864301c65 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 07:25:36.230571 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e80efbd-87d8-457b-a166-e516e369902b admin admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:25:36.232742 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.fernet_utils [None req-2e80efbd-87d8-457b-a166-e516e369902b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:25:36.276300 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-13208239-90f7-4aed-9053-b1ded6c861a1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e907053a699044f9a032e3227f1aff1a'} {{(pid=79744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:25:36.281014 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-13208239-90f7-4aed-9053-b1ded6c861a1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e907053a699044f9a032e3227f1aff1a'} {{(pid=79744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:25:36.292411 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-13208239-90f7-4aed-9053-b1ded6c861a1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e907053a699044f9a032e3227f1aff1a'} {{(pid=79744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:25:36.295617 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-13208239-90f7-4aed-9053-b1ded6c861a1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e907053a699044f9a032e3227f1aff1a'} {{(pid=79744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:25:36.321967 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-13208239-90f7-4aed-9053-b1ded6c861a1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e907053a699044f9a032e3227f1aff1a'} {{(pid=79744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:25:36.354508 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 1036/2060] 10.222.0.21 () {58 vars in 1223 bytes} [Wed May 4 07:25:36 2022] DELETE /identity/v3/users/e907053a699044f9a032e3227f1aff1a => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 07:25:36.361226 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf0404f-56fa-408d-b168-7f147d261189 None None] REQUEST_METHOD: `POST` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:25:36.362121 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf0404f-56fa-408d-b168-7f147d261189 None None] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:25:36.362837 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf0404f-56fa-408d-b168-7f147d261189 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:25:36.364619 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e80efbd-87d8-457b-a166-e516e369902b admin admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:25:36.390696 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.auth.core [None req-9cf0404f-56fa-408d-b168-7f147d261189 None None] MFA Rules not processed for user `83c5e0dcb991496ea6dee38384514508`. Rule list: `[]` (Enabled: `True`). {{(pid=79744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:25:36.392257 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.fernet_utils [None req-9cf0404f-56fa-408d-b168-7f147d261189 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:25:36.441122 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a671ec-9677-4e19-9dc3-95d9749dbef9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:25:36.444147 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a671ec-9677-4e19-9dc3-95d9749dbef9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:25:36.444446 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a671ec-9677-4e19-9dc3-95d9749dbef9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:25:36.444728 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a671ec-9677-4e19-9dc3-95d9749dbef9 admin admin] PATH_INFO: `/v3/users/7018ac662dfc4d09b5db11b4e90c3cec` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:25:36.456273 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a671ec-9677-4e19-9dc3-95d9749dbef9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7018ac662dfc4d09b5db11b4e90c3cec)` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:25:36.456273 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a671ec-9677-4e19-9dc3-95d9749dbef9 admin admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:25:36.485015 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 1037/2061] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 07:25:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 07:25:36.496634 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf0404f-56fa-408d-b168-7f147d261189 None None] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:25:36.498145 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.fernet_utils [None req-9cf0404f-56fa-408d-b168-7f147d261189 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:25:36.517423 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-94a671ec-9677-4e19-9dc3-95d9749dbef9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7018ac662dfc4d09b5db11b4e90c3cec'} {{(pid=79745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:25:36.534675 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-94a671ec-9677-4e19-9dc3-95d9749dbef9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7018ac662dfc4d09b5db11b4e90c3cec'} {{(pid=79745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:25:36.536107 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-94a671ec-9677-4e19-9dc3-95d9749dbef9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7018ac662dfc4d09b5db11b4e90c3cec'} {{(pid=79745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:25:36.538012 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-94a671ec-9677-4e19-9dc3-95d9749dbef9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7018ac662dfc4d09b5db11b4e90c3cec'} {{(pid=79745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:25:36.548991 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-94a671ec-9677-4e19-9dc3-95d9749dbef9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7018ac662dfc4d09b5db11b4e90c3cec'} {{(pid=79745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:25:36.568432 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 1025/2062] 10.222.0.21 () {58 vars in 1223 bytes} [Wed May 4 07:25:36 2022] DELETE /identity/v3/users/7018ac662dfc4d09b5db11b4e90c3cec => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 07:25:36.586640 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf0404f-56fa-408d-b168-7f147d261189 None None] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:25:36.650539 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9ac74e-7894-46d0-bf26-da216e79210c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91cb92d00273402b837cb29b37325101', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9f9c44db4984653b8d4b5f6b3b949f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:25:36.651413 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9ac74e-7894-46d0-bf26-da216e79210c service neutron] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:25:36.651797 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9ac74e-7894-46d0-bf26-da216e79210c service neutron] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:25:36.652193 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9ac74e-7894-46d0-bf26-da216e79210c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:25:36.655045 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.fernet_utils [None req-6a9ac74e-7894-46d0-bf26-da216e79210c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:25:36.770413 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9ac74e-7894-46d0-bf26-da216e79210c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:25:36.771904 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9ac74e-7894-46d0-bf26-da216e79210c service neutron] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:25:36.783498 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 1038/2063] 10.222.0.21 () {60 vars in 1365 bytes} [Wed May 4 07:25:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 287 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 04 07:25:36.966791 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a671ec-9677-4e19-9dc3-95d9749dbef9 admin admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:25:36.968686 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.fernet_utils [None req-94a671ec-9677-4e19-9dc3-95d9749dbef9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:25:36.995824 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a671ec-9677-4e19-9dc3-95d9749dbef9 admin admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:25:37.007611 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a467b695-f2c3-4b21-90e2-ebbc77d57447 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:25:37.008589 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a467b695-f2c3-4b21-90e2-ebbc77d57447 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:25:37.008886 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a467b695-f2c3-4b21-90e2-ebbc77d57447 admin admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:25:37.009160 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a467b695-f2c3-4b21-90e2-ebbc77d57447 admin admin] PATH_INFO: `/v3/projects/819b9f3893fc4a39a0b77aa941b3bcc4` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:25:37.010958 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a467b695-f2c3-4b21-90e2-ebbc77d57447 admin admin] RBAC: Authorizing `identity:delete_project(project_id=819b9f3893fc4a39a0b77aa941b3bcc4)` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:25:37.013502 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a467b695-f2c3-4b21-90e2-ebbc77d57447 admin admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:25:37.087070 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-a467b695-f2c3-4b21-90e2-ebbc77d57447 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '819b9f3893fc4a39a0b77aa941b3bcc4', 'request_id': 'req-a467b695-f2c3-4b21-90e2-ebbc77d57447'} {{(pid=79745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:25:37.095453 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-a467b695-f2c3-4b21-90e2-ebbc77d57447 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '819b9f3893fc4a39a0b77aa941b3bcc4', 'request_id': 'req-a467b695-f2c3-4b21-90e2-ebbc77d57447'} {{(pid=79745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:25:37.105566 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-a467b695-f2c3-4b21-90e2-ebbc77d57447 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '819b9f3893fc4a39a0b77aa941b3bcc4', 'request_id': 'req-a467b695-f2c3-4b21-90e2-ebbc77d57447'} {{(pid=79745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:25:37.124831 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-a467b695-f2c3-4b21-90e2-ebbc77d57447 admin admin] The token cache is being invalidate because project 819b9f3893fc4a39a0b77aa941b3bcc4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79745) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 07:25:37.125264 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-a467b695-f2c3-4b21-90e2-ebbc77d57447 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:25:37.126919 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-a467b695-f2c3-4b21-90e2-ebbc77d57447 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:25:37.128595 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 1026/2064] 10.222.0.21 () {58 vars in 1232 bytes} [Wed May 4 07:25:36 2022] DELETE /identity/v3/projects/819b9f3893fc4a39a0b77aa941b3bcc4 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 07:25:37.133856 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9ac74e-7894-46d0-bf26-da216e79210c service neutron] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:25:37.138258 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a467b695-f2c3-4b21-90e2-ebbc77d57447 admin admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:25:37.140008 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.fernet_utils [None req-a467b695-f2c3-4b21-90e2-ebbc77d57447 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:25:37.155371 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9ac74e-7894-46d0-bf26-da216e79210c service neutron] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:25:37.229138 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49df86d6-5134-473c-8280-0b665091322f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:25:37.230020 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49df86d6-5134-473c-8280-0b665091322f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:25:37.230446 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49df86d6-5134-473c-8280-0b665091322f admin admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:25:37.230730 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49df86d6-5134-473c-8280-0b665091322f admin admin] PATH_INFO: `/v3/users/1db50bb9b63041e7808134c4db955433` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:25:37.232277 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49df86d6-5134-473c-8280-0b665091322f admin admin] RBAC: Authorizing `identity:delete_user(user_id=1db50bb9b63041e7808134c4db955433)` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:25:37.234450 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49df86d6-5134-473c-8280-0b665091322f admin admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:25:37.253175 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a467b695-f2c3-4b21-90e2-ebbc77d57447 admin admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:25:37.263014 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1065c8ff-b055-464d-ae91-d91c65941acc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:25:37.264586 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1065c8ff-b055-464d-ae91-d91c65941acc admin admin] REQUEST_METHOD: `DELETE` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:25:37.265000 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1065c8ff-b055-464d-ae91-d91c65941acc admin admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:25:37.265427 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1065c8ff-b055-464d-ae91-d91c65941acc admin admin] PATH_INFO: `/v3/projects/004e21e065ae4f9da30ffbe49c85d3f3` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:25:37.267676 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1065c8ff-b055-464d-ae91-d91c65941acc admin admin] RBAC: Authorizing `identity:delete_project(project_id=004e21e065ae4f9da30ffbe49c85d3f3)` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:25:37.272966 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1065c8ff-b055-464d-ae91-d91c65941acc admin admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:25:37.331522 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-49df86d6-5134-473c-8280-0b665091322f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1db50bb9b63041e7808134c4db955433'} {{(pid=79744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:25:37.332711 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-49df86d6-5134-473c-8280-0b665091322f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1db50bb9b63041e7808134c4db955433'} {{(pid=79744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:25:37.346427 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-49df86d6-5134-473c-8280-0b665091322f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1db50bb9b63041e7808134c4db955433'} {{(pid=79744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:25:37.347401 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-49df86d6-5134-473c-8280-0b665091322f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1db50bb9b63041e7808134c4db955433'} {{(pid=79744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:25:37.359725 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-1065c8ff-b055-464d-ae91-d91c65941acc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '004e21e065ae4f9da30ffbe49c85d3f3', 'request_id': 'req-1065c8ff-b055-464d-ae91-d91c65941acc'} {{(pid=79745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:25:37.364792 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-49df86d6-5134-473c-8280-0b665091322f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1db50bb9b63041e7808134c4db955433'} {{(pid=79744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:25:37.367309 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-1065c8ff-b055-464d-ae91-d91c65941acc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '004e21e065ae4f9da30ffbe49c85d3f3', 'request_id': 'req-1065c8ff-b055-464d-ae91-d91c65941acc'} {{(pid=79745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:25:37.379497 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-1065c8ff-b055-464d-ae91-d91c65941acc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '004e21e065ae4f9da30ffbe49c85d3f3', 'request_id': 'req-1065c8ff-b055-464d-ae91-d91c65941acc'} {{(pid=79745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:25:37.399271 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-1065c8ff-b055-464d-ae91-d91c65941acc admin admin] The token cache is being invalidate because project 004e21e065ae4f9da30ffbe49c85d3f3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79745) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 07:25:37.399271 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-1065c8ff-b055-464d-ae91-d91c65941acc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:25:37.400157 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-1065c8ff-b055-464d-ae91-d91c65941acc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:25:37.403576 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 1027/2066] 10.222.0.21 () {58 vars in 1232 bytes} [Wed May 4 07:25:37 2022] DELETE /identity/v3/projects/004e21e065ae4f9da30ffbe49c85d3f3 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 07:25:37.407645 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1065c8ff-b055-464d-ae91-d91c65941acc admin admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:25:37.408027 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 1039/2066] 10.222.0.21 () {58 vars in 1223 bytes} [Wed May 4 07:25:37 2022] DELETE /identity/v3/users/1db50bb9b63041e7808134c4db955433 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 07:25:37.409942 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.fernet_utils [None req-1065c8ff-b055-464d-ae91-d91c65941acc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:25:37.515879 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1065c8ff-b055-464d-ae91-d91c65941acc admin admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:25:37.635890 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ab9f52-5f2c-4abb-be22-d1b2956290c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:25:37.637095 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ab9f52-5f2c-4abb-be22-d1b2956290c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:25:37.637095 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ab9f52-5f2c-4abb-be22-d1b2956290c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:25:37.637264 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ab9f52-5f2c-4abb-be22-d1b2956290c8 admin admin] PATH_INFO: `/v3/users/3c7110cd45954497891a52723af2714e` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:25:37.638575 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ab9f52-5f2c-4abb-be22-d1b2956290c8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3c7110cd45954497891a52723af2714e)` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:25:37.640744 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ab9f52-5f2c-4abb-be22-d1b2956290c8 admin admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:25:37.743714 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-99ab9f52-5f2c-4abb-be22-d1b2956290c8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3c7110cd45954497891a52723af2714e'} {{(pid=79745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:25:37.785152 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-99ab9f52-5f2c-4abb-be22-d1b2956290c8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3c7110cd45954497891a52723af2714e'} {{(pid=79745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:25:37.787019 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-99ab9f52-5f2c-4abb-be22-d1b2956290c8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3c7110cd45954497891a52723af2714e'} {{(pid=79745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:25:37.789081 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-99ab9f52-5f2c-4abb-be22-d1b2956290c8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3c7110cd45954497891a52723af2714e'} {{(pid=79745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:25:37.804803 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-99ab9f52-5f2c-4abb-be22-d1b2956290c8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3c7110cd45954497891a52723af2714e'} {{(pid=79745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:25:37.825594 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 1028/2067] 10.222.0.21 () {58 vars in 1223 bytes} [Wed May 4 07:25:37 2022] DELETE /identity/v3/users/3c7110cd45954497891a52723af2714e => generated 0 bytes in 419 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 07:25:37.978888 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49df86d6-5134-473c-8280-0b665091322f admin admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:25:37.980943 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.fernet_utils [None req-49df86d6-5134-473c-8280-0b665091322f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:25:37.997531 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49df86d6-5134-473c-8280-0b665091322f admin admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:25:38.133917 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700a0d09-495b-40bf-865b-4e5b11f3548d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:25:38.134808 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700a0d09-495b-40bf-865b-4e5b11f3548d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:25:38.135087 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700a0d09-495b-40bf-865b-4e5b11f3548d admin admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:25:38.135399 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700a0d09-495b-40bf-865b-4e5b11f3548d admin admin] PATH_INFO: `/v3/projects/536bacee92ba4db2ae5cd68d6709b7e7` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:25:38.136952 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700a0d09-495b-40bf-865b-4e5b11f3548d admin admin] RBAC: Authorizing `identity:delete_project(project_id=536bacee92ba4db2ae5cd68d6709b7e7)` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:25:38.139095 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700a0d09-495b-40bf-865b-4e5b11f3548d admin admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:25:38.213748 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-700a0d09-495b-40bf-865b-4e5b11f3548d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '536bacee92ba4db2ae5cd68d6709b7e7', 'request_id': 'req-700a0d09-495b-40bf-865b-4e5b11f3548d'} {{(pid=79744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:25:38.220333 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-700a0d09-495b-40bf-865b-4e5b11f3548d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '536bacee92ba4db2ae5cd68d6709b7e7', 'request_id': 'req-700a0d09-495b-40bf-865b-4e5b11f3548d'} {{(pid=79744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:25:38.237591 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-700a0d09-495b-40bf-865b-4e5b11f3548d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '536bacee92ba4db2ae5cd68d6709b7e7', 'request_id': 'req-700a0d09-495b-40bf-865b-4e5b11f3548d'} {{(pid=79744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:25:38.266077 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-700a0d09-495b-40bf-865b-4e5b11f3548d admin admin] The token cache is being invalidate because project 536bacee92ba4db2ae5cd68d6709b7e7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79744) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 07:25:38.266407 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-700a0d09-495b-40bf-865b-4e5b11f3548d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:25:38.270462 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-700a0d09-495b-40bf-865b-4e5b11f3548d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:25:38.272610 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 1040/2068] 10.222.0.21 () {58 vars in 1232 bytes} [Wed May 4 07:25:37 2022] DELETE /identity/v3/projects/536bacee92ba4db2ae5cd68d6709b7e7 => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 07:25:38.279632 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f78501-ea6b-4348-be12-9bed464cf559 None None] REQUEST_METHOD: `POST` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:25:38.279920 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f78501-ea6b-4348-be12-9bed464cf559 None None] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:25:38.280289 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f78501-ea6b-4348-be12-9bed464cf559 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:25:38.299846 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700a0d09-495b-40bf-865b-4e5b11f3548d admin admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:25:38.302351 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.fernet_utils [None req-700a0d09-495b-40bf-865b-4e5b11f3548d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:25:38.308447 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.auth.core [None req-40f78501-ea6b-4348-be12-9bed464cf559 None None] MFA Rules not processed for user `83c5e0dcb991496ea6dee38384514508`. Rule list: `[]` (Enabled: `True`). {{(pid=79745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:25:38.310058 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.fernet_utils [None req-40f78501-ea6b-4348-be12-9bed464cf559 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:25:38.418202 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 1029/2069] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 07:25:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 07:25:38.425774 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87004e7e-d14c-45fd-b960-ba9476c903fb None None] REQUEST_METHOD: `POST` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:25:38.426099 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87004e7e-d14c-45fd-b960-ba9476c903fb None None] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:25:38.426384 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87004e7e-d14c-45fd-b960-ba9476c903fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:25:38.443564 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700a0d09-495b-40bf-865b-4e5b11f3548d admin admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:25:38.452947 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952c9208-3e9c-4839-a698-db6add4a5af1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:25:38.452947 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952c9208-3e9c-4839-a698-db6add4a5af1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:25:38.452947 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952c9208-3e9c-4839-a698-db6add4a5af1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:25:38.452947 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952c9208-3e9c-4839-a698-db6add4a5af1 admin admin] PATH_INFO: `/v3/projects/af00c2881d4d4c10a698af14fa2c8370` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:25:38.453313 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952c9208-3e9c-4839-a698-db6add4a5af1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=af00c2881d4d4c10a698af14fa2c8370)` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:25:38.456479 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952c9208-3e9c-4839-a698-db6add4a5af1 admin admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:25:38.480169 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.auth.core [None req-87004e7e-d14c-45fd-b960-ba9476c903fb None None] MFA Rules not processed for user `83c5e0dcb991496ea6dee38384514508`. Rule list: `[]` (Enabled: `True`). {{(pid=79745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:25:38.481389 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.fernet_utils [None req-87004e7e-d14c-45fd-b960-ba9476c903fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:25:38.504420 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 1030/2070] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 07:25:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 07:25:38.509299 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87004e7e-d14c-45fd-b960-ba9476c903fb None None] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:25:38.529738 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87004e7e-d14c-45fd-b960-ba9476c903fb None None] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:25:38.548305 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-952c9208-3e9c-4839-a698-db6add4a5af1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'af00c2881d4d4c10a698af14fa2c8370', 'request_id': 'req-952c9208-3e9c-4839-a698-db6add4a5af1'} {{(pid=79744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:25:38.563450 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-952c9208-3e9c-4839-a698-db6add4a5af1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'af00c2881d4d4c10a698af14fa2c8370', 'request_id': 'req-952c9208-3e9c-4839-a698-db6add4a5af1'} {{(pid=79744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:25:38.582461 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-952c9208-3e9c-4839-a698-db6add4a5af1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'af00c2881d4d4c10a698af14fa2c8370', 'request_id': 'req-952c9208-3e9c-4839-a698-db6add4a5af1'} {{(pid=79744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:25:38.605285 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-952c9208-3e9c-4839-a698-db6add4a5af1 admin admin] The token cache is being invalidate because project af00c2881d4d4c10a698af14fa2c8370 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79744) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 07:25:38.605772 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-952c9208-3e9c-4839-a698-db6add4a5af1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:25:38.606673 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-952c9208-3e9c-4839-a698-db6add4a5af1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:25:38.608696 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 1041/2071] 10.222.0.21 () {58 vars in 1232 bytes} [Wed May 4 07:25:38 2022] DELETE /identity/v3/projects/af00c2881d4d4c10a698af14fa2c8370 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 07:25:38.617061 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce33ecf-c2b1-47e6-980c-b5eceb105134 None None] REQUEST_METHOD: `POST` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:25:38.617514 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce33ecf-c2b1-47e6-980c-b5eceb105134 None None] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:25:38.617786 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce33ecf-c2b1-47e6-980c-b5eceb105134 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:25:38.642345 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.auth.core [None req-1ce33ecf-c2b1-47e6-980c-b5eceb105134 None None] MFA Rules not processed for user `83c5e0dcb991496ea6dee38384514508`. Rule list: `[]` (Enabled: `True`). {{(pid=79744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:25:38.643731 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.fernet_utils [None req-1ce33ecf-c2b1-47e6-980c-b5eceb105134 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:25:38.643841 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f641b8c5-fa0a-4f6d-9e42-3a20485848f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:25:38.645116 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f641b8c5-fa0a-4f6d-9e42-3a20485848f2 admin admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:25:38.645401 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f641b8c5-fa0a-4f6d-9e42-3a20485848f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:25:38.645837 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f641b8c5-fa0a-4f6d-9e42-3a20485848f2 admin admin] PATH_INFO: `/v3/domains` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:25:38.646566 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f641b8c5-fa0a-4f6d-9e42-3a20485848f2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 07:25:38.646950 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f641b8c5-fa0a-4f6d-9e42-3a20485848f2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:25:38.649794 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f641b8c5-fa0a-4f6d-9e42-3a20485848f2 admin admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:25:38.654300 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 1042/2072] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 07:25:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 07:25:38.663210 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6baa6b06-5834-4aee-a2b0-310339b8aa70 None None] REQUEST_METHOD: `POST` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:25:38.663210 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6baa6b06-5834-4aee-a2b0-310339b8aa70 None None] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:25:38.663645 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6baa6b06-5834-4aee-a2b0-310339b8aa70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:25:38.667192 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 1031/2073] 10.222.0.21 () {58 vars in 1152 bytes} [Wed May 4 07:25:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 07:25:38.672152 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f641b8c5-fa0a-4f6d-9e42-3a20485848f2 admin admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:25:38.673914 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.fernet_utils [None req-f641b8c5-fa0a-4f6d-9e42-3a20485848f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:25:38.687790 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.auth.core [None req-6baa6b06-5834-4aee-a2b0-310339b8aa70 None None] MFA Rules not processed for user `83c5e0dcb991496ea6dee38384514508`. Rule list: `[]` (Enabled: `True`). {{(pid=79744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:25:38.689084 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.fernet_utils [None req-6baa6b06-5834-4aee-a2b0-310339b8aa70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:25:38.690363 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f641b8c5-fa0a-4f6d-9e42-3a20485848f2 admin admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:25:38.695391 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9148fd-3f66-467a-a160-6f0cb7c1b29c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:25:38.696175 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9148fd-3f66-467a-a160-6f0cb7c1b29c admin admin] REQUEST_METHOD: `POST` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:25:38.696533 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9148fd-3f66-467a-a160-6f0cb7c1b29c admin admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:25:38.696878 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9148fd-3f66-467a-a160-6f0cb7c1b29c admin admin] PATH_INFO: `/v3/projects` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:25:38.697651 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9148fd-3f66-467a-a160-6f0cb7c1b29c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:25:38.697963 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 1043/2074] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 07:25:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 07:25:38.699777 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9148fd-3f66-467a-a160-6f0cb7c1b29c admin admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:25:38.702184 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6baa6b06-5834-4aee-a2b0-310339b8aa70 None None] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:25:38.713080 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6baa6b06-5834-4aee-a2b0-310339b8aa70 None None] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:25:38.719227 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03189c29-e5f7-47e8-9808-6a0bad4b323d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:25:38.719876 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03189c29-e5f7-47e8-9808-6a0bad4b323d admin admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:25:38.720168 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03189c29-e5f7-47e8-9808-6a0bad4b323d admin admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:25:38.720573 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03189c29-e5f7-47e8-9808-6a0bad4b323d admin admin] PATH_INFO: `/v3/domains` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:25:38.721355 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03189c29-e5f7-47e8-9808-6a0bad4b323d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79744) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 07:25:38.721658 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03189c29-e5f7-47e8-9808-6a0bad4b323d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:25:38.723300 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03189c29-e5f7-47e8-9808-6a0bad4b323d admin admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:25:38.734907 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 1032/2075] 10.222.0.21 () {60 vars in 1152 bytes} [Wed May 4 07:25:38 2022] POST /identity/v3/projects => generated 385 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 07:25:38.739719 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9148fd-3f66-467a-a160-6f0cb7c1b29c admin admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:25:38.739983 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 1044/2076] 10.222.0.21 () {58 vars in 1152 bytes} [Wed May 4 07:25:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 07:25:38.742529 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03189c29-e5f7-47e8-9808-6a0bad4b323d admin admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:25:38.753911 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03189c29-e5f7-47e8-9808-6a0bad4b323d admin admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:25:38.830147 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9148fd-3f66-467a-a160-6f0cb7c1b29c admin admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:25:38.831906 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e26507-633f-47d7-ade5-c0be486eaf15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:25:38.832678 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e26507-633f-47d7-ade5-c0be486eaf15 admin admin] REQUEST_METHOD: `POST` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:25:38.833022 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e26507-633f-47d7-ade5-c0be486eaf15 admin admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:25:38.833363 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e26507-633f-47d7-ade5-c0be486eaf15 admin admin] PATH_INFO: `/v3/users` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:25:38.834066 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e26507-633f-47d7-ade5-c0be486eaf15 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:25:38.836045 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e26507-633f-47d7-ade5-c0be486eaf15 admin admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:25:38.837456 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4d1bd5-db36-4178-97ec-20082192b59d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:25:38.838125 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4d1bd5-db36-4178-97ec-20082192b59d admin admin] REQUEST_METHOD: `POST` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:25:38.838407 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4d1bd5-db36-4178-97ec-20082192b59d admin admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:25:38.838683 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4d1bd5-db36-4178-97ec-20082192b59d admin admin] PATH_INFO: `/v3/projects` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:25:38.839436 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4d1bd5-db36-4178-97ec-20082192b59d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:25:38.841484 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4d1bd5-db36-4178-97ec-20082192b59d admin admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:25:38.860352 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 1033/2077] 10.222.0.21 () {60 vars in 1143 bytes} [Wed May 4 07:25:38 2022] POST /identity/v3/users => generated 293 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 07:25:38.861700 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e26507-633f-47d7-ade5-c0be486eaf15 admin admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:25:38.873952 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 1045/2078] 10.222.0.21 () {60 vars in 1152 bytes} [Wed May 4 07:25:38 2022] POST /identity/v3/projects => generated 383 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 07:25:38.874152 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e26507-633f-47d7-ade5-c0be486eaf15 admin admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:25:38.875372 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4d1bd5-db36-4178-97ec-20082192b59d admin admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:25:38.954349 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4d9fd7-2cc7-4171-9f25-a80a67fb82ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:25:38.955025 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4d9fd7-2cc7-4171-9f25-a80a67fb82ce admin admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:25:38.955337 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4d9fd7-2cc7-4171-9f25-a80a67fb82ce admin admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:25:38.955609 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4d9fd7-2cc7-4171-9f25-a80a67fb82ce admin admin] PATH_INFO: `/v3/roles` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:25:38.956332 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4d9fd7-2cc7-4171-9f25-a80a67fb82ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:25:38.957990 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4d9fd7-2cc7-4171-9f25-a80a67fb82ce admin admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:25:38.966921 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4d1bd5-db36-4178-97ec-20082192b59d admin admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:25:38.972643 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b69f96-8e1a-4108-b69f-e594da2293b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:25:38.973339 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b69f96-8e1a-4108-b69f-e594da2293b2 admin admin] REQUEST_METHOD: `POST` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:25:38.973628 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b69f96-8e1a-4108-b69f-e594da2293b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:25:38.973902 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b69f96-8e1a-4108-b69f-e594da2293b2 admin admin] PATH_INFO: `/v3/users` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:25:38.975893 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b69f96-8e1a-4108-b69f-e594da2293b2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:25:38.976015 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 1034/2079] 10.222.0.21 () {58 vars in 1121 bytes} [Wed May 4 07:25:38 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 07:25:38.978104 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b69f96-8e1a-4108-b69f-e594da2293b2 admin admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:25:38.980360 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4d9fd7-2cc7-4171-9f25-a80a67fb82ce admin admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:25:38.998306 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4d9fd7-2cc7-4171-9f25-a80a67fb82ce admin admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:25:39.008320 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2f1c09-2575-445f-a25a-8e9609d4d5eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:25:39.009063 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2f1c09-2575-445f-a25a-8e9609d4d5eb admin admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:25:39.009484 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2f1c09-2575-445f-a25a-8e9609d4d5eb admin admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:25:39.009631 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2f1c09-2575-445f-a25a-8e9609d4d5eb admin admin] PATH_INFO: `/v3/roles` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:25:39.009788 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 1046/2080] 10.222.0.21 () {60 vars in 1143 bytes} [Wed May 4 07:25:38 2022] POST /identity/v3/users => generated 292 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 07:25:39.010342 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2f1c09-2575-445f-a25a-8e9609d4d5eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:25:39.012521 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2f1c09-2575-445f-a25a-8e9609d4d5eb admin admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:25:39.013556 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b69f96-8e1a-4108-b69f-e594da2293b2 admin admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:25:39.031449 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 1035/2081] 10.222.0.21 () {58 vars in 1121 bytes} [Wed May 4 07:25:38 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 07:25:39.031665 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b69f96-8e1a-4108-b69f-e594da2293b2 admin admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:25:39.032523 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2f1c09-2575-445f-a25a-8e9609d4d5eb admin admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:25:39.034466 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f6c45a-d193-41fe-8d9b-85cbc6f80d85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:25:39.035256 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f6c45a-d193-41fe-8d9b-85cbc6f80d85 admin admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:25:39.035667 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f6c45a-d193-41fe-8d9b-85cbc6f80d85 admin admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:25:39.036005 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f6c45a-d193-41fe-8d9b-85cbc6f80d85 admin admin] PATH_INFO: `/v3/roles` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:25:39.036801 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f6c45a-d193-41fe-8d9b-85cbc6f80d85 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:25:39.039856 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f6c45a-d193-41fe-8d9b-85cbc6f80d85 admin admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:25:39.052179 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 1047/2082] 10.222.0.21 () {58 vars in 1121 bytes} [Wed May 4 07:25:39 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 07:25:39.057079 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f6c45a-d193-41fe-8d9b-85cbc6f80d85 admin admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:25:39.058545 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2f1c09-2575-445f-a25a-8e9609d4d5eb admin admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:25:39.063349 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606ac03e-9274-473a-8795-c8e1595927da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:25:39.065063 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606ac03e-9274-473a-8795-c8e1595927da admin admin] REQUEST_METHOD: `PUT` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:25:39.065356 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606ac03e-9274-473a-8795-c8e1595927da admin admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:25:39.065635 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606ac03e-9274-473a-8795-c8e1595927da admin admin] PATH_INFO: `/v3/projects/4341dfa5947c4f77be4949f3fc5565db/users/c7369fe10fee4315be896ca97ebd26e6/roles/9f89c07b05a14f18836116af22cba5f6` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:25:39.074541 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f6c45a-d193-41fe-8d9b-85cbc6f80d85 admin admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:25:39.079660 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a626be-b8fe-47d9-85b1-aab0584dac7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:25:39.080346 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a626be-b8fe-47d9-85b1-aab0584dac7f admin admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:25:39.080623 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a626be-b8fe-47d9-85b1-aab0584dac7f admin admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:25:39.080903 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a626be-b8fe-47d9-85b1-aab0584dac7f admin admin] PATH_INFO: `/v3/roles` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:25:39.081635 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a626be-b8fe-47d9-85b1-aab0584dac7f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:25:39.083324 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a626be-b8fe-47d9-85b1-aab0584dac7f admin admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:25:39.083768 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606ac03e-9274-473a-8795-c8e1595927da admin admin] RBAC: Authorizing `identity:create_grant(project_id=4341dfa5947c4f77be4949f3fc5565db, user_id=c7369fe10fee4315be896ca97ebd26e6, role_id=9f89c07b05a14f18836116af22cba5f6)` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:25:39.087677 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606ac03e-9274-473a-8795-c8e1595927da admin admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:25:39.099312 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 1048/2083] 10.222.0.21 () {58 vars in 1121 bytes} [Wed May 4 07:25:39 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 07:25:39.100849 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a626be-b8fe-47d9-85b1-aab0584dac7f admin admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:25:39.107037 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 1036/2084] 10.222.0.21 () {60 vars in 1482 bytes} [Wed May 4 07:25:39 2022] PUT /identity/v3/projects/4341dfa5947c4f77be4949f3fc5565db/users/c7369fe10fee4315be896ca97ebd26e6/roles/9f89c07b05a14f18836116af22cba5f6 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 07:25:39.110842 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a626be-b8fe-47d9-85b1-aab0584dac7f admin admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:25:39.120126 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449762f2-2258-4eda-b21f-fc2ed4cc81da None None] REQUEST_METHOD: `POST` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:25:39.120504 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449762f2-2258-4eda-b21f-fc2ed4cc81da None None] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:25:39.120953 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449762f2-2258-4eda-b21f-fc2ed4cc81da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:25:39.158616 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.auth.core [None req-449762f2-2258-4eda-b21f-fc2ed4cc81da None None] MFA Rules not processed for user `c7369fe10fee4315be896ca97ebd26e6`. Rule list: `[]` (Enabled: `True`). {{(pid=79745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:25:39.159846 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.fernet_utils [None req-449762f2-2258-4eda-b21f-fc2ed4cc81da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:25:39.171707 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd18641-c12a-4106-be21-064cdf1387ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:25:39.172625 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd18641-c12a-4106-be21-064cdf1387ee admin admin] REQUEST_METHOD: `PUT` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:25:39.172909 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd18641-c12a-4106-be21-064cdf1387ee admin admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:25:39.173173 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd18641-c12a-4106-be21-064cdf1387ee admin admin] PATH_INFO: `/v3/projects/9d6c19afbeab426c923342ed329104c1/users/04bbe4deb2524371bfcff3d140972a89/roles/9f89c07b05a14f18836116af22cba5f6` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:25:39.188101 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd18641-c12a-4106-be21-064cdf1387ee admin admin] RBAC: Authorizing `identity:create_grant(project_id=9d6c19afbeab426c923342ed329104c1, user_id=04bbe4deb2524371bfcff3d140972a89, role_id=9f89c07b05a14f18836116af22cba5f6)` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:25:39.190761 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd18641-c12a-4106-be21-064cdf1387ee admin admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:25:39.204678 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 1049/2085] 10.222.0.21 () {60 vars in 1482 bytes} [Wed May 4 07:25:39 2022] PUT /identity/v3/projects/9d6c19afbeab426c923342ed329104c1/users/04bbe4deb2524371bfcff3d140972a89/roles/9f89c07b05a14f18836116af22cba5f6 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 07:25:39.216902 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2188bf67-1d36-47bd-bb9b-761f27a2f40f None None] REQUEST_METHOD: `POST` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:25:39.217537 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2188bf67-1d36-47bd-bb9b-761f27a2f40f None None] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:25:39.217775 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2188bf67-1d36-47bd-bb9b-761f27a2f40f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:25:39.232024 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 1037/2086] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 07:25:39 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 07:25:39.243531 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449762f2-2258-4eda-b21f-fc2ed4cc81da None None] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:25:39.244932 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.fernet_utils [None req-449762f2-2258-4eda-b21f-fc2ed4cc81da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:25:39.246490 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.auth.core [None req-2188bf67-1d36-47bd-bb9b-761f27a2f40f None None] MFA Rules not processed for user `04bbe4deb2524371bfcff3d140972a89`. Rule list: `[]` (Enabled: `True`). {{(pid=79744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:25:39.247697 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.fernet_utils [None req-2188bf67-1d36-47bd-bb9b-761f27a2f40f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:25:39.305869 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449762f2-2258-4eda-b21f-fc2ed4cc81da None None] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:25:39.320025 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 1050/2087] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 07:25:39 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 07:25:39.330924 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2188bf67-1d36-47bd-bb9b-761f27a2f40f None None] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:25:39.332410 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.fernet_utils [None req-2188bf67-1d36-47bd-bb9b-761f27a2f40f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:25:39.364231 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa452c38-5880-439a-97a1-9d9ce8d73bd5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb341257aa8246b6847561e2fe1fa385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9f9c44db4984653b8d4b5f6b3b949f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:25:39.364874 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa452c38-5880-439a-97a1-9d9ce8d73bd5 service cinder] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:25:39.365158 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa452c38-5880-439a-97a1-9d9ce8d73bd5 service cinder] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:25:39.365435 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa452c38-5880-439a-97a1-9d9ce8d73bd5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:25:39.390835 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2188bf67-1d36-47bd-bb9b-761f27a2f40f None None] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:25:39.394755 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ace84dc-9d86-44a9-bcba-0f79a25905cc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb341257aa8246b6847561e2fe1fa385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9f9c44db4984653b8d4b5f6b3b949f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:25:39.395569 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ace84dc-9d86-44a9-bcba-0f79a25905cc service cinder] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:25:39.395850 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ace84dc-9d86-44a9-bcba-0f79a25905cc service cinder] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:25:39.396120 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ace84dc-9d86-44a9-bcba-0f79a25905cc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:25:39.407072 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ace84dc-9d86-44a9-bcba-0f79a25905cc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:25:39.408577 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ace84dc-9d86-44a9-bcba-0f79a25905cc service cinder] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:25:39.419722 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 1051/2088] 10.222.0.21 () {60 vars in 1365 bytes} [Wed May 4 07:25:39 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 04 07:25:39.428424 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa452c38-5880-439a-97a1-9d9ce8d73bd5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:25:39.429971 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa452c38-5880-439a-97a1-9d9ce8d73bd5 service cinder] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:25:39.441185 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 1038/2089] 10.222.0.21 () {60 vars in 1365 bytes} [Wed May 4 07:25:39 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 04 07:25:44.109781 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ace84dc-9d86-44a9-bcba-0f79a25905cc service cinder] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:25:44.111330 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.fernet_utils [None req-2ace84dc-9d86-44a9-bcba-0f79a25905cc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:25:44.195872 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ace84dc-9d86-44a9-bcba-0f79a25905cc service cinder] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:25:44.200597 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce67424c-acda-466e-8896-22702af287f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:25:44.201506 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce67424c-acda-466e-8896-22702af287f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:25:44.201787 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce67424c-acda-466e-8896-22702af287f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:25:44.202120 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce67424c-acda-466e-8896-22702af287f1 admin admin] PATH_INFO: `/v3/users/74eff6d608bb4611bcaad61f001adfa9` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:25:44.203371 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce67424c-acda-466e-8896-22702af287f1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=74eff6d608bb4611bcaad61f001adfa9)` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:25:44.205327 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce67424c-acda-466e-8896-22702af287f1 admin admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:25:44.261363 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-ce67424c-acda-466e-8896-22702af287f1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '74eff6d608bb4611bcaad61f001adfa9'} {{(pid=79744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:25:44.262080 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-ce67424c-acda-466e-8896-22702af287f1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '74eff6d608bb4611bcaad61f001adfa9'} {{(pid=79744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:25:44.272198 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-ce67424c-acda-466e-8896-22702af287f1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '74eff6d608bb4611bcaad61f001adfa9'} {{(pid=79744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:25:44.272198 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-ce67424c-acda-466e-8896-22702af287f1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '74eff6d608bb4611bcaad61f001adfa9'} {{(pid=79744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:25:44.282788 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-ce67424c-acda-466e-8896-22702af287f1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '74eff6d608bb4611bcaad61f001adfa9'} {{(pid=79744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:25:44.296090 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 1052/2090] 10.222.0.21 () {58 vars in 1223 bytes} [Wed May 4 07:25:44 2022] DELETE /identity/v3/users/74eff6d608bb4611bcaad61f001adfa9 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 07:25:44.300981 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede108fd-8f40-4042-8e19-ed75d9c54baa None None] REQUEST_METHOD: `POST` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:25:44.301464 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede108fd-8f40-4042-8e19-ed75d9c54baa None None] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:25:44.301606 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede108fd-8f40-4042-8e19-ed75d9c54baa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:25:44.320640 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.auth.core [None req-ede108fd-8f40-4042-8e19-ed75d9c54baa None None] MFA Rules not processed for user `83c5e0dcb991496ea6dee38384514508`. Rule list: `[]` (Enabled: `True`). {{(pid=79745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:25:44.321850 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.fernet_utils [None req-ede108fd-8f40-4042-8e19-ed75d9c54baa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:25:44.386494 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 1039/2091] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 07:25:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 07:25:44.396838 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce67424c-acda-466e-8896-22702af287f1 admin admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:25:44.399185 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.fernet_utils [None req-ce67424c-acda-466e-8896-22702af287f1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:25:44.461650 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce67424c-acda-466e-8896-22702af287f1 admin admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:25:44.465337 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5cf166-7334-449b-8e86-71afc6ab1bf0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91cb92d00273402b837cb29b37325101', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9f9c44db4984653b8d4b5f6b3b949f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:25:44.465982 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5cf166-7334-449b-8e86-71afc6ab1bf0 service neutron] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:25:44.466262 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5cf166-7334-449b-8e86-71afc6ab1bf0 service neutron] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:25:44.466541 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5cf166-7334-449b-8e86-71afc6ab1bf0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:25:44.476201 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5cf166-7334-449b-8e86-71afc6ab1bf0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:25:44.477639 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5cf166-7334-449b-8e86-71afc6ab1bf0 service neutron] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:25:44.487523 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 1053/2092] 10.222.0.21 () {60 vars in 1365 bytes} [Wed May 4 07:25:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 07:25:44.777132 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede108fd-8f40-4042-8e19-ed75d9c54baa None None] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:25:44.778675 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.fernet_utils [None req-ede108fd-8f40-4042-8e19-ed75d9c54baa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:25:44.794832 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede108fd-8f40-4042-8e19-ed75d9c54baa None None] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:25:44.802026 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7a3ba8-d6df-4dd7-a838-88d953d1a24d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:25:44.802821 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7a3ba8-d6df-4dd7-a838-88d953d1a24d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:25:44.803088 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7a3ba8-d6df-4dd7-a838-88d953d1a24d admin admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:25:44.803485 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7a3ba8-d6df-4dd7-a838-88d953d1a24d admin admin] PATH_INFO: `/v3/projects/02e376ab4eb84d9e9c96767cd3f5fc17` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:25:44.805633 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7a3ba8-d6df-4dd7-a838-88d953d1a24d admin admin] RBAC: Authorizing `identity:delete_project(project_id=02e376ab4eb84d9e9c96767cd3f5fc17)` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:25:44.807612 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7a3ba8-d6df-4dd7-a838-88d953d1a24d admin admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:25:44.856117 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-fc7a3ba8-d6df-4dd7-a838-88d953d1a24d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '02e376ab4eb84d9e9c96767cd3f5fc17', 'request_id': 'req-fc7a3ba8-d6df-4dd7-a838-88d953d1a24d'} {{(pid=79745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:25:44.862188 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-fc7a3ba8-d6df-4dd7-a838-88d953d1a24d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '02e376ab4eb84d9e9c96767cd3f5fc17', 'request_id': 'req-fc7a3ba8-d6df-4dd7-a838-88d953d1a24d'} {{(pid=79745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:25:44.870987 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-fc7a3ba8-d6df-4dd7-a838-88d953d1a24d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '02e376ab4eb84d9e9c96767cd3f5fc17', 'request_id': 'req-fc7a3ba8-d6df-4dd7-a838-88d953d1a24d'} {{(pid=79745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:25:44.882265 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-fc7a3ba8-d6df-4dd7-a838-88d953d1a24d admin admin] The token cache is being invalidate because project 02e376ab4eb84d9e9c96767cd3f5fc17 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79745) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 07:25:44.882593 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-fc7a3ba8-d6df-4dd7-a838-88d953d1a24d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:25:44.883651 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-fc7a3ba8-d6df-4dd7-a838-88d953d1a24d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:25:44.885338 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 1040/2093] 10.222.0.21 () {58 vars in 1232 bytes} [Wed May 4 07:25:44 2022] DELETE /identity/v3/projects/02e376ab4eb84d9e9c96767cd3f5fc17 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 07:25:44.889509 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5cf166-7334-449b-8e86-71afc6ab1bf0 service neutron] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:25:44.899962 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5cf166-7334-449b-8e86-71afc6ab1bf0 service neutron] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:25:44.963006 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3145c30e-7e10-48a5-89ec-ccc0717ed3a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:25:44.964047 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3145c30e-7e10-48a5-89ec-ccc0717ed3a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:25:44.964340 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3145c30e-7e10-48a5-89ec-ccc0717ed3a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:25:44.964691 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3145c30e-7e10-48a5-89ec-ccc0717ed3a7 admin admin] PATH_INFO: `/v3/users/a1f42b32a9684d6b899dd50d8ffb4a30` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:25:44.965975 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3145c30e-7e10-48a5-89ec-ccc0717ed3a7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a1f42b32a9684d6b899dd50d8ffb4a30)` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:25:44.967963 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3145c30e-7e10-48a5-89ec-ccc0717ed3a7 admin admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:25:45.023676 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-3145c30e-7e10-48a5-89ec-ccc0717ed3a7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a1f42b32a9684d6b899dd50d8ffb4a30'} {{(pid=79744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:25:45.024287 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-3145c30e-7e10-48a5-89ec-ccc0717ed3a7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a1f42b32a9684d6b899dd50d8ffb4a30'} {{(pid=79744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:25:45.031545 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-3145c30e-7e10-48a5-89ec-ccc0717ed3a7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a1f42b32a9684d6b899dd50d8ffb4a30'} {{(pid=79744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:25:45.034639 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-3145c30e-7e10-48a5-89ec-ccc0717ed3a7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a1f42b32a9684d6b899dd50d8ffb4a30'} {{(pid=79744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:25:45.045525 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-3145c30e-7e10-48a5-89ec-ccc0717ed3a7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a1f42b32a9684d6b899dd50d8ffb4a30'} {{(pid=79744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:25:45.060325 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 1054/2094] 10.222.0.21 () {58 vars in 1223 bytes} [Wed May 4 07:25:44 2022] DELETE /identity/v3/users/a1f42b32a9684d6b899dd50d8ffb4a30 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 07:25:45.343177 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7a3ba8-d6df-4dd7-a838-88d953d1a24d admin admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:25:45.344610 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.fernet_utils [None req-fc7a3ba8-d6df-4dd7-a838-88d953d1a24d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:25:45.368926 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7a3ba8-d6df-4dd7-a838-88d953d1a24d admin admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:25:45.429301 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ea9f79-ddd8-4ef4-a76d-9d43c521f4c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:25:45.430073 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ea9f79-ddd8-4ef4-a76d-9d43c521f4c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:25:45.430355 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ea9f79-ddd8-4ef4-a76d-9d43c521f4c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:25:45.430631 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ea9f79-ddd8-4ef4-a76d-9d43c521f4c9 admin admin] PATH_INFO: `/v3/projects/85c766d967f94fd48b5fe101387d226c` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:25:45.433985 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ea9f79-ddd8-4ef4-a76d-9d43c521f4c9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=85c766d967f94fd48b5fe101387d226c)` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:25:45.435927 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ea9f79-ddd8-4ef4-a76d-9d43c521f4c9 admin admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:25:45.483972 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-a9ea9f79-ddd8-4ef4-a76d-9d43c521f4c9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '85c766d967f94fd48b5fe101387d226c', 'request_id': 'req-a9ea9f79-ddd8-4ef4-a76d-9d43c521f4c9'} {{(pid=79745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:25:45.490173 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-a9ea9f79-ddd8-4ef4-a76d-9d43c521f4c9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '85c766d967f94fd48b5fe101387d226c', 'request_id': 'req-a9ea9f79-ddd8-4ef4-a76d-9d43c521f4c9'} {{(pid=79745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:25:45.499229 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-a9ea9f79-ddd8-4ef4-a76d-9d43c521f4c9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '85c766d967f94fd48b5fe101387d226c', 'request_id': 'req-a9ea9f79-ddd8-4ef4-a76d-9d43c521f4c9'} {{(pid=79745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:25:45.510643 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-a9ea9f79-ddd8-4ef4-a76d-9d43c521f4c9 admin admin] The token cache is being invalidate because project 85c766d967f94fd48b5fe101387d226c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79745) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 07:25:45.510923 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-a9ea9f79-ddd8-4ef4-a76d-9d43c521f4c9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:25:45.511592 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-a9ea9f79-ddd8-4ef4-a76d-9d43c521f4c9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:25:45.513167 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 1041/2095] 10.222.0.21 () {58 vars in 1232 bytes} [Wed May 4 07:25:45 2022] DELETE /identity/v3/projects/85c766d967f94fd48b5fe101387d226c => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 07:25:45.518078 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8e05e6-ecce-46cb-885b-5fefa45b45bd None None] REQUEST_METHOD: `POST` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:25:45.518567 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8e05e6-ecce-46cb-885b-5fefa45b45bd None None] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:25:45.518658 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8e05e6-ecce-46cb-885b-5fefa45b45bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:25:45.536833 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.auth.core [None req-5d8e05e6-ecce-46cb-885b-5fefa45b45bd None None] MFA Rules not processed for user `83c5e0dcb991496ea6dee38384514508`. Rule list: `[]` (Enabled: `True`). {{(pid=79744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:25:45.538066 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.fernet_utils [None req-5d8e05e6-ecce-46cb-885b-5fefa45b45bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:25:45.596387 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 1055/2096] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 07:25:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 07:25:45.604481 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2d99e0-9fc1-464c-8668-f413d32501a5 None None] REQUEST_METHOD: `POST` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:25:45.604763 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2d99e0-9fc1-464c-8668-f413d32501a5 None None] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:25:45.605043 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2d99e0-9fc1-464c-8668-f413d32501a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:25:45.624861 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.auth.core [None req-4a2d99e0-9fc1-464c-8668-f413d32501a5 None None] MFA Rules not processed for user `83c5e0dcb991496ea6dee38384514508`. Rule list: `[]` (Enabled: `True`). {{(pid=79745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:25:45.626059 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.fernet_utils [None req-4a2d99e0-9fc1-464c-8668-f413d32501a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:25:45.635004 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 1042/2097] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 07:25:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 07:25:45.639288 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8e05e6-ecce-46cb-885b-5fefa45b45bd None None] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:25:45.649677 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8e05e6-ecce-46cb-885b-5fefa45b45bd None None] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:25:45.654287 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b8b76c-5686-4f70-bc8a-1f5c7ee7a347 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:25:45.654942 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b8b76c-5686-4f70-bc8a-1f5c7ee7a347 admin admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:25:45.655252 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b8b76c-5686-4f70-bc8a-1f5c7ee7a347 admin admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:25:45.655520 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b8b76c-5686-4f70-bc8a-1f5c7ee7a347 admin admin] PATH_INFO: `/v3/domains` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:25:45.656247 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b8b76c-5686-4f70-bc8a-1f5c7ee7a347 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79744) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 07:25:45.656545 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b8b76c-5686-4f70-bc8a-1f5c7ee7a347 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:25:45.658130 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b8b76c-5686-4f70-bc8a-1f5c7ee7a347 admin admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:25:45.671923 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 1056/2098] 10.222.0.21 () {58 vars in 1152 bytes} [Wed May 4 07:25:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 07:25:45.676229 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2d99e0-9fc1-464c-8668-f413d32501a5 None None] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:25:45.685790 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2d99e0-9fc1-464c-8668-f413d32501a5 None None] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:25:45.690380 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b1e5e8-3fb3-4968-b173-6fc6dbc2640b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:25:45.691031 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b1e5e8-3fb3-4968-b173-6fc6dbc2640b admin admin] REQUEST_METHOD: `POST` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:25:45.691347 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b1e5e8-3fb3-4968-b173-6fc6dbc2640b admin admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:25:45.691621 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b1e5e8-3fb3-4968-b173-6fc6dbc2640b admin admin] PATH_INFO: `/v3/projects` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:25:45.692333 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b1e5e8-3fb3-4968-b173-6fc6dbc2640b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:25:45.694740 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b1e5e8-3fb3-4968-b173-6fc6dbc2640b admin admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:25:45.722953 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 1043/2099] 10.222.0.21 () {60 vars in 1152 bytes} [Wed May 4 07:25:45 2022] POST /identity/v3/projects => generated 373 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 07:25:45.727047 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b8b76c-5686-4f70-bc8a-1f5c7ee7a347 admin admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:25:45.737185 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b8b76c-5686-4f70-bc8a-1f5c7ee7a347 admin admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:25:45.794869 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efddcf22-376c-4bce-9a8e-7d09271f8f89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:25:45.795575 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efddcf22-376c-4bce-9a8e-7d09271f8f89 admin admin] REQUEST_METHOD: `POST` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:25:45.795851 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efddcf22-376c-4bce-9a8e-7d09271f8f89 admin admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:25:45.796121 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efddcf22-376c-4bce-9a8e-7d09271f8f89 admin admin] PATH_INFO: `/v3/users` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:25:45.796849 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efddcf22-376c-4bce-9a8e-7d09271f8f89 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:25:45.798765 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efddcf22-376c-4bce-9a8e-7d09271f8f89 admin admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:25:45.818667 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 1057/2100] 10.222.0.21 () {60 vars in 1143 bytes} [Wed May 4 07:25:45 2022] POST /identity/v3/users => generated 287 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 07:25:45.823676 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b1e5e8-3fb3-4968-b173-6fc6dbc2640b admin admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:25:45.833962 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b1e5e8-3fb3-4968-b173-6fc6dbc2640b admin admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:25:45.838959 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93106fae-c49c-4154-b11b-2de39df3021d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:25:45.839655 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93106fae-c49c-4154-b11b-2de39df3021d admin admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:25:45.839943 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93106fae-c49c-4154-b11b-2de39df3021d admin admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:25:45.840216 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93106fae-c49c-4154-b11b-2de39df3021d admin admin] PATH_INFO: `/v3/roles` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:25:45.840948 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93106fae-c49c-4154-b11b-2de39df3021d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:25:45.842531 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93106fae-c49c-4154-b11b-2de39df3021d admin admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:25:45.853433 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 1044/2101] 10.222.0.21 () {58 vars in 1121 bytes} [Wed May 4 07:25:45 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 07:25:45.857590 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efddcf22-376c-4bce-9a8e-7d09271f8f89 admin admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:25:45.870391 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efddcf22-376c-4bce-9a8e-7d09271f8f89 admin admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:25:45.875006 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731937dd-74c4-4b68-86a4-375fcf72a96c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:25:45.875721 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731937dd-74c4-4b68-86a4-375fcf72a96c admin admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:25:45.876005 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731937dd-74c4-4b68-86a4-375fcf72a96c admin admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:25:45.876267 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731937dd-74c4-4b68-86a4-375fcf72a96c admin admin] PATH_INFO: `/v3/roles` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:25:45.876983 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731937dd-74c4-4b68-86a4-375fcf72a96c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:25:45.878604 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731937dd-74c4-4b68-86a4-375fcf72a96c admin admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:25:45.889907 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 1058/2102] 10.222.0.21 () {58 vars in 1121 bytes} [Wed May 4 07:25:45 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 07:25:45.893946 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93106fae-c49c-4154-b11b-2de39df3021d admin admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:25:45.904162 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93106fae-c49c-4154-b11b-2de39df3021d admin admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:25:45.909024 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e086c1-2ed9-41b8-a949-967b34833f9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:25:45.909904 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e086c1-2ed9-41b8-a949-967b34833f9f admin admin] REQUEST_METHOD: `PUT` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:25:45.910182 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e086c1-2ed9-41b8-a949-967b34833f9f admin admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:25:45.910455 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e086c1-2ed9-41b8-a949-967b34833f9f admin admin] PATH_INFO: `/v3/projects/86aed21cb680429fa6880678118fba02/users/1c72650a35474e37925ca6e403c65045/roles/9f89c07b05a14f18836116af22cba5f6` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:25:45.925548 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e086c1-2ed9-41b8-a949-967b34833f9f admin admin] RBAC: Authorizing `identity:create_grant(project_id=86aed21cb680429fa6880678118fba02, user_id=1c72650a35474e37925ca6e403c65045, role_id=9f89c07b05a14f18836116af22cba5f6)` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:25:45.928289 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e086c1-2ed9-41b8-a949-967b34833f9f admin admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:25:45.942080 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 1045/2103] 10.222.0.21 () {60 vars in 1482 bytes} [Wed May 4 07:25:45 2022] PUT /identity/v3/projects/86aed21cb680429fa6880678118fba02/users/1c72650a35474e37925ca6e403c65045/roles/9f89c07b05a14f18836116af22cba5f6 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 07:25:45.947952 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9878c501-f60c-4290-99fa-5043b4e0e728 None None] REQUEST_METHOD: `POST` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:25:45.948243 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9878c501-f60c-4290-99fa-5043b4e0e728 None None] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:25:45.948529 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9878c501-f60c-4290-99fa-5043b4e0e728 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:25:45.966658 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.auth.core [None req-9878c501-f60c-4290-99fa-5043b4e0e728 None None] MFA Rules not processed for user `83c5e0dcb991496ea6dee38384514508`. Rule list: `[]` (Enabled: `True`). {{(pid=79744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:25:45.967892 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.fernet_utils [None req-9878c501-f60c-4290-99fa-5043b4e0e728 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:25:46.034122 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 1059/2104] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 07:25:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 07:25:46.044104 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e086c1-2ed9-41b8-a949-967b34833f9f admin admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:25:46.054052 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.fernet_utils [None req-41e086c1-2ed9-41b8-a949-967b34833f9f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:25:46.110510 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e086c1-2ed9-41b8-a949-967b34833f9f admin admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:25:46.115166 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1943d5-cf6e-4a8a-86c2-f3ee0e8946a8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91cb92d00273402b837cb29b37325101', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9f9c44db4984653b8d4b5f6b3b949f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:25:46.116373 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1943d5-cf6e-4a8a-86c2-f3ee0e8946a8 service neutron] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:25:46.117011 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1943d5-cf6e-4a8a-86c2-f3ee0e8946a8 service neutron] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:25:46.117388 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1943d5-cf6e-4a8a-86c2-f3ee0e8946a8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:25:46.128313 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1943d5-cf6e-4a8a-86c2-f3ee0e8946a8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:25:46.130098 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1943d5-cf6e-4a8a-86c2-f3ee0e8946a8 service neutron] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:25:46.141153 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 1046/2105] 10.222.0.21 () {60 vars in 1365 bytes} [Wed May 4 07:25:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 07:25:46.805102 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38f6181-2368-4ee7-acbe-c4bdf091df50 None None] REQUEST_METHOD: `POST` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:25:46.805102 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38f6181-2368-4ee7-acbe-c4bdf091df50 None None] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:25:46.805102 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38f6181-2368-4ee7-acbe-c4bdf091df50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:25:46.835440 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.auth.core [None req-d38f6181-2368-4ee7-acbe-c4bdf091df50 None None] MFA Rules not processed for user `1c72650a35474e37925ca6e403c65045`. Rule list: `[]` (Enabled: `True`). {{(pid=79744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:25:46.836744 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.fernet_utils [None req-d38f6181-2368-4ee7-acbe-c4bdf091df50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:25:46.911467 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 1060/2106] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 07:25:46 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 07:25:46.916607 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1943d5-cf6e-4a8a-86c2-f3ee0e8946a8 service neutron] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:25:46.926626 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1943d5-cf6e-4a8a-86c2-f3ee0e8946a8 service neutron] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:25:46.932073 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aeaa105-6953-4b76-a69e-0b6d9346634b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:25:46.932724 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aeaa105-6953-4b76-a69e-0b6d9346634b admin admin] REQUEST_METHOD: `POST` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:25:46.932999 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aeaa105-6953-4b76-a69e-0b6d9346634b admin admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:25:46.933269 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aeaa105-6953-4b76-a69e-0b6d9346634b admin admin] PATH_INFO: `/v3/projects` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:25:46.933955 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aeaa105-6953-4b76-a69e-0b6d9346634b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:25:46.935885 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aeaa105-6953-4b76-a69e-0b6d9346634b admin admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:25:46.964482 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 1047/2107] 10.222.0.21 () {60 vars in 1152 bytes} [Wed May 4 07:25:46 2022] POST /identity/v3/projects => generated 371 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 07:25:46.968666 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38f6181-2368-4ee7-acbe-c4bdf091df50 None None] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:25:46.980588 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38f6181-2368-4ee7-acbe-c4bdf091df50 None None] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:25:47.040352 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67429210-3496-467f-8330-8e65e5886442 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:25:47.041027 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67429210-3496-467f-8330-8e65e5886442 admin admin] REQUEST_METHOD: `POST` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:25:47.041314 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67429210-3496-467f-8330-8e65e5886442 admin admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:25:47.041587 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67429210-3496-467f-8330-8e65e5886442 admin admin] PATH_INFO: `/v3/users` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:25:47.042281 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67429210-3496-467f-8330-8e65e5886442 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:25:47.044275 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67429210-3496-467f-8330-8e65e5886442 admin admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:25:47.068223 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 1061/2108] 10.222.0.21 () {60 vars in 1143 bytes} [Wed May 4 07:25:46 2022] POST /identity/v3/users => generated 292 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 07:25:47.070256 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aeaa105-6953-4b76-a69e-0b6d9346634b admin admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:25:47.080768 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aeaa105-6953-4b76-a69e-0b6d9346634b admin admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:25:47.086390 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1e820a-c562-461c-abbe-2e82c5e6e67c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:25:47.087056 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1e820a-c562-461c-abbe-2e82c5e6e67c admin admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:25:47.087369 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1e820a-c562-461c-abbe-2e82c5e6e67c admin admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:25:47.087643 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1e820a-c562-461c-abbe-2e82c5e6e67c admin admin] PATH_INFO: `/v3/roles` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:25:47.088372 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1e820a-c562-461c-abbe-2e82c5e6e67c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:25:47.089958 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1e820a-c562-461c-abbe-2e82c5e6e67c admin admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:25:47.100856 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 1048/2109] 10.222.0.21 () {58 vars in 1121 bytes} [Wed May 4 07:25:47 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 07:25:47.105276 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67429210-3496-467f-8330-8e65e5886442 admin admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:25:47.116035 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67429210-3496-467f-8330-8e65e5886442 admin admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:25:47.121191 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6338657-3610-4ad9-8918-4cc2063e5321 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:25:47.122203 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6338657-3610-4ad9-8918-4cc2063e5321 admin admin] REQUEST_METHOD: `PUT` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:25:47.122536 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6338657-3610-4ad9-8918-4cc2063e5321 admin admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:25:47.122904 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6338657-3610-4ad9-8918-4cc2063e5321 admin admin] PATH_INFO: `/v3/projects/b132b82bfd264245ba162acfb7adfe6e/users/300b4fbeff694924b1fe1dfebfbfc766/roles/eb54c9cea2774a25b1fe8c79724408ee` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:25:47.148396 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6338657-3610-4ad9-8918-4cc2063e5321 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b132b82bfd264245ba162acfb7adfe6e, user_id=300b4fbeff694924b1fe1dfebfbfc766, role_id=eb54c9cea2774a25b1fe8c79724408ee)` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:25:47.151103 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6338657-3610-4ad9-8918-4cc2063e5321 admin admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:25:47.164025 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 1062/2110] 10.222.0.21 () {60 vars in 1482 bytes} [Wed May 4 07:25:47 2022] PUT /identity/v3/projects/b132b82bfd264245ba162acfb7adfe6e/users/300b4fbeff694924b1fe1dfebfbfc766/roles/eb54c9cea2774a25b1fe8c79724408ee => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 07:25:47.168818 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1e820a-c562-461c-abbe-2e82c5e6e67c admin admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:25:47.178779 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1e820a-c562-461c-abbe-2e82c5e6e67c admin admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:25:47.237117 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83dc1676-9dc6-405f-aed8-2bc6b1084055 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:25:47.237785 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83dc1676-9dc6-405f-aed8-2bc6b1084055 admin admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:25:47.238067 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83dc1676-9dc6-405f-aed8-2bc6b1084055 admin admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:25:47.238340 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83dc1676-9dc6-405f-aed8-2bc6b1084055 admin admin] PATH_INFO: `/v3/roles` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:25:47.239061 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83dc1676-9dc6-405f-aed8-2bc6b1084055 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:25:47.240722 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83dc1676-9dc6-405f-aed8-2bc6b1084055 admin admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:25:47.251033 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 1049/2111] 10.222.0.21 () {58 vars in 1121 bytes} [Wed May 4 07:25:47 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 07:25:47.257126 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6338657-3610-4ad9-8918-4cc2063e5321 admin admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:25:47.268277 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6338657-3610-4ad9-8918-4cc2063e5321 admin admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:25:47.273556 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebcd4944-6a53-4a31-b219-ec7c007ec58e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:25:47.274440 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcd4944-6a53-4a31-b219-ec7c007ec58e admin admin] REQUEST_METHOD: `PUT` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:25:47.274716 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcd4944-6a53-4a31-b219-ec7c007ec58e admin admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:25:47.274986 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcd4944-6a53-4a31-b219-ec7c007ec58e admin admin] PATH_INFO: `/v3/projects/b132b82bfd264245ba162acfb7adfe6e/users/300b4fbeff694924b1fe1dfebfbfc766/roles/eb54c9cea2774a25b1fe8c79724408ee` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:25:47.277943 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebcd4944-6a53-4a31-b219-ec7c007ec58e admin admin] RBAC: Authorizing `identity:create_grant(project_id=b132b82bfd264245ba162acfb7adfe6e, user_id=300b4fbeff694924b1fe1dfebfbfc766, role_id=eb54c9cea2774a25b1fe8c79724408ee)` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:25:47.281285 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebcd4944-6a53-4a31-b219-ec7c007ec58e admin admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:25:47.292926 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 1063/2112] 10.222.0.21 () {60 vars in 1482 bytes} [Wed May 4 07:25:47 2022] PUT /identity/v3/projects/b132b82bfd264245ba162acfb7adfe6e/users/300b4fbeff694924b1fe1dfebfbfc766/roles/eb54c9cea2774a25b1fe8c79724408ee => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 07:25:48.009181 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583c7f9b-8a14-487a-83e5-d1e0a4d358df None None] REQUEST_METHOD: `POST` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:25:48.009726 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583c7f9b-8a14-487a-83e5-d1e0a4d358df None None] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:25:48.009726 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583c7f9b-8a14-487a-83e5-d1e0a4d358df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:25:48.041149 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.auth.core [None req-583c7f9b-8a14-487a-83e5-d1e0a4d358df None None] MFA Rules not processed for user `300b4fbeff694924b1fe1dfebfbfc766`. Rule list: `[]` (Enabled: `True`). {{(pid=79745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:25:48.042362 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.fernet_utils [None req-583c7f9b-8a14-487a-83e5-d1e0a4d358df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:25:48.152031 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 1050/2113] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 07:25:48 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 07:25:48.164724 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebcd4944-6a53-4a31-b219-ec7c007ec58e admin admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:25:48.167001 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.fernet_utils [None req-ebcd4944-6a53-4a31-b219-ec7c007ec58e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:25:48.238304 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebcd4944-6a53-4a31-b219-ec7c007ec58e admin admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:25:48.242913 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817e30e7-5099-42e1-b5e7-b2b31ea10db6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb341257aa8246b6847561e2fe1fa385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9f9c44db4984653b8d4b5f6b3b949f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:25:48.243601 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817e30e7-5099-42e1-b5e7-b2b31ea10db6 service cinder] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:25:48.243884 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817e30e7-5099-42e1-b5e7-b2b31ea10db6 service cinder] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:25:48.244158 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817e30e7-5099-42e1-b5e7-b2b31ea10db6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:25:48.309470 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817e30e7-5099-42e1-b5e7-b2b31ea10db6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:25:48.310910 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817e30e7-5099-42e1-b5e7-b2b31ea10db6 service cinder] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:25:48.324156 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 1064/2114] 10.222.0.21 () {60 vars in 1365 bytes} [Wed May 4 07:25:48 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 04 07:25:49.637454 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583c7f9b-8a14-487a-83e5-d1e0a4d358df None None] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:25:49.639027 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.fernet_utils [None req-583c7f9b-8a14-487a-83e5-d1e0a4d358df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:25:49.703654 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583c7f9b-8a14-487a-83e5-d1e0a4d358df None None] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:25:49.708199 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b29729-f3a2-473f-a4a2-22d8c74a92d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:25:49.708999 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b29729-f3a2-473f-a4a2-22d8c74a92d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:25:49.709276 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b29729-f3a2-473f-a4a2-22d8c74a92d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:25:49.709623 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b29729-f3a2-473f-a4a2-22d8c74a92d7 admin admin] PATH_INFO: `/v3/users/c7369fe10fee4315be896ca97ebd26e6` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:25:49.710828 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b29729-f3a2-473f-a4a2-22d8c74a92d7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c7369fe10fee4315be896ca97ebd26e6)` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:25:49.712774 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b29729-f3a2-473f-a4a2-22d8c74a92d7 admin admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:25:49.779976 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-19b29729-f3a2-473f-a4a2-22d8c74a92d7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c7369fe10fee4315be896ca97ebd26e6'} {{(pid=79745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:25:49.792622 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-19b29729-f3a2-473f-a4a2-22d8c74a92d7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c7369fe10fee4315be896ca97ebd26e6'} {{(pid=79745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:25:49.793380 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-19b29729-f3a2-473f-a4a2-22d8c74a92d7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c7369fe10fee4315be896ca97ebd26e6'} {{(pid=79745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:25:49.793988 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-19b29729-f3a2-473f-a4a2-22d8c74a92d7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c7369fe10fee4315be896ca97ebd26e6'} {{(pid=79745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:25:49.800902 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-19b29729-f3a2-473f-a4a2-22d8c74a92d7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c7369fe10fee4315be896ca97ebd26e6'} {{(pid=79745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:25:49.814407 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 1051/2115] 10.222.0.21 () {58 vars in 1223 bytes} [Wed May 4 07:25:49 2022] DELETE /identity/v3/users/c7369fe10fee4315be896ca97ebd26e6 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 07:25:49.819650 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e552d7-a08b-4a89-90d3-93ecd4faa5e4 None None] REQUEST_METHOD: `POST` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:25:49.820397 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e552d7-a08b-4a89-90d3-93ecd4faa5e4 None None] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:25:49.820600 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e552d7-a08b-4a89-90d3-93ecd4faa5e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:25:49.839594 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.auth.core [None req-32e552d7-a08b-4a89-90d3-93ecd4faa5e4 None None] MFA Rules not processed for user `83c5e0dcb991496ea6dee38384514508`. Rule list: `[]` (Enabled: `True`). {{(pid=79744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:25:49.840839 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.fernet_utils [None req-32e552d7-a08b-4a89-90d3-93ecd4faa5e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:25:49.907909 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 1065/2116] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 07:25:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 07:25:49.918668 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b29729-f3a2-473f-a4a2-22d8c74a92d7 admin admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:25:49.920125 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.fernet_utils [None req-19b29729-f3a2-473f-a4a2-22d8c74a92d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:25:49.985661 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b29729-f3a2-473f-a4a2-22d8c74a92d7 admin admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:25:49.993541 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b485f1b-0a05-4198-822b-4bb18027517e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91cb92d00273402b837cb29b37325101', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9f9c44db4984653b8d4b5f6b3b949f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:25:49.994205 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b485f1b-0a05-4198-822b-4bb18027517e service neutron] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:25:49.994565 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b485f1b-0a05-4198-822b-4bb18027517e service neutron] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:25:49.994782 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b485f1b-0a05-4198-822b-4bb18027517e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:25:50.005804 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b485f1b-0a05-4198-822b-4bb18027517e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:25:50.008526 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b485f1b-0a05-4198-822b-4bb18027517e service neutron] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:25:50.024147 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 1052/2117] 10.222.0.21 () {60 vars in 1365 bytes} [Wed May 4 07:25:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 04 07:25:50.414885 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e552d7-a08b-4a89-90d3-93ecd4faa5e4 None None] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:25:50.416865 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.fernet_utils [None req-32e552d7-a08b-4a89-90d3-93ecd4faa5e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:25:50.434087 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e552d7-a08b-4a89-90d3-93ecd4faa5e4 None None] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:25:50.446470 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82cf93eb-fe01-4e07-9a64-ed5fa4fac59d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:25:50.447651 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cf93eb-fe01-4e07-9a64-ed5fa4fac59d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:25:50.448014 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cf93eb-fe01-4e07-9a64-ed5fa4fac59d admin admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:25:50.448295 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cf93eb-fe01-4e07-9a64-ed5fa4fac59d admin admin] PATH_INFO: `/v3/projects/4341dfa5947c4f77be4949f3fc5565db` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:25:50.449931 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82cf93eb-fe01-4e07-9a64-ed5fa4fac59d admin admin] RBAC: Authorizing `identity:delete_project(project_id=4341dfa5947c4f77be4949f3fc5565db)` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:25:50.452254 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82cf93eb-fe01-4e07-9a64-ed5fa4fac59d admin admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:25:50.512502 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-82cf93eb-fe01-4e07-9a64-ed5fa4fac59d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4341dfa5947c4f77be4949f3fc5565db', 'request_id': 'req-82cf93eb-fe01-4e07-9a64-ed5fa4fac59d'} {{(pid=79744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:25:50.517670 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-82cf93eb-fe01-4e07-9a64-ed5fa4fac59d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4341dfa5947c4f77be4949f3fc5565db', 'request_id': 'req-82cf93eb-fe01-4e07-9a64-ed5fa4fac59d'} {{(pid=79744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:25:50.525163 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-82cf93eb-fe01-4e07-9a64-ed5fa4fac59d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4341dfa5947c4f77be4949f3fc5565db', 'request_id': 'req-82cf93eb-fe01-4e07-9a64-ed5fa4fac59d'} {{(pid=79744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:25:50.537018 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-82cf93eb-fe01-4e07-9a64-ed5fa4fac59d admin admin] The token cache is being invalidate because project 4341dfa5947c4f77be4949f3fc5565db was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79744) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 07:25:50.537316 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-82cf93eb-fe01-4e07-9a64-ed5fa4fac59d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:25:50.537996 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-82cf93eb-fe01-4e07-9a64-ed5fa4fac59d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:25:50.539604 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 1066/2118] 10.222.0.21 () {58 vars in 1232 bytes} [Wed May 4 07:25:50 2022] DELETE /identity/v3/projects/4341dfa5947c4f77be4949f3fc5565db => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 07:25:50.834276 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b485f1b-0a05-4198-822b-4bb18027517e service neutron] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:25:50.835772 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.fernet_utils [None req-4b485f1b-0a05-4198-822b-4bb18027517e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:25:50.895624 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b485f1b-0a05-4198-822b-4bb18027517e service neutron] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:25:50.952238 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1137e4b3-7b7b-478f-abee-7dbdec98e7a9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb341257aa8246b6847561e2fe1fa385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9f9c44db4984653b8d4b5f6b3b949f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:25:50.952889 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1137e4b3-7b7b-478f-abee-7dbdec98e7a9 service cinder] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:25:50.953175 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1137e4b3-7b7b-478f-abee-7dbdec98e7a9 service cinder] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:25:50.953476 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1137e4b3-7b7b-478f-abee-7dbdec98e7a9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:25:50.955338 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.fernet_utils [None req-1137e4b3-7b7b-478f-abee-7dbdec98e7a9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:25:51.019375 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1137e4b3-7b7b-478f-abee-7dbdec98e7a9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:25:51.020826 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1137e4b3-7b7b-478f-abee-7dbdec98e7a9 service cinder] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:25:51.033150 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 1053/2119] 10.222.0.21 () {60 vars in 1365 bytes} [Wed May 4 07:25:50 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 07:25:52.624096 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82cf93eb-fe01-4e07-9a64-ed5fa4fac59d admin admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:25:52.626380 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.fernet_utils [None req-82cf93eb-fe01-4e07-9a64-ed5fa4fac59d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:25:52.722933 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82cf93eb-fe01-4e07-9a64-ed5fa4fac59d admin admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:25:52.728397 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888c2897-fc10-46ff-aad2-479badf826b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:25:52.729256 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888c2897-fc10-46ff-aad2-479badf826b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:25:52.729493 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888c2897-fc10-46ff-aad2-479badf826b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:25:52.730119 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888c2897-fc10-46ff-aad2-479badf826b1 admin admin] PATH_INFO: `/v3/users/04bbe4deb2524371bfcff3d140972a89` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:25:52.731522 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888c2897-fc10-46ff-aad2-479badf826b1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=04bbe4deb2524371bfcff3d140972a89)` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:25:52.733784 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888c2897-fc10-46ff-aad2-479badf826b1 admin admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:25:52.786779 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-888c2897-fc10-46ff-aad2-479badf826b1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '04bbe4deb2524371bfcff3d140972a89'} {{(pid=79744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:25:52.787831 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-888c2897-fc10-46ff-aad2-479badf826b1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '04bbe4deb2524371bfcff3d140972a89'} {{(pid=79744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:25:52.794646 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-888c2897-fc10-46ff-aad2-479badf826b1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '04bbe4deb2524371bfcff3d140972a89'} {{(pid=79744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:25:52.795782 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-888c2897-fc10-46ff-aad2-479badf826b1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '04bbe4deb2524371bfcff3d140972a89'} {{(pid=79744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:25:52.811125 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-888c2897-fc10-46ff-aad2-479badf826b1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '04bbe4deb2524371bfcff3d140972a89'} {{(pid=79744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:25:52.836741 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 1067/2120] 10.222.0.21 () {58 vars in 1223 bytes} [Wed May 4 07:25:52 2022] DELETE /identity/v3/users/04bbe4deb2524371bfcff3d140972a89 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 07:25:52.841294 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421352c5-2bd6-4fe9-a37c-4eb5fbf94722 None None] REQUEST_METHOD: `POST` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:25:52.841842 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421352c5-2bd6-4fe9-a37c-4eb5fbf94722 None None] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:25:52.841842 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421352c5-2bd6-4fe9-a37c-4eb5fbf94722 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:25:52.859230 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.auth.core [None req-421352c5-2bd6-4fe9-a37c-4eb5fbf94722 None None] MFA Rules not processed for user `83c5e0dcb991496ea6dee38384514508`. Rule list: `[]` (Enabled: `True`). {{(pid=79745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:25:52.860432 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.fernet_utils [None req-421352c5-2bd6-4fe9-a37c-4eb5fbf94722 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:25:52.938027 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 1054/2121] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 07:25:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 07:25:52.947992 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888c2897-fc10-46ff-aad2-479badf826b1 admin admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:25:52.949570 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.fernet_utils [None req-888c2897-fc10-46ff-aad2-479badf826b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:25:53.013145 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888c2897-fc10-46ff-aad2-479badf826b1 admin admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:25:53.017040 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb73172-66db-4f0f-a1a6-bff9f5c569a9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91cb92d00273402b837cb29b37325101', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9f9c44db4984653b8d4b5f6b3b949f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:25:53.017705 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb73172-66db-4f0f-a1a6-bff9f5c569a9 service neutron] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:25:53.018003 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb73172-66db-4f0f-a1a6-bff9f5c569a9 service neutron] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:25:53.018426 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb73172-66db-4f0f-a1a6-bff9f5c569a9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:25:53.028797 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb73172-66db-4f0f-a1a6-bff9f5c569a9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:25:53.030371 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb73172-66db-4f0f-a1a6-bff9f5c569a9 service neutron] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:25:53.042233 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 1068/2122] 10.222.0.21 () {60 vars in 1365 bytes} [Wed May 4 07:25:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 04 07:25:53.393173 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421352c5-2bd6-4fe9-a37c-4eb5fbf94722 None None] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:25:53.394652 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.fernet_utils [None req-421352c5-2bd6-4fe9-a37c-4eb5fbf94722 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:25:53.411851 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421352c5-2bd6-4fe9-a37c-4eb5fbf94722 None None] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:25:53.417041 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4d7c7b-fd6a-45ee-a9f6-017e138eef49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:25:53.417951 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4d7c7b-fd6a-45ee-a9f6-017e138eef49 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:25:53.418179 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4d7c7b-fd6a-45ee-a9f6-017e138eef49 admin admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:25:53.418454 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4d7c7b-fd6a-45ee-a9f6-017e138eef49 admin admin] PATH_INFO: `/v3/projects/9d6c19afbeab426c923342ed329104c1` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:25:53.419806 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4d7c7b-fd6a-45ee-a9f6-017e138eef49 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9d6c19afbeab426c923342ed329104c1)` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:25:53.421602 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4d7c7b-fd6a-45ee-a9f6-017e138eef49 admin admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:25:53.477668 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-1f4d7c7b-fd6a-45ee-a9f6-017e138eef49 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9d6c19afbeab426c923342ed329104c1', 'request_id': 'req-1f4d7c7b-fd6a-45ee-a9f6-017e138eef49'} {{(pid=79745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:25:53.483757 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-1f4d7c7b-fd6a-45ee-a9f6-017e138eef49 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9d6c19afbeab426c923342ed329104c1', 'request_id': 'req-1f4d7c7b-fd6a-45ee-a9f6-017e138eef49'} {{(pid=79745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:25:53.492288 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-1f4d7c7b-fd6a-45ee-a9f6-017e138eef49 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9d6c19afbeab426c923342ed329104c1', 'request_id': 'req-1f4d7c7b-fd6a-45ee-a9f6-017e138eef49'} {{(pid=79745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:25:53.503342 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-1f4d7c7b-fd6a-45ee-a9f6-017e138eef49 admin admin] The token cache is being invalidate because project 9d6c19afbeab426c923342ed329104c1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79745) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 07:25:53.503628 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-1f4d7c7b-fd6a-45ee-a9f6-017e138eef49 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:25:53.504526 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-1f4d7c7b-fd6a-45ee-a9f6-017e138eef49 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:25:53.506080 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 1055/2123] 10.222.0.21 () {58 vars in 1232 bytes} [Wed May 4 07:25:53 2022] DELETE /identity/v3/projects/9d6c19afbeab426c923342ed329104c1 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 07:25:53.511634 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602d39e6-caae-4dd8-9256-9ae4c42594de None None] REQUEST_METHOD: `POST` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:25:53.511970 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602d39e6-caae-4dd8-9256-9ae4c42594de None None] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:25:53.512276 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602d39e6-caae-4dd8-9256-9ae4c42594de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:25:53.530353 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.auth.core [None req-602d39e6-caae-4dd8-9256-9ae4c42594de None None] MFA Rules not processed for user `83c5e0dcb991496ea6dee38384514508`. Rule list: `[]` (Enabled: `True`). {{(pid=79744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:25:53.531743 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.fernet_utils [None req-602d39e6-caae-4dd8-9256-9ae4c42594de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:25:53.592049 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 1069/2124] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 07:25:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 07:25:53.599884 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb65ec7-8398-4741-9667-529fb8a2f009 None None] REQUEST_METHOD: `POST` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:25:53.600442 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb65ec7-8398-4741-9667-529fb8a2f009 None None] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:25:53.600561 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb65ec7-8398-4741-9667-529fb8a2f009 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:25:53.619318 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.auth.core [None req-fbb65ec7-8398-4741-9667-529fb8a2f009 None None] MFA Rules not processed for user `83c5e0dcb991496ea6dee38384514508`. Rule list: `[]` (Enabled: `True`). {{(pid=79745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:25:53.620520 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.fernet_utils [None req-fbb65ec7-8398-4741-9667-529fb8a2f009 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:25:53.628574 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 1056/2125] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 07:25:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 07:25:53.633888 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602d39e6-caae-4dd8-9256-9ae4c42594de None None] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:25:53.644009 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602d39e6-caae-4dd8-9256-9ae4c42594de None None] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:25:53.649379 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e530b8d8-2aed-44ce-b548-8da0a75d943d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:25:53.650040 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e530b8d8-2aed-44ce-b548-8da0a75d943d admin admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:25:53.650325 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e530b8d8-2aed-44ce-b548-8da0a75d943d admin admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:25:53.650638 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e530b8d8-2aed-44ce-b548-8da0a75d943d admin admin] PATH_INFO: `/v3/domains` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:25:53.651402 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e530b8d8-2aed-44ce-b548-8da0a75d943d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79744) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 07:25:53.651713 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e530b8d8-2aed-44ce-b548-8da0a75d943d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:25:53.653320 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e530b8d8-2aed-44ce-b548-8da0a75d943d admin admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:25:53.665929 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 1070/2126] 10.222.0.21 () {58 vars in 1152 bytes} [Wed May 4 07:25:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 07:25:53.670673 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb65ec7-8398-4741-9667-529fb8a2f009 None None] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:25:53.680627 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb65ec7-8398-4741-9667-529fb8a2f009 None None] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:25:53.685423 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90553d1-d866-40b9-93eb-24d77bc0e529 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:25:53.686069 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90553d1-d866-40b9-93eb-24d77bc0e529 admin admin] REQUEST_METHOD: `POST` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:25:53.686345 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90553d1-d866-40b9-93eb-24d77bc0e529 admin admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:25:53.686701 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90553d1-d866-40b9-93eb-24d77bc0e529 admin admin] PATH_INFO: `/v3/projects` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:25:53.687427 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90553d1-d866-40b9-93eb-24d77bc0e529 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:25:53.689317 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90553d1-d866-40b9-93eb-24d77bc0e529 admin admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:25:53.726260 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 1057/2127] 10.222.0.21 () {60 vars in 1152 bytes} [Wed May 4 07:25:53 2022] POST /identity/v3/projects => generated 377 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 07:25:53.730437 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e530b8d8-2aed-44ce-b548-8da0a75d943d admin admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:25:53.748771 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e530b8d8-2aed-44ce-b548-8da0a75d943d admin admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:25:53.808142 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50cb5865-ae54-4d99-a265-3cbce72b0a47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:25:53.808818 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cb5865-ae54-4d99-a265-3cbce72b0a47 admin admin] REQUEST_METHOD: `POST` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:25:53.809122 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cb5865-ae54-4d99-a265-3cbce72b0a47 admin admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:25:53.809394 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cb5865-ae54-4d99-a265-3cbce72b0a47 admin admin] PATH_INFO: `/v3/users` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:25:53.810106 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50cb5865-ae54-4d99-a265-3cbce72b0a47 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:25:53.812152 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50cb5865-ae54-4d99-a265-3cbce72b0a47 admin admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:25:53.840283 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 1071/2128] 10.222.0.21 () {60 vars in 1143 bytes} [Wed May 4 07:25:53 2022] POST /identity/v3/users => generated 289 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 07:25:53.845835 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90553d1-d866-40b9-93eb-24d77bc0e529 admin admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:25:53.856930 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90553d1-d866-40b9-93eb-24d77bc0e529 admin admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:25:53.864176 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd71b8ec-5b72-4c42-9be4-ca5b6deec66e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:25:53.864842 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd71b8ec-5b72-4c42-9be4-ca5b6deec66e admin admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:25:53.865116 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd71b8ec-5b72-4c42-9be4-ca5b6deec66e admin admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:25:53.865385 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd71b8ec-5b72-4c42-9be4-ca5b6deec66e admin admin] PATH_INFO: `/v3/roles` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:25:53.866168 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd71b8ec-5b72-4c42-9be4-ca5b6deec66e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:25:53.867805 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd71b8ec-5b72-4c42-9be4-ca5b6deec66e admin admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:25:53.878630 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 1058/2129] 10.222.0.21 () {58 vars in 1121 bytes} [Wed May 4 07:25:53 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 04 07:25:53.883494 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50cb5865-ae54-4d99-a265-3cbce72b0a47 admin admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:25:53.893407 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50cb5865-ae54-4d99-a265-3cbce72b0a47 admin admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:25:53.898692 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469dcc32-38c0-4870-b3cf-67caa9ea8195 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:25:53.899381 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469dcc32-38c0-4870-b3cf-67caa9ea8195 admin admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:25:53.899660 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469dcc32-38c0-4870-b3cf-67caa9ea8195 admin admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:25:53.899954 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469dcc32-38c0-4870-b3cf-67caa9ea8195 admin admin] PATH_INFO: `/v3/roles` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:25:53.900675 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469dcc32-38c0-4870-b3cf-67caa9ea8195 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:25:53.902252 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469dcc32-38c0-4870-b3cf-67caa9ea8195 admin admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:25:53.912734 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 1072/2130] 10.222.0.21 () {58 vars in 1121 bytes} [Wed May 4 07:25:53 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 07:25:53.917480 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd71b8ec-5b72-4c42-9be4-ca5b6deec66e admin admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:25:53.930364 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd71b8ec-5b72-4c42-9be4-ca5b6deec66e admin admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:25:53.935139 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd432ad3-b98b-4547-af80-1bbc4a77725f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:25:53.936052 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd432ad3-b98b-4547-af80-1bbc4a77725f admin admin] REQUEST_METHOD: `PUT` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:25:53.936333 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd432ad3-b98b-4547-af80-1bbc4a77725f admin admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:25:53.936612 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd432ad3-b98b-4547-af80-1bbc4a77725f admin admin] PATH_INFO: `/v3/projects/bc5d1b51715a4385ac1f4aa55dde4970/users/744bd376cf784021affcd744d392ef88/roles/9f89c07b05a14f18836116af22cba5f6` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:25:53.952690 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd432ad3-b98b-4547-af80-1bbc4a77725f admin admin] RBAC: Authorizing `identity:create_grant(project_id=bc5d1b51715a4385ac1f4aa55dde4970, user_id=744bd376cf784021affcd744d392ef88, role_id=9f89c07b05a14f18836116af22cba5f6)` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:25:53.956864 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd432ad3-b98b-4547-af80-1bbc4a77725f admin admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:25:53.971632 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 1059/2131] 10.222.0.21 () {60 vars in 1482 bytes} [Wed May 4 07:25:53 2022] PUT /identity/v3/projects/bc5d1b51715a4385ac1f4aa55dde4970/users/744bd376cf784021affcd744d392ef88/roles/9f89c07b05a14f18836116af22cba5f6 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 07:25:53.988312 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3337158f-15a1-4c56-a935-2ce878fa7796 None None] REQUEST_METHOD: `POST` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:25:53.988602 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3337158f-15a1-4c56-a935-2ce878fa7796 None None] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:25:53.989058 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3337158f-15a1-4c56-a935-2ce878fa7796 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:25:54.018900 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.auth.core [None req-3337158f-15a1-4c56-a935-2ce878fa7796 None None] MFA Rules not processed for user `744bd376cf784021affcd744d392ef88`. Rule list: `[]` (Enabled: `True`). {{(pid=79744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:25:54.020221 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.fernet_utils [None req-3337158f-15a1-4c56-a935-2ce878fa7796 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:25:54.086613 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 1073/2132] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 07:25:53 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 07:25:54.097874 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd432ad3-b98b-4547-af80-1bbc4a77725f admin admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:25:54.099636 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.fernet_utils [None req-fd432ad3-b98b-4547-af80-1bbc4a77725f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:25:54.161741 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd432ad3-b98b-4547-af80-1bbc4a77725f admin admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:25:54.166660 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea53a3bb-00d2-4193-ad94-9e08ecfaa5bb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb341257aa8246b6847561e2fe1fa385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9f9c44db4984653b8d4b5f6b3b949f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:25:54.167412 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea53a3bb-00d2-4193-ad94-9e08ecfaa5bb service cinder] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:25:54.167864 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea53a3bb-00d2-4193-ad94-9e08ecfaa5bb service cinder] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:25:54.168134 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea53a3bb-00d2-4193-ad94-9e08ecfaa5bb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:25:54.177367 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea53a3bb-00d2-4193-ad94-9e08ecfaa5bb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:25:54.179048 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea53a3bb-00d2-4193-ad94-9e08ecfaa5bb service cinder] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:25:54.195669 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 1060/2133] 10.222.0.21 () {60 vars in 1365 bytes} [Wed May 4 07:25:54 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 07:26:06.096210 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3337158f-15a1-4c56-a935-2ce878fa7796 None None] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:26:06.101215 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.fernet_utils [None req-3337158f-15a1-4c56-a935-2ce878fa7796 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:26:06.281889 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3337158f-15a1-4c56-a935-2ce878fa7796 None None] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:26:06.287488 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9556804c-efd0-4b71-aec2-aef29a2a6065 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:26:06.288881 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9556804c-efd0-4b71-aec2-aef29a2a6065 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:26:06.289320 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9556804c-efd0-4b71-aec2-aef29a2a6065 admin admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:26:06.289659 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9556804c-efd0-4b71-aec2-aef29a2a6065 admin admin] PATH_INFO: `/v3/users/9d6690ce7a1448a7b10e619bfddee852` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:26:06.291083 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9556804c-efd0-4b71-aec2-aef29a2a6065 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9d6690ce7a1448a7b10e619bfddee852)` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:26:06.293122 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9556804c-efd0-4b71-aec2-aef29a2a6065 admin admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:26:06.351929 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-9556804c-efd0-4b71-aec2-aef29a2a6065 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9d6690ce7a1448a7b10e619bfddee852'} {{(pid=79744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:26:06.352619 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-9556804c-efd0-4b71-aec2-aef29a2a6065 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9d6690ce7a1448a7b10e619bfddee852'} {{(pid=79744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:26:06.361505 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-9556804c-efd0-4b71-aec2-aef29a2a6065 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9d6690ce7a1448a7b10e619bfddee852'} {{(pid=79744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:26:06.362743 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-9556804c-efd0-4b71-aec2-aef29a2a6065 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9d6690ce7a1448a7b10e619bfddee852'} {{(pid=79744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:26:06.376536 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-9556804c-efd0-4b71-aec2-aef29a2a6065 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9d6690ce7a1448a7b10e619bfddee852'} {{(pid=79744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:26:06.392015 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 1074/2134] 10.222.0.21 () {58 vars in 1223 bytes} [Wed May 4 07:26:06 2022] DELETE /identity/v3/users/9d6690ce7a1448a7b10e619bfddee852 => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 07:26:06.396051 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea53a3bb-00d2-4193-ad94-9e08ecfaa5bb service cinder] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:26:06.398245 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.fernet_utils [None req-ea53a3bb-00d2-4193-ad94-9e08ecfaa5bb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:26:06.435780 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea53a3bb-00d2-4193-ad94-9e08ecfaa5bb service cinder] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:26:06.503750 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e476fb-ab1a-4f54-ba6d-c0093c099077 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:26:06.504878 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e476fb-ab1a-4f54-ba6d-c0093c099077 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:26:06.505143 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e476fb-ab1a-4f54-ba6d-c0093c099077 admin admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:26:06.505412 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e476fb-ab1a-4f54-ba6d-c0093c099077 admin admin] PATH_INFO: `/v3/users/8ecd54d47c424fe0a899f463552ebd3a` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:26:06.507256 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e476fb-ab1a-4f54-ba6d-c0093c099077 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8ecd54d47c424fe0a899f463552ebd3a)` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:26:06.509191 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e476fb-ab1a-4f54-ba6d-c0093c099077 admin admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:26:06.556964 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-49e476fb-ab1a-4f54-ba6d-c0093c099077 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8ecd54d47c424fe0a899f463552ebd3a'} {{(pid=79745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:26:06.570349 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-49e476fb-ab1a-4f54-ba6d-c0093c099077 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8ecd54d47c424fe0a899f463552ebd3a'} {{(pid=79745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:26:06.571212 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-49e476fb-ab1a-4f54-ba6d-c0093c099077 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8ecd54d47c424fe0a899f463552ebd3a'} {{(pid=79745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:26:06.571815 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-49e476fb-ab1a-4f54-ba6d-c0093c099077 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8ecd54d47c424fe0a899f463552ebd3a'} {{(pid=79745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:26:06.579121 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-49e476fb-ab1a-4f54-ba6d-c0093c099077 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8ecd54d47c424fe0a899f463552ebd3a'} {{(pid=79745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:26:06.582794 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9556804c-efd0-4b71-aec2-aef29a2a6065 admin admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:26:06.585158 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.fernet_utils [None req-9556804c-efd0-4b71-aec2-aef29a2a6065 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:26:06.598611 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 1061/2135] 10.222.0.21 () {58 vars in 1223 bytes} [Wed May 4 07:26:06 2022] DELETE /identity/v3/users/8ecd54d47c424fe0a899f463552ebd3a => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 07:26:06.600173 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa8eb76-67f5-445a-a92b-b53fea3b1e83 None None] REQUEST_METHOD: `POST` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:26:06.600652 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa8eb76-67f5-445a-a92b-b53fea3b1e83 None None] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:26:06.601005 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa8eb76-67f5-445a-a92b-b53fea3b1e83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:26:06.621267 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9556804c-efd0-4b71-aec2-aef29a2a6065 admin admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:26:06.629463 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.auth.core [None req-5aa8eb76-67f5-445a-a92b-b53fea3b1e83 None None] MFA Rules not processed for user `83c5e0dcb991496ea6dee38384514508`. Rule list: `[]` (Enabled: `True`). {{(pid=79745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:26:06.630726 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.fernet_utils [None req-5aa8eb76-67f5-445a-a92b-b53fea3b1e83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:26:06.688058 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e72b8f4-5b93-4bb4-8950-743542791d76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:26:06.689062 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e72b8f4-5b93-4bb4-8950-743542791d76 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:26:06.689464 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e72b8f4-5b93-4bb4-8950-743542791d76 admin admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:26:06.689741 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e72b8f4-5b93-4bb4-8950-743542791d76 admin admin] PATH_INFO: `/v3/projects/c2edc784041949ea978066369bd4aa29` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:26:06.690941 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e72b8f4-5b93-4bb4-8950-743542791d76 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c2edc784041949ea978066369bd4aa29)` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:26:06.692897 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e72b8f4-5b93-4bb4-8950-743542791d76 admin admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:26:06.695728 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 1062/2136] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 07:26:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 07:26:06.707901 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa8eb76-67f5-445a-a92b-b53fea3b1e83 None None] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:26:06.710358 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.fernet_utils [None req-5aa8eb76-67f5-445a-a92b-b53fea3b1e83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:26:06.741814 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-0e72b8f4-5b93-4bb4-8950-743542791d76 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c2edc784041949ea978066369bd4aa29', 'request_id': 'req-0e72b8f4-5b93-4bb4-8950-743542791d76'} {{(pid=79744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:26:06.747014 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-0e72b8f4-5b93-4bb4-8950-743542791d76 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c2edc784041949ea978066369bd4aa29', 'request_id': 'req-0e72b8f4-5b93-4bb4-8950-743542791d76'} {{(pid=79744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:26:06.757247 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-0e72b8f4-5b93-4bb4-8950-743542791d76 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c2edc784041949ea978066369bd4aa29', 'request_id': 'req-0e72b8f4-5b93-4bb4-8950-743542791d76'} {{(pid=79744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:26:06.770839 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-0e72b8f4-5b93-4bb4-8950-743542791d76 admin admin] The token cache is being invalidate because project c2edc784041949ea978066369bd4aa29 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79744) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 07:26:06.771295 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-0e72b8f4-5b93-4bb4-8950-743542791d76 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:26:06.772646 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-0e72b8f4-5b93-4bb4-8950-743542791d76 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:26:06.774424 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 1075/2137] 10.222.0.21 () {58 vars in 1232 bytes} [Wed May 4 07:26:06 2022] DELETE /identity/v3/projects/c2edc784041949ea978066369bd4aa29 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 07:26:06.780218 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5589616-625e-4426-b485-6ea7cfb12433 None None] REQUEST_METHOD: `POST` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:26:06.780503 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5589616-625e-4426-b485-6ea7cfb12433 None None] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:26:06.780832 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5589616-625e-4426-b485-6ea7cfb12433 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:26:06.818773 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa8eb76-67f5-445a-a92b-b53fea3b1e83 None None] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:26:06.823917 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.auth.core [None req-d5589616-625e-4426-b485-6ea7cfb12433 None None] MFA Rules not processed for user `83c5e0dcb991496ea6dee38384514508`. Rule list: `[]` (Enabled: `True`). {{(pid=79744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:26:06.825060 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.fernet_utils [None req-d5589616-625e-4426-b485-6ea7cfb12433 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:26:06.871040 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2039e8-5512-4a0e-998c-9f8675889a43 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91cb92d00273402b837cb29b37325101', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9f9c44db4984653b8d4b5f6b3b949f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:26:06.871729 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2039e8-5512-4a0e-998c-9f8675889a43 service neutron] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:26:06.872036 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2039e8-5512-4a0e-998c-9f8675889a43 service neutron] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:26:06.872308 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2039e8-5512-4a0e-998c-9f8675889a43 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:26:06.874095 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.fernet_utils [None req-4b2039e8-5512-4a0e-998c-9f8675889a43 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:26:06.885802 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 1076/2138] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 07:26:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 07:26:06.893740 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e3555a-81c8-46fd-9aeb-935872650e89 None None] REQUEST_METHOD: `POST` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:26:06.894022 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e3555a-81c8-46fd-9aeb-935872650e89 None None] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:26:06.894296 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e3555a-81c8-46fd-9aeb-935872650e89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:26:06.915165 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.auth.core [None req-e4e3555a-81c8-46fd-9aeb-935872650e89 None None] MFA Rules not processed for user `83c5e0dcb991496ea6dee38384514508`. Rule list: `[]` (Enabled: `True`). {{(pid=79744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:26:06.916362 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.fernet_utils [None req-e4e3555a-81c8-46fd-9aeb-935872650e89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:26:06.924385 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 1077/2139] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 07:26:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 07:26:06.929354 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e3555a-81c8-46fd-9aeb-935872650e89 None None] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:26:06.938398 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e3555a-81c8-46fd-9aeb-935872650e89 None None] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:26:06.940175 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2039e8-5512-4a0e-998c-9f8675889a43 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:26:06.941610 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2039e8-5512-4a0e-998c-9f8675889a43 service neutron] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:26:06.946641 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6172e8d0-ccd8-4ccc-a7da-4e30596f99b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:26:06.947335 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6172e8d0-ccd8-4ccc-a7da-4e30596f99b5 admin admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:26:06.947615 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6172e8d0-ccd8-4ccc-a7da-4e30596f99b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:26:06.947886 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6172e8d0-ccd8-4ccc-a7da-4e30596f99b5 admin admin] PATH_INFO: `/v3/domains` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:26:06.948624 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6172e8d0-ccd8-4ccc-a7da-4e30596f99b5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79744) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 07:26:06.948926 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6172e8d0-ccd8-4ccc-a7da-4e30596f99b5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:26:06.950533 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6172e8d0-ccd8-4ccc-a7da-4e30596f99b5 admin admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:26:06.952890 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 1063/2140] 10.222.0.21 () {60 vars in 1365 bytes} [Wed May 4 07:26:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 246 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 04 07:26:06.967675 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 1078/2141] 10.222.0.21 () {58 vars in 1152 bytes} [Wed May 4 07:26:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 07:26:06.969688 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2039e8-5512-4a0e-998c-9f8675889a43 service neutron] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:26:06.979590 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2039e8-5512-4a0e-998c-9f8675889a43 service neutron] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:26:06.984520 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad1c6d2-a093-4123-adc7-2f0240fd4b55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:26:06.985268 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad1c6d2-a093-4123-adc7-2f0240fd4b55 admin admin] REQUEST_METHOD: `POST` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:26:06.985618 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad1c6d2-a093-4123-adc7-2f0240fd4b55 admin admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:26:06.986159 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad1c6d2-a093-4123-adc7-2f0240fd4b55 admin admin] PATH_INFO: `/v3/projects` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:26:06.987410 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad1c6d2-a093-4123-adc7-2f0240fd4b55 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:26:06.990385 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad1c6d2-a093-4123-adc7-2f0240fd4b55 admin admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:26:07.027205 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 1064/2142] 10.222.0.21 () {60 vars in 1152 bytes} [Wed May 4 07:26:06 2022] POST /identity/v3/projects => generated 389 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 07:26:07.031685 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6172e8d0-ccd8-4ccc-a7da-4e30596f99b5 admin admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:26:07.043365 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6172e8d0-ccd8-4ccc-a7da-4e30596f99b5 admin admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:26:07.102862 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d908233e-7de9-4290-a8ff-79e66aae1aeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:26:07.103572 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d908233e-7de9-4290-a8ff-79e66aae1aeb admin admin] REQUEST_METHOD: `POST` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:26:07.103740 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d908233e-7de9-4290-a8ff-79e66aae1aeb admin admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:26:07.104035 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d908233e-7de9-4290-a8ff-79e66aae1aeb admin admin] PATH_INFO: `/v3/users` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:26:07.104789 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d908233e-7de9-4290-a8ff-79e66aae1aeb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:26:07.106709 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d908233e-7de9-4290-a8ff-79e66aae1aeb admin admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:26:07.136175 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 1079/2143] 10.222.0.21 () {60 vars in 1143 bytes} [Wed May 4 07:26:07 2022] POST /identity/v3/users => generated 295 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 07:26:07.140697 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad1c6d2-a093-4123-adc7-2f0240fd4b55 admin admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:26:07.153132 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad1c6d2-a093-4123-adc7-2f0240fd4b55 admin admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:26:07.158256 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84967880-9bc5-4cd1-90a6-59d3f83c72e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:26:07.159223 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84967880-9bc5-4cd1-90a6-59d3f83c72e4 admin admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:26:07.159657 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84967880-9bc5-4cd1-90a6-59d3f83c72e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:26:07.159940 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84967880-9bc5-4cd1-90a6-59d3f83c72e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:26:07.160686 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84967880-9bc5-4cd1-90a6-59d3f83c72e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:26:07.162363 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84967880-9bc5-4cd1-90a6-59d3f83c72e4 admin admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:26:07.178781 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 1065/2144] 10.222.0.21 () {58 vars in 1121 bytes} [Wed May 4 07:26:07 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 07:26:07.180203 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d908233e-7de9-4290-a8ff-79e66aae1aeb admin admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:26:07.202120 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d908233e-7de9-4290-a8ff-79e66aae1aeb admin admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:26:07.210191 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a419b2-d0a4-40e5-93c0-842e44739618 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:26:07.211862 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a419b2-d0a4-40e5-93c0-842e44739618 admin admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:26:07.212149 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a419b2-d0a4-40e5-93c0-842e44739618 admin admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:26:07.212432 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a419b2-d0a4-40e5-93c0-842e44739618 admin admin] PATH_INFO: `/v3/roles` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:26:07.213181 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a419b2-d0a4-40e5-93c0-842e44739618 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:26:07.214827 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a419b2-d0a4-40e5-93c0-842e44739618 admin admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:26:07.237537 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 1080/2145] 10.222.0.21 () {58 vars in 1121 bytes} [Wed May 4 07:26:07 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 07:26:07.242417 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84967880-9bc5-4cd1-90a6-59d3f83c72e4 admin admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:26:07.252679 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84967880-9bc5-4cd1-90a6-59d3f83c72e4 admin admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:26:07.259003 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbc3073-0afe-474b-bb90-b740cb34bba2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:26:07.259955 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbc3073-0afe-474b-bb90-b740cb34bba2 admin admin] REQUEST_METHOD: `PUT` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:26:07.260239 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbc3073-0afe-474b-bb90-b740cb34bba2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:26:07.260541 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbc3073-0afe-474b-bb90-b740cb34bba2 admin admin] PATH_INFO: `/v3/projects/a183ac2391e141ca8ef0e7f7cc47daed/users/c0d8468db2524d76b712b831f83d2cbe/roles/9f89c07b05a14f18836116af22cba5f6` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:26:07.270741 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a419b2-d0a4-40e5-93c0-842e44739618 admin admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:26:07.273940 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.fernet_utils [None req-f8a419b2-d0a4-40e5-93c0-842e44739618 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:26:07.288721 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a419b2-d0a4-40e5-93c0-842e44739618 admin admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:26:07.289247 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdbc3073-0afe-474b-bb90-b740cb34bba2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a183ac2391e141ca8ef0e7f7cc47daed, user_id=c0d8468db2524d76b712b831f83d2cbe, role_id=9f89c07b05a14f18836116af22cba5f6)` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:26:07.292001 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdbc3073-0afe-474b-bb90-b740cb34bba2 admin admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:26:07.293999 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb4d828-ba76-4e09-a3eb-e137f06242ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:26:07.294877 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb4d828-ba76-4e09-a3eb-e137f06242ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:26:07.295177 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb4d828-ba76-4e09-a3eb-e137f06242ce admin admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:26:07.295482 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb4d828-ba76-4e09-a3eb-e137f06242ce admin admin] PATH_INFO: `/v3/projects/7f52331c913b4f5fa041337b7e614345` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:26:07.296790 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb4d828-ba76-4e09-a3eb-e137f06242ce admin admin] RBAC: Authorizing `identity:delete_project(project_id=7f52331c913b4f5fa041337b7e614345)` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:26:07.299064 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb4d828-ba76-4e09-a3eb-e137f06242ce admin admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:26:07.317727 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 1066/2146] 10.222.0.21 () {60 vars in 1482 bytes} [Wed May 4 07:26:07 2022] PUT /identity/v3/projects/a183ac2391e141ca8ef0e7f7cc47daed/users/c0d8468db2524d76b712b831f83d2cbe/roles/9f89c07b05a14f18836116af22cba5f6 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 07:26:07.319627 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db5a11d-6ece-4394-8963-088605da29cd None None] REQUEST_METHOD: `POST` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:26:07.319900 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db5a11d-6ece-4394-8963-088605da29cd None None] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:26:07.320181 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db5a11d-6ece-4394-8963-088605da29cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:26:07.338392 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.auth.core [None req-4db5a11d-6ece-4394-8963-088605da29cd None None] MFA Rules not processed for user `83c5e0dcb991496ea6dee38384514508`. Rule list: `[]` (Enabled: `True`). {{(pid=79745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:26:07.339693 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.fernet_utils [None req-4db5a11d-6ece-4394-8963-088605da29cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:26:07.367833 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-ffb4d828-ba76-4e09-a3eb-e137f06242ce admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7f52331c913b4f5fa041337b7e614345', 'request_id': 'req-ffb4d828-ba76-4e09-a3eb-e137f06242ce'} {{(pid=79744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:26:07.376006 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-ffb4d828-ba76-4e09-a3eb-e137f06242ce admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7f52331c913b4f5fa041337b7e614345', 'request_id': 'req-ffb4d828-ba76-4e09-a3eb-e137f06242ce'} {{(pid=79744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:26:07.387361 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-ffb4d828-ba76-4e09-a3eb-e137f06242ce admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7f52331c913b4f5fa041337b7e614345', 'request_id': 'req-ffb4d828-ba76-4e09-a3eb-e137f06242ce'} {{(pid=79744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:26:07.401490 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-ffb4d828-ba76-4e09-a3eb-e137f06242ce admin admin] The token cache is being invalidate because project 7f52331c913b4f5fa041337b7e614345 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79744) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 07:26:07.401796 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-ffb4d828-ba76-4e09-a3eb-e137f06242ce admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:26:07.402465 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-ffb4d828-ba76-4e09-a3eb-e137f06242ce admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:26:07.404361 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 1081/2147] 10.222.0.21 () {58 vars in 1232 bytes} [Wed May 4 07:26:07 2022] DELETE /identity/v3/projects/7f52331c913b4f5fa041337b7e614345 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 07:26:07.408516 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb4d828-ba76-4e09-a3eb-e137f06242ce admin admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:26:07.410061 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.fernet_utils [None req-ffb4d828-ba76-4e09-a3eb-e137f06242ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:26:07.413502 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 1067/2148] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 07:26:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 07:26:07.423204 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db5a11d-6ece-4394-8963-088605da29cd None None] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:26:07.424620 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.fernet_utils [None req-4db5a11d-6ece-4394-8963-088605da29cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:26:07.482888 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db5a11d-6ece-4394-8963-088605da29cd None None] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:26:07.486685 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb4d828-ba76-4e09-a3eb-e137f06242ce admin admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:26:07.492443 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6265b0f7-c5cf-4281-974e-45b21fe2ed1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:26:07.493653 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6265b0f7-c5cf-4281-974e-45b21fe2ed1e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:26:07.493934 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6265b0f7-c5cf-4281-974e-45b21fe2ed1e admin admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:26:07.494210 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6265b0f7-c5cf-4281-974e-45b21fe2ed1e admin admin] PATH_INFO: `/v3/users/97a2be0eb5bd4caf945871bd9754c2da` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:26:07.495501 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6265b0f7-c5cf-4281-974e-45b21fe2ed1e admin admin] RBAC: Authorizing `identity:delete_user(user_id=97a2be0eb5bd4caf945871bd9754c2da)` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:26:07.497439 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6265b0f7-c5cf-4281-974e-45b21fe2ed1e admin admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:26:07.533544 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbe3160-4f3e-40fa-add2-57d6ec9ef155 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91cb92d00273402b837cb29b37325101', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9f9c44db4984653b8d4b5f6b3b949f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:26:07.534207 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbe3160-4f3e-40fa-add2-57d6ec9ef155 service neutron] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:26:07.534486 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbe3160-4f3e-40fa-add2-57d6ec9ef155 service neutron] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:26:07.534757 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbe3160-4f3e-40fa-add2-57d6ec9ef155 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:26:07.546410 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cbe3160-4f3e-40fa-add2-57d6ec9ef155 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:26:07.547888 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cbe3160-4f3e-40fa-add2-57d6ec9ef155 service neutron] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:26:07.556322 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-6265b0f7-c5cf-4281-974e-45b21fe2ed1e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '97a2be0eb5bd4caf945871bd9754c2da'} {{(pid=79744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:26:07.557007 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-6265b0f7-c5cf-4281-974e-45b21fe2ed1e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '97a2be0eb5bd4caf945871bd9754c2da'} {{(pid=79744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:26:07.559108 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 1068/2149] 10.222.0.21 () {60 vars in 1365 bytes} [Wed May 4 07:26:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 04 07:26:07.564441 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-6265b0f7-c5cf-4281-974e-45b21fe2ed1e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '97a2be0eb5bd4caf945871bd9754c2da'} {{(pid=79744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:26:07.565252 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-6265b0f7-c5cf-4281-974e-45b21fe2ed1e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '97a2be0eb5bd4caf945871bd9754c2da'} {{(pid=79744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:26:07.581940 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-6265b0f7-c5cf-4281-974e-45b21fe2ed1e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '97a2be0eb5bd4caf945871bd9754c2da'} {{(pid=79744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:26:07.596082 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 1082/2150] 10.222.0.21 () {58 vars in 1223 bytes} [Wed May 4 07:26:07 2022] DELETE /identity/v3/users/97a2be0eb5bd4caf945871bd9754c2da => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 07:26:08.029351 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbe3160-4f3e-40fa-add2-57d6ec9ef155 service neutron] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:26:08.042243 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbe3160-4f3e-40fa-add2-57d6ec9ef155 service neutron] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:26:08.104416 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ded8b91-383a-4041-8997-3653a80e7145 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:26:08.105404 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ded8b91-383a-4041-8997-3653a80e7145 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:26:08.105744 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ded8b91-383a-4041-8997-3653a80e7145 admin admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:26:08.106396 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ded8b91-383a-4041-8997-3653a80e7145 admin admin] PATH_INFO: `/v3/projects/39a5062334f2447aaa3346d08367e6b4` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:26:08.107384 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ded8b91-383a-4041-8997-3653a80e7145 admin admin] RBAC: Authorizing `identity:delete_project(project_id=39a5062334f2447aaa3346d08367e6b4)` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:26:08.109392 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ded8b91-383a-4041-8997-3653a80e7145 admin admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:26:08.162909 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-2ded8b91-383a-4041-8997-3653a80e7145 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '39a5062334f2447aaa3346d08367e6b4', 'request_id': 'req-2ded8b91-383a-4041-8997-3653a80e7145'} {{(pid=79745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:26:08.169474 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-2ded8b91-383a-4041-8997-3653a80e7145 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '39a5062334f2447aaa3346d08367e6b4', 'request_id': 'req-2ded8b91-383a-4041-8997-3653a80e7145'} {{(pid=79745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:26:08.178517 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-2ded8b91-383a-4041-8997-3653a80e7145 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '39a5062334f2447aaa3346d08367e6b4', 'request_id': 'req-2ded8b91-383a-4041-8997-3653a80e7145'} {{(pid=79745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:26:08.189872 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-2ded8b91-383a-4041-8997-3653a80e7145 admin admin] The token cache is being invalidate because project 39a5062334f2447aaa3346d08367e6b4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79745) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 07:26:08.190156 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-2ded8b91-383a-4041-8997-3653a80e7145 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:26:08.190840 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-2ded8b91-383a-4041-8997-3653a80e7145 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:26:08.192457 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 1069/2151] 10.222.0.21 () {58 vars in 1232 bytes} [Wed May 4 07:26:08 2022] DELETE /identity/v3/projects/39a5062334f2447aaa3346d08367e6b4 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 07:26:08.198301 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c700881-c3b3-497e-b2d0-2eb30e17d103 None None] REQUEST_METHOD: `POST` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:26:08.199314 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c700881-c3b3-497e-b2d0-2eb30e17d103 None None] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:26:08.199314 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c700881-c3b3-497e-b2d0-2eb30e17d103 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:26:08.221929 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.auth.core [None req-4c700881-c3b3-497e-b2d0-2eb30e17d103 None None] MFA Rules not processed for user `83c5e0dcb991496ea6dee38384514508`. Rule list: `[]` (Enabled: `True`). {{(pid=79744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:26:08.223285 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.fernet_utils [None req-4c700881-c3b3-497e-b2d0-2eb30e17d103 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:26:08.309505 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 1083/2152] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 07:26:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 07:26:08.320904 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2dc3142-91f2-4a06-b339-f1d1bddc8bd9 None None] REQUEST_METHOD: `POST` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:26:08.320904 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2dc3142-91f2-4a06-b339-f1d1bddc8bd9 None None] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:26:08.320904 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2dc3142-91f2-4a06-b339-f1d1bddc8bd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:26:08.340242 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.auth.core [None req-e2dc3142-91f2-4a06-b339-f1d1bddc8bd9 None None] MFA Rules not processed for user `83c5e0dcb991496ea6dee38384514508`. Rule list: `[]` (Enabled: `True`). {{(pid=79745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:26:08.341552 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.fernet_utils [None req-e2dc3142-91f2-4a06-b339-f1d1bddc8bd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:26:08.351433 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 1070/2153] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 07:26:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 07:26:08.356206 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c700881-c3b3-497e-b2d0-2eb30e17d103 None None] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:26:08.367786 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c700881-c3b3-497e-b2d0-2eb30e17d103 None None] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:26:08.387014 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bbfa2b-bebd-41a9-8245-aef4d997ac7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:26:08.390269 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bbfa2b-bebd-41a9-8245-aef4d997ac7d admin admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:26:08.390269 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bbfa2b-bebd-41a9-8245-aef4d997ac7d admin admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:26:08.390269 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bbfa2b-bebd-41a9-8245-aef4d997ac7d admin admin] PATH_INFO: `/v3/domains` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:26:08.392515 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36bbfa2b-bebd-41a9-8245-aef4d997ac7d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79744) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 07:26:08.393906 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36bbfa2b-bebd-41a9-8245-aef4d997ac7d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:26:08.395683 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36bbfa2b-bebd-41a9-8245-aef4d997ac7d admin admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:26:08.440206 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 1084/2154] 10.222.0.21 () {58 vars in 1152 bytes} [Wed May 4 07:26:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 07:26:08.447189 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2dc3142-91f2-4a06-b339-f1d1bddc8bd9 None None] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:26:08.454585 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2dc3142-91f2-4a06-b339-f1d1bddc8bd9 None None] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:26:08.460742 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8354f611-d3f9-49ab-afb8-4746fa4122f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:26:08.462261 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8354f611-d3f9-49ab-afb8-4746fa4122f5 admin admin] REQUEST_METHOD: `POST` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:26:08.463308 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8354f611-d3f9-49ab-afb8-4746fa4122f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:26:08.463499 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8354f611-d3f9-49ab-afb8-4746fa4122f5 admin admin] PATH_INFO: `/v3/projects` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:26:08.464921 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8354f611-d3f9-49ab-afb8-4746fa4122f5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:26:08.466908 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8354f611-d3f9-49ab-afb8-4746fa4122f5 admin admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:26:08.499094 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 1071/2155] 10.222.0.21 () {60 vars in 1152 bytes} [Wed May 4 07:26:08 2022] POST /identity/v3/projects => generated 381 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 07:26:08.503795 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bbfa2b-bebd-41a9-8245-aef4d997ac7d admin admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:26:08.516066 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bbfa2b-bebd-41a9-8245-aef4d997ac7d admin admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:26:08.595430 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990f1152-0785-4a60-982a-837b91f0e9d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:26:08.597401 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990f1152-0785-4a60-982a-837b91f0e9d4 admin admin] REQUEST_METHOD: `POST` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:26:08.597883 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990f1152-0785-4a60-982a-837b91f0e9d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:26:08.598544 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990f1152-0785-4a60-982a-837b91f0e9d4 admin admin] PATH_INFO: `/v3/users` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:26:08.599435 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990f1152-0785-4a60-982a-837b91f0e9d4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:26:08.601610 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990f1152-0785-4a60-982a-837b91f0e9d4 admin admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:26:08.625203 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 1085/2156] 10.222.0.21 () {60 vars in 1143 bytes} [Wed May 4 07:26:08 2022] POST /identity/v3/users => generated 291 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 07:26:08.630836 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8354f611-d3f9-49ab-afb8-4746fa4122f5 admin admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:26:08.644028 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8354f611-d3f9-49ab-afb8-4746fa4122f5 admin admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:26:08.649296 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc212c22-bb2a-4767-93e2-ecce82fbf37d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:26:08.650155 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc212c22-bb2a-4767-93e2-ecce82fbf37d admin admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:26:08.650533 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc212c22-bb2a-4767-93e2-ecce82fbf37d admin admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:26:08.650936 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc212c22-bb2a-4767-93e2-ecce82fbf37d admin admin] PATH_INFO: `/v3/roles` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:26:08.651814 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc212c22-bb2a-4767-93e2-ecce82fbf37d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:26:08.653552 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc212c22-bb2a-4767-93e2-ecce82fbf37d admin admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:26:08.666501 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 1072/2157] 10.222.0.21 () {58 vars in 1121 bytes} [Wed May 4 07:26:08 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 07:26:08.671274 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990f1152-0785-4a60-982a-837b91f0e9d4 admin admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:26:08.682979 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990f1152-0785-4a60-982a-837b91f0e9d4 admin admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:26:08.687796 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3100dae-8308-42b7-88a5-74f34fcc5f73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:26:08.688495 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3100dae-8308-42b7-88a5-74f34fcc5f73 admin admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:26:08.688754 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3100dae-8308-42b7-88a5-74f34fcc5f73 admin admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:26:08.689023 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3100dae-8308-42b7-88a5-74f34fcc5f73 admin admin] PATH_INFO: `/v3/roles` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:26:08.689758 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3100dae-8308-42b7-88a5-74f34fcc5f73 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:26:08.691428 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3100dae-8308-42b7-88a5-74f34fcc5f73 admin admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:26:08.703053 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 1086/2158] 10.222.0.21 () {58 vars in 1121 bytes} [Wed May 4 07:26:08 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 04 07:26:08.708530 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc212c22-bb2a-4767-93e2-ecce82fbf37d admin admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:26:08.722627 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc212c22-bb2a-4767-93e2-ecce82fbf37d admin admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:26:08.728743 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb43a950-474a-42f7-90a6-91475f8ee6b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:26:08.729683 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb43a950-474a-42f7-90a6-91475f8ee6b0 admin admin] REQUEST_METHOD: `PUT` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:26:08.729964 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb43a950-474a-42f7-90a6-91475f8ee6b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:26:08.730234 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb43a950-474a-42f7-90a6-91475f8ee6b0 admin admin] PATH_INFO: `/v3/projects/5b07e5418c28453eb4d33b6bbb442af8/users/30c22425fe824db4ac75043db1a399ef/roles/9f89c07b05a14f18836116af22cba5f6` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:26:08.753497 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb43a950-474a-42f7-90a6-91475f8ee6b0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5b07e5418c28453eb4d33b6bbb442af8, user_id=30c22425fe824db4ac75043db1a399ef, role_id=9f89c07b05a14f18836116af22cba5f6)` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:26:08.756889 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb43a950-474a-42f7-90a6-91475f8ee6b0 admin admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:26:08.780057 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 1073/2159] 10.222.0.21 () {60 vars in 1482 bytes} [Wed May 4 07:26:08 2022] PUT /identity/v3/projects/5b07e5418c28453eb4d33b6bbb442af8/users/30c22425fe824db4ac75043db1a399ef/roles/9f89c07b05a14f18836116af22cba5f6 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 07:26:08.791405 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeaeac99-533a-4e1d-9c48-655dbe74f390 None None] REQUEST_METHOD: `POST` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:26:08.791721 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeaeac99-533a-4e1d-9c48-655dbe74f390 None None] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:26:08.791983 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeaeac99-533a-4e1d-9c48-655dbe74f390 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:26:08.829065 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.auth.core [None req-eeaeac99-533a-4e1d-9c48-655dbe74f390 None None] MFA Rules not processed for user `30c22425fe824db4ac75043db1a399ef`. Rule list: `[]` (Enabled: `True`). {{(pid=79744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:26:08.830338 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.fernet_utils [None req-eeaeac99-533a-4e1d-9c48-655dbe74f390 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:26:08.917528 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 1087/2160] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 07:26:08 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 07:26:08.919334 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb43a950-474a-42f7-90a6-91475f8ee6b0 admin admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:26:09.010402 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb43a950-474a-42f7-90a6-91475f8ee6b0 admin admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:26:09.023811 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c928020d-25fc-427a-bec4-2f4eaa27a6d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:26:09.024492 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c928020d-25fc-427a-bec4-2f4eaa27a6d9 admin admin] REQUEST_METHOD: `POST` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:26:09.024837 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c928020d-25fc-427a-bec4-2f4eaa27a6d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:26:09.025118 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c928020d-25fc-427a-bec4-2f4eaa27a6d9 admin admin] PATH_INFO: `/v3/projects` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:26:09.026365 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c928020d-25fc-427a-bec4-2f4eaa27a6d9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:26:09.028935 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c928020d-25fc-427a-bec4-2f4eaa27a6d9 admin admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:26:09.063830 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 1074/2161] 10.222.0.21 () {60 vars in 1152 bytes} [Wed May 4 07:26:08 2022] POST /identity/v3/projects => generated 381 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 07:26:09.067867 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeaeac99-533a-4e1d-9c48-655dbe74f390 None None] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:26:09.080316 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeaeac99-533a-4e1d-9c48-655dbe74f390 None None] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:26:09.160257 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd92e8c-6b3d-46ce-8529-e0dc095a5e4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:26:09.161416 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd92e8c-6b3d-46ce-8529-e0dc095a5e4c admin admin] REQUEST_METHOD: `POST` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:26:09.161866 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd92e8c-6b3d-46ce-8529-e0dc095a5e4c admin admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:26:09.162145 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd92e8c-6b3d-46ce-8529-e0dc095a5e4c admin admin] PATH_INFO: `/v3/users` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:26:09.164993 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd92e8c-6b3d-46ce-8529-e0dc095a5e4c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:26:09.167488 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd92e8c-6b3d-46ce-8529-e0dc095a5e4c admin admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:26:09.194382 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 1088/2162] 10.222.0.21 () {60 vars in 1143 bytes} [Wed May 4 07:26:09 2022] POST /identity/v3/users => generated 297 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 07:26:09.198418 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c928020d-25fc-427a-bec4-2f4eaa27a6d9 admin admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:26:09.212557 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c928020d-25fc-427a-bec4-2f4eaa27a6d9 admin admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:26:09.218135 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d981b194-ec9a-47f7-8da7-32bc469175a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:26:09.219268 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d981b194-ec9a-47f7-8da7-32bc469175a4 admin admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:26:09.219589 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d981b194-ec9a-47f7-8da7-32bc469175a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:26:09.220362 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d981b194-ec9a-47f7-8da7-32bc469175a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:26:09.221106 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d981b194-ec9a-47f7-8da7-32bc469175a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:26:09.222827 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d981b194-ec9a-47f7-8da7-32bc469175a4 admin admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:26:09.235437 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 1075/2163] 10.222.0.21 () {58 vars in 1121 bytes} [Wed May 4 07:26:09 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 07:26:09.242035 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd92e8c-6b3d-46ce-8529-e0dc095a5e4c admin admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:26:09.252593 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd92e8c-6b3d-46ce-8529-e0dc095a5e4c admin admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:26:09.260584 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d1ea9c-a0d3-451b-825f-a2ca0d3495b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:26:09.261386 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d1ea9c-a0d3-451b-825f-a2ca0d3495b8 admin admin] REQUEST_METHOD: `PUT` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:26:09.261672 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d1ea9c-a0d3-451b-825f-a2ca0d3495b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:26:09.261949 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d1ea9c-a0d3-451b-825f-a2ca0d3495b8 admin admin] PATH_INFO: `/v3/projects/d1ae648168cb47f0b59cf9b69e47f2e0/users/1f054afbb8934cb4acba2761276e3203/roles/eb54c9cea2774a25b1fe8c79724408ee` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:26:09.291741 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d1ea9c-a0d3-451b-825f-a2ca0d3495b8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d1ae648168cb47f0b59cf9b69e47f2e0, user_id=1f054afbb8934cb4acba2761276e3203, role_id=eb54c9cea2774a25b1fe8c79724408ee)` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:26:09.294652 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d1ea9c-a0d3-451b-825f-a2ca0d3495b8 admin admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:26:09.330003 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 1089/2164] 10.222.0.21 () {60 vars in 1482 bytes} [Wed May 4 07:26:09 2022] PUT /identity/v3/projects/d1ae648168cb47f0b59cf9b69e47f2e0/users/1f054afbb8934cb4acba2761276e3203/roles/eb54c9cea2774a25b1fe8c79724408ee => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 07:26:09.333810 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d981b194-ec9a-47f7-8da7-32bc469175a4 admin admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:26:09.348106 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d981b194-ec9a-47f7-8da7-32bc469175a4 admin admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:26:09.438084 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab41368-0810-4051-a7c7-af150119ddec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:26:09.439559 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab41368-0810-4051-a7c7-af150119ddec admin admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:26:09.440495 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab41368-0810-4051-a7c7-af150119ddec admin admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:26:09.441051 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab41368-0810-4051-a7c7-af150119ddec admin admin] PATH_INFO: `/v3/roles` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:26:09.442584 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab41368-0810-4051-a7c7-af150119ddec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:26:09.468160 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab41368-0810-4051-a7c7-af150119ddec admin admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:26:09.484593 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 1076/2165] 10.222.0.21 () {58 vars in 1121 bytes} [Wed May 4 07:26:09 2022] GET /identity/v3/roles => generated 1420 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 07:26:09.489197 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d1ea9c-a0d3-451b-825f-a2ca0d3495b8 admin admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:26:09.531417 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d1ea9c-a0d3-451b-825f-a2ca0d3495b8 admin admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:26:09.559483 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb027fa-b387-4de1-b670-770faf0af443 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:26:09.561392 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb027fa-b387-4de1-b670-770faf0af443 admin admin] REQUEST_METHOD: `PUT` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:26:09.561856 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb027fa-b387-4de1-b670-770faf0af443 admin admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:26:09.562278 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb027fa-b387-4de1-b670-770faf0af443 admin admin] PATH_INFO: `/v3/projects/d1ae648168cb47f0b59cf9b69e47f2e0/users/1f054afbb8934cb4acba2761276e3203/roles/eb54c9cea2774a25b1fe8c79724408ee` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:26:09.564825 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb027fa-b387-4de1-b670-770faf0af443 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d1ae648168cb47f0b59cf9b69e47f2e0, user_id=1f054afbb8934cb4acba2761276e3203, role_id=eb54c9cea2774a25b1fe8c79724408ee)` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:26:09.567673 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb027fa-b387-4de1-b670-770faf0af443 admin admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:26:09.591254 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 1090/2166] 10.222.0.21 () {60 vars in 1482 bytes} [Wed May 4 07:26:09 2022] PUT /identity/v3/projects/d1ae648168cb47f0b59cf9b69e47f2e0/users/1f054afbb8934cb4acba2761276e3203/roles/eb54c9cea2774a25b1fe8c79724408ee => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 07:26:09.592889 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30eca4cc-8a48-4556-822b-ea652dfc9620 None None] REQUEST_METHOD: `POST` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:26:09.593172 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30eca4cc-8a48-4556-822b-ea652dfc9620 None None] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:26:09.593452 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30eca4cc-8a48-4556-822b-ea652dfc9620 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:26:09.633604 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.auth.core [None req-30eca4cc-8a48-4556-822b-ea652dfc9620 None None] MFA Rules not processed for user `1f054afbb8934cb4acba2761276e3203`. Rule list: `[]` (Enabled: `True`). {{(pid=79745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:26:09.635319 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.fernet_utils [None req-30eca4cc-8a48-4556-822b-ea652dfc9620 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:26:09.729022 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 1077/2167] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 07:26:09 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 07:26:09.739040 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb027fa-b387-4de1-b670-770faf0af443 admin admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:26:09.742525 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.fernet_utils [None req-5bb027fa-b387-4de1-b670-770faf0af443 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:26:09.805605 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb027fa-b387-4de1-b670-770faf0af443 admin admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:26:09.809535 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c2dea9-6a51-47fd-a4a4-68a882ebb9e0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb341257aa8246b6847561e2fe1fa385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9f9c44db4984653b8d4b5f6b3b949f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:26:09.810192 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c2dea9-6a51-47fd-a4a4-68a882ebb9e0 service cinder] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:26:09.810473 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c2dea9-6a51-47fd-a4a4-68a882ebb9e0 service cinder] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:26:09.810829 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c2dea9-6a51-47fd-a4a4-68a882ebb9e0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:26:09.820823 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c2dea9-6a51-47fd-a4a4-68a882ebb9e0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:26:09.822427 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c2dea9-6a51-47fd-a4a4-68a882ebb9e0 service cinder] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:26:09.834786 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 1091/2168] 10.222.0.21 () {60 vars in 1365 bytes} [Wed May 4 07:26:09 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 07:26:09.920954 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30eca4cc-8a48-4556-822b-ea652dfc9620 None None] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:26:09.931524 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30eca4cc-8a48-4556-822b-ea652dfc9620 None None] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:26:09.935379 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e391578f-aee8-435a-99e1-86cc422c0bd7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb341257aa8246b6847561e2fe1fa385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9f9c44db4984653b8d4b5f6b3b949f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:26:09.936330 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e391578f-aee8-435a-99e1-86cc422c0bd7 service cinder] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:26:09.936630 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e391578f-aee8-435a-99e1-86cc422c0bd7 service cinder] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:26:09.936950 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e391578f-aee8-435a-99e1-86cc422c0bd7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:26:10.016805 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e391578f-aee8-435a-99e1-86cc422c0bd7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:26:10.018298 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e391578f-aee8-435a-99e1-86cc422c0bd7 service cinder] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:26:10.042773 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 1078/2169] 10.222.0.21 () {60 vars in 1365 bytes} [Wed May 4 07:26:09 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 07:26:13.214936 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9f7919-b33e-4b3a-922e-f23c985e6046 None None] REQUEST_METHOD: `POST` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:26:13.215603 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9f7919-b33e-4b3a-922e-f23c985e6046 None None] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:26:13.215734 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9f7919-b33e-4b3a-922e-f23c985e6046 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:26:13.246840 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.auth.core [None req-5d9f7919-b33e-4b3a-922e-f23c985e6046 None None] MFA Rules not processed for user `c0d8468db2524d76b712b831f83d2cbe`. Rule list: `[]` (Enabled: `True`). {{(pid=79744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:26:13.248568 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.fernet_utils [None req-5d9f7919-b33e-4b3a-922e-f23c985e6046 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:26:13.323724 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 1092/2170] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 07:26:13 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 07:26:13.338236 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e391578f-aee8-435a-99e1-86cc422c0bd7 service cinder] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:26:13.340152 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.fernet_utils [None req-e391578f-aee8-435a-99e1-86cc422c0bd7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:26:13.438898 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e391578f-aee8-435a-99e1-86cc422c0bd7 service cinder] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:26:13.444763 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16ed76c-f763-41d9-87be-9dc38ae6008c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1077289fedae43b6be47be7f716d573a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9f9c44db4984653b8d4b5f6b3b949f5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:26:13.445444 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16ed76c-f763-41d9-87be-9dc38ae6008c service nova] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:26:13.445716 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16ed76c-f763-41d9-87be-9dc38ae6008c service nova] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:26:13.445987 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16ed76c-f763-41d9-87be-9dc38ae6008c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:26:13.454626 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16ed76c-f763-41d9-87be-9dc38ae6008c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:26:13.456281 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16ed76c-f763-41d9-87be-9dc38ae6008c service nova] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:26:13.473216 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 1079/2171] 10.222.0.21 () {60 vars in 1365 bytes} [Wed May 4 07:26:13 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 07:26:15.722458 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52950881-ec0e-473b-b383-8fb095864635 None None] REQUEST_METHOD: `POST` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:26:15.723040 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52950881-ec0e-473b-b383-8fb095864635 None None] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:26:15.723040 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52950881-ec0e-473b-b383-8fb095864635 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:26:15.746274 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.auth.core [None req-52950881-ec0e-473b-b383-8fb095864635 None None] MFA Rules not processed for user `c0d8468db2524d76b712b831f83d2cbe`. Rule list: `[]` (Enabled: `True`). {{(pid=79744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:26:15.747856 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.fernet_utils [None req-52950881-ec0e-473b-b383-8fb095864635 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:26:15.762728 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 1093/2172] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 07:26:15 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 07:26:23.844121 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16ed76c-f763-41d9-87be-9dc38ae6008c service nova] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:26:23.904933 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16ed76c-f763-41d9-87be-9dc38ae6008c service nova] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:26:23.909409 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4493db-35fc-4f51-9924-86d819c4ed36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:26:23.910261 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4493db-35fc-4f51-9924-86d819c4ed36 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:26:23.910541 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4493db-35fc-4f51-9924-86d819c4ed36 admin admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:26:23.910812 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4493db-35fc-4f51-9924-86d819c4ed36 admin admin] PATH_INFO: `/v3/users/30c22425fe824db4ac75043db1a399ef` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:26:23.912015 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4493db-35fc-4f51-9924-86d819c4ed36 admin admin] RBAC: Authorizing `identity:delete_user(user_id=30c22425fe824db4ac75043db1a399ef)` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:26:23.914607 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4493db-35fc-4f51-9924-86d819c4ed36 admin admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:26:23.959621 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-ac4493db-35fc-4f51-9924-86d819c4ed36 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '30c22425fe824db4ac75043db1a399ef'} {{(pid=79745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:26:23.970264 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-ac4493db-35fc-4f51-9924-86d819c4ed36 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '30c22425fe824db4ac75043db1a399ef'} {{(pid=79745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:26:23.971187 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-ac4493db-35fc-4f51-9924-86d819c4ed36 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '30c22425fe824db4ac75043db1a399ef'} {{(pid=79745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:26:23.971764 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-ac4493db-35fc-4f51-9924-86d819c4ed36 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '30c22425fe824db4ac75043db1a399ef'} {{(pid=79745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:26:23.979877 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-ac4493db-35fc-4f51-9924-86d819c4ed36 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '30c22425fe824db4ac75043db1a399ef'} {{(pid=79745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:26:23.992824 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 1080/2173] 10.222.0.21 () {58 vars in 1223 bytes} [Wed May 4 07:26:23 2022] DELETE /identity/v3/users/30c22425fe824db4ac75043db1a399ef => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 07:26:23.997528 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4db476-85ae-468b-af1a-f9e5966e7e6d None None] REQUEST_METHOD: `POST` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:26:23.998007 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4db476-85ae-468b-af1a-f9e5966e7e6d None None] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:26:23.998120 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4db476-85ae-468b-af1a-f9e5966e7e6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:26:24.015259 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.auth.core [None req-6f4db476-85ae-468b-af1a-f9e5966e7e6d None None] MFA Rules not processed for user `83c5e0dcb991496ea6dee38384514508`. Rule list: `[]` (Enabled: `True`). {{(pid=79744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:26:24.016462 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.fernet_utils [None req-6f4db476-85ae-468b-af1a-f9e5966e7e6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:26:24.074686 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 1094/2174] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 07:26:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 07:26:24.084954 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4493db-35fc-4f51-9924-86d819c4ed36 admin admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:26:24.086348 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.fernet_utils [None req-ac4493db-35fc-4f51-9924-86d819c4ed36 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:26:24.147874 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4493db-35fc-4f51-9924-86d819c4ed36 admin admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:26:24.151595 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb85ab8e-331d-4b37-b241-7091eb1e100d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91cb92d00273402b837cb29b37325101', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9f9c44db4984653b8d4b5f6b3b949f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:26:24.152247 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb85ab8e-331d-4b37-b241-7091eb1e100d service neutron] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:26:24.152541 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb85ab8e-331d-4b37-b241-7091eb1e100d service neutron] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:26:24.152814 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb85ab8e-331d-4b37-b241-7091eb1e100d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:26:24.163979 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb85ab8e-331d-4b37-b241-7091eb1e100d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:26:24.165768 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb85ab8e-331d-4b37-b241-7091eb1e100d service neutron] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:26:24.175782 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 1081/2175] 10.222.0.21 () {60 vars in 1365 bytes} [Wed May 4 07:26:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 07:26:24.491590 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4db476-85ae-468b-af1a-f9e5966e7e6d None None] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:26:24.493003 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.fernet_utils [None req-6f4db476-85ae-468b-af1a-f9e5966e7e6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:26:24.505763 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4db476-85ae-468b-af1a-f9e5966e7e6d None None] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:26:24.511338 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07789720-fbb5-480a-9e9d-f81a2eec4078 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:26:24.512540 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07789720-fbb5-480a-9e9d-f81a2eec4078 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:26:24.512817 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07789720-fbb5-480a-9e9d-f81a2eec4078 admin admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:26:24.513083 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07789720-fbb5-480a-9e9d-f81a2eec4078 admin admin] PATH_INFO: `/v3/projects/5b07e5418c28453eb4d33b6bbb442af8` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:26:24.514294 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07789720-fbb5-480a-9e9d-f81a2eec4078 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5b07e5418c28453eb4d33b6bbb442af8)` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:26:24.516241 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07789720-fbb5-480a-9e9d-f81a2eec4078 admin admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:26:24.564761 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-07789720-fbb5-480a-9e9d-f81a2eec4078 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5b07e5418c28453eb4d33b6bbb442af8', 'request_id': 'req-07789720-fbb5-480a-9e9d-f81a2eec4078'} {{(pid=79744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:26:24.570418 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-07789720-fbb5-480a-9e9d-f81a2eec4078 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5b07e5418c28453eb4d33b6bbb442af8', 'request_id': 'req-07789720-fbb5-480a-9e9d-f81a2eec4078'} {{(pid=79744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:26:24.578616 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-07789720-fbb5-480a-9e9d-f81a2eec4078 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5b07e5418c28453eb4d33b6bbb442af8', 'request_id': 'req-07789720-fbb5-480a-9e9d-f81a2eec4078'} {{(pid=79744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:26:24.590232 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-07789720-fbb5-480a-9e9d-f81a2eec4078 admin admin] The token cache is being invalidate because project 5b07e5418c28453eb4d33b6bbb442af8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79744) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 07:26:24.590431 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-07789720-fbb5-480a-9e9d-f81a2eec4078 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:26:24.591073 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-07789720-fbb5-480a-9e9d-f81a2eec4078 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:26:24.592664 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 1095/2176] 10.222.0.21 () {58 vars in 1232 bytes} [Wed May 4 07:26:24 2022] DELETE /identity/v3/projects/5b07e5418c28453eb4d33b6bbb442af8 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 07:26:24.596672 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb85ab8e-331d-4b37-b241-7091eb1e100d service neutron] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:26:24.606876 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb85ab8e-331d-4b37-b241-7091eb1e100d service neutron] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:26:24.661113 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8536ec3-1838-40ab-9ecb-eeb634870f9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:26:24.661978 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8536ec3-1838-40ab-9ecb-eeb634870f9a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:26:24.662781 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8536ec3-1838-40ab-9ecb-eeb634870f9a admin admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:26:24.663090 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8536ec3-1838-40ab-9ecb-eeb634870f9a admin admin] PATH_INFO: `/v3/users/1f054afbb8934cb4acba2761276e3203` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:26:24.664510 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8536ec3-1838-40ab-9ecb-eeb634870f9a admin admin] RBAC: Authorizing `identity:delete_user(user_id=1f054afbb8934cb4acba2761276e3203)` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:26:24.666414 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8536ec3-1838-40ab-9ecb-eeb634870f9a admin admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:26:24.720099 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-f8536ec3-1838-40ab-9ecb-eeb634870f9a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1f054afbb8934cb4acba2761276e3203'} {{(pid=79745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:26:24.736210 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-f8536ec3-1838-40ab-9ecb-eeb634870f9a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1f054afbb8934cb4acba2761276e3203'} {{(pid=79745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:26:24.737232 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-f8536ec3-1838-40ab-9ecb-eeb634870f9a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1f054afbb8934cb4acba2761276e3203'} {{(pid=79745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:26:24.738155 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-f8536ec3-1838-40ab-9ecb-eeb634870f9a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1f054afbb8934cb4acba2761276e3203'} {{(pid=79745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:26:24.749981 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-f8536ec3-1838-40ab-9ecb-eeb634870f9a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1f054afbb8934cb4acba2761276e3203'} {{(pid=79745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:26:24.766587 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 1082/2177] 10.222.0.21 () {58 vars in 1223 bytes} [Wed May 4 07:26:24 2022] DELETE /identity/v3/users/1f054afbb8934cb4acba2761276e3203 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 07:26:25.157332 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07789720-fbb5-480a-9e9d-f81a2eec4078 admin admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:26:25.158897 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.fernet_utils [None req-07789720-fbb5-480a-9e9d-f81a2eec4078 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:26:25.181331 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07789720-fbb5-480a-9e9d-f81a2eec4078 admin admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:26:25.248887 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1934d60-bb0e-4196-8ac3-dad7490050c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:26:25.249778 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1934d60-bb0e-4196-8ac3-dad7490050c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:26:25.250054 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1934d60-bb0e-4196-8ac3-dad7490050c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:26:25.250326 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1934d60-bb0e-4196-8ac3-dad7490050c4 admin admin] PATH_INFO: `/v3/projects/d1ae648168cb47f0b59cf9b69e47f2e0` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:26:25.251581 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1934d60-bb0e-4196-8ac3-dad7490050c4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d1ae648168cb47f0b59cf9b69e47f2e0)` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:26:25.253520 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1934d60-bb0e-4196-8ac3-dad7490050c4 admin admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:26:25.306757 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-d1934d60-bb0e-4196-8ac3-dad7490050c4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd1ae648168cb47f0b59cf9b69e47f2e0', 'request_id': 'req-d1934d60-bb0e-4196-8ac3-dad7490050c4'} {{(pid=79744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:26:25.313468 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-d1934d60-bb0e-4196-8ac3-dad7490050c4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd1ae648168cb47f0b59cf9b69e47f2e0', 'request_id': 'req-d1934d60-bb0e-4196-8ac3-dad7490050c4'} {{(pid=79744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:26:25.331534 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-d1934d60-bb0e-4196-8ac3-dad7490050c4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd1ae648168cb47f0b59cf9b69e47f2e0', 'request_id': 'req-d1934d60-bb0e-4196-8ac3-dad7490050c4'} {{(pid=79744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:26:25.344496 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-d1934d60-bb0e-4196-8ac3-dad7490050c4 admin admin] The token cache is being invalidate because project d1ae648168cb47f0b59cf9b69e47f2e0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79744) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 07:26:25.344776 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-d1934d60-bb0e-4196-8ac3-dad7490050c4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:26:25.345439 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-d1934d60-bb0e-4196-8ac3-dad7490050c4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:26:25.346981 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 1096/2178] 10.222.0.21 () {58 vars in 1232 bytes} [Wed May 4 07:26:25 2022] DELETE /identity/v3/projects/d1ae648168cb47f0b59cf9b69e47f2e0 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 07:26:25.353471 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5baa346e-820a-41b9-81bd-d3cad87caa10 None None] REQUEST_METHOD: `POST` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:26:25.354159 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5baa346e-820a-41b9-81bd-d3cad87caa10 None None] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:26:25.354159 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5baa346e-820a-41b9-81bd-d3cad87caa10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:26:25.384868 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.auth.core [None req-5baa346e-820a-41b9-81bd-d3cad87caa10 None None] MFA Rules not processed for user `83c5e0dcb991496ea6dee38384514508`. Rule list: `[]` (Enabled: `True`). {{(pid=79745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:26:25.386173 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.fernet_utils [None req-5baa346e-820a-41b9-81bd-d3cad87caa10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:26:25.444468 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 1083/2179] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 07:26:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 07:26:25.452406 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f7e9af-290b-40e0-8310-5dc53cd9c406 None None] REQUEST_METHOD: `POST` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:26:25.452688 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f7e9af-290b-40e0-8310-5dc53cd9c406 None None] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:26:25.452971 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f7e9af-290b-40e0-8310-5dc53cd9c406 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:26:25.472481 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.auth.core [None req-26f7e9af-290b-40e0-8310-5dc53cd9c406 None None] MFA Rules not processed for user `83c5e0dcb991496ea6dee38384514508`. Rule list: `[]` (Enabled: `True`). {{(pid=79744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:26:25.473669 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.fernet_utils [None req-26f7e9af-290b-40e0-8310-5dc53cd9c406 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:26:25.482381 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 1097/2180] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 07:26:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 07:26:25.486799 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5baa346e-820a-41b9-81bd-d3cad87caa10 None None] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:26:25.497323 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5baa346e-820a-41b9-81bd-d3cad87caa10 None None] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:26:25.501939 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de99f832-f104-4e32-b05b-bc2140e656a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:26:25.502584 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de99f832-f104-4e32-b05b-bc2140e656a6 admin admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:26:25.502862 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de99f832-f104-4e32-b05b-bc2140e656a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:26:25.503133 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de99f832-f104-4e32-b05b-bc2140e656a6 admin admin] PATH_INFO: `/v3/domains` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:26:25.504127 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de99f832-f104-4e32-b05b-bc2140e656a6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 07:26:25.504439 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de99f832-f104-4e32-b05b-bc2140e656a6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:26:25.506128 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de99f832-f104-4e32-b05b-bc2140e656a6 admin admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:26:25.518191 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 1084/2181] 10.222.0.21 () {58 vars in 1152 bytes} [Wed May 4 07:26:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 07:26:25.523178 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f7e9af-290b-40e0-8310-5dc53cd9c406 None None] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:26:25.532775 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f7e9af-290b-40e0-8310-5dc53cd9c406 None None] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:26:25.538575 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503fb2aa-9bf5-46a7-ae0b-984ef43a5643 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:26:25.539398 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503fb2aa-9bf5-46a7-ae0b-984ef43a5643 admin admin] REQUEST_METHOD: `POST` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:26:25.539742 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503fb2aa-9bf5-46a7-ae0b-984ef43a5643 admin admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:26:25.540013 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503fb2aa-9bf5-46a7-ae0b-984ef43a5643 admin admin] PATH_INFO: `/v3/projects` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:26:25.540734 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503fb2aa-9bf5-46a7-ae0b-984ef43a5643 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:26:25.542702 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503fb2aa-9bf5-46a7-ae0b-984ef43a5643 admin admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:26:25.577485 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 1098/2182] 10.222.0.21 () {60 vars in 1152 bytes} [Wed May 4 07:26:25 2022] POST /identity/v3/projects => generated 363 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 07:26:25.582843 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de99f832-f104-4e32-b05b-bc2140e656a6 admin admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:26:25.593419 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de99f832-f104-4e32-b05b-bc2140e656a6 admin admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:26:25.652791 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746a49f6-6ebf-4167-bd65-3796f77aa6d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:26:25.653458 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746a49f6-6ebf-4167-bd65-3796f77aa6d1 admin admin] REQUEST_METHOD: `POST` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:26:25.653732 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746a49f6-6ebf-4167-bd65-3796f77aa6d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:26:25.653998 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746a49f6-6ebf-4167-bd65-3796f77aa6d1 admin admin] PATH_INFO: `/v3/users` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:26:25.654709 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746a49f6-6ebf-4167-bd65-3796f77aa6d1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:26:25.656663 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746a49f6-6ebf-4167-bd65-3796f77aa6d1 admin admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:26:25.681374 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 1085/2183] 10.222.0.21 () {60 vars in 1143 bytes} [Wed May 4 07:26:25 2022] POST /identity/v3/users => generated 282 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 07:26:25.685920 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503fb2aa-9bf5-46a7-ae0b-984ef43a5643 admin admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:26:25.696393 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503fb2aa-9bf5-46a7-ae0b-984ef43a5643 admin admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:26:25.701103 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1793c396-5cd3-4fd6-aab1-e6e4d4e23aa6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:26:25.701764 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1793c396-5cd3-4fd6-aab1-e6e4d4e23aa6 admin admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:26:25.702041 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1793c396-5cd3-4fd6-aab1-e6e4d4e23aa6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:26:25.702311 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1793c396-5cd3-4fd6-aab1-e6e4d4e23aa6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:26:25.703070 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1793c396-5cd3-4fd6-aab1-e6e4d4e23aa6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:26:25.704693 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1793c396-5cd3-4fd6-aab1-e6e4d4e23aa6 admin admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:26:25.715851 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 1099/2184] 10.222.0.21 () {58 vars in 1121 bytes} [Wed May 4 07:26:25 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 07:26:25.719951 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746a49f6-6ebf-4167-bd65-3796f77aa6d1 admin admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:26:25.731803 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746a49f6-6ebf-4167-bd65-3796f77aa6d1 admin admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:26:25.736810 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1da61e-da8b-4eb8-9e4d-f59ad4e4a344 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:26:25.737497 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1da61e-da8b-4eb8-9e4d-f59ad4e4a344 admin admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:26:25.737777 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1da61e-da8b-4eb8-9e4d-f59ad4e4a344 admin admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:26:25.738049 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1da61e-da8b-4eb8-9e4d-f59ad4e4a344 admin admin] PATH_INFO: `/v3/roles` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:26:25.738802 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1da61e-da8b-4eb8-9e4d-f59ad4e4a344 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:26:25.740444 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1da61e-da8b-4eb8-9e4d-f59ad4e4a344 admin admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:26:25.751215 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 1086/2185] 10.222.0.21 () {58 vars in 1121 bytes} [Wed May 4 07:26:25 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 07:26:25.756502 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1793c396-5cd3-4fd6-aab1-e6e4d4e23aa6 admin admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:26:25.766124 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1793c396-5cd3-4fd6-aab1-e6e4d4e23aa6 admin admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:26:25.770765 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f4a53f-9c04-42e3-8982-2e1147880884 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:26:25.772167 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f4a53f-9c04-42e3-8982-2e1147880884 admin admin] REQUEST_METHOD: `PUT` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:26:25.772444 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f4a53f-9c04-42e3-8982-2e1147880884 admin admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:26:25.772715 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f4a53f-9c04-42e3-8982-2e1147880884 admin admin] PATH_INFO: `/v3/projects/302ad528b424485b8a859d28ccb33b02/users/c42d081e54644fd0ac8017de1e64491c/roles/9f89c07b05a14f18836116af22cba5f6` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:26:25.788572 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f4a53f-9c04-42e3-8982-2e1147880884 admin admin] RBAC: Authorizing `identity:create_grant(project_id=302ad528b424485b8a859d28ccb33b02, user_id=c42d081e54644fd0ac8017de1e64491c, role_id=9f89c07b05a14f18836116af22cba5f6)` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:26:25.791244 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f4a53f-9c04-42e3-8982-2e1147880884 admin admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:26:25.803611 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 1100/2186] 10.222.0.21 () {60 vars in 1482 bytes} [Wed May 4 07:26:25 2022] PUT /identity/v3/projects/302ad528b424485b8a859d28ccb33b02/users/c42d081e54644fd0ac8017de1e64491c/roles/9f89c07b05a14f18836116af22cba5f6 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 07:26:25.814717 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c918c0d6-2f21-4ee4-94b8-c5d56ebd4496 None None] REQUEST_METHOD: `POST` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:26:25.815024 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c918c0d6-2f21-4ee4-94b8-c5d56ebd4496 None None] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:26:25.815335 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c918c0d6-2f21-4ee4-94b8-c5d56ebd4496 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:26:25.841243 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.auth.core [None req-c918c0d6-2f21-4ee4-94b8-c5d56ebd4496 None None] MFA Rules not processed for user `c42d081e54644fd0ac8017de1e64491c`. Rule list: `[]` (Enabled: `True`). {{(pid=79745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:26:25.842437 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.fernet_utils [None req-c918c0d6-2f21-4ee4-94b8-c5d56ebd4496 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:26:25.906316 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 1087/2187] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 07:26:25 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 07:26:25.910950 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f4a53f-9c04-42e3-8982-2e1147880884 admin admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:26:25.980685 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f4a53f-9c04-42e3-8982-2e1147880884 admin admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:26:25.987033 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e43cf0-fd10-4304-9d31-fd019ee5ea14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:26:25.987719 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e43cf0-fd10-4304-9d31-fd019ee5ea14 admin admin] REQUEST_METHOD: `POST` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:26:25.987994 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e43cf0-fd10-4304-9d31-fd019ee5ea14 admin admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:26:25.988267 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e43cf0-fd10-4304-9d31-fd019ee5ea14 admin admin] PATH_INFO: `/v3/projects` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:26:25.988949 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e43cf0-fd10-4304-9d31-fd019ee5ea14 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:26:25.990976 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e43cf0-fd10-4304-9d31-fd019ee5ea14 admin admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:26:26.021631 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 1101/2188] 10.222.0.21 () {60 vars in 1152 bytes} [Wed May 4 07:26:25 2022] POST /identity/v3/projects => generated 365 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 07:26:26.023465 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c918c0d6-2f21-4ee4-94b8-c5d56ebd4496 None None] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:26:26.039321 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c918c0d6-2f21-4ee4-94b8-c5d56ebd4496 None None] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:26:26.107684 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc8e432-7379-489a-9baf-4cf13e71045c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:26:26.108842 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc8e432-7379-489a-9baf-4cf13e71045c admin admin] REQUEST_METHOD: `POST` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:26:26.108842 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc8e432-7379-489a-9baf-4cf13e71045c admin admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:26:26.108842 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc8e432-7379-489a-9baf-4cf13e71045c admin admin] PATH_INFO: `/v3/users` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:26:26.109710 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc8e432-7379-489a-9baf-4cf13e71045c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:26:26.111719 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc8e432-7379-489a-9baf-4cf13e71045c admin admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:26:26.140895 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 1088/2189] 10.222.0.21 () {60 vars in 1143 bytes} [Wed May 4 07:26:26 2022] POST /identity/v3/users => generated 289 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 07:26:26.147921 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e43cf0-fd10-4304-9d31-fd019ee5ea14 admin admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:26:26.161514 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e43cf0-fd10-4304-9d31-fd019ee5ea14 admin admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:26:26.167292 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf072d71-ee14-4804-b3a4-3afe60e1d095 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:26:26.168056 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf072d71-ee14-4804-b3a4-3afe60e1d095 admin admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:26:26.168406 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf072d71-ee14-4804-b3a4-3afe60e1d095 admin admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:26:26.168779 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf072d71-ee14-4804-b3a4-3afe60e1d095 admin admin] PATH_INFO: `/v3/roles` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:26:26.169522 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf072d71-ee14-4804-b3a4-3afe60e1d095 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:26:26.171134 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf072d71-ee14-4804-b3a4-3afe60e1d095 admin admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:26:26.183341 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 1102/2190] 10.222.0.21 () {58 vars in 1121 bytes} [Wed May 4 07:26:26 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 04 07:26:26.187597 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc8e432-7379-489a-9baf-4cf13e71045c admin admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:26:26.200458 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc8e432-7379-489a-9baf-4cf13e71045c admin admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:26:26.204946 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f84789-cc8c-4bdd-87ca-e46a465c83a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:26:26.205822 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f84789-cc8c-4bdd-87ca-e46a465c83a4 admin admin] REQUEST_METHOD: `PUT` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:26:26.206100 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f84789-cc8c-4bdd-87ca-e46a465c83a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:26:26.206370 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f84789-cc8c-4bdd-87ca-e46a465c83a4 admin admin] PATH_INFO: `/v3/projects/c8ca65e8deb1471a9cedb4282b9f2b67/users/16ad5c68d50e4bec8d2f00505a89d6ba/roles/eb54c9cea2774a25b1fe8c79724408ee` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:26:26.222523 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f84789-cc8c-4bdd-87ca-e46a465c83a4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c8ca65e8deb1471a9cedb4282b9f2b67, user_id=16ad5c68d50e4bec8d2f00505a89d6ba, role_id=eb54c9cea2774a25b1fe8c79724408ee)` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:26:26.225379 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f84789-cc8c-4bdd-87ca-e46a465c83a4 admin admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:26:26.240474 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 1089/2191] 10.222.0.21 () {60 vars in 1482 bytes} [Wed May 4 07:26:26 2022] PUT /identity/v3/projects/c8ca65e8deb1471a9cedb4282b9f2b67/users/16ad5c68d50e4bec8d2f00505a89d6ba/roles/eb54c9cea2774a25b1fe8c79724408ee => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 07:26:26.244432 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf072d71-ee14-4804-b3a4-3afe60e1d095 admin admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:26:26.256560 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf072d71-ee14-4804-b3a4-3afe60e1d095 admin admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:26:26.343584 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc12d70-c6cc-4445-b0f1-51067368f07b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:26:26.344375 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc12d70-c6cc-4445-b0f1-51067368f07b admin admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:26:26.344721 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc12d70-c6cc-4445-b0f1-51067368f07b admin admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:26:26.345084 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc12d70-c6cc-4445-b0f1-51067368f07b admin admin] PATH_INFO: `/v3/roles` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:26:26.345876 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc12d70-c6cc-4445-b0f1-51067368f07b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:26:26.347590 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc12d70-c6cc-4445-b0f1-51067368f07b admin admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:26:26.361409 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 1103/2192] 10.222.0.21 () {58 vars in 1121 bytes} [Wed May 4 07:26:26 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 07:26:26.367799 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f84789-cc8c-4bdd-87ca-e46a465c83a4 admin admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:26:26.381931 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f84789-cc8c-4bdd-87ca-e46a465c83a4 admin admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:26:26.388368 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6579672d-cbf0-4b43-b63e-ecb6eeece2b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:26:26.389258 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6579672d-cbf0-4b43-b63e-ecb6eeece2b4 admin admin] REQUEST_METHOD: `PUT` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:26:26.389589 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6579672d-cbf0-4b43-b63e-ecb6eeece2b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:26:26.389800 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6579672d-cbf0-4b43-b63e-ecb6eeece2b4 admin admin] PATH_INFO: `/v3/projects/c8ca65e8deb1471a9cedb4282b9f2b67/users/16ad5c68d50e4bec8d2f00505a89d6ba/roles/eb54c9cea2774a25b1fe8c79724408ee` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:26:26.391959 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6579672d-cbf0-4b43-b63e-ecb6eeece2b4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c8ca65e8deb1471a9cedb4282b9f2b67, user_id=16ad5c68d50e4bec8d2f00505a89d6ba, role_id=eb54c9cea2774a25b1fe8c79724408ee)` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:26:26.394607 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6579672d-cbf0-4b43-b63e-ecb6eeece2b4 admin admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:26:26.406372 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 1090/2193] 10.222.0.21 () {60 vars in 1482 bytes} [Wed May 4 07:26:26 2022] PUT /identity/v3/projects/c8ca65e8deb1471a9cedb4282b9f2b67/users/16ad5c68d50e4bec8d2f00505a89d6ba/roles/eb54c9cea2774a25b1fe8c79724408ee => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 07:26:26.417068 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94f77d9-ff80-452f-8824-317f95243443 None None] REQUEST_METHOD: `POST` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:26:26.417385 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94f77d9-ff80-452f-8824-317f95243443 None None] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:26:26.417694 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94f77d9-ff80-452f-8824-317f95243443 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:26:26.454690 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.auth.core [None req-c94f77d9-ff80-452f-8824-317f95243443 None None] MFA Rules not processed for user `16ad5c68d50e4bec8d2f00505a89d6ba`. Rule list: `[]` (Enabled: `True`). {{(pid=79744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:26:26.455924 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.fernet_utils [None req-c94f77d9-ff80-452f-8824-317f95243443 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:26:26.540919 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 1104/2194] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 07:26:26 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 07:26:26.552961 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6579672d-cbf0-4b43-b63e-ecb6eeece2b4 admin admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:26:26.555598 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.fernet_utils [None req-6579672d-cbf0-4b43-b63e-ecb6eeece2b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:26:26.621181 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6579672d-cbf0-4b43-b63e-ecb6eeece2b4 admin admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:26:26.625132 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d10ed27-11ee-4125-9bf0-689565295435 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb341257aa8246b6847561e2fe1fa385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9f9c44db4984653b8d4b5f6b3b949f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:26:26.625776 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d10ed27-11ee-4125-9bf0-689565295435 service cinder] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:26:26.626058 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d10ed27-11ee-4125-9bf0-689565295435 service cinder] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:26:26.626332 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d10ed27-11ee-4125-9bf0-689565295435 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:26:26.640872 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d10ed27-11ee-4125-9bf0-689565295435 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:26:26.640872 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d10ed27-11ee-4125-9bf0-689565295435 service cinder] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:26:26.649681 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 1091/2195] 10.222.0.21 () {60 vars in 1365 bytes} [Wed May 4 07:26:26 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 07:26:26.737827 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94f77d9-ff80-452f-8824-317f95243443 None None] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:26:26.747823 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94f77d9-ff80-452f-8824-317f95243443 None None] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:26:26.751665 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e554fefb-efe5-4102-b63b-b46a88b2cc17 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb341257aa8246b6847561e2fe1fa385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9f9c44db4984653b8d4b5f6b3b949f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:26:26.752315 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e554fefb-efe5-4102-b63b-b46a88b2cc17 service cinder] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:26:26.752602 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e554fefb-efe5-4102-b63b-b46a88b2cc17 service cinder] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:26:26.752870 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e554fefb-efe5-4102-b63b-b46a88b2cc17 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:26:26.815507 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e554fefb-efe5-4102-b63b-b46a88b2cc17 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:26:26.815507 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e554fefb-efe5-4102-b63b-b46a88b2cc17 service cinder] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:26:26.824512 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 1105/2196] 10.222.0.21 () {60 vars in 1365 bytes} [Wed May 4 07:26:26 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 07:26:30.562710 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d10ed27-11ee-4125-9bf0-689565295435 service cinder] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:26:30.565791 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.fernet_utils [None req-6d10ed27-11ee-4125-9bf0-689565295435 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:26:30.652251 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d10ed27-11ee-4125-9bf0-689565295435 service cinder] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:26:30.656806 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39ec829-ab11-4728-b782-8d2f7f73fe4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:26:30.657671 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39ec829-ab11-4728-b782-8d2f7f73fe4b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:26:30.657954 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39ec829-ab11-4728-b782-8d2f7f73fe4b admin admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:26:30.658223 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39ec829-ab11-4728-b782-8d2f7f73fe4b admin admin] PATH_INFO: `/v3/users/1c72650a35474e37925ca6e403c65045` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:26:30.659505 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39ec829-ab11-4728-b782-8d2f7f73fe4b admin admin] RBAC: Authorizing `identity:delete_user(user_id=1c72650a35474e37925ca6e403c65045)` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:26:30.661379 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39ec829-ab11-4728-b782-8d2f7f73fe4b admin admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:26:30.708706 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-f39ec829-ab11-4728-b782-8d2f7f73fe4b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1c72650a35474e37925ca6e403c65045'} {{(pid=79745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:26:30.721537 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-f39ec829-ab11-4728-b782-8d2f7f73fe4b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1c72650a35474e37925ca6e403c65045'} {{(pid=79745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:26:30.722276 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-f39ec829-ab11-4728-b782-8d2f7f73fe4b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1c72650a35474e37925ca6e403c65045'} {{(pid=79745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:26:30.722891 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-f39ec829-ab11-4728-b782-8d2f7f73fe4b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1c72650a35474e37925ca6e403c65045'} {{(pid=79745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:26:30.730047 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-f39ec829-ab11-4728-b782-8d2f7f73fe4b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1c72650a35474e37925ca6e403c65045'} {{(pid=79745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:26:30.743490 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 1092/2197] 10.222.0.21 () {58 vars in 1223 bytes} [Wed May 4 07:26:30 2022] DELETE /identity/v3/users/1c72650a35474e37925ca6e403c65045 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 07:26:30.939709 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e554fefb-efe5-4102-b63b-b46a88b2cc17 service cinder] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:26:30.956526 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e554fefb-efe5-4102-b63b-b46a88b2cc17 service cinder] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:26:31.020033 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e368a9-5eb2-4054-87e3-87c2ed6b0aee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:26:31.021031 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e368a9-5eb2-4054-87e3-87c2ed6b0aee admin admin] REQUEST_METHOD: `DELETE` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:26:31.021309 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e368a9-5eb2-4054-87e3-87c2ed6b0aee admin admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:26:31.021959 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e368a9-5eb2-4054-87e3-87c2ed6b0aee admin admin] PATH_INFO: `/v3/projects/86aed21cb680429fa6880678118fba02` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:26:31.023211 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e368a9-5eb2-4054-87e3-87c2ed6b0aee admin admin] RBAC: Authorizing `identity:delete_project(project_id=86aed21cb680429fa6880678118fba02)` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:26:31.025162 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e368a9-5eb2-4054-87e3-87c2ed6b0aee admin admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:26:31.075132 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-e9e368a9-5eb2-4054-87e3-87c2ed6b0aee admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '86aed21cb680429fa6880678118fba02', 'request_id': 'req-e9e368a9-5eb2-4054-87e3-87c2ed6b0aee'} {{(pid=79744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:26:31.080655 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-e9e368a9-5eb2-4054-87e3-87c2ed6b0aee admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '86aed21cb680429fa6880678118fba02', 'request_id': 'req-e9e368a9-5eb2-4054-87e3-87c2ed6b0aee'} {{(pid=79744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:26:31.088781 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-e9e368a9-5eb2-4054-87e3-87c2ed6b0aee admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '86aed21cb680429fa6880678118fba02', 'request_id': 'req-e9e368a9-5eb2-4054-87e3-87c2ed6b0aee'} {{(pid=79744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:26:31.105880 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-e9e368a9-5eb2-4054-87e3-87c2ed6b0aee admin admin] The token cache is being invalidate because project 86aed21cb680429fa6880678118fba02 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79744) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 07:26:31.106172 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-e9e368a9-5eb2-4054-87e3-87c2ed6b0aee admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:26:31.106845 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-e9e368a9-5eb2-4054-87e3-87c2ed6b0aee admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:26:31.108489 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 1106/2198] 10.222.0.21 () {58 vars in 1232 bytes} [Wed May 4 07:26:30 2022] DELETE /identity/v3/projects/86aed21cb680429fa6880678118fba02 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 07:26:31.114133 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39ec829-ab11-4728-b782-8d2f7f73fe4b admin admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:26:31.116294 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.fernet_utils [None req-f39ec829-ab11-4728-b782-8d2f7f73fe4b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:26:31.130163 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39ec829-ab11-4728-b782-8d2f7f73fe4b admin admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:26:31.187644 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9ce58d-309b-4289-be84-540fd0b9e8f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:26:31.188757 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9ce58d-309b-4289-be84-540fd0b9e8f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:26:31.189035 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9ce58d-309b-4289-be84-540fd0b9e8f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:26:31.189308 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9ce58d-309b-4289-be84-540fd0b9e8f7 admin admin] PATH_INFO: `/v3/users/300b4fbeff694924b1fe1dfebfbfc766` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:26:31.190487 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9ce58d-309b-4289-be84-540fd0b9e8f7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=300b4fbeff694924b1fe1dfebfbfc766)` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:26:31.192443 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9ce58d-309b-4289-be84-540fd0b9e8f7 admin admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:26:31.237650 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-cc9ce58d-309b-4289-be84-540fd0b9e8f7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '300b4fbeff694924b1fe1dfebfbfc766'} {{(pid=79745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:26:31.249906 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-cc9ce58d-309b-4289-be84-540fd0b9e8f7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '300b4fbeff694924b1fe1dfebfbfc766'} {{(pid=79745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:26:31.250594 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-cc9ce58d-309b-4289-be84-540fd0b9e8f7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '300b4fbeff694924b1fe1dfebfbfc766'} {{(pid=79745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:26:31.251218 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-cc9ce58d-309b-4289-be84-540fd0b9e8f7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '300b4fbeff694924b1fe1dfebfbfc766'} {{(pid=79745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:26:31.258420 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-cc9ce58d-309b-4289-be84-540fd0b9e8f7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '300b4fbeff694924b1fe1dfebfbfc766'} {{(pid=79745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:26:31.270796 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 1093/2199] 10.222.0.21 () {58 vars in 1223 bytes} [Wed May 4 07:26:31 2022] DELETE /identity/v3/users/300b4fbeff694924b1fe1dfebfbfc766 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 07:26:31.443735 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e368a9-5eb2-4054-87e3-87c2ed6b0aee admin admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:26:31.445256 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.fernet_utils [None req-e9e368a9-5eb2-4054-87e3-87c2ed6b0aee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:26:31.458651 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e368a9-5eb2-4054-87e3-87c2ed6b0aee admin admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:26:31.527467 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8adc25-d7e3-4218-84aa-9f3a4fe0707e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:26:31.528343 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8adc25-d7e3-4218-84aa-9f3a4fe0707e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:26:31.528616 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8adc25-d7e3-4218-84aa-9f3a4fe0707e admin admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:26:31.528883 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8adc25-d7e3-4218-84aa-9f3a4fe0707e admin admin] PATH_INFO: `/v3/projects/b132b82bfd264245ba162acfb7adfe6e` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:26:31.530085 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8adc25-d7e3-4218-84aa-9f3a4fe0707e admin admin] RBAC: Authorizing `identity:delete_project(project_id=b132b82bfd264245ba162acfb7adfe6e)` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:26:31.532035 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8adc25-d7e3-4218-84aa-9f3a4fe0707e admin admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:26:31.582984 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-cb8adc25-d7e3-4218-84aa-9f3a4fe0707e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b132b82bfd264245ba162acfb7adfe6e', 'request_id': 'req-cb8adc25-d7e3-4218-84aa-9f3a4fe0707e'} {{(pid=79744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:26:31.590130 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-cb8adc25-d7e3-4218-84aa-9f3a4fe0707e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b132b82bfd264245ba162acfb7adfe6e', 'request_id': 'req-cb8adc25-d7e3-4218-84aa-9f3a4fe0707e'} {{(pid=79744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:26:31.597500 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-cb8adc25-d7e3-4218-84aa-9f3a4fe0707e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b132b82bfd264245ba162acfb7adfe6e', 'request_id': 'req-cb8adc25-d7e3-4218-84aa-9f3a4fe0707e'} {{(pid=79744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:26:31.619709 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-cb8adc25-d7e3-4218-84aa-9f3a4fe0707e admin admin] The token cache is being invalidate because project b132b82bfd264245ba162acfb7adfe6e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79744) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 07:26:31.620083 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-cb8adc25-d7e3-4218-84aa-9f3a4fe0707e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:26:31.620893 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-cb8adc25-d7e3-4218-84aa-9f3a4fe0707e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:26:31.622707 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 1107/2200] 10.222.0.21 () {58 vars in 1232 bytes} [Wed May 4 07:26:31 2022] DELETE /identity/v3/projects/b132b82bfd264245ba162acfb7adfe6e => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 07:26:31.629709 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6986547-0db8-4759-926c-b4baeb66dd68 None None] REQUEST_METHOD: `POST` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:26:31.630289 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6986547-0db8-4759-926c-b4baeb66dd68 None None] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:26:31.630727 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6986547-0db8-4759-926c-b4baeb66dd68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:26:31.662700 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.auth.core [None req-c6986547-0db8-4759-926c-b4baeb66dd68 None None] MFA Rules not processed for user `83c5e0dcb991496ea6dee38384514508`. Rule list: `[]` (Enabled: `True`). {{(pid=79745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:26:31.665659 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.fernet_utils [None req-c6986547-0db8-4759-926c-b4baeb66dd68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:26:31.733761 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 1094/2201] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 07:26:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 07:26:31.743479 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1e35ee-01eb-4bdc-b6c7-0b4fd714a82d None None] REQUEST_METHOD: `POST` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:26:31.743766 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1e35ee-01eb-4bdc-b6c7-0b4fd714a82d None None] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:26:31.744046 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1e35ee-01eb-4bdc-b6c7-0b4fd714a82d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:26:31.764372 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.auth.core [None req-8d1e35ee-01eb-4bdc-b6c7-0b4fd714a82d None None] MFA Rules not processed for user `83c5e0dcb991496ea6dee38384514508`. Rule list: `[]` (Enabled: `True`). {{(pid=79744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:26:31.765624 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.fernet_utils [None req-8d1e35ee-01eb-4bdc-b6c7-0b4fd714a82d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:26:31.774751 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 1108/2202] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 07:26:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 07:26:31.778999 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6986547-0db8-4759-926c-b4baeb66dd68 None None] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:26:31.789462 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6986547-0db8-4759-926c-b4baeb66dd68 None None] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:26:31.794040 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ded785-a721-433a-bd2c-dc8380370ee2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:26:31.794696 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ded785-a721-433a-bd2c-dc8380370ee2 admin admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:26:31.794978 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ded785-a721-433a-bd2c-dc8380370ee2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:26:31.795291 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ded785-a721-433a-bd2c-dc8380370ee2 admin admin] PATH_INFO: `/v3/domains` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:26:31.796020 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ded785-a721-433a-bd2c-dc8380370ee2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 07:26:31.796329 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ded785-a721-433a-bd2c-dc8380370ee2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:26:31.797941 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ded785-a721-433a-bd2c-dc8380370ee2 admin admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:26:31.810176 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 1095/2203] 10.222.0.21 () {58 vars in 1152 bytes} [Wed May 4 07:26:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 07:26:31.814545 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1e35ee-01eb-4bdc-b6c7-0b4fd714a82d None None] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:26:31.824355 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1e35ee-01eb-4bdc-b6c7-0b4fd714a82d None None] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:26:31.829117 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6372628e-a675-40d8-a3e3-74f368ccfec0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:26:31.829778 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6372628e-a675-40d8-a3e3-74f368ccfec0 admin admin] REQUEST_METHOD: `POST` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:26:31.830064 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6372628e-a675-40d8-a3e3-74f368ccfec0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:26:31.830331 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6372628e-a675-40d8-a3e3-74f368ccfec0 admin admin] PATH_INFO: `/v3/projects` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:26:31.831018 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6372628e-a675-40d8-a3e3-74f368ccfec0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:26:31.832945 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6372628e-a675-40d8-a3e3-74f368ccfec0 admin admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:26:31.860328 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 1109/2204] 10.222.0.21 () {60 vars in 1152 bytes} [Wed May 4 07:26:31 2022] POST /identity/v3/projects => generated 383 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 07:26:31.864213 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ded785-a721-433a-bd2c-dc8380370ee2 admin admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:26:31.874320 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ded785-a721-433a-bd2c-dc8380370ee2 admin admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:26:31.931129 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2bd2e8-b1ec-45f0-b65c-25efba465fe9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:26:31.932000 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2bd2e8-b1ec-45f0-b65c-25efba465fe9 admin admin] REQUEST_METHOD: `POST` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:26:31.932277 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2bd2e8-b1ec-45f0-b65c-25efba465fe9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:26:31.932552 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2bd2e8-b1ec-45f0-b65c-25efba465fe9 admin admin] PATH_INFO: `/v3/users` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:26:31.933310 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2bd2e8-b1ec-45f0-b65c-25efba465fe9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:26:31.935174 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2bd2e8-b1ec-45f0-b65c-25efba465fe9 admin admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:26:31.957003 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 1096/2205] 10.222.0.21 () {60 vars in 1143 bytes} [Wed May 4 07:26:31 2022] POST /identity/v3/users => generated 292 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 07:26:31.961683 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6372628e-a675-40d8-a3e3-74f368ccfec0 admin admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:26:31.972204 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6372628e-a675-40d8-a3e3-74f368ccfec0 admin admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:26:31.977680 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2663120e-b527-4465-b9af-1cd10104e986 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:26:31.978359 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2663120e-b527-4465-b9af-1cd10104e986 admin admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:26:31.978770 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2663120e-b527-4465-b9af-1cd10104e986 admin admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:26:31.979046 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2663120e-b527-4465-b9af-1cd10104e986 admin admin] PATH_INFO: `/v3/roles` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:26:31.979824 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2663120e-b527-4465-b9af-1cd10104e986 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:26:31.981448 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2663120e-b527-4465-b9af-1cd10104e986 admin admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:26:31.996870 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 1110/2206] 10.222.0.21 () {58 vars in 1121 bytes} [Wed May 4 07:26:31 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 07:26:31.998170 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2bd2e8-b1ec-45f0-b65c-25efba465fe9 admin admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:26:32.009807 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2bd2e8-b1ec-45f0-b65c-25efba465fe9 admin admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:26:32.014731 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024dc2e4-754f-4a45-92b7-57cc78d139d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:26:32.015443 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024dc2e4-754f-4a45-92b7-57cc78d139d2 admin admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:26:32.015729 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024dc2e4-754f-4a45-92b7-57cc78d139d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:26:32.016004 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024dc2e4-754f-4a45-92b7-57cc78d139d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:26:32.016729 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024dc2e4-754f-4a45-92b7-57cc78d139d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:26:32.018330 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024dc2e4-754f-4a45-92b7-57cc78d139d2 admin admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:26:32.030000 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 1097/2207] 10.222.0.21 () {58 vars in 1121 bytes} [Wed May 4 07:26:31 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 07:26:32.034173 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2663120e-b527-4465-b9af-1cd10104e986 admin admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:26:32.045067 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2663120e-b527-4465-b9af-1cd10104e986 admin admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:26:32.049799 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e9967a-55ef-4073-9872-90b0d7cbf6ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:26:32.050721 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e9967a-55ef-4073-9872-90b0d7cbf6ae admin admin] REQUEST_METHOD: `PUT` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:26:32.050999 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e9967a-55ef-4073-9872-90b0d7cbf6ae admin admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:26:32.051306 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e9967a-55ef-4073-9872-90b0d7cbf6ae admin admin] PATH_INFO: `/v3/projects/33889480037f4a33bdad83f618fe2bb3/users/76b2818ddaaa4930bec3786fc23246e2/roles/9f89c07b05a14f18836116af22cba5f6` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:26:32.067124 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e9967a-55ef-4073-9872-90b0d7cbf6ae admin admin] RBAC: Authorizing `identity:create_grant(project_id=33889480037f4a33bdad83f618fe2bb3, user_id=76b2818ddaaa4930bec3786fc23246e2, role_id=9f89c07b05a14f18836116af22cba5f6)` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:26:32.070591 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e9967a-55ef-4073-9872-90b0d7cbf6ae admin admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:26:32.084857 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 1111/2208] 10.222.0.21 () {60 vars in 1482 bytes} [Wed May 4 07:26:32 2022] PUT /identity/v3/projects/33889480037f4a33bdad83f618fe2bb3/users/76b2818ddaaa4930bec3786fc23246e2/roles/9f89c07b05a14f18836116af22cba5f6 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 07:26:32.095938 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1603d9db-9af4-430a-bdb2-2e9caea2efea None None] REQUEST_METHOD: `POST` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:26:32.096223 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1603d9db-9af4-430a-bdb2-2e9caea2efea None None] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:26:32.096500 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1603d9db-9af4-430a-bdb2-2e9caea2efea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:26:32.123088 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.auth.core [None req-1603d9db-9af4-430a-bdb2-2e9caea2efea None None] MFA Rules not processed for user `76b2818ddaaa4930bec3786fc23246e2`. Rule list: `[]` (Enabled: `True`). {{(pid=79745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:26:32.124308 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.fernet_utils [None req-1603d9db-9af4-430a-bdb2-2e9caea2efea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:26:32.190432 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 1098/2209] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 07:26:32 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 07:26:32.195595 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e9967a-55ef-4073-9872-90b0d7cbf6ae admin admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:26:32.260426 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e9967a-55ef-4073-9872-90b0d7cbf6ae admin admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:26:32.280976 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543f6327-279f-4a76-950e-0d5b9703c9f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:26:32.281679 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543f6327-279f-4a76-950e-0d5b9703c9f6 admin admin] REQUEST_METHOD: `POST` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:26:32.283421 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543f6327-279f-4a76-950e-0d5b9703c9f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:26:32.283421 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543f6327-279f-4a76-950e-0d5b9703c9f6 admin admin] PATH_INFO: `/v3/projects` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:26:32.283421 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543f6327-279f-4a76-950e-0d5b9703c9f6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:26:32.295499 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543f6327-279f-4a76-950e-0d5b9703c9f6 admin admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:26:32.322974 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 1112/2210] 10.222.0.21 () {60 vars in 1152 bytes} [Wed May 4 07:26:32 2022] POST /identity/v3/projects => generated 383 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 07:26:32.326870 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1603d9db-9af4-430a-bdb2-2e9caea2efea None None] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:26:32.344511 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1603d9db-9af4-430a-bdb2-2e9caea2efea None None] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:26:32.404944 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81ef767-7af8-482f-9699-b6fbd52b3abc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:26:32.405627 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81ef767-7af8-482f-9699-b6fbd52b3abc admin admin] REQUEST_METHOD: `POST` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:26:32.405910 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81ef767-7af8-482f-9699-b6fbd52b3abc admin admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:26:32.406208 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81ef767-7af8-482f-9699-b6fbd52b3abc admin admin] PATH_INFO: `/v3/users` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:26:32.406896 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81ef767-7af8-482f-9699-b6fbd52b3abc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:26:32.408867 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81ef767-7af8-482f-9699-b6fbd52b3abc admin admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:26:32.436325 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 1099/2211] 10.222.0.21 () {60 vars in 1143 bytes} [Wed May 4 07:26:32 2022] POST /identity/v3/users => generated 298 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 07:26:32.440250 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543f6327-279f-4a76-950e-0d5b9703c9f6 admin admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:26:32.452285 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543f6327-279f-4a76-950e-0d5b9703c9f6 admin admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:26:32.456911 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59879edc-e5ac-41ab-ac84-316ddf08babc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:26:32.457576 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59879edc-e5ac-41ab-ac84-316ddf08babc admin admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:26:32.457861 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59879edc-e5ac-41ab-ac84-316ddf08babc admin admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:26:32.458137 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59879edc-e5ac-41ab-ac84-316ddf08babc admin admin] PATH_INFO: `/v3/roles` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:26:32.458917 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59879edc-e5ac-41ab-ac84-316ddf08babc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:26:32.460556 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59879edc-e5ac-41ab-ac84-316ddf08babc admin admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:26:32.471458 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 1113/2212] 10.222.0.21 () {58 vars in 1121 bytes} [Wed May 4 07:26:32 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 04 07:26:32.475638 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81ef767-7af8-482f-9699-b6fbd52b3abc admin admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:26:32.485987 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81ef767-7af8-482f-9699-b6fbd52b3abc admin admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:26:32.491763 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ca0185-22e5-4bd1-b4dc-20f892f68e05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:26:32.492648 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ca0185-22e5-4bd1-b4dc-20f892f68e05 admin admin] REQUEST_METHOD: `PUT` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:26:32.492927 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ca0185-22e5-4bd1-b4dc-20f892f68e05 admin admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:26:32.493198 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ca0185-22e5-4bd1-b4dc-20f892f68e05 admin admin] PATH_INFO: `/v3/projects/4084eab199e4476fba10075f66b1a495/users/28448c06ed814538be5a8caabe9f4285/roles/eb54c9cea2774a25b1fe8c79724408ee` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:26:32.509246 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ca0185-22e5-4bd1-b4dc-20f892f68e05 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4084eab199e4476fba10075f66b1a495, user_id=28448c06ed814538be5a8caabe9f4285, role_id=eb54c9cea2774a25b1fe8c79724408ee)` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:26:32.511999 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ca0185-22e5-4bd1-b4dc-20f892f68e05 admin admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:26:32.530056 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 1100/2213] 10.222.0.21 () {60 vars in 1482 bytes} [Wed May 4 07:26:32 2022] PUT /identity/v3/projects/4084eab199e4476fba10075f66b1a495/users/28448c06ed814538be5a8caabe9f4285/roles/eb54c9cea2774a25b1fe8c79724408ee => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 07:26:32.536027 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59879edc-e5ac-41ab-ac84-316ddf08babc admin admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:26:32.546289 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59879edc-e5ac-41ab-ac84-316ddf08babc admin admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:26:32.601981 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704af1d3-4981-4fcb-932e-4728c7022fdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:26:32.602645 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704af1d3-4981-4fcb-932e-4728c7022fdd admin admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:26:32.602922 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704af1d3-4981-4fcb-932e-4728c7022fdd admin admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:26:32.603219 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704af1d3-4981-4fcb-932e-4728c7022fdd admin admin] PATH_INFO: `/v3/roles` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:26:32.603937 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704af1d3-4981-4fcb-932e-4728c7022fdd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:26:32.605512 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704af1d3-4981-4fcb-932e-4728c7022fdd admin admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:26:32.616096 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 1114/2214] 10.222.0.21 () {58 vars in 1121 bytes} [Wed May 4 07:26:32 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 07:26:32.620369 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ca0185-22e5-4bd1-b4dc-20f892f68e05 admin admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:26:32.631539 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ca0185-22e5-4bd1-b4dc-20f892f68e05 admin admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:26:32.636554 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6491ad-3975-4305-8db4-151147184170 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:26:32.637429 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6491ad-3975-4305-8db4-151147184170 admin admin] REQUEST_METHOD: `PUT` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:26:32.637712 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6491ad-3975-4305-8db4-151147184170 admin admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:26:32.637988 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6491ad-3975-4305-8db4-151147184170 admin admin] PATH_INFO: `/v3/projects/4084eab199e4476fba10075f66b1a495/users/28448c06ed814538be5a8caabe9f4285/roles/eb54c9cea2774a25b1fe8c79724408ee` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:26:32.639987 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6491ad-3975-4305-8db4-151147184170 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4084eab199e4476fba10075f66b1a495, user_id=28448c06ed814538be5a8caabe9f4285, role_id=eb54c9cea2774a25b1fe8c79724408ee)` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:26:32.642646 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6491ad-3975-4305-8db4-151147184170 admin admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:26:32.653275 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 1101/2215] 10.222.0.21 () {60 vars in 1482 bytes} [Wed May 4 07:26:32 2022] PUT /identity/v3/projects/4084eab199e4476fba10075f66b1a495/users/28448c06ed814538be5a8caabe9f4285/roles/eb54c9cea2774a25b1fe8c79724408ee => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 07:26:32.664329 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd00c46d-3ef4-4d76-87b6-7bdc933b0623 None None] REQUEST_METHOD: `POST` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:26:32.664616 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd00c46d-3ef4-4d76-87b6-7bdc933b0623 None None] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:26:32.664890 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd00c46d-3ef4-4d76-87b6-7bdc933b0623 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:26:32.692697 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.auth.core [None req-fd00c46d-3ef4-4d76-87b6-7bdc933b0623 None None] MFA Rules not processed for user `28448c06ed814538be5a8caabe9f4285`. Rule list: `[]` (Enabled: `True`). {{(pid=79744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:26:32.694524 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.fernet_utils [None req-fd00c46d-3ef4-4d76-87b6-7bdc933b0623 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:26:32.774962 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 1115/2216] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 07:26:32 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 07:26:32.786828 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6491ad-3975-4305-8db4-151147184170 admin admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:26:32.789231 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.fernet_utils [None req-ca6491ad-3975-4305-8db4-151147184170 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:26:32.844864 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6491ad-3975-4305-8db4-151147184170 admin admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:26:32.848530 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1148f299-6ce2-4d7b-b659-957052c549cf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb341257aa8246b6847561e2fe1fa385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9f9c44db4984653b8d4b5f6b3b949f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:26:32.849161 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1148f299-6ce2-4d7b-b659-957052c549cf service cinder] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:26:32.849981 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1148f299-6ce2-4d7b-b659-957052c549cf service cinder] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:26:32.850428 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1148f299-6ce2-4d7b-b659-957052c549cf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:26:32.904758 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1148f299-6ce2-4d7b-b659-957052c549cf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:26:32.906196 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1148f299-6ce2-4d7b-b659-957052c549cf service cinder] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:26:32.915766 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 1102/2217] 10.222.0.21 () {60 vars in 1365 bytes} [Wed May 4 07:26:32 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 07:26:42.046422 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd00c46d-3ef4-4d76-87b6-7bdc933b0623 None None] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:26:42.049915 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.fernet_utils [None req-fd00c46d-3ef4-4d76-87b6-7bdc933b0623 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:26:42.139959 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd00c46d-3ef4-4d76-87b6-7bdc933b0623 None None] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:26:42.156902 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe91118-ff06-4c14-ba5f-9555c92de813 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:26:42.157740 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe91118-ff06-4c14-ba5f-9555c92de813 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:26:42.158335 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe91118-ff06-4c14-ba5f-9555c92de813 admin admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:26:42.159255 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe91118-ff06-4c14-ba5f-9555c92de813 admin admin] PATH_INFO: `/v3/users/744bd376cf784021affcd744d392ef88` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:26:42.161503 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe91118-ff06-4c14-ba5f-9555c92de813 admin admin] RBAC: Authorizing `identity:delete_user(user_id=744bd376cf784021affcd744d392ef88)` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:26:42.164156 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe91118-ff06-4c14-ba5f-9555c92de813 admin admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:26:42.226676 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-dbe91118-ff06-4c14-ba5f-9555c92de813 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '744bd376cf784021affcd744d392ef88'} {{(pid=79744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:26:42.229177 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-dbe91118-ff06-4c14-ba5f-9555c92de813 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '744bd376cf784021affcd744d392ef88'} {{(pid=79744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:26:42.235464 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-dbe91118-ff06-4c14-ba5f-9555c92de813 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '744bd376cf784021affcd744d392ef88'} {{(pid=79744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:26:42.237378 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-dbe91118-ff06-4c14-ba5f-9555c92de813 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '744bd376cf784021affcd744d392ef88'} {{(pid=79744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:26:42.250111 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-dbe91118-ff06-4c14-ba5f-9555c92de813 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '744bd376cf784021affcd744d392ef88'} {{(pid=79744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:26:42.264997 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 1116/2218] 10.222.0.21 () {58 vars in 1223 bytes} [Wed May 4 07:26:42 2022] DELETE /identity/v3/users/744bd376cf784021affcd744d392ef88 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 07:26:42.269698 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535d9466-164f-4f79-8c4d-51e436e78813 None None] REQUEST_METHOD: `POST` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:26:42.270223 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535d9466-164f-4f79-8c4d-51e436e78813 None None] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:26:42.270223 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535d9466-164f-4f79-8c4d-51e436e78813 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:26:42.290670 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.auth.core [None req-535d9466-164f-4f79-8c4d-51e436e78813 None None] MFA Rules not processed for user `83c5e0dcb991496ea6dee38384514508`. Rule list: `[]` (Enabled: `True`). {{(pid=79745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:26:42.292721 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.fernet_utils [None req-535d9466-164f-4f79-8c4d-51e436e78813 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:26:42.401330 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 1103/2219] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 07:26:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 07:26:42.416128 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe91118-ff06-4c14-ba5f-9555c92de813 admin admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:26:42.417644 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.fernet_utils [None req-dbe91118-ff06-4c14-ba5f-9555c92de813 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:26:42.495452 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe91118-ff06-4c14-ba5f-9555c92de813 admin admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:26:42.499757 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70bd8f58-1cd9-45ca-915e-41f9b6a7edda service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91cb92d00273402b837cb29b37325101', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9f9c44db4984653b8d4b5f6b3b949f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:26:42.500457 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bd8f58-1cd9-45ca-915e-41f9b6a7edda service neutron] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:26:42.500809 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bd8f58-1cd9-45ca-915e-41f9b6a7edda service neutron] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:26:42.501170 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bd8f58-1cd9-45ca-915e-41f9b6a7edda service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:26:42.511719 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70bd8f58-1cd9-45ca-915e-41f9b6a7edda service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:26:42.513213 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70bd8f58-1cd9-45ca-915e-41f9b6a7edda service neutron] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:26:42.524043 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 1117/2220] 10.222.0.21 () {60 vars in 1365 bytes} [Wed May 4 07:26:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 07:26:43.121452 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535d9466-164f-4f79-8c4d-51e436e78813 None None] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:26:43.122980 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.fernet_utils [None req-535d9466-164f-4f79-8c4d-51e436e78813 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:26:43.139022 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535d9466-164f-4f79-8c4d-51e436e78813 None None] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:26:43.146518 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8794db2e-e88b-45bc-a866-4832bf996faf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:26:43.147604 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8794db2e-e88b-45bc-a866-4832bf996faf admin admin] REQUEST_METHOD: `DELETE` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:26:43.147882 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8794db2e-e88b-45bc-a866-4832bf996faf admin admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:26:43.148161 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8794db2e-e88b-45bc-a866-4832bf996faf admin admin] PATH_INFO: `/v3/projects/bc5d1b51715a4385ac1f4aa55dde4970` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:26:43.149973 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8794db2e-e88b-45bc-a866-4832bf996faf admin admin] RBAC: Authorizing `identity:delete_project(project_id=bc5d1b51715a4385ac1f4aa55dde4970)` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:26:43.152903 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8794db2e-e88b-45bc-a866-4832bf996faf admin admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:26:43.219580 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-8794db2e-e88b-45bc-a866-4832bf996faf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bc5d1b51715a4385ac1f4aa55dde4970', 'request_id': 'req-8794db2e-e88b-45bc-a866-4832bf996faf'} {{(pid=79745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:26:43.226087 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-8794db2e-e88b-45bc-a866-4832bf996faf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bc5d1b51715a4385ac1f4aa55dde4970', 'request_id': 'req-8794db2e-e88b-45bc-a866-4832bf996faf'} {{(pid=79745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:26:43.236474 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-8794db2e-e88b-45bc-a866-4832bf996faf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bc5d1b51715a4385ac1f4aa55dde4970', 'request_id': 'req-8794db2e-e88b-45bc-a866-4832bf996faf'} {{(pid=79745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:26:43.251681 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-8794db2e-e88b-45bc-a866-4832bf996faf admin admin] The token cache is being invalidate because project bc5d1b51715a4385ac1f4aa55dde4970 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79745) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 07:26:43.252124 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-8794db2e-e88b-45bc-a866-4832bf996faf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:26:43.252906 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-8794db2e-e88b-45bc-a866-4832bf996faf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:26:43.260659 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 1104/2221] 10.222.0.21 () {58 vars in 1232 bytes} [Wed May 4 07:26:43 2022] DELETE /identity/v3/projects/bc5d1b51715a4385ac1f4aa55dde4970 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 07:26:43.270810 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a387d3e-edef-4cc3-80eb-390ec850f549 None None] REQUEST_METHOD: `POST` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:26:43.272113 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a387d3e-edef-4cc3-80eb-390ec850f549 None None] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:26:43.272535 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a387d3e-edef-4cc3-80eb-390ec850f549 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:26:43.293694 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.auth.core [None req-6a387d3e-edef-4cc3-80eb-390ec850f549 None None] MFA Rules not processed for user `83c5e0dcb991496ea6dee38384514508`. Rule list: `[]` (Enabled: `True`). {{(pid=79744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:26:43.295429 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.fernet_utils [None req-6a387d3e-edef-4cc3-80eb-390ec850f549 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:26:43.379186 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 1118/2222] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 07:26:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 07:26:43.380887 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca12b887-54af-461a-899d-00f7d4832554 None None] REQUEST_METHOD: `POST` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:26:43.381369 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca12b887-54af-461a-899d-00f7d4832554 None None] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:26:43.381458 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca12b887-54af-461a-899d-00f7d4832554 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:26:43.423334 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.auth.core [None req-ca12b887-54af-461a-899d-00f7d4832554 None None] MFA Rules not processed for user `83c5e0dcb991496ea6dee38384514508`. Rule list: `[]` (Enabled: `True`). {{(pid=79745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:26:43.425900 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.fernet_utils [None req-ca12b887-54af-461a-899d-00f7d4832554 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:26:43.437934 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 1105/2223] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 07:26:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 07:26:43.443630 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a387d3e-edef-4cc3-80eb-390ec850f549 None None] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:26:43.456726 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a387d3e-edef-4cc3-80eb-390ec850f549 None None] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:26:43.468367 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1efe91f-27ad-4560-bc41-041b7cfd5be8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:26:43.469076 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1efe91f-27ad-4560-bc41-041b7cfd5be8 admin admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:26:43.469386 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1efe91f-27ad-4560-bc41-041b7cfd5be8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:26:43.469633 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1efe91f-27ad-4560-bc41-041b7cfd5be8 admin admin] PATH_INFO: `/v3/domains` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:26:43.470575 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1efe91f-27ad-4560-bc41-041b7cfd5be8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79744) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 07:26:43.471237 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1efe91f-27ad-4560-bc41-041b7cfd5be8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:26:43.473858 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1efe91f-27ad-4560-bc41-041b7cfd5be8 admin admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:26:43.492644 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 1119/2224] 10.222.0.21 () {58 vars in 1152 bytes} [Wed May 4 07:26:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 07:26:43.498685 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca12b887-54af-461a-899d-00f7d4832554 None None] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:26:43.510354 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca12b887-54af-461a-899d-00f7d4832554 None None] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:26:43.516512 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42a85da-0066-467e-8d77-c55e1d4ff714 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:26:43.517907 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42a85da-0066-467e-8d77-c55e1d4ff714 admin admin] REQUEST_METHOD: `POST` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:26:43.518863 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42a85da-0066-467e-8d77-c55e1d4ff714 admin admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:26:43.519356 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42a85da-0066-467e-8d77-c55e1d4ff714 admin admin] PATH_INFO: `/v3/projects` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:26:43.520324 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42a85da-0066-467e-8d77-c55e1d4ff714 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:26:43.522842 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42a85da-0066-467e-8d77-c55e1d4ff714 admin admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:26:43.557021 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 1106/2225] 10.222.0.21 () {60 vars in 1152 bytes} [Wed May 4 07:26:43 2022] POST /identity/v3/projects => generated 369 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 07:26:43.561271 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1efe91f-27ad-4560-bc41-041b7cfd5be8 admin admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:26:43.573066 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1efe91f-27ad-4560-bc41-041b7cfd5be8 admin admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:26:43.656327 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9055233d-c4a1-46a5-8b00-3b6550936232 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:26:43.656914 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9055233d-c4a1-46a5-8b00-3b6550936232 admin admin] REQUEST_METHOD: `POST` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:26:43.657201 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9055233d-c4a1-46a5-8b00-3b6550936232 admin admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:26:43.657474 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9055233d-c4a1-46a5-8b00-3b6550936232 admin admin] PATH_INFO: `/v3/users` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:26:43.658382 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9055233d-c4a1-46a5-8b00-3b6550936232 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:26:43.660856 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9055233d-c4a1-46a5-8b00-3b6550936232 admin admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:26:43.690519 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 1120/2226] 10.222.0.21 () {60 vars in 1143 bytes} [Wed May 4 07:26:43 2022] POST /identity/v3/users => generated 285 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 07:26:43.696085 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42a85da-0066-467e-8d77-c55e1d4ff714 admin admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:26:43.708585 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42a85da-0066-467e-8d77-c55e1d4ff714 admin admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:26:43.721172 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1491c76-fa75-495a-a5d6-279d2616a95b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:26:43.722264 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1491c76-fa75-495a-a5d6-279d2616a95b admin admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:26:43.722729 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1491c76-fa75-495a-a5d6-279d2616a95b admin admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:26:43.723690 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1491c76-fa75-495a-a5d6-279d2616a95b admin admin] PATH_INFO: `/v3/roles` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:26:43.725324 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1491c76-fa75-495a-a5d6-279d2616a95b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:26:43.729352 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1491c76-fa75-495a-a5d6-279d2616a95b admin admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:26:43.755807 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 1107/2227] 10.222.0.21 () {58 vars in 1121 bytes} [Wed May 4 07:26:43 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 04 07:26:43.756653 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9055233d-c4a1-46a5-8b00-3b6550936232 admin admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:26:43.769990 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9055233d-c4a1-46a5-8b00-3b6550936232 admin admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:26:43.780996 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b11abc4-f4cf-461c-b5e7-433832b24eac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:26:43.788642 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b11abc4-f4cf-461c-b5e7-433832b24eac admin admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:26:43.788642 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b11abc4-f4cf-461c-b5e7-433832b24eac admin admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:26:43.788642 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b11abc4-f4cf-461c-b5e7-433832b24eac admin admin] PATH_INFO: `/v3/roles` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:26:43.789440 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b11abc4-f4cf-461c-b5e7-433832b24eac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:26:43.791636 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b11abc4-f4cf-461c-b5e7-433832b24eac admin admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:26:43.804357 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 1121/2228] 10.222.0.21 () {58 vars in 1121 bytes} [Wed May 4 07:26:43 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 04 07:26:43.809706 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1491c76-fa75-495a-a5d6-279d2616a95b admin admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:26:43.824859 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1491c76-fa75-495a-a5d6-279d2616a95b admin admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:26:43.830726 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e35022-c981-47ab-8f59-95858d1838c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:26:43.832196 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e35022-c981-47ab-8f59-95858d1838c0 admin admin] REQUEST_METHOD: `PUT` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:26:43.832668 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e35022-c981-47ab-8f59-95858d1838c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:26:43.833025 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e35022-c981-47ab-8f59-95858d1838c0 admin admin] PATH_INFO: `/v3/projects/d9a9e8f43db44d9e8b9d556feddeaedb/users/73e835b281f94eadac2bc0e97ab23e67/roles/9f89c07b05a14f18836116af22cba5f6` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:26:43.853175 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e35022-c981-47ab-8f59-95858d1838c0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d9a9e8f43db44d9e8b9d556feddeaedb, user_id=73e835b281f94eadac2bc0e97ab23e67, role_id=9f89c07b05a14f18836116af22cba5f6)` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:26:43.856019 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e35022-c981-47ab-8f59-95858d1838c0 admin admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:26:43.871651 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 1108/2229] 10.222.0.21 () {60 vars in 1482 bytes} [Wed May 4 07:26:43 2022] PUT /identity/v3/projects/d9a9e8f43db44d9e8b9d556feddeaedb/users/73e835b281f94eadac2bc0e97ab23e67/roles/9f89c07b05a14f18836116af22cba5f6 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 07:26:43.883472 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7190c4c2-79c1-4aef-adb4-49fdf016a336 None None] REQUEST_METHOD: `POST` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:26:43.884601 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7190c4c2-79c1-4aef-adb4-49fdf016a336 None None] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:26:43.884601 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7190c4c2-79c1-4aef-adb4-49fdf016a336 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:26:43.925961 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.auth.core [None req-7190c4c2-79c1-4aef-adb4-49fdf016a336 None None] MFA Rules not processed for user `73e835b281f94eadac2bc0e97ab23e67`. Rule list: `[]` (Enabled: `True`). {{(pid=79744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:26:43.927338 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.fernet_utils [None req-7190c4c2-79c1-4aef-adb4-49fdf016a336 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:26:44.031996 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 1122/2230] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 07:26:43 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 07:26:44.045957 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e35022-c981-47ab-8f59-95858d1838c0 admin admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:26:44.051070 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.fernet_utils [None req-69e35022-c981-47ab-8f59-95858d1838c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:26:44.125949 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e35022-c981-47ab-8f59-95858d1838c0 admin admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:26:44.131732 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85cb0a9f-e789-48c0-b246-e0dfd1090b58 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7538f5cab3364625a3e909f5f117ef2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9f9c44db4984653b8d4b5f6b3b949f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:26:44.132788 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cb0a9f-e789-48c0-b246-e0dfd1090b58 service glance] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:26:44.133110 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cb0a9f-e789-48c0-b246-e0dfd1090b58 service glance] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:26:44.133499 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cb0a9f-e789-48c0-b246-e0dfd1090b58 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:26:44.145766 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85cb0a9f-e789-48c0-b246-e0dfd1090b58 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:26:44.147424 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85cb0a9f-e789-48c0-b246-e0dfd1090b58 service glance] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:26:44.159656 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 1109/2231] 10.222.0.21 () {60 vars in 1365 bytes} [Wed May 4 07:26:44 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 07:26:44.668225 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7190c4c2-79c1-4aef-adb4-49fdf016a336 None None] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:26:44.670502 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.fernet_utils [None req-7190c4c2-79c1-4aef-adb4-49fdf016a336 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:26:44.771383 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7190c4c2-79c1-4aef-adb4-49fdf016a336 None None] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:26:44.776382 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f47d4b-d634-4b65-a091-4e125059f7c9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb341257aa8246b6847561e2fe1fa385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9f9c44db4984653b8d4b5f6b3b949f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:26:44.777560 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f47d4b-d634-4b65-a091-4e125059f7c9 service cinder] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:26:44.777846 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f47d4b-d634-4b65-a091-4e125059f7c9 service cinder] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:26:44.778126 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f47d4b-d634-4b65-a091-4e125059f7c9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:26:44.780049 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.fernet_utils [None req-47f47d4b-d634-4b65-a091-4e125059f7c9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:26:44.900124 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f47d4b-d634-4b65-a091-4e125059f7c9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:26:44.902449 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f47d4b-d634-4b65-a091-4e125059f7c9 service cinder] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:26:44.926237 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 1123/2232] 10.222.0.21 () {60 vars in 1365 bytes} [Wed May 4 07:26:44 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 246 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 04 07:26:45.099516 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85cb0a9f-e789-48c0-b246-e0dfd1090b58 service glance] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:26:45.101901 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.fernet_utils [None req-85cb0a9f-e789-48c0-b246-e0dfd1090b58 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:26:45.265060 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85cb0a9f-e789-48c0-b246-e0dfd1090b58 service glance] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:26:45.295887 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d436bca-6876-4df5-8344-9aa8c3357296 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:26:45.296843 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d436bca-6876-4df5-8344-9aa8c3357296 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:26:45.298360 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d436bca-6876-4df5-8344-9aa8c3357296 admin admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:26:45.298647 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d436bca-6876-4df5-8344-9aa8c3357296 admin admin] PATH_INFO: `/v3/users/c42d081e54644fd0ac8017de1e64491c` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:26:45.301893 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d436bca-6876-4df5-8344-9aa8c3357296 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c42d081e54644fd0ac8017de1e64491c)` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:26:45.304051 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d436bca-6876-4df5-8344-9aa8c3357296 admin admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:26:45.395403 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-0d436bca-6876-4df5-8344-9aa8c3357296 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c42d081e54644fd0ac8017de1e64491c'} {{(pid=79745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:26:45.409010 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-0d436bca-6876-4df5-8344-9aa8c3357296 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c42d081e54644fd0ac8017de1e64491c'} {{(pid=79745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:26:45.409792 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-0d436bca-6876-4df5-8344-9aa8c3357296 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c42d081e54644fd0ac8017de1e64491c'} {{(pid=79745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:26:45.410410 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-0d436bca-6876-4df5-8344-9aa8c3357296 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c42d081e54644fd0ac8017de1e64491c'} {{(pid=79745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:26:45.418916 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-0d436bca-6876-4df5-8344-9aa8c3357296 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c42d081e54644fd0ac8017de1e64491c'} {{(pid=79745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:26:45.441420 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 1110/2233] 10.222.0.21 () {58 vars in 1223 bytes} [Wed May 4 07:26:45 2022] DELETE /identity/v3/users/c42d081e54644fd0ac8017de1e64491c => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 07:26:45.448674 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303906b4-ee43-4bb2-ab2c-935e80717627 None None] REQUEST_METHOD: `POST` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:26:45.448674 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303906b4-ee43-4bb2-ab2c-935e80717627 None None] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:26:45.448674 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303906b4-ee43-4bb2-ab2c-935e80717627 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:26:45.472159 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.auth.core [None req-303906b4-ee43-4bb2-ab2c-935e80717627 None None] MFA Rules not processed for user `83c5e0dcb991496ea6dee38384514508`. Rule list: `[]` (Enabled: `True`). {{(pid=79744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:26:45.473417 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.fernet_utils [None req-303906b4-ee43-4bb2-ab2c-935e80717627 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:26:45.562653 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 1124/2234] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 07:26:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 07:26:45.573819 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d436bca-6876-4df5-8344-9aa8c3357296 admin admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:26:45.575527 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.fernet_utils [None req-0d436bca-6876-4df5-8344-9aa8c3357296 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:26:45.652511 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d436bca-6876-4df5-8344-9aa8c3357296 admin admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:26:45.658396 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c15ccb-4cb4-49f0-b1d1-cb43102ac309 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91cb92d00273402b837cb29b37325101', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9f9c44db4984653b8d4b5f6b3b949f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:26:45.659605 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c15ccb-4cb4-49f0-b1d1-cb43102ac309 service neutron] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:26:45.660057 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c15ccb-4cb4-49f0-b1d1-cb43102ac309 service neutron] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:26:45.660530 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c15ccb-4cb4-49f0-b1d1-cb43102ac309 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:26:45.673598 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c15ccb-4cb4-49f0-b1d1-cb43102ac309 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:26:45.674951 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c15ccb-4cb4-49f0-b1d1-cb43102ac309 service neutron] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:26:45.686471 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 1111/2235] 10.222.0.21 () {60 vars in 1365 bytes} [Wed May 4 07:26:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 07:26:46.039047 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303906b4-ee43-4bb2-ab2c-935e80717627 None None] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:26:46.041721 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.fernet_utils [None req-303906b4-ee43-4bb2-ab2c-935e80717627 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:26:46.057816 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303906b4-ee43-4bb2-ab2c-935e80717627 None None] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:26:46.063179 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d26f2b-ce9f-4543-88bb-8da737db40c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:26:46.064319 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d26f2b-ce9f-4543-88bb-8da737db40c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:26:46.064882 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d26f2b-ce9f-4543-88bb-8da737db40c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:26:46.065310 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d26f2b-ce9f-4543-88bb-8da737db40c3 admin admin] PATH_INFO: `/v3/projects/302ad528b424485b8a859d28ccb33b02` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:26:46.073522 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d26f2b-ce9f-4543-88bb-8da737db40c3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=302ad528b424485b8a859d28ccb33b02)` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:26:46.075712 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d26f2b-ce9f-4543-88bb-8da737db40c3 admin admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:26:46.162856 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-e4d26f2b-ce9f-4543-88bb-8da737db40c3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '302ad528b424485b8a859d28ccb33b02', 'request_id': 'req-e4d26f2b-ce9f-4543-88bb-8da737db40c3'} {{(pid=79744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:26:46.170488 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-e4d26f2b-ce9f-4543-88bb-8da737db40c3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '302ad528b424485b8a859d28ccb33b02', 'request_id': 'req-e4d26f2b-ce9f-4543-88bb-8da737db40c3'} {{(pid=79744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:26:46.181637 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-e4d26f2b-ce9f-4543-88bb-8da737db40c3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '302ad528b424485b8a859d28ccb33b02', 'request_id': 'req-e4d26f2b-ce9f-4543-88bb-8da737db40c3'} {{(pid=79744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:26:46.194978 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-e4d26f2b-ce9f-4543-88bb-8da737db40c3 admin admin] The token cache is being invalidate because project 302ad528b424485b8a859d28ccb33b02 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79744) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 07:26:46.195291 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-e4d26f2b-ce9f-4543-88bb-8da737db40c3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:26:46.196033 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-e4d26f2b-ce9f-4543-88bb-8da737db40c3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:26:46.199054 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 1125/2236] 10.222.0.21 () {58 vars in 1232 bytes} [Wed May 4 07:26:46 2022] DELETE /identity/v3/projects/302ad528b424485b8a859d28ccb33b02 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 07:26:46.203641 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c15ccb-4cb4-49f0-b1d1-cb43102ac309 service neutron] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:26:46.229852 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c15ccb-4cb4-49f0-b1d1-cb43102ac309 service neutron] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:26:46.295125 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a95022-aac5-41f2-bdee-f1c0b0455641 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:26:46.296031 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a95022-aac5-41f2-bdee-f1c0b0455641 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:26:46.296314 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a95022-aac5-41f2-bdee-f1c0b0455641 admin admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:26:46.296583 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a95022-aac5-41f2-bdee-f1c0b0455641 admin admin] PATH_INFO: `/v3/users/16ad5c68d50e4bec8d2f00505a89d6ba` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:26:46.298222 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a95022-aac5-41f2-bdee-f1c0b0455641 admin admin] RBAC: Authorizing `identity:delete_user(user_id=16ad5c68d50e4bec8d2f00505a89d6ba)` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:26:46.299939 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a95022-aac5-41f2-bdee-f1c0b0455641 admin admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:26:46.356614 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-22a95022-aac5-41f2-bdee-f1c0b0455641 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '16ad5c68d50e4bec8d2f00505a89d6ba'} {{(pid=79745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:26:46.369119 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-22a95022-aac5-41f2-bdee-f1c0b0455641 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '16ad5c68d50e4bec8d2f00505a89d6ba'} {{(pid=79745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:26:46.369961 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-22a95022-aac5-41f2-bdee-f1c0b0455641 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '16ad5c68d50e4bec8d2f00505a89d6ba'} {{(pid=79745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:26:46.370648 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-22a95022-aac5-41f2-bdee-f1c0b0455641 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '16ad5c68d50e4bec8d2f00505a89d6ba'} {{(pid=79745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:26:46.378110 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-22a95022-aac5-41f2-bdee-f1c0b0455641 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '16ad5c68d50e4bec8d2f00505a89d6ba'} {{(pid=79745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:26:46.395507 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 1112/2237] 10.222.0.21 () {58 vars in 1223 bytes} [Wed May 4 07:26:46 2022] DELETE /identity/v3/users/16ad5c68d50e4bec8d2f00505a89d6ba => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 07:26:46.715850 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d26f2b-ce9f-4543-88bb-8da737db40c3 admin admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:26:46.717558 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.fernet_utils [None req-e4d26f2b-ce9f-4543-88bb-8da737db40c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:26:46.733269 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d26f2b-ce9f-4543-88bb-8da737db40c3 admin admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:26:46.818265 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6e4f5b-42b2-4a6e-870a-eacaaa6a0d0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:26:46.819180 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6e4f5b-42b2-4a6e-870a-eacaaa6a0d0a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:26:46.819501 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6e4f5b-42b2-4a6e-870a-eacaaa6a0d0a admin admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:26:46.819779 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6e4f5b-42b2-4a6e-870a-eacaaa6a0d0a admin admin] PATH_INFO: `/v3/projects/c8ca65e8deb1471a9cedb4282b9f2b67` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:26:46.821052 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6e4f5b-42b2-4a6e-870a-eacaaa6a0d0a admin admin] RBAC: Authorizing `identity:delete_project(project_id=c8ca65e8deb1471a9cedb4282b9f2b67)` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:26:46.823627 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6e4f5b-42b2-4a6e-870a-eacaaa6a0d0a admin admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:26:46.916441 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-3f6e4f5b-42b2-4a6e-870a-eacaaa6a0d0a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c8ca65e8deb1471a9cedb4282b9f2b67', 'request_id': 'req-3f6e4f5b-42b2-4a6e-870a-eacaaa6a0d0a'} {{(pid=79744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:26:46.916836 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-3f6e4f5b-42b2-4a6e-870a-eacaaa6a0d0a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c8ca65e8deb1471a9cedb4282b9f2b67', 'request_id': 'req-3f6e4f5b-42b2-4a6e-870a-eacaaa6a0d0a'} {{(pid=79744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:26:46.926550 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-3f6e4f5b-42b2-4a6e-870a-eacaaa6a0d0a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c8ca65e8deb1471a9cedb4282b9f2b67', 'request_id': 'req-3f6e4f5b-42b2-4a6e-870a-eacaaa6a0d0a'} {{(pid=79744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:26:46.943203 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-3f6e4f5b-42b2-4a6e-870a-eacaaa6a0d0a admin admin] The token cache is being invalidate because project c8ca65e8deb1471a9cedb4282b9f2b67 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79744) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 07:26:46.943203 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-3f6e4f5b-42b2-4a6e-870a-eacaaa6a0d0a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:26:46.943203 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-3f6e4f5b-42b2-4a6e-870a-eacaaa6a0d0a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:26:46.943660 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 1126/2238] 10.222.0.21 () {58 vars in 1232 bytes} [Wed May 4 07:26:46 2022] DELETE /identity/v3/projects/c8ca65e8deb1471a9cedb4282b9f2b67 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 07:26:46.949849 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b73309-7913-4a8d-990a-b90d78da2ef0 None None] REQUEST_METHOD: `POST` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:26:46.950221 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b73309-7913-4a8d-990a-b90d78da2ef0 None None] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:26:46.950424 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b73309-7913-4a8d-990a-b90d78da2ef0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:26:46.969974 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.auth.core [None req-b1b73309-7913-4a8d-990a-b90d78da2ef0 None None] MFA Rules not processed for user `83c5e0dcb991496ea6dee38384514508`. Rule list: `[]` (Enabled: `True`). {{(pid=79745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:26:46.971299 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.fernet_utils [None req-b1b73309-7913-4a8d-990a-b90d78da2ef0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:26:47.046547 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 1113/2239] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 07:26:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 07:26:47.054792 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3df208-5ebf-4cbd-bf6b-54dabd0b20cb None None] REQUEST_METHOD: `POST` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:26:47.055351 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3df208-5ebf-4cbd-bf6b-54dabd0b20cb None None] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:26:47.055351 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3df208-5ebf-4cbd-bf6b-54dabd0b20cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:26:47.076492 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.auth.core [None req-cb3df208-5ebf-4cbd-bf6b-54dabd0b20cb None None] MFA Rules not processed for user `83c5e0dcb991496ea6dee38384514508`. Rule list: `[]` (Enabled: `True`). {{(pid=79744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:26:47.078015 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.fernet_utils [None req-cb3df208-5ebf-4cbd-bf6b-54dabd0b20cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:26:47.089553 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 1127/2240] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 07:26:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 07:26:47.094295 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b73309-7913-4a8d-990a-b90d78da2ef0 None None] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:26:47.108715 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b73309-7913-4a8d-990a-b90d78da2ef0 None None] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:26:47.115662 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e30a89-fab7-4031-ba0e-f0ef55dba946 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:26:47.116873 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e30a89-fab7-4031-ba0e-f0ef55dba946 admin admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:26:47.117343 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e30a89-fab7-4031-ba0e-f0ef55dba946 admin admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:26:47.117759 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e30a89-fab7-4031-ba0e-f0ef55dba946 admin admin] PATH_INFO: `/v3/domains` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:26:47.119522 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e30a89-fab7-4031-ba0e-f0ef55dba946 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 07:26:47.119999 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e30a89-fab7-4031-ba0e-f0ef55dba946 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:26:47.122768 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e30a89-fab7-4031-ba0e-f0ef55dba946 admin admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:26:47.150059 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 1114/2241] 10.222.0.21 () {58 vars in 1152 bytes} [Wed May 4 07:26:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 07:26:47.151307 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3df208-5ebf-4cbd-bf6b-54dabd0b20cb None None] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:26:47.161146 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3df208-5ebf-4cbd-bf6b-54dabd0b20cb None None] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:26:47.177845 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbd9fa1-072c-4151-a577-d55cd381023c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:26:47.178636 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbd9fa1-072c-4151-a577-d55cd381023c admin admin] REQUEST_METHOD: `POST` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:26:47.179004 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbd9fa1-072c-4151-a577-d55cd381023c admin admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:26:47.179368 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbd9fa1-072c-4151-a577-d55cd381023c admin admin] PATH_INFO: `/v3/projects` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:26:47.180175 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bbd9fa1-072c-4151-a577-d55cd381023c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:26:47.183257 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bbd9fa1-072c-4151-a577-d55cd381023c admin admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:26:47.213135 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 1128/2242] 10.222.0.21 () {60 vars in 1152 bytes} [Wed May 4 07:26:47 2022] POST /identity/v3/projects => generated 383 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 07:26:47.217709 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e30a89-fab7-4031-ba0e-f0ef55dba946 admin admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:26:47.229278 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e30a89-fab7-4031-ba0e-f0ef55dba946 admin admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:26:47.310041 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4591c004-93b1-4cb4-99ed-3468013b838f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:26:47.310666 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4591c004-93b1-4cb4-99ed-3468013b838f admin admin] REQUEST_METHOD: `POST` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:26:47.310949 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4591c004-93b1-4cb4-99ed-3468013b838f admin admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:26:47.311250 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4591c004-93b1-4cb4-99ed-3468013b838f admin admin] PATH_INFO: `/v3/users` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:26:47.312026 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4591c004-93b1-4cb4-99ed-3468013b838f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:26:47.314240 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4591c004-93b1-4cb4-99ed-3468013b838f admin admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:26:47.336223 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 1115/2243] 10.222.0.21 () {60 vars in 1143 bytes} [Wed May 4 07:26:47 2022] POST /identity/v3/users => generated 292 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 07:26:47.341758 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbd9fa1-072c-4151-a577-d55cd381023c admin admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:26:47.353742 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbd9fa1-072c-4151-a577-d55cd381023c admin admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:26:47.359108 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c157a3bf-e848-4aa4-ab19-dab2d6dd48cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:26:47.359804 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c157a3bf-e848-4aa4-ab19-dab2d6dd48cc admin admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:26:47.360085 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c157a3bf-e848-4aa4-ab19-dab2d6dd48cc admin admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:26:47.360361 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c157a3bf-e848-4aa4-ab19-dab2d6dd48cc admin admin] PATH_INFO: `/v3/roles` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:26:47.361090 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c157a3bf-e848-4aa4-ab19-dab2d6dd48cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:26:47.362693 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c157a3bf-e848-4aa4-ab19-dab2d6dd48cc admin admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:26:47.374186 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 1129/2244] 10.222.0.21 () {58 vars in 1121 bytes} [Wed May 4 07:26:47 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 04 07:26:47.378465 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4591c004-93b1-4cb4-99ed-3468013b838f admin admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:26:47.389404 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4591c004-93b1-4cb4-99ed-3468013b838f admin admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:26:47.394832 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad179ad-d632-443d-9174-bab97490b53a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:26:47.395540 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad179ad-d632-443d-9174-bab97490b53a admin admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:26:47.395821 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad179ad-d632-443d-9174-bab97490b53a admin admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:26:47.396098 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad179ad-d632-443d-9174-bab97490b53a admin admin] PATH_INFO: `/v3/roles` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:26:47.396859 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad179ad-d632-443d-9174-bab97490b53a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:26:47.398460 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad179ad-d632-443d-9174-bab97490b53a admin admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:26:47.409905 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 1116/2245] 10.222.0.21 () {58 vars in 1121 bytes} [Wed May 4 07:26:47 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 07:26:47.414065 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c157a3bf-e848-4aa4-ab19-dab2d6dd48cc admin admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:26:47.424571 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c157a3bf-e848-4aa4-ab19-dab2d6dd48cc admin admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:26:47.429385 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1af48f7-212b-46c7-bac2-4aa6fcbbb604 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:26:47.430325 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1af48f7-212b-46c7-bac2-4aa6fcbbb604 admin admin] REQUEST_METHOD: `PUT` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:26:47.430606 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1af48f7-212b-46c7-bac2-4aa6fcbbb604 admin admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:26:47.430879 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1af48f7-212b-46c7-bac2-4aa6fcbbb604 admin admin] PATH_INFO: `/v3/projects/13f43c66a60c4cd290e64ad9e0a826fb/users/e4cf02e06a4043098fc17f3b3acf19dd/roles/9f89c07b05a14f18836116af22cba5f6` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:26:47.458288 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1af48f7-212b-46c7-bac2-4aa6fcbbb604 admin admin] RBAC: Authorizing `identity:create_grant(project_id=13f43c66a60c4cd290e64ad9e0a826fb, user_id=e4cf02e06a4043098fc17f3b3acf19dd, role_id=9f89c07b05a14f18836116af22cba5f6)` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:26:47.461447 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1af48f7-212b-46c7-bac2-4aa6fcbbb604 admin admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:26:47.489364 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 1130/2246] 10.222.0.21 () {60 vars in 1482 bytes} [Wed May 4 07:26:47 2022] PUT /identity/v3/projects/13f43c66a60c4cd290e64ad9e0a826fb/users/e4cf02e06a4043098fc17f3b3acf19dd/roles/9f89c07b05a14f18836116af22cba5f6 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 07:26:47.500163 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a26971-892b-43c4-990c-8e07fb8d3169 None None] REQUEST_METHOD: `POST` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:26:47.500401 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a26971-892b-43c4-990c-8e07fb8d3169 None None] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:26:47.501088 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a26971-892b-43c4-990c-8e07fb8d3169 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:26:47.533552 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.auth.core [None req-69a26971-892b-43c4-990c-8e07fb8d3169 None None] MFA Rules not processed for user `e4cf02e06a4043098fc17f3b3acf19dd`. Rule list: `[]` (Enabled: `True`). {{(pid=79745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:26:47.535061 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.fernet_utils [None req-69a26971-892b-43c4-990c-8e07fb8d3169 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:26:47.619429 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 1117/2247] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 07:26:47 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 07:26:47.628204 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1af48f7-212b-46c7-bac2-4aa6fcbbb604 admin admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:26:47.699115 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1af48f7-212b-46c7-bac2-4aa6fcbbb604 admin admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:26:47.704399 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9657d9a0-0517-4eea-b7d2-0149d644b9ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:26:47.705311 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9657d9a0-0517-4eea-b7d2-0149d644b9ae admin admin] REQUEST_METHOD: `POST` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:26:47.705617 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9657d9a0-0517-4eea-b7d2-0149d644b9ae admin admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:26:47.705919 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9657d9a0-0517-4eea-b7d2-0149d644b9ae admin admin] PATH_INFO: `/v3/projects` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:26:47.706722 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9657d9a0-0517-4eea-b7d2-0149d644b9ae admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:26:47.708845 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9657d9a0-0517-4eea-b7d2-0149d644b9ae admin admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:26:47.742596 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 1131/2248] 10.222.0.21 () {60 vars in 1152 bytes} [Wed May 4 07:26:47 2022] POST /identity/v3/projects => generated 381 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 07:26:47.743549 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a26971-892b-43c4-990c-8e07fb8d3169 None None] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:26:47.754870 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a26971-892b-43c4-990c-8e07fb8d3169 None None] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:26:47.824633 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e594d48f-8c36-480f-bbb9-d2331d40d6f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:26:47.825316 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e594d48f-8c36-480f-bbb9-d2331d40d6f7 admin admin] REQUEST_METHOD: `POST` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:26:47.825597 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e594d48f-8c36-480f-bbb9-d2331d40d6f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:26:47.825871 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e594d48f-8c36-480f-bbb9-d2331d40d6f7 admin admin] PATH_INFO: `/v3/users` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:26:47.826610 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e594d48f-8c36-480f-bbb9-d2331d40d6f7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:26:47.828608 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e594d48f-8c36-480f-bbb9-d2331d40d6f7 admin admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:26:47.850525 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 1118/2249] 10.222.0.21 () {60 vars in 1143 bytes} [Wed May 4 07:26:47 2022] POST /identity/v3/users => generated 297 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 07:26:47.856297 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9657d9a0-0517-4eea-b7d2-0149d644b9ae admin admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:26:47.867114 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9657d9a0-0517-4eea-b7d2-0149d644b9ae admin admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:26:47.872096 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d866855-a8a7-4499-8975-1351b0a4315a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:26:47.872770 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d866855-a8a7-4499-8975-1351b0a4315a admin admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:26:47.873056 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d866855-a8a7-4499-8975-1351b0a4315a admin admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:26:47.873328 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d866855-a8a7-4499-8975-1351b0a4315a admin admin] PATH_INFO: `/v3/roles` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:26:47.874064 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d866855-a8a7-4499-8975-1351b0a4315a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:26:47.875717 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d866855-a8a7-4499-8975-1351b0a4315a admin admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:26:47.888092 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 1132/2250] 10.222.0.21 () {58 vars in 1121 bytes} [Wed May 4 07:26:47 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 07:26:47.892594 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e594d48f-8c36-480f-bbb9-d2331d40d6f7 admin admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:26:47.903897 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e594d48f-8c36-480f-bbb9-d2331d40d6f7 admin admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:26:47.910649 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1220cf05-69ee-486e-96f9-133fbfff15a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:26:47.911567 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1220cf05-69ee-486e-96f9-133fbfff15a3 admin admin] REQUEST_METHOD: `PUT` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:26:47.911841 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1220cf05-69ee-486e-96f9-133fbfff15a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:26:47.912117 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1220cf05-69ee-486e-96f9-133fbfff15a3 admin admin] PATH_INFO: `/v3/projects/7dd00da78a4146429bbe7e1e8b355f15/users/3d72841b5f9d4f38baa5a153c6472e2f/roles/eb54c9cea2774a25b1fe8c79724408ee` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:26:47.929325 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1220cf05-69ee-486e-96f9-133fbfff15a3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7dd00da78a4146429bbe7e1e8b355f15, user_id=3d72841b5f9d4f38baa5a153c6472e2f, role_id=eb54c9cea2774a25b1fe8c79724408ee)` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:26:47.932366 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1220cf05-69ee-486e-96f9-133fbfff15a3 admin admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:26:47.949001 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 1119/2251] 10.222.0.21 () {60 vars in 1482 bytes} [Wed May 4 07:26:47 2022] PUT /identity/v3/projects/7dd00da78a4146429bbe7e1e8b355f15/users/3d72841b5f9d4f38baa5a153c6472e2f/roles/eb54c9cea2774a25b1fe8c79724408ee => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 07:26:47.953710 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d866855-a8a7-4499-8975-1351b0a4315a admin admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:26:47.964945 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d866855-a8a7-4499-8975-1351b0a4315a admin admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:26:48.035512 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60119f67-1ce8-443f-b395-644e86706e31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:26:48.036249 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60119f67-1ce8-443f-b395-644e86706e31 admin admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:26:48.036540 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60119f67-1ce8-443f-b395-644e86706e31 admin admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:26:48.036868 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60119f67-1ce8-443f-b395-644e86706e31 admin admin] PATH_INFO: `/v3/roles` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:26:48.037535 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60119f67-1ce8-443f-b395-644e86706e31 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:26:48.044605 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60119f67-1ce8-443f-b395-644e86706e31 admin admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:26:48.053453 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 1133/2252] 10.222.0.21 () {58 vars in 1121 bytes} [Wed May 4 07:26:47 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 07:26:48.054836 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1220cf05-69ee-486e-96f9-133fbfff15a3 admin admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:26:48.065317 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1220cf05-69ee-486e-96f9-133fbfff15a3 admin admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:26:48.074108 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776abb0d-f0bd-4ed6-8051-2b871867f461 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:26:48.075046 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776abb0d-f0bd-4ed6-8051-2b871867f461 admin admin] REQUEST_METHOD: `PUT` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:26:48.075416 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776abb0d-f0bd-4ed6-8051-2b871867f461 admin admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:26:48.075770 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776abb0d-f0bd-4ed6-8051-2b871867f461 admin admin] PATH_INFO: `/v3/projects/7dd00da78a4146429bbe7e1e8b355f15/users/3d72841b5f9d4f38baa5a153c6472e2f/roles/eb54c9cea2774a25b1fe8c79724408ee` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:26:48.079892 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776abb0d-f0bd-4ed6-8051-2b871867f461 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7dd00da78a4146429bbe7e1e8b355f15, user_id=3d72841b5f9d4f38baa5a153c6472e2f, role_id=eb54c9cea2774a25b1fe8c79724408ee)` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:26:48.085517 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776abb0d-f0bd-4ed6-8051-2b871867f461 admin admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:26:48.105469 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 1120/2253] 10.222.0.21 () {60 vars in 1482 bytes} [Wed May 4 07:26:48 2022] PUT /identity/v3/projects/7dd00da78a4146429bbe7e1e8b355f15/users/3d72841b5f9d4f38baa5a153c6472e2f/roles/eb54c9cea2774a25b1fe8c79724408ee => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 07:26:48.109737 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc7f732-cad6-4fe0-80cf-32cf0a58cab1 None None] REQUEST_METHOD: `POST` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:26:48.110243 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc7f732-cad6-4fe0-80cf-32cf0a58cab1 None None] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:26:48.110364 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc7f732-cad6-4fe0-80cf-32cf0a58cab1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:26:48.139773 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.auth.core [None req-dcc7f732-cad6-4fe0-80cf-32cf0a58cab1 None None] MFA Rules not processed for user `3d72841b5f9d4f38baa5a153c6472e2f`. Rule list: `[]` (Enabled: `True`). {{(pid=79744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:26:48.141138 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.fernet_utils [None req-dcc7f732-cad6-4fe0-80cf-32cf0a58cab1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:26:48.220823 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 1134/2254] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 07:26:48 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 07:26:48.235512 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776abb0d-f0bd-4ed6-8051-2b871867f461 admin admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:26:48.237323 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.fernet_utils [None req-776abb0d-f0bd-4ed6-8051-2b871867f461 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:26:48.320360 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776abb0d-f0bd-4ed6-8051-2b871867f461 admin admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:26:48.340658 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5352a524-4983-485b-bf5e-20adf8f59bd3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb341257aa8246b6847561e2fe1fa385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9f9c44db4984653b8d4b5f6b3b949f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:26:48.346502 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5352a524-4983-485b-bf5e-20adf8f59bd3 service cinder] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:26:48.346502 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5352a524-4983-485b-bf5e-20adf8f59bd3 service cinder] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:26:48.346502 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5352a524-4983-485b-bf5e-20adf8f59bd3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:26:48.356869 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5352a524-4983-485b-bf5e-20adf8f59bd3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:26:48.358789 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5352a524-4983-485b-bf5e-20adf8f59bd3 service cinder] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:26:48.370323 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 1121/2255] 10.222.0.21 () {60 vars in 1365 bytes} [Wed May 4 07:26:48 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 07:26:48.450040 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc7f732-cad6-4fe0-80cf-32cf0a58cab1 None None] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:26:48.461708 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc7f732-cad6-4fe0-80cf-32cf0a58cab1 None None] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:26:48.466181 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7872a886-df25-4f06-9582-1f445d2ffc71 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb341257aa8246b6847561e2fe1fa385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9f9c44db4984653b8d4b5f6b3b949f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:26:48.466827 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7872a886-df25-4f06-9582-1f445d2ffc71 service cinder] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:26:48.467101 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7872a886-df25-4f06-9582-1f445d2ffc71 service cinder] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:26:48.467401 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7872a886-df25-4f06-9582-1f445d2ffc71 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:26:48.530911 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7872a886-df25-4f06-9582-1f445d2ffc71 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:26:48.532445 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7872a886-df25-4f06-9582-1f445d2ffc71 service cinder] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:26:48.544272 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 1135/2256] 10.222.0.21 () {60 vars in 1365 bytes} [Wed May 4 07:26:48 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 07:26:48.651648 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5352a524-4983-485b-bf5e-20adf8f59bd3 service cinder] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:26:48.653773 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.fernet_utils [None req-5352a524-4983-485b-bf5e-20adf8f59bd3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:26:48.739800 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5352a524-4983-485b-bf5e-20adf8f59bd3 service cinder] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:26:48.746400 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b0ae1a-9c14-4d57-9fba-ab2938636ac0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:26:48.747353 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b0ae1a-9c14-4d57-9fba-ab2938636ac0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:26:48.747657 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b0ae1a-9c14-4d57-9fba-ab2938636ac0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:26:48.747977 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b0ae1a-9c14-4d57-9fba-ab2938636ac0 admin admin] PATH_INFO: `/v3/users/5074d1dc23a54562a9c79a377b052817` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:26:48.749245 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b0ae1a-9c14-4d57-9fba-ab2938636ac0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5074d1dc23a54562a9c79a377b052817)` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:26:48.751280 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b0ae1a-9c14-4d57-9fba-ab2938636ac0 admin admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:26:48.813611 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-54b0ae1a-9c14-4d57-9fba-ab2938636ac0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5074d1dc23a54562a9c79a377b052817'} {{(pid=79745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:26:48.835807 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-54b0ae1a-9c14-4d57-9fba-ab2938636ac0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5074d1dc23a54562a9c79a377b052817'} {{(pid=79745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:26:48.836665 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-54b0ae1a-9c14-4d57-9fba-ab2938636ac0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5074d1dc23a54562a9c79a377b052817'} {{(pid=79745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:26:48.838258 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-54b0ae1a-9c14-4d57-9fba-ab2938636ac0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5074d1dc23a54562a9c79a377b052817'} {{(pid=79745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:26:48.847477 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-54b0ae1a-9c14-4d57-9fba-ab2938636ac0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5074d1dc23a54562a9c79a377b052817'} {{(pid=79745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:26:48.860864 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7872a886-df25-4f06-9582-1f445d2ffc71 service cinder] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:26:48.863742 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 1122/2257] 10.222.0.21 () {58 vars in 1223 bytes} [Wed May 4 07:26:48 2022] DELETE /identity/v3/users/5074d1dc23a54562a9c79a377b052817 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 07:26:48.869143 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22deb8b4-88ae-4238-9f29-7d94e9975e00 None None] REQUEST_METHOD: `POST` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:26:48.869606 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22deb8b4-88ae-4238-9f29-7d94e9975e00 None None] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:26:48.870284 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22deb8b4-88ae-4238-9f29-7d94e9975e00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:26:48.878544 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7872a886-df25-4f06-9582-1f445d2ffc71 service cinder] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:26:48.896450 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.auth.core [None req-22deb8b4-88ae-4238-9f29-7d94e9975e00 None None] MFA Rules not processed for user `83c5e0dcb991496ea6dee38384514508`. Rule list: `[]` (Enabled: `True`). {{(pid=79745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:26:48.897671 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.fernet_utils [None req-22deb8b4-88ae-4238-9f29-7d94e9975e00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:26:48.966513 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 1123/2258] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 07:26:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 07:26:48.973863 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5845b0d2-20cf-4cd3-a709-674bc614df7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:26:48.974743 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5845b0d2-20cf-4cd3-a709-674bc614df7c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:26:48.975022 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5845b0d2-20cf-4cd3-a709-674bc614df7c admin admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:26:48.975327 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5845b0d2-20cf-4cd3-a709-674bc614df7c admin admin] PATH_INFO: `/v3/users/e4cf02e06a4043098fc17f3b3acf19dd` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:26:48.976945 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5845b0d2-20cf-4cd3-a709-674bc614df7c admin admin] RBAC: Authorizing `identity:delete_user(user_id=e4cf02e06a4043098fc17f3b3acf19dd)` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:26:48.977719 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22deb8b4-88ae-4238-9f29-7d94e9975e00 None None] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:26:48.979037 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.fernet_utils [None req-22deb8b4-88ae-4238-9f29-7d94e9975e00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:26:48.979826 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5845b0d2-20cf-4cd3-a709-674bc614df7c admin admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:26:49.047927 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-5845b0d2-20cf-4cd3-a709-674bc614df7c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e4cf02e06a4043098fc17f3b3acf19dd'} {{(pid=79744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:26:49.048784 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-5845b0d2-20cf-4cd3-a709-674bc614df7c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e4cf02e06a4043098fc17f3b3acf19dd'} {{(pid=79744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:26:49.057098 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-5845b0d2-20cf-4cd3-a709-674bc614df7c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e4cf02e06a4043098fc17f3b3acf19dd'} {{(pid=79744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:26:49.057988 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-5845b0d2-20cf-4cd3-a709-674bc614df7c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e4cf02e06a4043098fc17f3b3acf19dd'} {{(pid=79744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:26:49.058128 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22deb8b4-88ae-4238-9f29-7d94e9975e00 None None] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:26:49.061690 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7235f4-07b7-4fa5-b30f-9cc1540c1e51 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91cb92d00273402b837cb29b37325101', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9f9c44db4984653b8d4b5f6b3b949f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:26:49.062337 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7235f4-07b7-4fa5-b30f-9cc1540c1e51 service neutron] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:26:49.062619 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7235f4-07b7-4fa5-b30f-9cc1540c1e51 service neutron] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:26:49.062905 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7235f4-07b7-4fa5-b30f-9cc1540c1e51 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:26:49.064826 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.fernet_utils [None req-de7235f4-07b7-4fa5-b30f-9cc1540c1e51 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:26:49.070106 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-5845b0d2-20cf-4cd3-a709-674bc614df7c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e4cf02e06a4043098fc17f3b3acf19dd'} {{(pid=79744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:26:49.077924 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7235f4-07b7-4fa5-b30f-9cc1540c1e51 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:26:49.079437 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7235f4-07b7-4fa5-b30f-9cc1540c1e51 service neutron] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:26:49.086092 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 1136/2259] 10.222.0.21 () {58 vars in 1223 bytes} [Wed May 4 07:26:48 2022] DELETE /identity/v3/users/e4cf02e06a4043098fc17f3b3acf19dd => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 07:26:49.089907 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 1124/2260] 10.222.0.21 () {60 vars in 1365 bytes} [Wed May 4 07:26:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 04 07:26:49.090734 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177cb0ed-27c0-4297-adaa-6996c27050aa None None] REQUEST_METHOD: `POST` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:26:49.091024 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177cb0ed-27c0-4297-adaa-6996c27050aa None None] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:26:49.091339 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177cb0ed-27c0-4297-adaa-6996c27050aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:26:49.118794 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.auth.core [None req-177cb0ed-27c0-4297-adaa-6996c27050aa None None] MFA Rules not processed for user `83c5e0dcb991496ea6dee38384514508`. Rule list: `[]` (Enabled: `True`). {{(pid=79744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:26:49.121854 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.fernet_utils [None req-177cb0ed-27c0-4297-adaa-6996c27050aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:26:49.198015 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 1137/2261] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 07:26:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 07:26:49.228418 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7235f4-07b7-4fa5-b30f-9cc1540c1e51 service neutron] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:26:49.230267 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.fernet_utils [None req-de7235f4-07b7-4fa5-b30f-9cc1540c1e51 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:26:49.244323 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7235f4-07b7-4fa5-b30f-9cc1540c1e51 service neutron] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:26:49.319107 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc3617b-20e1-453e-aa15-f610264df105 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91cb92d00273402b837cb29b37325101', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9f9c44db4984653b8d4b5f6b3b949f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:26:49.320145 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc3617b-20e1-453e-aa15-f610264df105 service neutron] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:26:49.320559 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc3617b-20e1-453e-aa15-f610264df105 service neutron] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:26:49.321693 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc3617b-20e1-453e-aa15-f610264df105 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:26:49.342252 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc3617b-20e1-453e-aa15-f610264df105 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:26:49.344289 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc3617b-20e1-453e-aa15-f610264df105 service neutron] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:26:49.358796 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 1125/2262] 10.222.0.21 () {60 vars in 1365 bytes} [Wed May 4 07:26:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 07:26:49.422235 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177cb0ed-27c0-4297-adaa-6996c27050aa None None] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:26:49.423759 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.fernet_utils [None req-177cb0ed-27c0-4297-adaa-6996c27050aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:26:49.437419 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177cb0ed-27c0-4297-adaa-6996c27050aa None None] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:26:49.446644 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b8a030-d8ef-4100-bbbf-e3edf6e1e738 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:26:49.448528 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b8a030-d8ef-4100-bbbf-e3edf6e1e738 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:26:49.448971 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b8a030-d8ef-4100-bbbf-e3edf6e1e738 admin admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:26:49.449557 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b8a030-d8ef-4100-bbbf-e3edf6e1e738 admin admin] PATH_INFO: `/v3/projects/f971bd19417b4f1ba9cfc546419b9f15` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:26:49.451899 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b8a030-d8ef-4100-bbbf-e3edf6e1e738 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f971bd19417b4f1ba9cfc546419b9f15)` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:26:49.455446 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b8a030-d8ef-4100-bbbf-e3edf6e1e738 admin admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:26:49.517999 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-55b8a030-d8ef-4100-bbbf-e3edf6e1e738 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f971bd19417b4f1ba9cfc546419b9f15', 'request_id': 'req-55b8a030-d8ef-4100-bbbf-e3edf6e1e738'} {{(pid=79744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:26:49.524490 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-55b8a030-d8ef-4100-bbbf-e3edf6e1e738 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f971bd19417b4f1ba9cfc546419b9f15', 'request_id': 'req-55b8a030-d8ef-4100-bbbf-e3edf6e1e738'} {{(pid=79744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:26:49.539981 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-55b8a030-d8ef-4100-bbbf-e3edf6e1e738 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f971bd19417b4f1ba9cfc546419b9f15', 'request_id': 'req-55b8a030-d8ef-4100-bbbf-e3edf6e1e738'} {{(pid=79744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:26:49.553071 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-55b8a030-d8ef-4100-bbbf-e3edf6e1e738 admin admin] The token cache is being invalidate because project f971bd19417b4f1ba9cfc546419b9f15 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79744) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 07:26:49.553669 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-55b8a030-d8ef-4100-bbbf-e3edf6e1e738 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:26:49.554491 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-55b8a030-d8ef-4100-bbbf-e3edf6e1e738 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:26:49.557396 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 1138/2263] 10.222.0.21 () {58 vars in 1232 bytes} [Wed May 4 07:26:49 2022] DELETE /identity/v3/projects/f971bd19417b4f1ba9cfc546419b9f15 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 07:26:49.562311 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13e0a85-3b89-4ceb-ba31-3fbc6617ce61 None None] REQUEST_METHOD: `POST` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:26:49.563549 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13e0a85-3b89-4ceb-ba31-3fbc6617ce61 None None] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:26:49.564112 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13e0a85-3b89-4ceb-ba31-3fbc6617ce61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:26:49.596011 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.auth.core [None req-e13e0a85-3b89-4ceb-ba31-3fbc6617ce61 None None] MFA Rules not processed for user `83c5e0dcb991496ea6dee38384514508`. Rule list: `[]` (Enabled: `True`). {{(pid=79745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:26:49.597979 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.fernet_utils [None req-e13e0a85-3b89-4ceb-ba31-3fbc6617ce61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:26:49.687066 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 1126/2264] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 07:26:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 07:26:49.695018 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8ea64a-eb97-43dc-9d6e-271881ec84a0 None None] REQUEST_METHOD: `POST` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:26:49.695337 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8ea64a-eb97-43dc-9d6e-271881ec84a0 None None] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:26:49.695615 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8ea64a-eb97-43dc-9d6e-271881ec84a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:26:49.721335 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.auth.core [None req-6b8ea64a-eb97-43dc-9d6e-271881ec84a0 None None] MFA Rules not processed for user `83c5e0dcb991496ea6dee38384514508`. Rule list: `[]` (Enabled: `True`). {{(pid=79744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:26:49.722573 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.fernet_utils [None req-6b8ea64a-eb97-43dc-9d6e-271881ec84a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:26:49.732506 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 1139/2265] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 07:26:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 07:26:49.737080 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13e0a85-3b89-4ceb-ba31-3fbc6617ce61 None None] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:26:49.747190 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13e0a85-3b89-4ceb-ba31-3fbc6617ce61 None None] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:26:49.753115 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e572d14-805e-4135-8668-c81841bb4f36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:26:49.754672 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e572d14-805e-4135-8668-c81841bb4f36 admin admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:26:49.754672 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e572d14-805e-4135-8668-c81841bb4f36 admin admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:26:49.754930 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e572d14-805e-4135-8668-c81841bb4f36 admin admin] PATH_INFO: `/v3/domains` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:26:49.755822 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e572d14-805e-4135-8668-c81841bb4f36 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 07:26:49.756190 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e572d14-805e-4135-8668-c81841bb4f36 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:26:49.758259 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e572d14-805e-4135-8668-c81841bb4f36 admin admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:26:49.772899 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 1127/2266] 10.222.0.21 () {58 vars in 1152 bytes} [Wed May 4 07:26:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 07:26:49.779952 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8ea64a-eb97-43dc-9d6e-271881ec84a0 None None] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:26:49.789547 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8ea64a-eb97-43dc-9d6e-271881ec84a0 None None] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:26:49.797781 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535491d9-f721-4d5e-b4e7-d7f67d3aa111 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:26:49.798691 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535491d9-f721-4d5e-b4e7-d7f67d3aa111 admin admin] REQUEST_METHOD: `POST` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:26:49.799211 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535491d9-f721-4d5e-b4e7-d7f67d3aa111 admin admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:26:49.799672 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535491d9-f721-4d5e-b4e7-d7f67d3aa111 admin admin] PATH_INFO: `/v3/projects` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:26:49.800803 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535491d9-f721-4d5e-b4e7-d7f67d3aa111 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:26:49.802965 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535491d9-f721-4d5e-b4e7-d7f67d3aa111 admin admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:26:49.804845 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e572d14-805e-4135-8668-c81841bb4f36 admin admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:26:49.806626 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.fernet_utils [None req-3e572d14-805e-4135-8668-c81841bb4f36 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:26:49.825346 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e572d14-805e-4135-8668-c81841bb4f36 admin admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:26:49.831139 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2e7518-897d-422a-8d58-c62e4cc1dcda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:26:49.833531 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2e7518-897d-422a-8d58-c62e4cc1dcda admin admin] REQUEST_METHOD: `DELETE` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:26:49.834442 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2e7518-897d-422a-8d58-c62e4cc1dcda admin admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:26:49.835073 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2e7518-897d-422a-8d58-c62e4cc1dcda admin admin] PATH_INFO: `/v3/projects/13f43c66a60c4cd290e64ad9e0a826fb` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:26:49.837685 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2e7518-897d-422a-8d58-c62e4cc1dcda admin admin] RBAC: Authorizing `identity:delete_project(project_id=13f43c66a60c4cd290e64ad9e0a826fb)` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:26:49.839987 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2e7518-897d-422a-8d58-c62e4cc1dcda admin admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:26:49.853199 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 1140/2267] 10.222.0.21 () {60 vars in 1152 bytes} [Wed May 4 07:26:49 2022] POST /identity/v3/projects => generated 371 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 07:26:49.859035 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535491d9-f721-4d5e-b4e7-d7f67d3aa111 admin admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:26:49.909783 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-db2e7518-897d-422a-8d58-c62e4cc1dcda admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '13f43c66a60c4cd290e64ad9e0a826fb', 'request_id': 'req-db2e7518-897d-422a-8d58-c62e4cc1dcda'} {{(pid=79745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:26:49.918450 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-db2e7518-897d-422a-8d58-c62e4cc1dcda admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '13f43c66a60c4cd290e64ad9e0a826fb', 'request_id': 'req-db2e7518-897d-422a-8d58-c62e4cc1dcda'} {{(pid=79745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:26:49.929677 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-db2e7518-897d-422a-8d58-c62e4cc1dcda admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '13f43c66a60c4cd290e64ad9e0a826fb', 'request_id': 'req-db2e7518-897d-422a-8d58-c62e4cc1dcda'} {{(pid=79745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:26:49.951451 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-db2e7518-897d-422a-8d58-c62e4cc1dcda admin admin] The token cache is being invalidate because project 13f43c66a60c4cd290e64ad9e0a826fb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79745) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 07:26:49.951874 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-db2e7518-897d-422a-8d58-c62e4cc1dcda admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:26:49.952792 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-db2e7518-897d-422a-8d58-c62e4cc1dcda admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:26:49.955540 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 1128/2268] 10.222.0.21 () {58 vars in 1232 bytes} [Wed May 4 07:26:49 2022] DELETE /identity/v3/projects/13f43c66a60c4cd290e64ad9e0a826fb => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 07:26:49.961943 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2e7518-897d-422a-8d58-c62e4cc1dcda admin admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:26:49.964351 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.fernet_utils [None req-db2e7518-897d-422a-8d58-c62e4cc1dcda admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:26:49.974272 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535491d9-f721-4d5e-b4e7-d7f67d3aa111 admin admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:26:50.090340 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2e7518-897d-422a-8d58-c62e4cc1dcda admin admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:26:50.096671 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb3da43-0dfc-4cb4-8a75-a1841a7def56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:26:50.097618 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb3da43-0dfc-4cb4-8a75-a1841a7def56 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:26:50.097820 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb3da43-0dfc-4cb4-8a75-a1841a7def56 admin admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:26:50.098093 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb3da43-0dfc-4cb4-8a75-a1841a7def56 admin admin] PATH_INFO: `/v3/users/3d72841b5f9d4f38baa5a153c6472e2f` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:26:50.099423 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb3da43-0dfc-4cb4-8a75-a1841a7def56 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3d72841b5f9d4f38baa5a153c6472e2f)` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:26:50.101475 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb3da43-0dfc-4cb4-8a75-a1841a7def56 admin admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:26:50.127709 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c8f043-9ad2-4639-a270-7704f78b898a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:26:50.128536 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c8f043-9ad2-4639-a270-7704f78b898a admin admin] REQUEST_METHOD: `POST` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:26:50.129208 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c8f043-9ad2-4639-a270-7704f78b898a admin admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:26:50.129608 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c8f043-9ad2-4639-a270-7704f78b898a admin admin] PATH_INFO: `/v3/users` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:26:50.131805 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c8f043-9ad2-4639-a270-7704f78b898a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:26:50.138022 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c8f043-9ad2-4639-a270-7704f78b898a admin admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:26:50.165541 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 1141/2269] 10.222.0.21 () {60 vars in 1143 bytes} [Wed May 4 07:26:49 2022] POST /identity/v3/users => generated 286 bytes in 309 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 07:26:50.168607 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-fcb3da43-0dfc-4cb4-8a75-a1841a7def56 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3d72841b5f9d4f38baa5a153c6472e2f'} {{(pid=79745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:26:50.169888 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c8f043-9ad2-4639-a270-7704f78b898a admin admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:26:50.172453 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.fernet_utils [None req-69c8f043-9ad2-4639-a270-7704f78b898a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:26:50.183992 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-fcb3da43-0dfc-4cb4-8a75-a1841a7def56 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3d72841b5f9d4f38baa5a153c6472e2f'} {{(pid=79745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:26:50.184784 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-fcb3da43-0dfc-4cb4-8a75-a1841a7def56 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3d72841b5f9d4f38baa5a153c6472e2f'} {{(pid=79745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:26:50.185584 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-fcb3da43-0dfc-4cb4-8a75-a1841a7def56 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3d72841b5f9d4f38baa5a153c6472e2f'} {{(pid=79745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:26:50.188744 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c8f043-9ad2-4639-a270-7704f78b898a admin admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:26:50.193355 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-fcb3da43-0dfc-4cb4-8a75-a1841a7def56 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3d72841b5f9d4f38baa5a153c6472e2f'} {{(pid=79745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:26:50.193648 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c842ec71-70cd-4f44-bce6-f503d4052699 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:26:50.194315 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c842ec71-70cd-4f44-bce6-f503d4052699 admin admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:26:50.194601 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c842ec71-70cd-4f44-bce6-f503d4052699 admin admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:26:50.194860 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c842ec71-70cd-4f44-bce6-f503d4052699 admin admin] PATH_INFO: `/v3/roles` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:26:50.197027 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c842ec71-70cd-4f44-bce6-f503d4052699 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:26:50.199198 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c842ec71-70cd-4f44-bce6-f503d4052699 admin admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:26:50.208241 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 1129/2270] 10.222.0.21 () {58 vars in 1223 bytes} [Wed May 4 07:26:49 2022] DELETE /identity/v3/users/3d72841b5f9d4f38baa5a153c6472e2f => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 07:26:50.219339 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 1142/2271] 10.222.0.21 () {58 vars in 1121 bytes} [Wed May 4 07:26:50 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 07:26:50.221229 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb3da43-0dfc-4cb4-8a75-a1841a7def56 admin admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:26:50.223193 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.fernet_utils [None req-fcb3da43-0dfc-4cb4-8a75-a1841a7def56 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:26:50.296734 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb3da43-0dfc-4cb4-8a75-a1841a7def56 admin admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:26:50.303014 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fcf7a07-5ed3-446b-be59-a6cccd93fba2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:26:50.303784 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcf7a07-5ed3-446b-be59-a6cccd93fba2 admin admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:26:50.304193 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcf7a07-5ed3-446b-be59-a6cccd93fba2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:26:50.304526 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcf7a07-5ed3-446b-be59-a6cccd93fba2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:26:50.305681 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fcf7a07-5ed3-446b-be59-a6cccd93fba2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:26:50.307448 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fcf7a07-5ed3-446b-be59-a6cccd93fba2 admin admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:26:50.319190 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 1130/2272] 10.222.0.21 () {58 vars in 1121 bytes} [Wed May 4 07:26:50 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 04 07:26:50.323334 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c842ec71-70cd-4f44-bce6-f503d4052699 admin admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:26:50.335405 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c842ec71-70cd-4f44-bce6-f503d4052699 admin admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:26:50.341256 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b1213d-fc61-45e4-9855-4889c7fc3371 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:26:50.342261 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b1213d-fc61-45e4-9855-4889c7fc3371 admin admin] REQUEST_METHOD: `PUT` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:26:50.342616 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b1213d-fc61-45e4-9855-4889c7fc3371 admin admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:26:50.342966 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b1213d-fc61-45e4-9855-4889c7fc3371 admin admin] PATH_INFO: `/v3/projects/46ae301c322949b4958dfbcc14d424d9/users/fbf0f411da8043b682ad7fa6cb62a52a/roles/9f89c07b05a14f18836116af22cba5f6` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:26:50.359373 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b1213d-fc61-45e4-9855-4889c7fc3371 admin admin] RBAC: Authorizing `identity:create_grant(project_id=46ae301c322949b4958dfbcc14d424d9, user_id=fbf0f411da8043b682ad7fa6cb62a52a, role_id=9f89c07b05a14f18836116af22cba5f6)` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:26:50.362134 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b1213d-fc61-45e4-9855-4889c7fc3371 admin admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:26:50.377088 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 1143/2273] 10.222.0.21 () {60 vars in 1482 bytes} [Wed May 4 07:26:50 2022] PUT /identity/v3/projects/46ae301c322949b4958dfbcc14d424d9/users/fbf0f411da8043b682ad7fa6cb62a52a/roles/9f89c07b05a14f18836116af22cba5f6 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 07:26:50.388307 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6a698e-f588-42c8-90eb-87159de11ca4 None None] REQUEST_METHOD: `POST` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:26:50.388628 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6a698e-f588-42c8-90eb-87159de11ca4 None None] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:26:50.388904 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6a698e-f588-42c8-90eb-87159de11ca4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:26:50.422547 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.auth.core [None req-7a6a698e-f588-42c8-90eb-87159de11ca4 None None] MFA Rules not processed for user `fbf0f411da8043b682ad7fa6cb62a52a`. Rule list: `[]` (Enabled: `True`). {{(pid=79745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:26:50.423811 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.fernet_utils [None req-7a6a698e-f588-42c8-90eb-87159de11ca4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:26:50.519583 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 1131/2274] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 07:26:50 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 07:26:50.534508 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b1213d-fc61-45e4-9855-4889c7fc3371 admin admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:26:50.536646 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.fernet_utils [None req-a4b1213d-fc61-45e4-9855-4889c7fc3371 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:26:50.605611 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b1213d-fc61-45e4-9855-4889c7fc3371 admin admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:26:50.616532 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffee2d3-9627-4add-ac84-fba5e3e7fc54 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb341257aa8246b6847561e2fe1fa385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9f9c44db4984653b8d4b5f6b3b949f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:26:50.617407 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffee2d3-9627-4add-ac84-fba5e3e7fc54 service cinder] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:26:50.617691 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffee2d3-9627-4add-ac84-fba5e3e7fc54 service cinder] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:26:50.618551 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffee2d3-9627-4add-ac84-fba5e3e7fc54 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:26:50.640943 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ffee2d3-9627-4add-ac84-fba5e3e7fc54 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:26:50.643950 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ffee2d3-9627-4add-ac84-fba5e3e7fc54 service cinder] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:26:50.659413 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 1144/2275] 10.222.0.21 () {60 vars in 1365 bytes} [Wed May 4 07:26:50 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 07:26:50.701270 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6a698e-f588-42c8-90eb-87159de11ca4 None None] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:26:50.782963 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffee2d3-9627-4add-ac84-fba5e3e7fc54 service cinder] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:26:50.784570 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.fernet_utils [None req-3ffee2d3-9627-4add-ac84-fba5e3e7fc54 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:26:50.792288 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6a698e-f588-42c8-90eb-87159de11ca4 None None] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:26:50.798099 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f7e87c-2a88-492b-8da2-067f867455e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:26:50.798772 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f7e87c-2a88-492b-8da2-067f867455e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:26:50.799031 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f7e87c-2a88-492b-8da2-067f867455e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:26:50.799351 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f7e87c-2a88-492b-8da2-067f867455e1 admin admin] PATH_INFO: `/v3/users/fbf0f411da8043b682ad7fa6cb62a52a` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:26:50.800696 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f7e87c-2a88-492b-8da2-067f867455e1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fbf0f411da8043b682ad7fa6cb62a52a)` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:26:50.802864 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f7e87c-2a88-492b-8da2-067f867455e1 admin admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:26:50.817924 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffee2d3-9627-4add-ac84-fba5e3e7fc54 service cinder] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:26:50.824910 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0c6739-536a-44f1-b44e-295dab9527d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:26:50.826455 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0c6739-536a-44f1-b44e-295dab9527d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:26:50.827091 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0c6739-536a-44f1-b44e-295dab9527d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:26:50.827575 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0c6739-536a-44f1-b44e-295dab9527d8 admin admin] PATH_INFO: `/v3/projects/7dd00da78a4146429bbe7e1e8b355f15` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:26:50.830457 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0c6739-536a-44f1-b44e-295dab9527d8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7dd00da78a4146429bbe7e1e8b355f15)` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:26:50.833075 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0c6739-536a-44f1-b44e-295dab9527d8 admin admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:26:50.873436 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-b5f7e87c-2a88-492b-8da2-067f867455e1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fbf0f411da8043b682ad7fa6cb62a52a'} {{(pid=79745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:26:50.891561 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-b5f7e87c-2a88-492b-8da2-067f867455e1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fbf0f411da8043b682ad7fa6cb62a52a'} {{(pid=79745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:26:50.894161 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-b5f7e87c-2a88-492b-8da2-067f867455e1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fbf0f411da8043b682ad7fa6cb62a52a'} {{(pid=79745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:26:50.895466 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-b5f7e87c-2a88-492b-8da2-067f867455e1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fbf0f411da8043b682ad7fa6cb62a52a'} {{(pid=79745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:26:50.903770 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-b5f7e87c-2a88-492b-8da2-067f867455e1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fbf0f411da8043b682ad7fa6cb62a52a'} {{(pid=79745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:26:50.912648 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-2e0c6739-536a-44f1-b44e-295dab9527d8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7dd00da78a4146429bbe7e1e8b355f15', 'request_id': 'req-2e0c6739-536a-44f1-b44e-295dab9527d8'} {{(pid=79744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:26:50.922993 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-2e0c6739-536a-44f1-b44e-295dab9527d8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7dd00da78a4146429bbe7e1e8b355f15', 'request_id': 'req-2e0c6739-536a-44f1-b44e-295dab9527d8'} {{(pid=79744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:26:50.924933 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 1132/2276] 10.222.0.21 () {58 vars in 1223 bytes} [Wed May 4 07:26:50 2022] DELETE /identity/v3/users/fbf0f411da8043b682ad7fa6cb62a52a => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 07:26:50.929316 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98f8ddf-eb7d-4bf9-a828-3b4ec56edd67 None None] REQUEST_METHOD: `POST` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:26:50.929773 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98f8ddf-eb7d-4bf9-a828-3b4ec56edd67 None None] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:26:50.930162 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98f8ddf-eb7d-4bf9-a828-3b4ec56edd67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:26:50.937943 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-2e0c6739-536a-44f1-b44e-295dab9527d8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7dd00da78a4146429bbe7e1e8b355f15', 'request_id': 'req-2e0c6739-536a-44f1-b44e-295dab9527d8'} {{(pid=79744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:26:50.952315 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-2e0c6739-536a-44f1-b44e-295dab9527d8 admin admin] The token cache is being invalidate because project 7dd00da78a4146429bbe7e1e8b355f15 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79744) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 07:26:50.953156 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-2e0c6739-536a-44f1-b44e-295dab9527d8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:26:50.953289 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.auth.core [None req-a98f8ddf-eb7d-4bf9-a828-3b4ec56edd67 None None] MFA Rules not processed for user `83c5e0dcb991496ea6dee38384514508`. Rule list: `[]` (Enabled: `True`). {{(pid=79745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:26:50.953398 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-2e0c6739-536a-44f1-b44e-295dab9527d8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:26:50.954607 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.fernet_utils [None req-a98f8ddf-eb7d-4bf9-a828-3b4ec56edd67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:26:50.955178 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 1145/2277] 10.222.0.21 () {58 vars in 1232 bytes} [Wed May 4 07:26:50 2022] DELETE /identity/v3/projects/7dd00da78a4146429bbe7e1e8b355f15 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 07:26:50.960386 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de642ae-53dd-451b-9505-aa0c1dd32499 None None] REQUEST_METHOD: `POST` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:26:50.960751 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de642ae-53dd-451b-9505-aa0c1dd32499 None None] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:26:50.961037 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de642ae-53dd-451b-9505-aa0c1dd32499 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:26:50.983797 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.auth.core [None req-3de642ae-53dd-451b-9505-aa0c1dd32499 None None] MFA Rules not processed for user `83c5e0dcb991496ea6dee38384514508`. Rule list: `[]` (Enabled: `True`). {{(pid=79744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:26:50.985503 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.fernet_utils [None req-3de642ae-53dd-451b-9505-aa0c1dd32499 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:26:51.037515 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 1133/2278] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 07:26:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 07:26:51.052195 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98f8ddf-eb7d-4bf9-a828-3b4ec56edd67 None None] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:26:51.053581 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.fernet_utils [None req-a98f8ddf-eb7d-4bf9-a828-3b4ec56edd67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:26:51.067411 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 1146/2279] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 07:26:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 07:26:51.069874 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a52325-9741-42d7-9c8e-68ea57f41eb8 None None] REQUEST_METHOD: `POST` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:26:51.070238 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a52325-9741-42d7-9c8e-68ea57f41eb8 None None] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:26:51.070566 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a52325-9741-42d7-9c8e-68ea57f41eb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:26:51.094921 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.auth.core [None req-f4a52325-9741-42d7-9c8e-68ea57f41eb8 None None] MFA Rules not processed for user `83c5e0dcb991496ea6dee38384514508`. Rule list: `[]` (Enabled: `True`). {{(pid=79744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:26:51.096098 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.fernet_utils [None req-f4a52325-9741-42d7-9c8e-68ea57f41eb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:26:51.111897 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 1147/2280] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 07:26:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 07:26:51.113341 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a52325-9741-42d7-9c8e-68ea57f41eb8 None None] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:26:51.124879 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a52325-9741-42d7-9c8e-68ea57f41eb8 None None] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:26:51.125452 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98f8ddf-eb7d-4bf9-a828-3b4ec56edd67 None None] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:26:51.130894 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898a02c7-7f36-4c38-baa1-d73dd09f08d2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91cb92d00273402b837cb29b37325101', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9f9c44db4984653b8d4b5f6b3b949f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:26:51.131936 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898a02c7-7f36-4c38-baa1-d73dd09f08d2 service neutron] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:26:51.132260 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898a02c7-7f36-4c38-baa1-d73dd09f08d2 service neutron] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:26:51.132665 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898a02c7-7f36-4c38-baa1-d73dd09f08d2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:26:51.135542 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b8fc21-67e6-40a0-884c-79bac7957143 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:26:51.136341 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b8fc21-67e6-40a0-884c-79bac7957143 admin admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:26:51.137058 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b8fc21-67e6-40a0-884c-79bac7957143 admin admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:26:51.137493 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b8fc21-67e6-40a0-884c-79bac7957143 admin admin] PATH_INFO: `/v3/domains` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:26:51.138399 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b8fc21-67e6-40a0-884c-79bac7957143 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79744) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 07:26:51.138847 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b8fc21-67e6-40a0-884c-79bac7957143 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:26:51.140863 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b8fc21-67e6-40a0-884c-79bac7957143 admin admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:26:51.147797 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898a02c7-7f36-4c38-baa1-d73dd09f08d2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:26:51.150717 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898a02c7-7f36-4c38-baa1-d73dd09f08d2 service neutron] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:26:51.163515 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 1134/2281] 10.222.0.21 () {60 vars in 1365 bytes} [Wed May 4 07:26:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 07:26:51.183037 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 1148/2282] 10.222.0.21 () {58 vars in 1152 bytes} [Wed May 4 07:26:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 07:26:51.191066 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898a02c7-7f36-4c38-baa1-d73dd09f08d2 service neutron] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:26:51.203761 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b8fc21-67e6-40a0-884c-79bac7957143 admin admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:26:51.206724 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.fernet_utils [None req-44b8fc21-67e6-40a0-884c-79bac7957143 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:26:51.209381 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898a02c7-7f36-4c38-baa1-d73dd09f08d2 service neutron] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:26:51.218833 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14479183-88cd-4fca-bc87-82b07e8d5314 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:26:51.219576 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14479183-88cd-4fca-bc87-82b07e8d5314 admin admin] REQUEST_METHOD: `POST` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:26:51.219972 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14479183-88cd-4fca-bc87-82b07e8d5314 admin admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:26:51.220945 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14479183-88cd-4fca-bc87-82b07e8d5314 admin admin] PATH_INFO: `/v3/projects` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:26:51.221643 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14479183-88cd-4fca-bc87-82b07e8d5314 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:26:51.224140 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14479183-88cd-4fca-bc87-82b07e8d5314 admin admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:26:51.226192 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b8fc21-67e6-40a0-884c-79bac7957143 admin admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:26:51.233993 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00d582f-690f-4ffa-a308-2e70c13d1d3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:26:51.235405 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00d582f-690f-4ffa-a308-2e70c13d1d3a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:26:51.235955 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00d582f-690f-4ffa-a308-2e70c13d1d3a admin admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:26:51.237256 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00d582f-690f-4ffa-a308-2e70c13d1d3a admin admin] PATH_INFO: `/v3/users/76b2818ddaaa4930bec3786fc23246e2` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:26:51.238968 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00d582f-690f-4ffa-a308-2e70c13d1d3a admin admin] RBAC: Authorizing `identity:delete_user(user_id=76b2818ddaaa4930bec3786fc23246e2)` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:26:51.241176 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00d582f-690f-4ffa-a308-2e70c13d1d3a admin admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:26:51.266382 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 1135/2283] 10.222.0.21 () {60 vars in 1152 bytes} [Wed May 4 07:26:51 2022] POST /identity/v3/projects => generated 373 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 07:26:51.271074 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14479183-88cd-4fca-bc87-82b07e8d5314 admin admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:26:51.307943 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-d00d582f-690f-4ffa-a308-2e70c13d1d3a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '76b2818ddaaa4930bec3786fc23246e2'} {{(pid=79744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:26:51.308655 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-d00d582f-690f-4ffa-a308-2e70c13d1d3a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '76b2818ddaaa4930bec3786fc23246e2'} {{(pid=79744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:26:51.318579 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-d00d582f-690f-4ffa-a308-2e70c13d1d3a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '76b2818ddaaa4930bec3786fc23246e2'} {{(pid=79744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:26:51.319546 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-d00d582f-690f-4ffa-a308-2e70c13d1d3a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '76b2818ddaaa4930bec3786fc23246e2'} {{(pid=79744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:26:51.357344 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-d00d582f-690f-4ffa-a308-2e70c13d1d3a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '76b2818ddaaa4930bec3786fc23246e2'} {{(pid=79744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:26:51.362109 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14479183-88cd-4fca-bc87-82b07e8d5314 admin admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:26:51.369236 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc492790-7254-4f77-820a-e9e5215fd115 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:26:51.369930 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc492790-7254-4f77-820a-e9e5215fd115 admin admin] REQUEST_METHOD: `POST` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:26:51.370220 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc492790-7254-4f77-820a-e9e5215fd115 admin admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:26:51.370501 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc492790-7254-4f77-820a-e9e5215fd115 admin admin] PATH_INFO: `/v3/users` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:26:51.371579 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc492790-7254-4f77-820a-e9e5215fd115 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:26:51.380446 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 1149/2284] 10.222.0.21 () {58 vars in 1223 bytes} [Wed May 4 07:26:51 2022] DELETE /identity/v3/users/76b2818ddaaa4930bec3786fc23246e2 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 07:26:51.381336 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc492790-7254-4f77-820a-e9e5215fd115 admin admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:26:51.385585 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f522435-96df-4984-8ee2-d07e35081a76 None None] REQUEST_METHOD: `POST` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:26:51.385874 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f522435-96df-4984-8ee2-d07e35081a76 None None] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:26:51.386478 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f522435-96df-4984-8ee2-d07e35081a76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:26:51.407390 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.auth.core [None req-3f522435-96df-4984-8ee2-d07e35081a76 None None] MFA Rules not processed for user `83c5e0dcb991496ea6dee38384514508`. Rule list: `[]` (Enabled: `True`). {{(pid=79744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:26:51.408863 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.fernet_utils [None req-3f522435-96df-4984-8ee2-d07e35081a76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:26:51.429230 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 1136/2285] 10.222.0.21 () {60 vars in 1143 bytes} [Wed May 4 07:26:51 2022] POST /identity/v3/users => generated 287 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 07:26:51.434217 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc492790-7254-4f77-820a-e9e5215fd115 admin admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:26:51.438017 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.fernet_utils [None req-bc492790-7254-4f77-820a-e9e5215fd115 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:26:51.467248 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc492790-7254-4f77-820a-e9e5215fd115 admin admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:26:51.501135 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 1150/2286] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 07:26:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 07:26:51.506032 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e7f940-3fe4-4bfe-8bd0-eaa971b15db2 None None] REQUEST_METHOD: `POST` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:26:51.506326 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e7f940-3fe4-4bfe-8bd0-eaa971b15db2 None None] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:26:51.506608 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e7f940-3fe4-4bfe-8bd0-eaa971b15db2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:26:51.532575 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106703a3-2aae-4414-a6a9-bfdd40c96d56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:26:51.532934 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.auth.core [None req-27e7f940-3fe4-4bfe-8bd0-eaa971b15db2 None None] MFA Rules not processed for user `20497d01a7c34e2eb5a56bfabf95dced`. Rule list: `[]` (Enabled: `True`). {{(pid=79744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:26:51.533411 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106703a3-2aae-4414-a6a9-bfdd40c96d56 admin admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:26:51.534201 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106703a3-2aae-4414-a6a9-bfdd40c96d56 admin admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:26:51.534322 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.fernet_utils [None req-27e7f940-3fe4-4bfe-8bd0-eaa971b15db2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:26:51.534422 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106703a3-2aae-4414-a6a9-bfdd40c96d56 admin admin] PATH_INFO: `/v3/roles` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:26:51.534998 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106703a3-2aae-4414-a6a9-bfdd40c96d56 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:26:51.536857 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106703a3-2aae-4414-a6a9-bfdd40c96d56 admin admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:26:51.547774 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 1137/2287] 10.222.0.21 () {58 vars in 1121 bytes} [Wed May 4 07:26:51 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 07:26:51.548524 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106703a3-2aae-4414-a6a9-bfdd40c96d56 admin admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:26:51.552397 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.fernet_utils [None req-106703a3-2aae-4414-a6a9-bfdd40c96d56 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:26:51.598435 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 1151/2288] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 07:26:51 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 07:26:51.604650 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e7f940-3fe4-4bfe-8bd0-eaa971b15db2 None None] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:26:51.616555 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e7f940-3fe4-4bfe-8bd0-eaa971b15db2 None None] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:26:51.624483 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f2f664-3c1a-41ef-8f55-87d2f4ffbd25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:26:51.634236 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f2f664-3c1a-41ef-8f55-87d2f4ffbd25 admin admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:26:51.634860 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f2f664-3c1a-41ef-8f55-87d2f4ffbd25 admin admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:26:51.635073 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f2f664-3c1a-41ef-8f55-87d2f4ffbd25 admin admin] PATH_INFO: `/v3/roles` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:26:51.644615 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f2f664-3c1a-41ef-8f55-87d2f4ffbd25 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:26:51.644782 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106703a3-2aae-4414-a6a9-bfdd40c96d56 admin admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:26:51.644883 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f2f664-3c1a-41ef-8f55-87d2f4ffbd25 admin admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:26:51.644980 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876d0d1a-8452-4a4e-a616-71bd31a2b0ff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91cb92d00273402b837cb29b37325101', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9f9c44db4984653b8d4b5f6b3b949f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:26:51.644980 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876d0d1a-8452-4a4e-a616-71bd31a2b0ff service neutron] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:26:51.644980 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876d0d1a-8452-4a4e-a616-71bd31a2b0ff service neutron] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:26:51.644980 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876d0d1a-8452-4a4e-a616-71bd31a2b0ff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:26:51.649533 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 1152/2289] 10.222.0.21 () {58 vars in 1121 bytes} [Wed May 4 07:26:51 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 07:26:51.657148 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f2f664-3c1a-41ef-8f55-87d2f4ffbd25 admin admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:26:51.657638 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876d0d1a-8452-4a4e-a616-71bd31a2b0ff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:26:51.659674 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876d0d1a-8452-4a4e-a616-71bd31a2b0ff service neutron] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:26:51.672659 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f2f664-3c1a-41ef-8f55-87d2f4ffbd25 admin admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:26:51.674170 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 1138/2290] 10.222.0.21 () {60 vars in 1365 bytes} [Wed May 4 07:26:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 07:26:51.674917 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876d0d1a-8452-4a4e-a616-71bd31a2b0ff service neutron] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:26:51.676325 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.fernet_utils [None req-876d0d1a-8452-4a4e-a616-71bd31a2b0ff service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:26:51.682640 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efb4698-064b-477b-9f3f-ab7efa921efa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:26:51.684240 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efb4698-064b-477b-9f3f-ab7efa921efa admin admin] REQUEST_METHOD: `PUT` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:26:51.684739 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efb4698-064b-477b-9f3f-ab7efa921efa admin admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:26:51.685432 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efb4698-064b-477b-9f3f-ab7efa921efa admin admin] PATH_INFO: `/v3/projects/534cccf0331a47f4b753e744a152b837/users/aeaa420cbaea4e4ea39c31a5beb9080d/roles/9f89c07b05a14f18836116af22cba5f6` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:26:51.696827 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876d0d1a-8452-4a4e-a616-71bd31a2b0ff service neutron] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:26:51.703659 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376a264f-1754-48d0-b437-a09ec993d495 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:26:51.704646 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376a264f-1754-48d0-b437-a09ec993d495 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:26:51.712261 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376a264f-1754-48d0-b437-a09ec993d495 admin admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:26:51.712610 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376a264f-1754-48d0-b437-a09ec993d495 admin admin] PATH_INFO: `/v3/projects/46ae301c322949b4958dfbcc14d424d9` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:26:51.716552 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376a264f-1754-48d0-b437-a09ec993d495 admin admin] RBAC: Authorizing `identity:delete_project(project_id=46ae301c322949b4958dfbcc14d424d9)` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:26:51.720886 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376a264f-1754-48d0-b437-a09ec993d495 admin admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:26:51.726093 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2efb4698-064b-477b-9f3f-ab7efa921efa admin admin] RBAC: Authorizing `identity:create_grant(project_id=534cccf0331a47f4b753e744a152b837, user_id=aeaa420cbaea4e4ea39c31a5beb9080d, role_id=9f89c07b05a14f18836116af22cba5f6)` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:26:51.729969 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2efb4698-064b-477b-9f3f-ab7efa921efa admin admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:26:51.746979 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 1153/2291] 10.222.0.21 () {60 vars in 1482 bytes} [Wed May 4 07:26:51 2022] PUT /identity/v3/projects/534cccf0331a47f4b753e744a152b837/users/aeaa420cbaea4e4ea39c31a5beb9080d/roles/9f89c07b05a14f18836116af22cba5f6 => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 07:26:51.757165 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40903ba-da13-48d5-948b-50389b624419 None None] REQUEST_METHOD: `POST` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:26:51.757789 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40903ba-da13-48d5-948b-50389b624419 None None] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:26:51.757789 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40903ba-da13-48d5-948b-50389b624419 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:26:51.788812 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-376a264f-1754-48d0-b437-a09ec993d495 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '46ae301c322949b4958dfbcc14d424d9', 'request_id': 'req-376a264f-1754-48d0-b437-a09ec993d495'} {{(pid=79745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:26:51.790726 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.auth.core [None req-b40903ba-da13-48d5-948b-50389b624419 None None] MFA Rules not processed for user `aeaa420cbaea4e4ea39c31a5beb9080d`. Rule list: `[]` (Enabled: `True`). {{(pid=79744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:26:51.792097 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.fernet_utils [None req-b40903ba-da13-48d5-948b-50389b624419 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:26:51.797440 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-376a264f-1754-48d0-b437-a09ec993d495 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '46ae301c322949b4958dfbcc14d424d9', 'request_id': 'req-376a264f-1754-48d0-b437-a09ec993d495'} {{(pid=79745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:26:51.807728 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-376a264f-1754-48d0-b437-a09ec993d495 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '46ae301c322949b4958dfbcc14d424d9', 'request_id': 'req-376a264f-1754-48d0-b437-a09ec993d495'} {{(pid=79745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:26:51.820256 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-376a264f-1754-48d0-b437-a09ec993d495 admin admin] The token cache is being invalidate because project 46ae301c322949b4958dfbcc14d424d9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79745) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 07:26:51.820542 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-376a264f-1754-48d0-b437-a09ec993d495 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:26:51.821363 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-376a264f-1754-48d0-b437-a09ec993d495 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:26:51.823372 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 1139/2292] 10.222.0.21 () {58 vars in 1232 bytes} [Wed May 4 07:26:51 2022] DELETE /identity/v3/projects/46ae301c322949b4958dfbcc14d424d9 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 07:26:51.827954 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738bfc8d-0db0-4d96-9cb0-4d50590d9d17 None None] REQUEST_METHOD: `POST` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:26:51.828331 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738bfc8d-0db0-4d96-9cb0-4d50590d9d17 None None] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:26:51.828532 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738bfc8d-0db0-4d96-9cb0-4d50590d9d17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:26:51.855247 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.auth.core [None req-738bfc8d-0db0-4d96-9cb0-4d50590d9d17 None None] MFA Rules not processed for user `83c5e0dcb991496ea6dee38384514508`. Rule list: `[]` (Enabled: `True`). {{(pid=79745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:26:51.856458 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.fernet_utils [None req-738bfc8d-0db0-4d96-9cb0-4d50590d9d17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:26:51.900889 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 1154/2293] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 07:26:51 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 07:26:51.906575 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40903ba-da13-48d5-948b-50389b624419 None None] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:26:51.907856 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.fernet_utils [None req-b40903ba-da13-48d5-948b-50389b624419 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:26:51.935059 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 1140/2294] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 07:26:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 07:26:51.952492 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fd855d-9c3f-4d2e-8051-3a9221a025ac None None] REQUEST_METHOD: `POST` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:26:51.953103 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fd855d-9c3f-4d2e-8051-3a9221a025ac None None] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:26:51.953556 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fd855d-9c3f-4d2e-8051-3a9221a025ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:26:51.983030 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.auth.core [None req-62fd855d-9c3f-4d2e-8051-3a9221a025ac None None] MFA Rules not processed for user `83c5e0dcb991496ea6dee38384514508`. Rule list: `[]` (Enabled: `True`). {{(pid=79745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:26:51.983030 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.fernet_utils [None req-62fd855d-9c3f-4d2e-8051-3a9221a025ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:26:51.998448 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 1141/2295] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 07:26:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 07:26:52.004342 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fd855d-9c3f-4d2e-8051-3a9221a025ac None None] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:26:52.010029 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40903ba-da13-48d5-948b-50389b624419 None None] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:26:52.017105 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271aa0d7-d536-4bd5-aac1-d1f5af55d597 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb341257aa8246b6847561e2fe1fa385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9f9c44db4984653b8d4b5f6b3b949f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:26:52.018078 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271aa0d7-d536-4bd5-aac1-d1f5af55d597 service cinder] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:26:52.021391 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271aa0d7-d536-4bd5-aac1-d1f5af55d597 service cinder] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:26:52.023727 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271aa0d7-d536-4bd5-aac1-d1f5af55d597 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:26:52.024941 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fd855d-9c3f-4d2e-8051-3a9221a025ac None None] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:26:52.031196 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f671d66b-c9fb-49d1-bc34-3af8945bd127 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:26:52.031852 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f671d66b-c9fb-49d1-bc34-3af8945bd127 admin admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:26:52.032231 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f671d66b-c9fb-49d1-bc34-3af8945bd127 admin admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:26:52.032665 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f671d66b-c9fb-49d1-bc34-3af8945bd127 admin admin] PATH_INFO: `/v3/domains` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:26:52.033513 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f671d66b-c9fb-49d1-bc34-3af8945bd127 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 07:26:52.033927 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f671d66b-c9fb-49d1-bc34-3af8945bd127 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:26:52.035921 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f671d66b-c9fb-49d1-bc34-3af8945bd127 admin admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:26:52.046277 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271aa0d7-d536-4bd5-aac1-d1f5af55d597 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:26:52.047763 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271aa0d7-d536-4bd5-aac1-d1f5af55d597 service cinder] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:26:52.058240 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 1142/2296] 10.222.0.21 () {58 vars in 1152 bytes} [Wed May 4 07:26:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 07:26:52.062978 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f671d66b-c9fb-49d1-bc34-3af8945bd127 admin admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:26:52.079494 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f671d66b-c9fb-49d1-bc34-3af8945bd127 admin admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:26:52.081710 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 1155/2297] 10.222.0.21 () {60 vars in 1365 bytes} [Wed May 4 07:26:51 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 07:26:52.087266 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4065b3b7-d745-434c-98be-ee6bbcdca5d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:26:52.087930 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4065b3b7-d745-434c-98be-ee6bbcdca5d8 admin admin] REQUEST_METHOD: `POST` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:26:52.088237 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4065b3b7-d745-434c-98be-ee6bbcdca5d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:26:52.088607 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4065b3b7-d745-434c-98be-ee6bbcdca5d8 admin admin] PATH_INFO: `/v3/projects` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:26:52.089316 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4065b3b7-d745-434c-98be-ee6bbcdca5d8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:26:52.091420 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4065b3b7-d745-434c-98be-ee6bbcdca5d8 admin admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:26:52.122415 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271aa0d7-d536-4bd5-aac1-d1f5af55d597 service cinder] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:26:52.124560 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.fernet_utils [None req-271aa0d7-d536-4bd5-aac1-d1f5af55d597 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:26:52.141612 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 1143/2298] 10.222.0.21 () {60 vars in 1152 bytes} [Wed May 4 07:26:52 2022] POST /identity/v3/projects => generated 383 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 07:26:52.145556 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4065b3b7-d745-434c-98be-ee6bbcdca5d8 admin admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:26:52.149909 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271aa0d7-d536-4bd5-aac1-d1f5af55d597 service cinder] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:26:52.248615 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4065b3b7-d745-434c-98be-ee6bbcdca5d8 admin admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:26:52.258342 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7436f3d9-5eea-4809-b78d-7d9abe1fb937 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:26:52.263191 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7436f3d9-5eea-4809-b78d-7d9abe1fb937 admin admin] REQUEST_METHOD: `POST` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:26:52.263191 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7436f3d9-5eea-4809-b78d-7d9abe1fb937 admin admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:26:52.263191 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7436f3d9-5eea-4809-b78d-7d9abe1fb937 admin admin] PATH_INFO: `/v3/users` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:26:52.265404 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7436f3d9-5eea-4809-b78d-7d9abe1fb937 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:26:52.269224 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7436f3d9-5eea-4809-b78d-7d9abe1fb937 admin admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:26:52.278802 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f5d5db-720b-43d3-bf60-0d1799189a57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:26:52.280235 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f5d5db-720b-43d3-bf60-0d1799189a57 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:26:52.280708 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f5d5db-720b-43d3-bf60-0d1799189a57 admin admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:26:52.281155 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f5d5db-720b-43d3-bf60-0d1799189a57 admin admin] PATH_INFO: `/v3/users/aeaa420cbaea4e4ea39c31a5beb9080d` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:26:52.282907 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f5d5db-720b-43d3-bf60-0d1799189a57 admin admin] RBAC: Authorizing `identity:delete_user(user_id=aeaa420cbaea4e4ea39c31a5beb9080d)` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:26:52.286414 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f5d5db-720b-43d3-bf60-0d1799189a57 admin admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:26:52.345315 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 1144/2299] 10.222.0.21 () {60 vars in 1143 bytes} [Wed May 4 07:26:52 2022] POST /identity/v3/users => generated 292 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 07:26:52.346551 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7436f3d9-5eea-4809-b78d-7d9abe1fb937 admin admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:26:52.349476 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.fernet_utils [None req-7436f3d9-5eea-4809-b78d-7d9abe1fb937 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:26:52.362599 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7436f3d9-5eea-4809-b78d-7d9abe1fb937 admin admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:26:52.363206 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-03f5d5db-720b-43d3-bf60-0d1799189a57 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aeaa420cbaea4e4ea39c31a5beb9080d'} {{(pid=79744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:26:52.363424 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-03f5d5db-720b-43d3-bf60-0d1799189a57 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aeaa420cbaea4e4ea39c31a5beb9080d'} {{(pid=79744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:26:52.367608 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d496d66e-2f0c-4c1a-a586-2ec39cfdfab5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:26:52.368907 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d496d66e-2f0c-4c1a-a586-2ec39cfdfab5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:26:52.369185 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d496d66e-2f0c-4c1a-a586-2ec39cfdfab5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:26:52.369457 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d496d66e-2f0c-4c1a-a586-2ec39cfdfab5 admin admin] PATH_INFO: `/v3/projects/33889480037f4a33bdad83f618fe2bb3` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:26:52.370886 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d496d66e-2f0c-4c1a-a586-2ec39cfdfab5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=33889480037f4a33bdad83f618fe2bb3)` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:26:52.372622 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d496d66e-2f0c-4c1a-a586-2ec39cfdfab5 admin admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:26:52.372983 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-03f5d5db-720b-43d3-bf60-0d1799189a57 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aeaa420cbaea4e4ea39c31a5beb9080d'} {{(pid=79744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:26:52.373880 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-03f5d5db-720b-43d3-bf60-0d1799189a57 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aeaa420cbaea4e4ea39c31a5beb9080d'} {{(pid=79744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:26:52.394847 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-03f5d5db-720b-43d3-bf60-0d1799189a57 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aeaa420cbaea4e4ea39c31a5beb9080d'} {{(pid=79744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:26:52.410986 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 1156/2300] 10.222.0.21 () {58 vars in 1223 bytes} [Wed May 4 07:26:52 2022] DELETE /identity/v3/users/aeaa420cbaea4e4ea39c31a5beb9080d => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 07:26:52.412075 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f5d5db-720b-43d3-bf60-0d1799189a57 admin admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:26:52.413390 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.fernet_utils [None req-03f5d5db-720b-43d3-bf60-0d1799189a57 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:26:52.431439 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-d496d66e-2f0c-4c1a-a586-2ec39cfdfab5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '33889480037f4a33bdad83f618fe2bb3', 'request_id': 'req-d496d66e-2f0c-4c1a-a586-2ec39cfdfab5'} {{(pid=79745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:26:52.456073 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-d496d66e-2f0c-4c1a-a586-2ec39cfdfab5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '33889480037f4a33bdad83f618fe2bb3', 'request_id': 'req-d496d66e-2f0c-4c1a-a586-2ec39cfdfab5'} {{(pid=79745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:26:52.468090 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-d496d66e-2f0c-4c1a-a586-2ec39cfdfab5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '33889480037f4a33bdad83f618fe2bb3', 'request_id': 'req-d496d66e-2f0c-4c1a-a586-2ec39cfdfab5'} {{(pid=79745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:26:52.481437 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-d496d66e-2f0c-4c1a-a586-2ec39cfdfab5 admin admin] The token cache is being invalidate because project 33889480037f4a33bdad83f618fe2bb3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79745) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 07:26:52.481727 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-d496d66e-2f0c-4c1a-a586-2ec39cfdfab5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:26:52.482395 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-d496d66e-2f0c-4c1a-a586-2ec39cfdfab5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:26:52.484343 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 1145/2301] 10.222.0.21 () {58 vars in 1232 bytes} [Wed May 4 07:26:52 2022] DELETE /identity/v3/projects/33889480037f4a33bdad83f618fe2bb3 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 07:26:52.485731 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620665ec-e3aa-4368-b4b5-bee8b6714ab7 None None] REQUEST_METHOD: `POST` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:26:52.486020 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620665ec-e3aa-4368-b4b5-bee8b6714ab7 None None] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:26:52.486295 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620665ec-e3aa-4368-b4b5-bee8b6714ab7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:26:52.511073 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.auth.core [None req-620665ec-e3aa-4368-b4b5-bee8b6714ab7 None None] MFA Rules not processed for user `83c5e0dcb991496ea6dee38384514508`. Rule list: `[]` (Enabled: `True`). {{(pid=79745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:26:52.512301 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.fernet_utils [None req-620665ec-e3aa-4368-b4b5-bee8b6714ab7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:26:52.522562 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f5d5db-720b-43d3-bf60-0d1799189a57 admin admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:26:52.596822 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 1146/2302] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 07:26:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 07:26:52.609017 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620665ec-e3aa-4368-b4b5-bee8b6714ab7 None None] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:26:52.610431 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.fernet_utils [None req-620665ec-e3aa-4368-b4b5-bee8b6714ab7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:26:52.613050 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7ca083-232f-4012-8bf7-a5c62e670077 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:26:52.613852 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7ca083-232f-4012-8bf7-a5c62e670077 admin admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:26:52.614269 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7ca083-232f-4012-8bf7-a5c62e670077 admin admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:26:52.614643 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7ca083-232f-4012-8bf7-a5c62e670077 admin admin] PATH_INFO: `/v3/roles` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:26:52.615692 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7ca083-232f-4012-8bf7-a5c62e670077 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:26:52.617404 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7ca083-232f-4012-8bf7-a5c62e670077 admin admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:26:52.622445 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620665ec-e3aa-4368-b4b5-bee8b6714ab7 None None] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:26:52.627692 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4f3c5d-7670-49b7-9fd5-eb0078e658d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:26:52.628624 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4f3c5d-7670-49b7-9fd5-eb0078e658d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:26:52.629151 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4f3c5d-7670-49b7-9fd5-eb0078e658d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:26:52.629424 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4f3c5d-7670-49b7-9fd5-eb0078e658d6 admin admin] PATH_INFO: `/v3/users/28448c06ed814538be5a8caabe9f4285` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:26:52.630108 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 1157/2303] 10.222.0.21 () {58 vars in 1121 bytes} [Wed May 4 07:26:52 2022] GET /identity/v3/roles => generated 1420 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 07:26:52.630991 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4f3c5d-7670-49b7-9fd5-eb0078e658d6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=28448c06ed814538be5a8caabe9f4285)` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:26:52.631298 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7ca083-232f-4012-8bf7-a5c62e670077 admin admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:26:52.633123 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4f3c5d-7670-49b7-9fd5-eb0078e658d6 admin admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:26:52.634354 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.fernet_utils [None req-0d7ca083-232f-4012-8bf7-a5c62e670077 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:26:52.695660 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-ca4f3c5d-7670-49b7-9fd5-eb0078e658d6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '28448c06ed814538be5a8caabe9f4285'} {{(pid=79745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:26:52.704358 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7ca083-232f-4012-8bf7-a5c62e670077 admin admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:26:52.712905 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b01059-af94-4956-b2de-847796ea4aa5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91cb92d00273402b837cb29b37325101', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9f9c44db4984653b8d4b5f6b3b949f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:26:52.713695 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b01059-af94-4956-b2de-847796ea4aa5 service neutron] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:26:52.714018 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b01059-af94-4956-b2de-847796ea4aa5 service neutron] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:26:52.714301 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b01059-af94-4956-b2de-847796ea4aa5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:26:52.721173 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-ca4f3c5d-7670-49b7-9fd5-eb0078e658d6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '28448c06ed814538be5a8caabe9f4285'} {{(pid=79745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:26:52.721701 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-ca4f3c5d-7670-49b7-9fd5-eb0078e658d6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '28448c06ed814538be5a8caabe9f4285'} {{(pid=79745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:26:52.722546 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-ca4f3c5d-7670-49b7-9fd5-eb0078e658d6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '28448c06ed814538be5a8caabe9f4285'} {{(pid=79745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:26:52.732010 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-ca4f3c5d-7670-49b7-9fd5-eb0078e658d6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '28448c06ed814538be5a8caabe9f4285'} {{(pid=79745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:26:52.734234 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b01059-af94-4956-b2de-847796ea4aa5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:26:52.735885 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b01059-af94-4956-b2de-847796ea4aa5 service neutron] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:26:52.748057 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 1147/2304] 10.222.0.21 () {58 vars in 1223 bytes} [Wed May 4 07:26:52 2022] DELETE /identity/v3/users/28448c06ed814538be5a8caabe9f4285 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 07:26:52.748632 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 1158/2305] 10.222.0.21 () {60 vars in 1365 bytes} [Wed May 4 07:26:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 07:26:52.764054 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4f3c5d-7670-49b7-9fd5-eb0078e658d6 admin admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:26:52.765833 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.fernet_utils [None req-ca4f3c5d-7670-49b7-9fd5-eb0078e658d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:26:52.863920 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4f3c5d-7670-49b7-9fd5-eb0078e658d6 admin admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:26:52.871816 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61fb75eb-2496-4169-975b-a06e3f3cc517 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:26:52.872720 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fb75eb-2496-4169-975b-a06e3f3cc517 admin admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:26:52.872922 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fb75eb-2496-4169-975b-a06e3f3cc517 admin admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:26:52.873243 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fb75eb-2496-4169-975b-a06e3f3cc517 admin admin] PATH_INFO: `/v3/roles` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:26:52.874102 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61fb75eb-2496-4169-975b-a06e3f3cc517 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:26:52.876075 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61fb75eb-2496-4169-975b-a06e3f3cc517 admin admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:26:52.891014 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 1148/2306] 10.222.0.21 () {58 vars in 1121 bytes} [Wed May 4 07:26:52 2022] GET /identity/v3/roles => generated 1420 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 07:26:52.896694 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b01059-af94-4956-b2de-847796ea4aa5 service neutron] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:26:52.902020 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.fernet_utils [None req-e4b01059-af94-4956-b2de-847796ea4aa5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:26:52.934371 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b01059-af94-4956-b2de-847796ea4aa5 service neutron] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:26:52.940422 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9591c0-a0c6-43ac-b5ff-9ed9274e377c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:26:52.941656 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9591c0-a0c6-43ac-b5ff-9ed9274e377c admin admin] REQUEST_METHOD: `PUT` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:26:52.941913 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9591c0-a0c6-43ac-b5ff-9ed9274e377c admin admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:26:52.942254 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9591c0-a0c6-43ac-b5ff-9ed9274e377c admin admin] PATH_INFO: `/v3/projects/5454654e735d406cb8b3aea4dd45d770/users/feebf5b36f7d46fc80adcd2d5318c4a0/roles/9f89c07b05a14f18836116af22cba5f6` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:26:52.960636 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9591c0-a0c6-43ac-b5ff-9ed9274e377c admin admin] RBAC: Authorizing `identity:create_grant(project_id=5454654e735d406cb8b3aea4dd45d770, user_id=feebf5b36f7d46fc80adcd2d5318c4a0, role_id=9f89c07b05a14f18836116af22cba5f6)` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:26:52.963562 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9591c0-a0c6-43ac-b5ff-9ed9274e377c admin admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:26:52.980411 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 1159/2307] 10.222.0.21 () {60 vars in 1482 bytes} [Wed May 4 07:26:52 2022] PUT /identity/v3/projects/5454654e735d406cb8b3aea4dd45d770/users/feebf5b36f7d46fc80adcd2d5318c4a0/roles/9f89c07b05a14f18836116af22cba5f6 => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 07:26:52.985542 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e4afe8-4572-4424-959c-90c78d6f2321 None None] REQUEST_METHOD: `POST` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:26:52.985850 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e4afe8-4572-4424-959c-90c78d6f2321 None None] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:26:52.986100 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e4afe8-4572-4424-959c-90c78d6f2321 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:26:53.025830 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.auth.core [None req-e9e4afe8-4572-4424-959c-90c78d6f2321 None None] MFA Rules not processed for user `83c5e0dcb991496ea6dee38384514508`. Rule list: `[]` (Enabled: `True`). {{(pid=79745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:26:53.028697 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.fernet_utils [None req-e9e4afe8-4572-4424-959c-90c78d6f2321 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:26:53.153256 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 1149/2308] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 07:26:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 07:26:53.167060 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9591c0-a0c6-43ac-b5ff-9ed9274e377c admin admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:26:53.168992 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.fernet_utils [None req-9e9591c0-a0c6-43ac-b5ff-9ed9274e377c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:26:53.175543 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e4afe8-4572-4424-959c-90c78d6f2321 None None] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:26:53.189429 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.fernet_utils [None req-e9e4afe8-4572-4424-959c-90c78d6f2321 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:26:53.209358 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e4afe8-4572-4424-959c-90c78d6f2321 None None] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:26:53.216756 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d10cbc6-9baf-4e33-8733-496ded18c40d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:26:53.221567 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d10cbc6-9baf-4e33-8733-496ded18c40d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:26:53.221856 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d10cbc6-9baf-4e33-8733-496ded18c40d admin admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:26:53.222116 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d10cbc6-9baf-4e33-8733-496ded18c40d admin admin] PATH_INFO: `/v3/projects/534cccf0331a47f4b753e744a152b837` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:26:53.223704 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d10cbc6-9baf-4e33-8733-496ded18c40d admin admin] RBAC: Authorizing `identity:delete_project(project_id=534cccf0331a47f4b753e744a152b837)` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:26:53.225699 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d10cbc6-9baf-4e33-8733-496ded18c40d admin admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:26:53.272988 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9591c0-a0c6-43ac-b5ff-9ed9274e377c admin admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:26:53.287436 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-2d10cbc6-9baf-4e33-8733-496ded18c40d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '534cccf0331a47f4b753e744a152b837', 'request_id': 'req-2d10cbc6-9baf-4e33-8733-496ded18c40d'} {{(pid=79745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:26:53.297074 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-2d10cbc6-9baf-4e33-8733-496ded18c40d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '534cccf0331a47f4b753e744a152b837', 'request_id': 'req-2d10cbc6-9baf-4e33-8733-496ded18c40d'} {{(pid=79745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:26:53.310342 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-2d10cbc6-9baf-4e33-8733-496ded18c40d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '534cccf0331a47f4b753e744a152b837', 'request_id': 'req-2d10cbc6-9baf-4e33-8733-496ded18c40d'} {{(pid=79745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:26:53.342368 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-2d10cbc6-9baf-4e33-8733-496ded18c40d admin admin] The token cache is being invalidate because project 534cccf0331a47f4b753e744a152b837 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79745) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 07:26:53.343620 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-2d10cbc6-9baf-4e33-8733-496ded18c40d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:26:53.345148 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-2d10cbc6-9baf-4e33-8733-496ded18c40d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:26:53.347741 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae18e99b-fb64-41d8-aaaa-9638687797fd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91cb92d00273402b837cb29b37325101', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9f9c44db4984653b8d4b5f6b3b949f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:26:53.348250 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae18e99b-fb64-41d8-aaaa-9638687797fd service neutron] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:26:53.348595 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae18e99b-fb64-41d8-aaaa-9638687797fd service neutron] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:26:53.348930 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae18e99b-fb64-41d8-aaaa-9638687797fd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:26:53.350545 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 1150/2309] 10.222.0.21 () {58 vars in 1232 bytes} [Wed May 4 07:26:53 2022] DELETE /identity/v3/projects/534cccf0331a47f4b753e744a152b837 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 07:26:53.351831 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.fernet_utils [None req-ae18e99b-fb64-41d8-aaaa-9638687797fd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:26:53.353272 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d10cbc6-9baf-4e33-8733-496ded18c40d admin admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:26:53.355552 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.fernet_utils [None req-2d10cbc6-9baf-4e33-8733-496ded18c40d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:26:53.449924 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d10cbc6-9baf-4e33-8733-496ded18c40d admin admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:26:53.459134 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801b8089-06da-4b4a-9971-445637b7fb8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:26:53.460470 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801b8089-06da-4b4a-9971-445637b7fb8c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:26:53.460750 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801b8089-06da-4b4a-9971-445637b7fb8c admin admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:26:53.461023 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801b8089-06da-4b4a-9971-445637b7fb8c admin admin] PATH_INFO: `/v3/projects/4084eab199e4476fba10075f66b1a495` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:26:53.462979 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801b8089-06da-4b4a-9971-445637b7fb8c admin admin] RBAC: Authorizing `identity:delete_project(project_id=4084eab199e4476fba10075f66b1a495)` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:26:53.465153 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801b8089-06da-4b4a-9971-445637b7fb8c admin admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:26:53.486216 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae18e99b-fb64-41d8-aaaa-9638687797fd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:26:53.488831 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae18e99b-fb64-41d8-aaaa-9638687797fd service neutron] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:26:53.519396 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 1160/2310] 10.222.0.21 () {60 vars in 1365 bytes} [Wed May 4 07:26:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 07:26:53.539095 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-801b8089-06da-4b4a-9971-445637b7fb8c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4084eab199e4476fba10075f66b1a495', 'request_id': 'req-801b8089-06da-4b4a-9971-445637b7fb8c'} {{(pid=79745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:26:53.547376 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-801b8089-06da-4b4a-9971-445637b7fb8c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4084eab199e4476fba10075f66b1a495', 'request_id': 'req-801b8089-06da-4b4a-9971-445637b7fb8c'} {{(pid=79745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:26:53.565429 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-801b8089-06da-4b4a-9971-445637b7fb8c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4084eab199e4476fba10075f66b1a495', 'request_id': 'req-801b8089-06da-4b4a-9971-445637b7fb8c'} {{(pid=79745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:26:53.582587 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-801b8089-06da-4b4a-9971-445637b7fb8c admin admin] The token cache is being invalidate because project 4084eab199e4476fba10075f66b1a495 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79745) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 07:26:53.582877 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-801b8089-06da-4b4a-9971-445637b7fb8c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:26:53.584879 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-801b8089-06da-4b4a-9971-445637b7fb8c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:26:53.586574 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 1151/2311] 10.222.0.21 () {58 vars in 1232 bytes} [Wed May 4 07:26:53 2022] DELETE /identity/v3/projects/4084eab199e4476fba10075f66b1a495 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 07:26:53.592623 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e89b185-a035-467a-870f-301c2cd26104 None None] REQUEST_METHOD: `POST` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:26:53.592908 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e89b185-a035-467a-870f-301c2cd26104 None None] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:26:53.593188 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e89b185-a035-467a-870f-301c2cd26104 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:26:53.613168 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.auth.core [None req-1e89b185-a035-467a-870f-301c2cd26104 None None] MFA Rules not processed for user `83c5e0dcb991496ea6dee38384514508`. Rule list: `[]` (Enabled: `True`). {{(pid=79744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:26:53.614391 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.fernet_utils [None req-1e89b185-a035-467a-870f-301c2cd26104 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:26:53.704637 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 1161/2312] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 07:26:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 07:26:53.715288 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704659bb-81a2-43a5-b925-be474c57746e None None] REQUEST_METHOD: `POST` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:26:53.715581 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704659bb-81a2-43a5-b925-be474c57746e None None] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:26:53.715859 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704659bb-81a2-43a5-b925-be474c57746e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:26:53.744864 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.auth.core [None req-704659bb-81a2-43a5-b925-be474c57746e None None] MFA Rules not processed for user `83c5e0dcb991496ea6dee38384514508`. Rule list: `[]` (Enabled: `True`). {{(pid=79745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:26:53.747048 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.fernet_utils [None req-704659bb-81a2-43a5-b925-be474c57746e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:26:53.772123 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 1152/2313] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 07:26:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 07:26:53.777085 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e89b185-a035-467a-870f-301c2cd26104 None None] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:26:53.787904 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e89b185-a035-467a-870f-301c2cd26104 None None] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:26:53.792728 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621b1407-c6b8-400c-b2ea-98a504171bbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:26:53.793366 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621b1407-c6b8-400c-b2ea-98a504171bbd admin admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:26:53.793682 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621b1407-c6b8-400c-b2ea-98a504171bbd admin admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:26:53.794084 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621b1407-c6b8-400c-b2ea-98a504171bbd admin admin] PATH_INFO: `/v3/domains` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:26:53.794832 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621b1407-c6b8-400c-b2ea-98a504171bbd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79744) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 07:26:53.795139 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621b1407-c6b8-400c-b2ea-98a504171bbd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:26:53.797236 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621b1407-c6b8-400c-b2ea-98a504171bbd admin admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:26:53.811051 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 1162/2314] 10.222.0.21 () {58 vars in 1152 bytes} [Wed May 4 07:26:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 07:26:53.815721 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704659bb-81a2-43a5-b925-be474c57746e None None] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:26:53.826482 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704659bb-81a2-43a5-b925-be474c57746e None None] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:26:53.832711 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da6389f-83eb-475c-a01a-48837dd6a4be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:26:53.833947 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da6389f-83eb-475c-a01a-48837dd6a4be admin admin] REQUEST_METHOD: `POST` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:26:53.834232 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da6389f-83eb-475c-a01a-48837dd6a4be admin admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:26:53.834673 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da6389f-83eb-475c-a01a-48837dd6a4be admin admin] PATH_INFO: `/v3/projects` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:26:53.835599 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da6389f-83eb-475c-a01a-48837dd6a4be admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:26:53.838834 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da6389f-83eb-475c-a01a-48837dd6a4be admin admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:26:53.869783 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 1153/2315] 10.222.0.21 () {60 vars in 1152 bytes} [Wed May 4 07:26:53 2022] POST /identity/v3/projects => generated 383 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 07:26:53.874572 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621b1407-c6b8-400c-b2ea-98a504171bbd admin admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:26:53.887500 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621b1407-c6b8-400c-b2ea-98a504171bbd admin admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:26:53.966907 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac232dd-9f8b-45e6-aa2e-a883f17bbf48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:26:53.968087 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac232dd-9f8b-45e6-aa2e-a883f17bbf48 admin admin] REQUEST_METHOD: `POST` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:26:53.968615 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac232dd-9f8b-45e6-aa2e-a883f17bbf48 admin admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:26:53.968997 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac232dd-9f8b-45e6-aa2e-a883f17bbf48 admin admin] PATH_INFO: `/v3/users` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:26:53.969823 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac232dd-9f8b-45e6-aa2e-a883f17bbf48 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:26:53.972343 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac232dd-9f8b-45e6-aa2e-a883f17bbf48 admin admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:26:54.005715 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 1163/2316] 10.222.0.21 () {60 vars in 1143 bytes} [Wed May 4 07:26:53 2022] POST /identity/v3/users => generated 292 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 07:26:54.007048 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da6389f-83eb-475c-a01a-48837dd6a4be admin admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:26:54.022484 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da6389f-83eb-475c-a01a-48837dd6a4be admin admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:26:54.034022 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c377b432-56c4-4a03-8b41-c4291f50fcd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:26:54.034730 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c377b432-56c4-4a03-8b41-c4291f50fcd2 admin admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:26:54.036012 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c377b432-56c4-4a03-8b41-c4291f50fcd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:26:54.041164 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c377b432-56c4-4a03-8b41-c4291f50fcd2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:26:54.042147 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c377b432-56c4-4a03-8b41-c4291f50fcd2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:26:54.044038 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c377b432-56c4-4a03-8b41-c4291f50fcd2 admin admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:26:54.062351 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 1154/2317] 10.222.0.21 () {58 vars in 1121 bytes} [Wed May 4 07:26:54 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 07:26:54.068282 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac232dd-9f8b-45e6-aa2e-a883f17bbf48 admin admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:26:54.080627 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac232dd-9f8b-45e6-aa2e-a883f17bbf48 admin admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:26:54.087910 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad11721-7280-481b-8377-42217d1afec5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:26:54.089376 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad11721-7280-481b-8377-42217d1afec5 admin admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:26:54.090111 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad11721-7280-481b-8377-42217d1afec5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:26:54.090895 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad11721-7280-481b-8377-42217d1afec5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:26:54.092046 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad11721-7280-481b-8377-42217d1afec5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:26:54.094259 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad11721-7280-481b-8377-42217d1afec5 admin admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:26:54.109502 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 1164/2318] 10.222.0.21 () {58 vars in 1121 bytes} [Wed May 4 07:26:54 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 07:26:54.113939 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c377b432-56c4-4a03-8b41-c4291f50fcd2 admin admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:26:54.126910 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c377b432-56c4-4a03-8b41-c4291f50fcd2 admin admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:26:54.141456 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d7c1f0-404c-4ee4-8c07-58d4902a529f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:26:54.142564 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d7c1f0-404c-4ee4-8c07-58d4902a529f admin admin] REQUEST_METHOD: `PUT` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:26:54.142866 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d7c1f0-404c-4ee4-8c07-58d4902a529f admin admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:26:54.143177 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d7c1f0-404c-4ee4-8c07-58d4902a529f admin admin] PATH_INFO: `/v3/projects/71bff099ff7c4d34ab80a4871decc834/users/7f3dd4169d334681b2d5a7c87d56dfde/roles/9f89c07b05a14f18836116af22cba5f6` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:26:54.162105 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d7c1f0-404c-4ee4-8c07-58d4902a529f admin admin] RBAC: Authorizing `identity:create_grant(project_id=71bff099ff7c4d34ab80a4871decc834, user_id=7f3dd4169d334681b2d5a7c87d56dfde, role_id=9f89c07b05a14f18836116af22cba5f6)` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:26:54.166507 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d7c1f0-404c-4ee4-8c07-58d4902a529f admin admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:26:54.180664 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 1155/2319] 10.222.0.21 () {60 vars in 1482 bytes} [Wed May 4 07:26:54 2022] PUT /identity/v3/projects/71bff099ff7c4d34ab80a4871decc834/users/7f3dd4169d334681b2d5a7c87d56dfde/roles/9f89c07b05a14f18836116af22cba5f6 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 07:26:54.191878 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af93621e-a85e-4466-a844-e4870751f626 None None] REQUEST_METHOD: `POST` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:26:54.192392 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af93621e-a85e-4466-a844-e4870751f626 None None] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:26:54.192514 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af93621e-a85e-4466-a844-e4870751f626 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:26:54.226798 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.auth.core [None req-af93621e-a85e-4466-a844-e4870751f626 None None] MFA Rules not processed for user `7f3dd4169d334681b2d5a7c87d56dfde`. Rule list: `[]` (Enabled: `True`). {{(pid=79744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:26:54.229126 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.fernet_utils [None req-af93621e-a85e-4466-a844-e4870751f626 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:26:54.323516 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 1165/2320] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 07:26:54 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 07:26:54.334419 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d7c1f0-404c-4ee4-8c07-58d4902a529f admin admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:26:54.337032 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.fernet_utils [None req-72d7c1f0-404c-4ee4-8c07-58d4902a529f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:26:54.379916 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46b3406-3e2c-403e-a6e8-e23963461f0f None None] REQUEST_METHOD: `POST` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:26:54.380964 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46b3406-3e2c-403e-a6e8-e23963461f0f None None] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:26:54.381247 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46b3406-3e2c-403e-a6e8-e23963461f0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:26:54.446811 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d7c1f0-404c-4ee4-8c07-58d4902a529f admin admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:26:54.453699 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b69633-995f-44a0-b0e1-52131afdc080 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb341257aa8246b6847561e2fe1fa385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9f9c44db4984653b8d4b5f6b3b949f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:26:54.454609 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b69633-995f-44a0-b0e1-52131afdc080 service cinder] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:26:54.454609 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b69633-995f-44a0-b0e1-52131afdc080 service cinder] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:26:54.455230 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b69633-995f-44a0-b0e1-52131afdc080 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:26:54.468892 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.auth.core [None req-b46b3406-3e2c-403e-a6e8-e23963461f0f None None] MFA Rules not processed for user `feebf5b36f7d46fc80adcd2d5318c4a0`. Rule list: `[]` (Enabled: `True`). {{(pid=79744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:26:54.471032 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.fernet_utils [None req-b46b3406-3e2c-403e-a6e8-e23963461f0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:26:54.480275 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b69633-995f-44a0-b0e1-52131afdc080 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:26:54.481998 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b69633-995f-44a0-b0e1-52131afdc080 service cinder] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:26:54.493770 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 1156/2321] 10.222.0.21 () {60 vars in 1365 bytes} [Wed May 4 07:26:54 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 07:26:54.525132 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b69633-995f-44a0-b0e1-52131afdc080 service cinder] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:26:54.594521 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 1166/2322] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 07:26:54 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 07:26:54.612436 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46b3406-3e2c-403e-a6e8-e23963461f0f None None] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:26:54.614882 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.fernet_utils [None req-b46b3406-3e2c-403e-a6e8-e23963461f0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:26:54.627817 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b69633-995f-44a0-b0e1-52131afdc080 service cinder] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:26:54.631385 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46b3406-3e2c-403e-a6e8-e23963461f0f None None] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:26:54.636780 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25998ba4-58b5-4896-abeb-43755976e1e2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb341257aa8246b6847561e2fe1fa385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9f9c44db4984653b8d4b5f6b3b949f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:26:54.637243 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abb91e6-46e1-4ed9-869b-5259664f95c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:26:54.637944 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25998ba4-58b5-4896-abeb-43755976e1e2 service cinder] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:26:54.638276 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25998ba4-58b5-4896-abeb-43755976e1e2 service cinder] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:26:54.638606 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25998ba4-58b5-4896-abeb-43755976e1e2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:26:54.640079 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abb91e6-46e1-4ed9-869b-5259664f95c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:26:54.640554 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abb91e6-46e1-4ed9-869b-5259664f95c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:26:54.640830 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abb91e6-46e1-4ed9-869b-5259664f95c7 admin admin] PATH_INFO: `/v3/users/7f3dd4169d334681b2d5a7c87d56dfde` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:26:54.642115 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0abb91e6-46e1-4ed9-869b-5259664f95c7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7f3dd4169d334681b2d5a7c87d56dfde)` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:26:54.645300 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0abb91e6-46e1-4ed9-869b-5259664f95c7 admin admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:26:54.649842 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25998ba4-58b5-4896-abeb-43755976e1e2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:26:54.651687 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25998ba4-58b5-4896-abeb-43755976e1e2 service cinder] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:26:54.667446 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 1167/2323] 10.222.0.21 () {60 vars in 1365 bytes} [Wed May 4 07:26:54 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 07:26:54.724391 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-0abb91e6-46e1-4ed9-869b-5259664f95c7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7f3dd4169d334681b2d5a7c87d56dfde'} {{(pid=79745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:26:54.740917 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-0abb91e6-46e1-4ed9-869b-5259664f95c7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7f3dd4169d334681b2d5a7c87d56dfde'} {{(pid=79745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:26:54.741886 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-0abb91e6-46e1-4ed9-869b-5259664f95c7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7f3dd4169d334681b2d5a7c87d56dfde'} {{(pid=79745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:26:54.742564 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-0abb91e6-46e1-4ed9-869b-5259664f95c7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7f3dd4169d334681b2d5a7c87d56dfde'} {{(pid=79745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:26:54.756443 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-0abb91e6-46e1-4ed9-869b-5259664f95c7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7f3dd4169d334681b2d5a7c87d56dfde'} {{(pid=79745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:26:54.777764 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 1157/2324] 10.222.0.21 () {58 vars in 1223 bytes} [Wed May 4 07:26:54 2022] DELETE /identity/v3/users/7f3dd4169d334681b2d5a7c87d56dfde => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 07:26:54.783702 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4571267d-d3b5-477f-8310-8be53ef3bb02 None None] REQUEST_METHOD: `POST` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:26:54.783988 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4571267d-d3b5-477f-8310-8be53ef3bb02 None None] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:26:54.784292 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4571267d-d3b5-477f-8310-8be53ef3bb02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:26:54.823051 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.auth.core [None req-4571267d-d3b5-477f-8310-8be53ef3bb02 None None] MFA Rules not processed for user `83c5e0dcb991496ea6dee38384514508`. Rule list: `[]` (Enabled: `True`). {{(pid=79744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:26:54.826161 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.fernet_utils [None req-4571267d-d3b5-477f-8310-8be53ef3bb02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:26:54.908623 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 1168/2325] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 07:26:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 07:26:54.922552 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abb91e6-46e1-4ed9-869b-5259664f95c7 admin admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:26:54.924093 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.fernet_utils [None req-0abb91e6-46e1-4ed9-869b-5259664f95c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:26:55.023755 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abb91e6-46e1-4ed9-869b-5259664f95c7 admin admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:26:55.028763 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd175031-5615-497a-a44f-7aa64a354aa3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91cb92d00273402b837cb29b37325101', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9f9c44db4984653b8d4b5f6b3b949f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:26:55.029462 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd175031-5615-497a-a44f-7aa64a354aa3 service neutron] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:26:55.029908 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd175031-5615-497a-a44f-7aa64a354aa3 service neutron] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:26:55.030307 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd175031-5615-497a-a44f-7aa64a354aa3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:26:55.043736 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd175031-5615-497a-a44f-7aa64a354aa3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:26:55.045901 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd175031-5615-497a-a44f-7aa64a354aa3 service neutron] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:26:55.080272 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 1158/2326] 10.222.0.21 () {60 vars in 1365 bytes} [Wed May 4 07:26:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 07:26:55.626464 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4571267d-d3b5-477f-8310-8be53ef3bb02 None None] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:26:55.628167 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.fernet_utils [None req-4571267d-d3b5-477f-8310-8be53ef3bb02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:26:55.642779 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4571267d-d3b5-477f-8310-8be53ef3bb02 None None] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:26:55.648415 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239683c8-c3f6-4f24-bede-8f89772372d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:26:55.650071 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239683c8-c3f6-4f24-bede-8f89772372d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:26:55.650589 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239683c8-c3f6-4f24-bede-8f89772372d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:26:55.651055 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239683c8-c3f6-4f24-bede-8f89772372d6 admin admin] PATH_INFO: `/v3/projects/71bff099ff7c4d34ab80a4871decc834` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:26:55.652614 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239683c8-c3f6-4f24-bede-8f89772372d6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=71bff099ff7c4d34ab80a4871decc834)` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:26:55.654635 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239683c8-c3f6-4f24-bede-8f89772372d6 admin admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:26:55.717348 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-239683c8-c3f6-4f24-bede-8f89772372d6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '71bff099ff7c4d34ab80a4871decc834', 'request_id': 'req-239683c8-c3f6-4f24-bede-8f89772372d6'} {{(pid=79744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:26:55.725401 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-239683c8-c3f6-4f24-bede-8f89772372d6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '71bff099ff7c4d34ab80a4871decc834', 'request_id': 'req-239683c8-c3f6-4f24-bede-8f89772372d6'} {{(pid=79744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:26:55.739050 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-239683c8-c3f6-4f24-bede-8f89772372d6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '71bff099ff7c4d34ab80a4871decc834', 'request_id': 'req-239683c8-c3f6-4f24-bede-8f89772372d6'} {{(pid=79744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:26:55.753225 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-239683c8-c3f6-4f24-bede-8f89772372d6 admin admin] The token cache is being invalidate because project 71bff099ff7c4d34ab80a4871decc834 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79744) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 07:26:55.753505 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-239683c8-c3f6-4f24-bede-8f89772372d6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:26:55.754783 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-239683c8-c3f6-4f24-bede-8f89772372d6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:26:55.756603 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 1169/2327] 10.222.0.21 () {58 vars in 1232 bytes} [Wed May 4 07:26:55 2022] DELETE /identity/v3/projects/71bff099ff7c4d34ab80a4871decc834 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 07:26:57.267493 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28adcf35-3eb0-4b2e-8111-7598ff96610b None None] REQUEST_METHOD: `POST` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:26:57.268138 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28adcf35-3eb0-4b2e-8111-7598ff96610b None None] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:26:57.268138 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28adcf35-3eb0-4b2e-8111-7598ff96610b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:26:57.294202 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.auth.core [None req-28adcf35-3eb0-4b2e-8111-7598ff96610b None None] MFA Rules not processed for user `feebf5b36f7d46fc80adcd2d5318c4a0`. Rule list: `[]` (Enabled: `True`). {{(pid=79745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:26:57.295438 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.fernet_utils [None req-28adcf35-3eb0-4b2e-8111-7598ff96610b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:26:57.349965 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 1159/2328] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 07:26:57 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 07:27:41.144179 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239683c8-c3f6-4f24-bede-8f89772372d6 admin admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:27:41.145601 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.fernet_utils [None req-239683c8-c3f6-4f24-bede-8f89772372d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:27:41.215593 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239683c8-c3f6-4f24-bede-8f89772372d6 admin admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:27:41.220454 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d555c3-20e6-48ba-ba54-7bd1da8dcdb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:27:41.221345 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d555c3-20e6-48ba-ba54-7bd1da8dcdb5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:27:41.221620 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d555c3-20e6-48ba-ba54-7bd1da8dcdb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:27:41.222326 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d555c3-20e6-48ba-ba54-7bd1da8dcdb5 admin admin] PATH_INFO: `/v3/users/73e835b281f94eadac2bc0e97ab23e67` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:27:41.223347 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d555c3-20e6-48ba-ba54-7bd1da8dcdb5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=73e835b281f94eadac2bc0e97ab23e67)` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:27:41.225271 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d555c3-20e6-48ba-ba54-7bd1da8dcdb5 admin admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:27:41.272352 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-e3d555c3-20e6-48ba-ba54-7bd1da8dcdb5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '73e835b281f94eadac2bc0e97ab23e67'} {{(pid=79744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:27:41.272992 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-e3d555c3-20e6-48ba-ba54-7bd1da8dcdb5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '73e835b281f94eadac2bc0e97ab23e67'} {{(pid=79744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:27:41.281328 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-e3d555c3-20e6-48ba-ba54-7bd1da8dcdb5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '73e835b281f94eadac2bc0e97ab23e67'} {{(pid=79744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:27:41.282403 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-e3d555c3-20e6-48ba-ba54-7bd1da8dcdb5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '73e835b281f94eadac2bc0e97ab23e67'} {{(pid=79744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:27:41.294598 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-e3d555c3-20e6-48ba-ba54-7bd1da8dcdb5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '73e835b281f94eadac2bc0e97ab23e67'} {{(pid=79744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:27:41.308411 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 1170/2329] 10.222.0.21 () {58 vars in 1223 bytes} [Wed May 4 07:27:41 2022] DELETE /identity/v3/users/73e835b281f94eadac2bc0e97ab23e67 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 07:27:41.313147 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00158b8c-6286-4471-9056-315cfd7995b6 None None] REQUEST_METHOD: `POST` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:27:41.313673 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00158b8c-6286-4471-9056-315cfd7995b6 None None] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:27:41.313673 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00158b8c-6286-4471-9056-315cfd7995b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:27:41.331809 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.auth.core [None req-00158b8c-6286-4471-9056-315cfd7995b6 None None] MFA Rules not processed for user `83c5e0dcb991496ea6dee38384514508`. Rule list: `[]` (Enabled: `True`). {{(pid=79745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:27:41.332997 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.fernet_utils [None req-00158b8c-6286-4471-9056-315cfd7995b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:27:41.393463 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 1160/2330] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 07:27:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 07:27:41.404557 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d555c3-20e6-48ba-ba54-7bd1da8dcdb5 admin admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:27:41.405963 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.fernet_utils [None req-e3d555c3-20e6-48ba-ba54-7bd1da8dcdb5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:27:41.467770 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d555c3-20e6-48ba-ba54-7bd1da8dcdb5 admin admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:27:41.471471 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a309bc-9375-4f77-b240-ec7179a7966d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91cb92d00273402b837cb29b37325101', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9f9c44db4984653b8d4b5f6b3b949f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:27:41.472117 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a309bc-9375-4f77-b240-ec7179a7966d service neutron] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:27:41.472395 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a309bc-9375-4f77-b240-ec7179a7966d service neutron] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:27:41.472664 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a309bc-9375-4f77-b240-ec7179a7966d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:27:41.481964 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a309bc-9375-4f77-b240-ec7179a7966d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:27:41.483412 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a309bc-9375-4f77-b240-ec7179a7966d service neutron] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:27:41.493767 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 1171/2331] 10.222.0.21 () {60 vars in 1365 bytes} [Wed May 4 07:27:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 04 07:27:41.781124 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00158b8c-6286-4471-9056-315cfd7995b6 None None] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:27:41.782793 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.fernet_utils [None req-00158b8c-6286-4471-9056-315cfd7995b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:27:41.794482 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00158b8c-6286-4471-9056-315cfd7995b6 None None] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:27:41.799273 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244c4339-b7a8-44a4-b0c2-f1282e7b5156 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:27:41.800903 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244c4339-b7a8-44a4-b0c2-f1282e7b5156 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:27:41.801178 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244c4339-b7a8-44a4-b0c2-f1282e7b5156 admin admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:27:41.801628 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244c4339-b7a8-44a4-b0c2-f1282e7b5156 admin admin] PATH_INFO: `/v3/projects/d9a9e8f43db44d9e8b9d556feddeaedb` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:27:41.803033 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244c4339-b7a8-44a4-b0c2-f1282e7b5156 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d9a9e8f43db44d9e8b9d556feddeaedb)` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:27:41.805730 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244c4339-b7a8-44a4-b0c2-f1282e7b5156 admin admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:27:41.859947 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-244c4339-b7a8-44a4-b0c2-f1282e7b5156 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd9a9e8f43db44d9e8b9d556feddeaedb', 'request_id': 'req-244c4339-b7a8-44a4-b0c2-f1282e7b5156'} {{(pid=79745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:27:41.866454 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-244c4339-b7a8-44a4-b0c2-f1282e7b5156 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd9a9e8f43db44d9e8b9d556feddeaedb', 'request_id': 'req-244c4339-b7a8-44a4-b0c2-f1282e7b5156'} {{(pid=79745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:27:41.876097 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-244c4339-b7a8-44a4-b0c2-f1282e7b5156 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd9a9e8f43db44d9e8b9d556feddeaedb', 'request_id': 'req-244c4339-b7a8-44a4-b0c2-f1282e7b5156'} {{(pid=79745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:27:41.890200 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-244c4339-b7a8-44a4-b0c2-f1282e7b5156 admin admin] The token cache is being invalidate because project d9a9e8f43db44d9e8b9d556feddeaedb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79745) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 07:27:41.890484 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-244c4339-b7a8-44a4-b0c2-f1282e7b5156 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:27:41.891203 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-244c4339-b7a8-44a4-b0c2-f1282e7b5156 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:27:41.892846 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 1161/2332] 10.222.0.21 () {58 vars in 1232 bytes} [Wed May 4 07:27:41 2022] DELETE /identity/v3/projects/d9a9e8f43db44d9e8b9d556feddeaedb => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 07:27:41.898191 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b911e836-4a78-433e-ab31-bda3be3dbd3b None None] REQUEST_METHOD: `POST` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:27:41.899024 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b911e836-4a78-433e-ab31-bda3be3dbd3b None None] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:27:41.899417 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b911e836-4a78-433e-ab31-bda3be3dbd3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:27:41.918827 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.auth.core [None req-b911e836-4a78-433e-ab31-bda3be3dbd3b None None] MFA Rules not processed for user `83c5e0dcb991496ea6dee38384514508`. Rule list: `[]` (Enabled: `True`). {{(pid=79744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:27:41.920195 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.fernet_utils [None req-b911e836-4a78-433e-ab31-bda3be3dbd3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:27:41.995192 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 1172/2333] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 07:27:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 07:27:42.008787 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a91df9-6e48-43b7-be5d-a12540c7c2b0 None None] REQUEST_METHOD: `POST` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:27:42.009258 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a91df9-6e48-43b7-be5d-a12540c7c2b0 None None] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:27:42.009695 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a91df9-6e48-43b7-be5d-a12540c7c2b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:27:42.034453 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.auth.core [None req-86a91df9-6e48-43b7-be5d-a12540c7c2b0 None None] MFA Rules not processed for user `83c5e0dcb991496ea6dee38384514508`. Rule list: `[]` (Enabled: `True`). {{(pid=79745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:27:42.035694 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.fernet_utils [None req-86a91df9-6e48-43b7-be5d-a12540c7c2b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:27:42.044271 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 1162/2334] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 07:27:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 07:27:42.048632 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b911e836-4a78-433e-ab31-bda3be3dbd3b None None] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:27:42.059843 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b911e836-4a78-433e-ab31-bda3be3dbd3b None None] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:27:42.064651 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80a93cb-3d18-40dd-aa8b-af5ac9cfad79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:27:42.065313 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80a93cb-3d18-40dd-aa8b-af5ac9cfad79 admin admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:27:42.065592 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80a93cb-3d18-40dd-aa8b-af5ac9cfad79 admin admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:27:42.065864 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80a93cb-3d18-40dd-aa8b-af5ac9cfad79 admin admin] PATH_INFO: `/v3/domains` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:27:42.066601 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80a93cb-3d18-40dd-aa8b-af5ac9cfad79 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79744) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 07:27:42.066907 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80a93cb-3d18-40dd-aa8b-af5ac9cfad79 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:27:42.068549 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80a93cb-3d18-40dd-aa8b-af5ac9cfad79 admin admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:27:42.081092 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 1173/2335] 10.222.0.21 () {58 vars in 1152 bytes} [Wed May 4 07:27:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 07:27:42.085345 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a91df9-6e48-43b7-be5d-a12540c7c2b0 None None] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:27:42.095377 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a91df9-6e48-43b7-be5d-a12540c7c2b0 None None] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:27:42.100152 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7906c70-5bb0-416e-a23e-a2355dbd4cbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:27:42.100807 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7906c70-5bb0-416e-a23e-a2355dbd4cbd admin admin] REQUEST_METHOD: `POST` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:27:42.101083 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7906c70-5bb0-416e-a23e-a2355dbd4cbd admin admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:27:42.101950 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7906c70-5bb0-416e-a23e-a2355dbd4cbd admin admin] PATH_INFO: `/v3/projects` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:27:42.102753 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7906c70-5bb0-416e-a23e-a2355dbd4cbd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:27:42.104919 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7906c70-5bb0-416e-a23e-a2355dbd4cbd admin admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:27:42.141445 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 1163/2336] 10.222.0.21 () {60 vars in 1152 bytes} [Wed May 4 07:27:42 2022] POST /identity/v3/projects => generated 371 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 07:27:42.145515 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80a93cb-3d18-40dd-aa8b-af5ac9cfad79 admin admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:27:42.155699 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80a93cb-3d18-40dd-aa8b-af5ac9cfad79 admin admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:27:42.223179 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a0c5fe-8e26-4a47-8f50-c57b167b38d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:27:42.223864 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a0c5fe-8e26-4a47-8f50-c57b167b38d1 admin admin] REQUEST_METHOD: `POST` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:27:42.224145 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a0c5fe-8e26-4a47-8f50-c57b167b38d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:27:42.224419 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a0c5fe-8e26-4a47-8f50-c57b167b38d1 admin admin] PATH_INFO: `/v3/users` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:27:42.225122 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a0c5fe-8e26-4a47-8f50-c57b167b38d1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:27:42.227791 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a0c5fe-8e26-4a47-8f50-c57b167b38d1 admin admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:27:42.249340 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 1174/2337] 10.222.0.21 () {60 vars in 1143 bytes} [Wed May 4 07:27:42 2022] POST /identity/v3/users => generated 286 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 07:27:42.252734 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7906c70-5bb0-416e-a23e-a2355dbd4cbd admin admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:27:42.263655 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7906c70-5bb0-416e-a23e-a2355dbd4cbd admin admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:27:42.268244 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ad9b78-334c-40de-9acd-e8c31f6cb23f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:27:42.268898 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ad9b78-334c-40de-9acd-e8c31f6cb23f admin admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:27:42.269175 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ad9b78-334c-40de-9acd-e8c31f6cb23f admin admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:27:42.269444 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ad9b78-334c-40de-9acd-e8c31f6cb23f admin admin] PATH_INFO: `/v3/roles` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:27:42.270172 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ad9b78-334c-40de-9acd-e8c31f6cb23f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:27:42.275756 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ad9b78-334c-40de-9acd-e8c31f6cb23f admin admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:27:42.282844 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 1164/2338] 10.222.0.21 () {58 vars in 1121 bytes} [Wed May 4 07:27:42 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 07:27:42.287094 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a0c5fe-8e26-4a47-8f50-c57b167b38d1 admin admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:27:42.297619 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a0c5fe-8e26-4a47-8f50-c57b167b38d1 admin admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:27:42.302504 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a21c545-94e7-4451-aacb-f6252548668f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:27:42.303228 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a21c545-94e7-4451-aacb-f6252548668f admin admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:27:42.303537 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a21c545-94e7-4451-aacb-f6252548668f admin admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:27:42.303842 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a21c545-94e7-4451-aacb-f6252548668f admin admin] PATH_INFO: `/v3/roles` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:27:42.305352 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a21c545-94e7-4451-aacb-f6252548668f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:27:42.307128 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a21c545-94e7-4451-aacb-f6252548668f admin admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:27:42.318313 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 1175/2339] 10.222.0.21 () {58 vars in 1121 bytes} [Wed May 4 07:27:42 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 07:27:42.323128 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ad9b78-334c-40de-9acd-e8c31f6cb23f admin admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:27:42.339131 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ad9b78-334c-40de-9acd-e8c31f6cb23f admin admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:27:42.346256 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66695af-deab-448b-9b07-323ef8fad833 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:27:42.347696 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66695af-deab-448b-9b07-323ef8fad833 admin admin] REQUEST_METHOD: `PUT` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:27:42.348147 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66695af-deab-448b-9b07-323ef8fad833 admin admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:27:42.348586 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66695af-deab-448b-9b07-323ef8fad833 admin admin] PATH_INFO: `/v3/projects/fd1b0b8fc10f441cbb7ed557ba8d9917/users/b2e5ef7ac7c044caa221b7c51b050bb1/roles/9f89c07b05a14f18836116af22cba5f6` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:27:42.369554 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66695af-deab-448b-9b07-323ef8fad833 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fd1b0b8fc10f441cbb7ed557ba8d9917, user_id=b2e5ef7ac7c044caa221b7c51b050bb1, role_id=9f89c07b05a14f18836116af22cba5f6)` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:27:42.372229 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66695af-deab-448b-9b07-323ef8fad833 admin admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:27:42.387660 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 1165/2340] 10.222.0.21 () {60 vars in 1482 bytes} [Wed May 4 07:27:42 2022] PUT /identity/v3/projects/fd1b0b8fc10f441cbb7ed557ba8d9917/users/b2e5ef7ac7c044caa221b7c51b050bb1/roles/9f89c07b05a14f18836116af22cba5f6 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 07:27:42.398027 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1510f4f5-9018-4e49-bcac-7bcc31d7441a None None] REQUEST_METHOD: `POST` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:27:42.398970 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1510f4f5-9018-4e49-bcac-7bcc31d7441a None None] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:27:42.399410 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1510f4f5-9018-4e49-bcac-7bcc31d7441a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:27:42.428466 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.auth.core [None req-1510f4f5-9018-4e49-bcac-7bcc31d7441a None None] MFA Rules not processed for user `b2e5ef7ac7c044caa221b7c51b050bb1`. Rule list: `[]` (Enabled: `True`). {{(pid=79744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:27:42.429642 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.fernet_utils [None req-1510f4f5-9018-4e49-bcac-7bcc31d7441a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:27:42.497626 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 1176/2341] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 07:27:42 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 07:27:42.509181 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66695af-deab-448b-9b07-323ef8fad833 admin admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:27:42.510869 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.fernet_utils [None req-b66695af-deab-448b-9b07-323ef8fad833 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:27:42.593668 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66695af-deab-448b-9b07-323ef8fad833 admin admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:27:42.597450 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9c1d32-582e-456e-9219-c68445f1b24c service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7538f5cab3364625a3e909f5f117ef2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9f9c44db4984653b8d4b5f6b3b949f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:27:42.598096 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9c1d32-582e-456e-9219-c68445f1b24c service glance] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:27:42.598369 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9c1d32-582e-456e-9219-c68445f1b24c service glance] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:27:42.598636 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9c1d32-582e-456e-9219-c68445f1b24c service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:27:42.608352 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9c1d32-582e-456e-9219-c68445f1b24c service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:27:42.609795 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9c1d32-582e-456e-9219-c68445f1b24c service glance] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:27:42.618872 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 1166/2342] 10.222.0.21 () {60 vars in 1365 bytes} [Wed May 4 07:27:42 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 07:28:11.193687 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1510f4f5-9018-4e49-bcac-7bcc31d7441a None None] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:28:11.195094 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.fernet_utils [None req-1510f4f5-9018-4e49-bcac-7bcc31d7441a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:28:11.291769 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1510f4f5-9018-4e49-bcac-7bcc31d7441a None None] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:28:11.297453 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9bc4332-dbbc-4ca7-b5f6-0a6ead492597 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef28e980e8664d3eba4304e4589ea2df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9f9c44db4984653b8d4b5f6b3b949f5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:28:11.298152 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bc4332-dbbc-4ca7-b5f6-0a6ead492597 service placement] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:28:11.298441 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bc4332-dbbc-4ca7-b5f6-0a6ead492597 service placement] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:28:11.298720 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bc4332-dbbc-4ca7-b5f6-0a6ead492597 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:28:11.300699 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.fernet_utils [None req-b9bc4332-dbbc-4ca7-b5f6-0a6ead492597 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:28:11.312754 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9bc4332-dbbc-4ca7-b5f6-0a6ead492597 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:28:11.314331 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9bc4332-dbbc-4ca7-b5f6-0a6ead492597 service placement] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:28:11.324346 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 1177/2343] 10.222.0.21 () {60 vars in 1365 bytes} [Wed May 4 07:28:11 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 07:28:32.405260 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9c1d32-582e-456e-9219-c68445f1b24c service glance] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:28:32.474074 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9c1d32-582e-456e-9219-c68445f1b24c service glance] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:28:32.483774 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54fac6c-5267-44e1-bdd5-86cf7e8f0462 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:28:32.485185 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54fac6c-5267-44e1-bdd5-86cf7e8f0462 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:28:32.485485 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54fac6c-5267-44e1-bdd5-86cf7e8f0462 admin admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:28:32.485760 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54fac6c-5267-44e1-bdd5-86cf7e8f0462 admin admin] PATH_INFO: `/v3/users/b2e5ef7ac7c044caa221b7c51b050bb1` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:28:32.486989 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54fac6c-5267-44e1-bdd5-86cf7e8f0462 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b2e5ef7ac7c044caa221b7c51b050bb1)` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:28:32.488986 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54fac6c-5267-44e1-bdd5-86cf7e8f0462 admin admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:28:32.541497 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-d54fac6c-5267-44e1-bdd5-86cf7e8f0462 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b2e5ef7ac7c044caa221b7c51b050bb1'} {{(pid=79745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:28:32.554392 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-d54fac6c-5267-44e1-bdd5-86cf7e8f0462 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b2e5ef7ac7c044caa221b7c51b050bb1'} {{(pid=79745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:28:32.555123 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-d54fac6c-5267-44e1-bdd5-86cf7e8f0462 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b2e5ef7ac7c044caa221b7c51b050bb1'} {{(pid=79745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:28:32.555765 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-d54fac6c-5267-44e1-bdd5-86cf7e8f0462 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b2e5ef7ac7c044caa221b7c51b050bb1'} {{(pid=79745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:28:32.563824 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-d54fac6c-5267-44e1-bdd5-86cf7e8f0462 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b2e5ef7ac7c044caa221b7c51b050bb1'} {{(pid=79745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:28:32.577342 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 1167/2344] 10.222.0.21 () {58 vars in 1223 bytes} [Wed May 4 07:28:32 2022] DELETE /identity/v3/users/b2e5ef7ac7c044caa221b7c51b050bb1 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 07:28:32.582124 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9173185c-7925-4403-be5f-33694c13f5a3 None None] REQUEST_METHOD: `POST` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:28:32.582682 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9173185c-7925-4403-be5f-33694c13f5a3 None None] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:28:32.582852 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9173185c-7925-4403-be5f-33694c13f5a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:28:32.606722 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.auth.core [None req-9173185c-7925-4403-be5f-33694c13f5a3 None None] MFA Rules not processed for user `83c5e0dcb991496ea6dee38384514508`. Rule list: `[]` (Enabled: `True`). {{(pid=79744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:28:32.608000 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.fernet_utils [None req-9173185c-7925-4403-be5f-33694c13f5a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:28:32.670790 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 1178/2345] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 07:28:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 07:28:32.681268 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54fac6c-5267-44e1-bdd5-86cf7e8f0462 admin admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:28:32.682741 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.fernet_utils [None req-d54fac6c-5267-44e1-bdd5-86cf7e8f0462 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:28:32.741582 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54fac6c-5267-44e1-bdd5-86cf7e8f0462 admin admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:28:32.745271 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ae67ad-27b3-4599-a5ff-b25a27ead7cf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91cb92d00273402b837cb29b37325101', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9f9c44db4984653b8d4b5f6b3b949f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:28:32.745914 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ae67ad-27b3-4599-a5ff-b25a27ead7cf service neutron] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:28:32.746195 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ae67ad-27b3-4599-a5ff-b25a27ead7cf service neutron] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:28:32.746469 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ae67ad-27b3-4599-a5ff-b25a27ead7cf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:28:32.756893 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ae67ad-27b3-4599-a5ff-b25a27ead7cf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:28:32.758329 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ae67ad-27b3-4599-a5ff-b25a27ead7cf service neutron] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:28:32.768906 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 1168/2346] 10.222.0.21 () {60 vars in 1365 bytes} [Wed May 4 07:28:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 07:28:33.058929 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9173185c-7925-4403-be5f-33694c13f5a3 None None] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:28:33.060455 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.fernet_utils [None req-9173185c-7925-4403-be5f-33694c13f5a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:28:33.073027 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9173185c-7925-4403-be5f-33694c13f5a3 None None] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:28:33.077645 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19917854-a4e8-4123-a7bd-b186ed3143ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:28:33.078677 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19917854-a4e8-4123-a7bd-b186ed3143ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:28:33.078954 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19917854-a4e8-4123-a7bd-b186ed3143ef admin admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:28:33.079251 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19917854-a4e8-4123-a7bd-b186ed3143ef admin admin] PATH_INFO: `/v3/projects/fd1b0b8fc10f441cbb7ed557ba8d9917` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:28:33.080582 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19917854-a4e8-4123-a7bd-b186ed3143ef admin admin] RBAC: Authorizing `identity:delete_project(project_id=fd1b0b8fc10f441cbb7ed557ba8d9917)` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:28:33.082494 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19917854-a4e8-4123-a7bd-b186ed3143ef admin admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:28:33.136493 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-19917854-a4e8-4123-a7bd-b186ed3143ef admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fd1b0b8fc10f441cbb7ed557ba8d9917', 'request_id': 'req-19917854-a4e8-4123-a7bd-b186ed3143ef'} {{(pid=79744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:28:33.143410 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-19917854-a4e8-4123-a7bd-b186ed3143ef admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fd1b0b8fc10f441cbb7ed557ba8d9917', 'request_id': 'req-19917854-a4e8-4123-a7bd-b186ed3143ef'} {{(pid=79744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:28:33.151965 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-19917854-a4e8-4123-a7bd-b186ed3143ef admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fd1b0b8fc10f441cbb7ed557ba8d9917', 'request_id': 'req-19917854-a4e8-4123-a7bd-b186ed3143ef'} {{(pid=79744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:28:33.164860 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-19917854-a4e8-4123-a7bd-b186ed3143ef admin admin] The token cache is being invalidate because project fd1b0b8fc10f441cbb7ed557ba8d9917 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79744) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 07:28:33.165153 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-19917854-a4e8-4123-a7bd-b186ed3143ef admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:28:33.165825 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-19917854-a4e8-4123-a7bd-b186ed3143ef admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:28:33.167438 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 1179/2347] 10.222.0.21 () {58 vars in 1232 bytes} [Wed May 4 07:28:33 2022] DELETE /identity/v3/projects/fd1b0b8fc10f441cbb7ed557ba8d9917 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 07:28:33.173170 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9d2dc3-a01b-4d62-9e89-8e2f856faffa None None] REQUEST_METHOD: `POST` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:28:33.173456 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9d2dc3-a01b-4d62-9e89-8e2f856faffa None None] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:28:33.173732 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9d2dc3-a01b-4d62-9e89-8e2f856faffa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:28:33.193390 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.auth.core [None req-4b9d2dc3-a01b-4d62-9e89-8e2f856faffa None None] MFA Rules not processed for user `83c5e0dcb991496ea6dee38384514508`. Rule list: `[]` (Enabled: `True`). {{(pid=79745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:28:33.194608 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.fernet_utils [None req-4b9d2dc3-a01b-4d62-9e89-8e2f856faffa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:28:33.260616 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 1169/2348] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 07:28:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 07:28:33.269033 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72194747-ac71-4694-ac1f-5f9663226e88 None None] REQUEST_METHOD: `POST` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:28:33.269332 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72194747-ac71-4694-ac1f-5f9663226e88 None None] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:28:33.269592 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72194747-ac71-4694-ac1f-5f9663226e88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:28:33.291373 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.auth.core [None req-72194747-ac71-4694-ac1f-5f9663226e88 None None] MFA Rules not processed for user `83c5e0dcb991496ea6dee38384514508`. Rule list: `[]` (Enabled: `True`). {{(pid=79744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:28:33.292594 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.fernet_utils [None req-72194747-ac71-4694-ac1f-5f9663226e88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:28:33.300835 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 1180/2349] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 07:28:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 07:28:33.305207 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9d2dc3-a01b-4d62-9e89-8e2f856faffa None None] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:28:33.315517 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9d2dc3-a01b-4d62-9e89-8e2f856faffa None None] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:28:33.320156 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad1327a-ae13-47e6-b220-bd5bb6344542 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:28:33.320815 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad1327a-ae13-47e6-b220-bd5bb6344542 admin admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:28:33.321097 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad1327a-ae13-47e6-b220-bd5bb6344542 admin admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:28:33.321372 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad1327a-ae13-47e6-b220-bd5bb6344542 admin admin] PATH_INFO: `/v3/domains` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:28:33.322102 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad1327a-ae13-47e6-b220-bd5bb6344542 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 07:28:33.322404 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad1327a-ae13-47e6-b220-bd5bb6344542 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:28:33.324042 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad1327a-ae13-47e6-b220-bd5bb6344542 admin admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:28:33.337142 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 1170/2350] 10.222.0.21 () {58 vars in 1152 bytes} [Wed May 4 07:28:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 07:28:33.341595 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72194747-ac71-4694-ac1f-5f9663226e88 None None] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:28:33.351626 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72194747-ac71-4694-ac1f-5f9663226e88 None None] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:28:33.356322 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ac8f34-0614-462e-9ddd-2be9e1f52b15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:28:33.356987 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ac8f34-0614-462e-9ddd-2be9e1f52b15 admin admin] REQUEST_METHOD: `POST` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:28:33.357273 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ac8f34-0614-462e-9ddd-2be9e1f52b15 admin admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:28:33.357545 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ac8f34-0614-462e-9ddd-2be9e1f52b15 admin admin] PATH_INFO: `/v3/projects` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:28:33.358251 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ac8f34-0614-462e-9ddd-2be9e1f52b15 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:28:33.360430 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ac8f34-0614-462e-9ddd-2be9e1f52b15 admin admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:28:33.386693 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 1181/2351] 10.222.0.21 () {60 vars in 1152 bytes} [Wed May 4 07:28:33 2022] POST /identity/v3/projects => generated 373 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 07:28:33.391257 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad1327a-ae13-47e6-b220-bd5bb6344542 admin admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:28:33.402792 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad1327a-ae13-47e6-b220-bd5bb6344542 admin admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:28:33.463443 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e974a1ba-fcf6-4920-a8ef-bd5e005f404d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:28:33.464109 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e974a1ba-fcf6-4920-a8ef-bd5e005f404d admin admin] REQUEST_METHOD: `POST` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:28:33.464526 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e974a1ba-fcf6-4920-a8ef-bd5e005f404d admin admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:28:33.464926 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e974a1ba-fcf6-4920-a8ef-bd5e005f404d admin admin] PATH_INFO: `/v3/users` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:28:33.465635 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e974a1ba-fcf6-4920-a8ef-bd5e005f404d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:28:33.468163 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e974a1ba-fcf6-4920-a8ef-bd5e005f404d admin admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:28:33.491930 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 1171/2352] 10.222.0.21 () {60 vars in 1143 bytes} [Wed May 4 07:28:33 2022] POST /identity/v3/users => generated 287 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 07:28:33.496221 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ac8f34-0614-462e-9ddd-2be9e1f52b15 admin admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:28:33.508080 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ac8f34-0614-462e-9ddd-2be9e1f52b15 admin admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:28:33.512814 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76843b6c-9088-41e7-a91a-5e8e575654c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:28:33.513483 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76843b6c-9088-41e7-a91a-5e8e575654c5 admin admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:28:33.513763 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76843b6c-9088-41e7-a91a-5e8e575654c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:28:33.514034 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76843b6c-9088-41e7-a91a-5e8e575654c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:28:33.514793 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76843b6c-9088-41e7-a91a-5e8e575654c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:28:33.517671 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76843b6c-9088-41e7-a91a-5e8e575654c5 admin admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:28:33.528786 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 1182/2353] 10.222.0.21 () {58 vars in 1121 bytes} [Wed May 4 07:28:33 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 04 07:28:33.533549 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e974a1ba-fcf6-4920-a8ef-bd5e005f404d admin admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:28:33.543930 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e974a1ba-fcf6-4920-a8ef-bd5e005f404d admin admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:28:33.549623 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e20dc92-c803-4d38-bac4-c2ce101957fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:28:33.550289 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e20dc92-c803-4d38-bac4-c2ce101957fc admin admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:28:33.550568 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e20dc92-c803-4d38-bac4-c2ce101957fc admin admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:28:33.550851 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e20dc92-c803-4d38-bac4-c2ce101957fc admin admin] PATH_INFO: `/v3/roles` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:28:33.551615 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e20dc92-c803-4d38-bac4-c2ce101957fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:28:33.553207 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e20dc92-c803-4d38-bac4-c2ce101957fc admin admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:28:33.564632 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 1172/2354] 10.222.0.21 () {58 vars in 1121 bytes} [Wed May 4 07:28:33 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 07:28:33.569106 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76843b6c-9088-41e7-a91a-5e8e575654c5 admin admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:28:33.579798 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76843b6c-9088-41e7-a91a-5e8e575654c5 admin admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:28:33.584558 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2dc4684-d78e-4a22-9a23-9bf4114c7be2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:28:33.585451 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2dc4684-d78e-4a22-9a23-9bf4114c7be2 admin admin] REQUEST_METHOD: `PUT` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:28:33.585729 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2dc4684-d78e-4a22-9a23-9bf4114c7be2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:28:33.586003 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2dc4684-d78e-4a22-9a23-9bf4114c7be2 admin admin] PATH_INFO: `/v3/projects/344d6cd83d8c4bddb14a502d4a8fdf51/users/84cc14f9133d47a3b569610e7e89d650/roles/9f89c07b05a14f18836116af22cba5f6` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:28:33.602493 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2dc4684-d78e-4a22-9a23-9bf4114c7be2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=344d6cd83d8c4bddb14a502d4a8fdf51, user_id=84cc14f9133d47a3b569610e7e89d650, role_id=9f89c07b05a14f18836116af22cba5f6)` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:28:33.605207 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2dc4684-d78e-4a22-9a23-9bf4114c7be2 admin admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:28:33.620137 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 1183/2355] 10.222.0.21 () {60 vars in 1482 bytes} [Wed May 4 07:28:33 2022] PUT /identity/v3/projects/344d6cd83d8c4bddb14a502d4a8fdf51/users/84cc14f9133d47a3b569610e7e89d650/roles/9f89c07b05a14f18836116af22cba5f6 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 07:28:33.631492 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdbf585-4d62-463d-85fc-33f383404edf None None] REQUEST_METHOD: `POST` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:28:33.631777 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdbf585-4d62-463d-85fc-33f383404edf None None] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:28:33.632244 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdbf585-4d62-463d-85fc-33f383404edf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:28:33.660939 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.auth.core [None req-6cdbf585-4d62-463d-85fc-33f383404edf None None] MFA Rules not processed for user `84cc14f9133d47a3b569610e7e89d650`. Rule list: `[]` (Enabled: `True`). {{(pid=79745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:28:33.662158 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.fernet_utils [None req-6cdbf585-4d62-463d-85fc-33f383404edf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:28:33.727264 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 1173/2356] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 07:28:33 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 07:28:33.740823 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2dc4684-d78e-4a22-9a23-9bf4114c7be2 admin admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:28:33.742523 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.fernet_utils [None req-b2dc4684-d78e-4a22-9a23-9bf4114c7be2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:28:33.802521 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2dc4684-d78e-4a22-9a23-9bf4114c7be2 admin admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:28:33.806157 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b92b2a-f7aa-4902-9735-99056ff5453f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb341257aa8246b6847561e2fe1fa385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9f9c44db4984653b8d4b5f6b3b949f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:28:33.806803 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b92b2a-f7aa-4902-9735-99056ff5453f service cinder] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:28:33.807110 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b92b2a-f7aa-4902-9735-99056ff5453f service cinder] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:28:33.807424 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b92b2a-f7aa-4902-9735-99056ff5453f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:28:33.818956 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b92b2a-f7aa-4902-9735-99056ff5453f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:28:33.820722 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b92b2a-f7aa-4902-9735-99056ff5453f service cinder] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:28:33.830891 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 1184/2357] 10.222.0.21 () {60 vars in 1365 bytes} [Wed May 4 07:28:33 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 07:28:39.218237 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e932d491-b6a2-4aab-b750-708db1cd6d05 None None] REQUEST_METHOD: `POST` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:28:39.219609 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e932d491-b6a2-4aab-b750-708db1cd6d05 None None] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:28:39.219825 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e932d491-b6a2-4aab-b750-708db1cd6d05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:28:39.238445 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.auth.core [None req-e932d491-b6a2-4aab-b750-708db1cd6d05 None None] MFA Rules not processed for user `10265d473a5c49e6960740b21114fee1`. Rule list: `[]` (Enabled: `True`). {{(pid=79745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:28:39.239914 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.fernet_utils [None req-e932d491-b6a2-4aab-b750-708db1cd6d05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:28:39.304352 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 1174/2358] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 07:28:39 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 07:28:47.052519 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b92b2a-f7aa-4902-9735-99056ff5453f service cinder] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:28:47.116169 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b92b2a-f7aa-4902-9735-99056ff5453f service cinder] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:28:47.120591 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cea73a2-a002-4fb7-8225-8830aa1e3456 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:28:47.121451 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cea73a2-a002-4fb7-8225-8830aa1e3456 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:28:47.121725 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cea73a2-a002-4fb7-8225-8830aa1e3456 admin admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:28:47.121992 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cea73a2-a002-4fb7-8225-8830aa1e3456 admin admin] PATH_INFO: `/v3/users/84cc14f9133d47a3b569610e7e89d650` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:28:47.123188 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cea73a2-a002-4fb7-8225-8830aa1e3456 admin admin] RBAC: Authorizing `identity:delete_user(user_id=84cc14f9133d47a3b569610e7e89d650)` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:28:47.125200 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cea73a2-a002-4fb7-8225-8830aa1e3456 admin admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:28:47.173345 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-4cea73a2-a002-4fb7-8225-8830aa1e3456 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '84cc14f9133d47a3b569610e7e89d650'} {{(pid=79744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:28:47.174003 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-4cea73a2-a002-4fb7-8225-8830aa1e3456 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '84cc14f9133d47a3b569610e7e89d650'} {{(pid=79744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:28:47.180994 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-4cea73a2-a002-4fb7-8225-8830aa1e3456 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '84cc14f9133d47a3b569610e7e89d650'} {{(pid=79744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:28:47.181661 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-4cea73a2-a002-4fb7-8225-8830aa1e3456 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '84cc14f9133d47a3b569610e7e89d650'} {{(pid=79744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:28:47.193060 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-4cea73a2-a002-4fb7-8225-8830aa1e3456 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '84cc14f9133d47a3b569610e7e89d650'} {{(pid=79744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:28:47.206661 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 1185/2359] 10.222.0.21 () {58 vars in 1223 bytes} [Wed May 4 07:28:47 2022] DELETE /identity/v3/users/84cc14f9133d47a3b569610e7e89d650 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 07:28:47.212728 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7778c329-db03-4d1a-b044-c4a12097a893 None None] REQUEST_METHOD: `POST` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:28:47.213222 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7778c329-db03-4d1a-b044-c4a12097a893 None None] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:28:47.213365 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7778c329-db03-4d1a-b044-c4a12097a893 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:28:47.232643 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.auth.core [None req-7778c329-db03-4d1a-b044-c4a12097a893 None None] MFA Rules not processed for user `83c5e0dcb991496ea6dee38384514508`. Rule list: `[]` (Enabled: `True`). {{(pid=79745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:28:47.234408 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.fernet_utils [None req-7778c329-db03-4d1a-b044-c4a12097a893 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:28:47.297316 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 1175/2360] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 07:28:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 07:28:47.310956 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cea73a2-a002-4fb7-8225-8830aa1e3456 admin admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:28:47.312737 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.fernet_utils [None req-4cea73a2-a002-4fb7-8225-8830aa1e3456 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:28:47.382100 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cea73a2-a002-4fb7-8225-8830aa1e3456 admin admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:28:47.385882 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95140142-e171-49ed-a1a2-2b5123c4ee96 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91cb92d00273402b837cb29b37325101', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9f9c44db4984653b8d4b5f6b3b949f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:28:47.386533 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95140142-e171-49ed-a1a2-2b5123c4ee96 service neutron] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:28:47.386815 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95140142-e171-49ed-a1a2-2b5123c4ee96 service neutron] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:28:47.387090 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95140142-e171-49ed-a1a2-2b5123c4ee96 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:28:47.397485 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95140142-e171-49ed-a1a2-2b5123c4ee96 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:28:47.398935 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95140142-e171-49ed-a1a2-2b5123c4ee96 service neutron] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:28:47.410446 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 1186/2361] 10.222.0.21 () {60 vars in 1365 bytes} [Wed May 4 07:28:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 07:28:47.696190 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7778c329-db03-4d1a-b044-c4a12097a893 None None] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:28:47.697803 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.fernet_utils [None req-7778c329-db03-4d1a-b044-c4a12097a893 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:28:47.710828 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7778c329-db03-4d1a-b044-c4a12097a893 None None] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:28:47.715982 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf3d660-84c3-435f-9717-5656a18ead33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:28:47.716876 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf3d660-84c3-435f-9717-5656a18ead33 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:28:47.717161 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf3d660-84c3-435f-9717-5656a18ead33 admin admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:28:47.717426 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf3d660-84c3-435f-9717-5656a18ead33 admin admin] PATH_INFO: `/v3/projects/344d6cd83d8c4bddb14a502d4a8fdf51` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:28:47.719503 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf3d660-84c3-435f-9717-5656a18ead33 admin admin] RBAC: Authorizing `identity:delete_project(project_id=344d6cd83d8c4bddb14a502d4a8fdf51)` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:28:47.721646 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf3d660-84c3-435f-9717-5656a18ead33 admin admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:28:47.776572 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-7bf3d660-84c3-435f-9717-5656a18ead33 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '344d6cd83d8c4bddb14a502d4a8fdf51', 'request_id': 'req-7bf3d660-84c3-435f-9717-5656a18ead33'} {{(pid=79745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:28:47.783448 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-7bf3d660-84c3-435f-9717-5656a18ead33 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '344d6cd83d8c4bddb14a502d4a8fdf51', 'request_id': 'req-7bf3d660-84c3-435f-9717-5656a18ead33'} {{(pid=79745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:28:47.790932 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-7bf3d660-84c3-435f-9717-5656a18ead33 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '344d6cd83d8c4bddb14a502d4a8fdf51', 'request_id': 'req-7bf3d660-84c3-435f-9717-5656a18ead33'} {{(pid=79745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:28:47.802452 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-7bf3d660-84c3-435f-9717-5656a18ead33 admin admin] The token cache is being invalidate because project 344d6cd83d8c4bddb14a502d4a8fdf51 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79745) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 07:28:47.802733 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-7bf3d660-84c3-435f-9717-5656a18ead33 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:28:47.803406 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-7bf3d660-84c3-435f-9717-5656a18ead33 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:28:47.804988 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 1176/2362] 10.222.0.21 () {58 vars in 1232 bytes} [Wed May 4 07:28:47 2022] DELETE /identity/v3/projects/344d6cd83d8c4bddb14a502d4a8fdf51 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 07:28:47.811183 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa48ad1-e4ad-4261-a1f5-1f8af76074b8 None None] REQUEST_METHOD: `POST` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:28:47.811476 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa48ad1-e4ad-4261-a1f5-1f8af76074b8 None None] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:28:47.811829 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa48ad1-e4ad-4261-a1f5-1f8af76074b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:28:47.830034 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.auth.core [None req-3aa48ad1-e4ad-4261-a1f5-1f8af76074b8 None None] MFA Rules not processed for user `83c5e0dcb991496ea6dee38384514508`. Rule list: `[]` (Enabled: `True`). {{(pid=79744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:28:47.831259 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.fernet_utils [None req-3aa48ad1-e4ad-4261-a1f5-1f8af76074b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:28:47.896224 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 1187/2363] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 07:28:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 07:28:47.903999 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e73cc2-0514-4f66-901d-65c21eeff779 None None] REQUEST_METHOD: `POST` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:28:47.904285 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e73cc2-0514-4f66-901d-65c21eeff779 None None] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:28:47.904561 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e73cc2-0514-4f66-901d-65c21eeff779 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:28:47.923678 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.auth.core [None req-c6e73cc2-0514-4f66-901d-65c21eeff779 None None] MFA Rules not processed for user `83c5e0dcb991496ea6dee38384514508`. Rule list: `[]` (Enabled: `True`). {{(pid=79745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:28:47.924869 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.fernet_utils [None req-c6e73cc2-0514-4f66-901d-65c21eeff779 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:28:47.932762 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 1177/2364] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 07:28:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 07:28:47.937532 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa48ad1-e4ad-4261-a1f5-1f8af76074b8 None None] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:28:47.948741 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa48ad1-e4ad-4261-a1f5-1f8af76074b8 None None] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:28:47.954053 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362b1358-44f3-49d6-a991-96aa8324e73d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:28:47.954714 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362b1358-44f3-49d6-a991-96aa8324e73d admin admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:28:47.954993 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362b1358-44f3-49d6-a991-96aa8324e73d admin admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:28:47.955297 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362b1358-44f3-49d6-a991-96aa8324e73d admin admin] PATH_INFO: `/v3/domains` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:28:47.956030 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362b1358-44f3-49d6-a991-96aa8324e73d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79744) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 07:28:47.956332 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362b1358-44f3-49d6-a991-96aa8324e73d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:28:47.957928 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362b1358-44f3-49d6-a991-96aa8324e73d admin admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:28:47.972517 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 1188/2365] 10.222.0.21 () {58 vars in 1152 bytes} [Wed May 4 07:28:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 07:28:47.978872 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e73cc2-0514-4f66-901d-65c21eeff779 None None] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:28:47.986537 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e73cc2-0514-4f66-901d-65c21eeff779 None None] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:28:47.991423 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287ca6fe-d351-47f7-aa28-e07b1049aec7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:28:47.992144 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287ca6fe-d351-47f7-aa28-e07b1049aec7 admin admin] REQUEST_METHOD: `POST` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:28:47.992430 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287ca6fe-d351-47f7-aa28-e07b1049aec7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:28:47.992705 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287ca6fe-d351-47f7-aa28-e07b1049aec7 admin admin] PATH_INFO: `/v3/projects` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:28:47.993427 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287ca6fe-d351-47f7-aa28-e07b1049aec7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:28:47.995398 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287ca6fe-d351-47f7-aa28-e07b1049aec7 admin admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:28:48.025924 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 1178/2366] 10.222.0.21 () {60 vars in 1152 bytes} [Wed May 4 07:28:47 2022] POST /identity/v3/projects => generated 373 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 07:28:48.029047 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362b1358-44f3-49d6-a991-96aa8324e73d admin admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:28:48.040116 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362b1358-44f3-49d6-a991-96aa8324e73d admin admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:28:48.106099 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82625292-db87-49de-9491-5d14038d8f99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:28:48.106768 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82625292-db87-49de-9491-5d14038d8f99 admin admin] REQUEST_METHOD: `POST` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:28:48.107035 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82625292-db87-49de-9491-5d14038d8f99 admin admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:28:48.107350 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82625292-db87-49de-9491-5d14038d8f99 admin admin] PATH_INFO: `/v3/users` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:28:48.108053 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82625292-db87-49de-9491-5d14038d8f99 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:28:48.110275 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82625292-db87-49de-9491-5d14038d8f99 admin admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:28:48.134971 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 1189/2367] 10.222.0.21 () {60 vars in 1143 bytes} [Wed May 4 07:28:48 2022] POST /identity/v3/users => generated 287 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 07:28:48.138076 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287ca6fe-d351-47f7-aa28-e07b1049aec7 admin admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:28:48.151248 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287ca6fe-d351-47f7-aa28-e07b1049aec7 admin admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:28:48.157498 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd8c0b4-e479-4482-bc57-8c2d49725f2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:28:48.158178 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd8c0b4-e479-4482-bc57-8c2d49725f2b admin admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:28:48.158483 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd8c0b4-e479-4482-bc57-8c2d49725f2b admin admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:28:48.158781 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd8c0b4-e479-4482-bc57-8c2d49725f2b admin admin] PATH_INFO: `/v3/roles` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:28:48.159656 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd8c0b4-e479-4482-bc57-8c2d49725f2b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:28:48.161282 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd8c0b4-e479-4482-bc57-8c2d49725f2b admin admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:28:48.172392 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 1179/2368] 10.222.0.21 () {58 vars in 1121 bytes} [Wed May 4 07:28:48 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 07:28:48.176547 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82625292-db87-49de-9491-5d14038d8f99 admin admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:28:48.187305 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82625292-db87-49de-9491-5d14038d8f99 admin admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:28:48.192368 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c108cafb-1d5c-450c-9521-411126dccdeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:28:48.193031 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c108cafb-1d5c-450c-9521-411126dccdeb admin admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:28:48.193311 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c108cafb-1d5c-450c-9521-411126dccdeb admin admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:28:48.193590 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c108cafb-1d5c-450c-9521-411126dccdeb admin admin] PATH_INFO: `/v3/roles` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:28:48.194315 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c108cafb-1d5c-450c-9521-411126dccdeb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:28:48.195948 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c108cafb-1d5c-450c-9521-411126dccdeb admin admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:28:48.207505 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 1190/2369] 10.222.0.21 () {58 vars in 1121 bytes} [Wed May 4 07:28:48 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 07:28:48.211871 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd8c0b4-e479-4482-bc57-8c2d49725f2b admin admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:28:48.222290 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd8c0b4-e479-4482-bc57-8c2d49725f2b admin admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:28:48.228087 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12ddf75-3cff-448c-bf32-0d8214624786 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:28:48.229536 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12ddf75-3cff-448c-bf32-0d8214624786 admin admin] REQUEST_METHOD: `PUT` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:28:48.229996 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12ddf75-3cff-448c-bf32-0d8214624786 admin admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:28:48.230280 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12ddf75-3cff-448c-bf32-0d8214624786 admin admin] PATH_INFO: `/v3/projects/9490d418deac48d399051367f238b312/users/d7a13fbe7a9146ad95a9e732ef34eda4/roles/9f89c07b05a14f18836116af22cba5f6` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:28:48.247083 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12ddf75-3cff-448c-bf32-0d8214624786 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9490d418deac48d399051367f238b312, user_id=d7a13fbe7a9146ad95a9e732ef34eda4, role_id=9f89c07b05a14f18836116af22cba5f6)` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:28:48.250373 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12ddf75-3cff-448c-bf32-0d8214624786 admin admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:28:48.264603 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 1180/2370] 10.222.0.21 () {60 vars in 1482 bytes} [Wed May 4 07:28:48 2022] PUT /identity/v3/projects/9490d418deac48d399051367f238b312/users/d7a13fbe7a9146ad95a9e732ef34eda4/roles/9f89c07b05a14f18836116af22cba5f6 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 07:28:48.269981 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705f257d-193f-4528-af11-4c314f693d30 None None] REQUEST_METHOD: `POST` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:28:48.270299 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705f257d-193f-4528-af11-4c314f693d30 None None] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:28:48.270579 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705f257d-193f-4528-af11-4c314f693d30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:28:48.288194 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.auth.core [None req-705f257d-193f-4528-af11-4c314f693d30 None None] MFA Rules not processed for user `83c5e0dcb991496ea6dee38384514508`. Rule list: `[]` (Enabled: `True`). {{(pid=79744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:28:48.289430 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.fernet_utils [None req-705f257d-193f-4528-af11-4c314f693d30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:28:48.352197 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 1191/2371] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 07:28:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 07:28:48.362240 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12ddf75-3cff-448c-bf32-0d8214624786 admin admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:28:48.364008 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.fernet_utils [None req-c12ddf75-3cff-448c-bf32-0d8214624786 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:28:48.420902 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12ddf75-3cff-448c-bf32-0d8214624786 admin admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:28:48.425127 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c09c8ee-1cf1-42da-a033-e0ab5251ca15 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91cb92d00273402b837cb29b37325101', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9f9c44db4984653b8d4b5f6b3b949f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:28:48.425785 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c09c8ee-1cf1-42da-a033-e0ab5251ca15 service neutron] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:28:48.426050 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c09c8ee-1cf1-42da-a033-e0ab5251ca15 service neutron] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:28:48.426320 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c09c8ee-1cf1-42da-a033-e0ab5251ca15 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:28:48.436094 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c09c8ee-1cf1-42da-a033-e0ab5251ca15 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:28:48.438119 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c09c8ee-1cf1-42da-a033-e0ab5251ca15 service neutron] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:28:48.448194 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 1181/2372] 10.222.0.21 () {60 vars in 1365 bytes} [Wed May 4 07:28:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 07:28:52.785321 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa77228a-4a4e-4c60-b8cf-70979d41dc9a None None] REQUEST_METHOD: `POST` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:28:52.785872 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa77228a-4a4e-4c60-b8cf-70979d41dc9a None None] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:28:52.785872 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa77228a-4a4e-4c60-b8cf-70979d41dc9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:28:52.821592 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.auth.core [None req-fa77228a-4a4e-4c60-b8cf-70979d41dc9a None None] MFA Rules not processed for user `d7a13fbe7a9146ad95a9e732ef34eda4`. Rule list: `[]` (Enabled: `True`). {{(pid=79744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:28:52.822949 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.fernet_utils [None req-fa77228a-4a4e-4c60-b8cf-70979d41dc9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:28:52.890972 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 1192/2373] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 07:28:52 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 07:28:52.895508 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c09c8ee-1cf1-42da-a033-e0ab5251ca15 service neutron] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:28:52.905644 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c09c8ee-1cf1-42da-a033-e0ab5251ca15 service neutron] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:28:52.910645 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478956be-e9d3-48f3-b2df-090061af1ed6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:28:52.911442 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478956be-e9d3-48f3-b2df-090061af1ed6 admin admin] REQUEST_METHOD: `POST` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:28:52.911800 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478956be-e9d3-48f3-b2df-090061af1ed6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:28:52.912082 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478956be-e9d3-48f3-b2df-090061af1ed6 admin admin] PATH_INFO: `/v3/projects` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:28:52.912801 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478956be-e9d3-48f3-b2df-090061af1ed6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:28:52.914837 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478956be-e9d3-48f3-b2df-090061af1ed6 admin admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:28:52.943332 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 1182/2374] 10.222.0.21 () {60 vars in 1152 bytes} [Wed May 4 07:28:52 2022] POST /identity/v3/projects => generated 373 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 07:28:52.947389 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa77228a-4a4e-4c60-b8cf-70979d41dc9a None None] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:28:52.958891 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa77228a-4a4e-4c60-b8cf-70979d41dc9a None None] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:28:53.022611 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfbbf17-9d9f-4090-8aa5-9eab05d20cd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:28:53.023361 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfbbf17-9d9f-4090-8aa5-9eab05d20cd4 admin admin] REQUEST_METHOD: `POST` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:28:53.023872 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfbbf17-9d9f-4090-8aa5-9eab05d20cd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:28:53.024241 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfbbf17-9d9f-4090-8aa5-9eab05d20cd4 admin admin] PATH_INFO: `/v3/users` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:28:53.025038 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdfbbf17-9d9f-4090-8aa5-9eab05d20cd4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:28:53.028158 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdfbbf17-9d9f-4090-8aa5-9eab05d20cd4 admin admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:28:53.052785 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 1193/2375] 10.222.0.21 () {60 vars in 1143 bytes} [Wed May 4 07:28:52 2022] POST /identity/v3/users => generated 293 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 07:28:53.054015 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478956be-e9d3-48f3-b2df-090061af1ed6 admin admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:28:53.065892 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478956be-e9d3-48f3-b2df-090061af1ed6 admin admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:28:53.072316 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65073d7-483d-4a0d-988d-f6695d8cabf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:28:53.073219 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65073d7-483d-4a0d-988d-f6695d8cabf4 admin admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:28:53.073605 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65073d7-483d-4a0d-988d-f6695d8cabf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:28:53.073915 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65073d7-483d-4a0d-988d-f6695d8cabf4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:28:53.074735 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65073d7-483d-4a0d-988d-f6695d8cabf4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:28:53.077094 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65073d7-483d-4a0d-988d-f6695d8cabf4 admin admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:28:53.089983 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 1183/2376] 10.222.0.21 () {58 vars in 1121 bytes} [Wed May 4 07:28:53 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 07:28:53.094980 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfbbf17-9d9f-4090-8aa5-9eab05d20cd4 admin admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:28:53.107524 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfbbf17-9d9f-4090-8aa5-9eab05d20cd4 admin admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:28:53.114836 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2cada9b-4ec0-4e1e-9397-7b3492a59406 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:28:53.116242 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cada9b-4ec0-4e1e-9397-7b3492a59406 admin admin] REQUEST_METHOD: `PUT` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:28:53.116609 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cada9b-4ec0-4e1e-9397-7b3492a59406 admin admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:28:53.116886 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cada9b-4ec0-4e1e-9397-7b3492a59406 admin admin] PATH_INFO: `/v3/projects/53f0c604ec744193ba812e2ce6647254/users/313bcf20c61942fdb55e584b501d48a4/roles/eb54c9cea2774a25b1fe8c79724408ee` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:28:53.135289 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2cada9b-4ec0-4e1e-9397-7b3492a59406 admin admin] RBAC: Authorizing `identity:create_grant(project_id=53f0c604ec744193ba812e2ce6647254, user_id=313bcf20c61942fdb55e584b501d48a4, role_id=eb54c9cea2774a25b1fe8c79724408ee)` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:28:53.138361 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2cada9b-4ec0-4e1e-9397-7b3492a59406 admin admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:28:53.160036 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 1194/2377] 10.222.0.21 () {60 vars in 1482 bytes} [Wed May 4 07:28:53 2022] PUT /identity/v3/projects/53f0c604ec744193ba812e2ce6647254/users/313bcf20c61942fdb55e584b501d48a4/roles/eb54c9cea2774a25b1fe8c79724408ee => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 07:28:53.164061 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65073d7-483d-4a0d-988d-f6695d8cabf4 admin admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:28:53.175714 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65073d7-483d-4a0d-988d-f6695d8cabf4 admin admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:28:53.232318 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2407824a-efba-470d-ab8a-f3f9f8179a23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:28:53.232879 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2407824a-efba-470d-ab8a-f3f9f8179a23 admin admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:28:53.233152 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2407824a-efba-470d-ab8a-f3f9f8179a23 admin admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:28:53.233425 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2407824a-efba-470d-ab8a-f3f9f8179a23 admin admin] PATH_INFO: `/v3/roles` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:28:53.234878 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2407824a-efba-470d-ab8a-f3f9f8179a23 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:28:53.236516 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2407824a-efba-470d-ab8a-f3f9f8179a23 admin admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:28:53.246477 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 1184/2378] 10.222.0.21 () {58 vars in 1121 bytes} [Wed May 4 07:28:53 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 04 07:28:53.250763 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2cada9b-4ec0-4e1e-9397-7b3492a59406 admin admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:28:53.261294 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2cada9b-4ec0-4e1e-9397-7b3492a59406 admin admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:28:53.266123 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6ce841-c3e7-44ea-87c4-13bc3d984288 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:28:53.267004 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6ce841-c3e7-44ea-87c4-13bc3d984288 admin admin] REQUEST_METHOD: `PUT` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:28:53.267314 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6ce841-c3e7-44ea-87c4-13bc3d984288 admin admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:28:53.267592 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6ce841-c3e7-44ea-87c4-13bc3d984288 admin admin] PATH_INFO: `/v3/projects/53f0c604ec744193ba812e2ce6647254/users/313bcf20c61942fdb55e584b501d48a4/roles/eb54c9cea2774a25b1fe8c79724408ee` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:28:53.269574 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6ce841-c3e7-44ea-87c4-13bc3d984288 admin admin] RBAC: Authorizing `identity:create_grant(project_id=53f0c604ec744193ba812e2ce6647254, user_id=313bcf20c61942fdb55e584b501d48a4, role_id=eb54c9cea2774a25b1fe8c79724408ee)` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:28:53.272268 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6ce841-c3e7-44ea-87c4-13bc3d984288 admin admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:28:53.286677 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 1195/2379] 10.222.0.21 () {60 vars in 1482 bytes} [Wed May 4 07:28:53 2022] PUT /identity/v3/projects/53f0c604ec744193ba812e2ce6647254/users/313bcf20c61942fdb55e584b501d48a4/roles/eb54c9cea2774a25b1fe8c79724408ee => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 07:28:53.837133 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac04134f-3343-4633-97ea-5e00c3dd5ba2 None None] REQUEST_METHOD: `POST` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:28:53.837406 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac04134f-3343-4633-97ea-5e00c3dd5ba2 None None] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:28:53.840162 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac04134f-3343-4633-97ea-5e00c3dd5ba2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:28:53.868109 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.auth.core [None req-ac04134f-3343-4633-97ea-5e00c3dd5ba2 None None] MFA Rules not processed for user `feebf5b36f7d46fc80adcd2d5318c4a0`. Rule list: `[]` (Enabled: `True`). {{(pid=79745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:28:53.871503 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.fernet_utils [None req-ac04134f-3343-4633-97ea-5e00c3dd5ba2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:28:53.950970 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 1185/2380] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 07:28:53 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 07:29:00.554003 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb07768-5954-4cc0-8496-ffdfe80620f5 None None] REQUEST_METHOD: `POST` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:29:00.555058 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb07768-5954-4cc0-8496-ffdfe80620f5 None None] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:29:00.555650 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb07768-5954-4cc0-8496-ffdfe80620f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:29:00.594878 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.auth.core [None req-afb07768-5954-4cc0-8496-ffdfe80620f5 None None] MFA Rules not processed for user `313bcf20c61942fdb55e584b501d48a4`. Rule list: `[]` (Enabled: `True`). {{(pid=79744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:29:00.596701 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.fernet_utils [None req-afb07768-5954-4cc0-8496-ffdfe80620f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:29:00.751644 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 1196/2381] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 07:29:00 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 07:29:00.759390 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac04134f-3343-4633-97ea-5e00c3dd5ba2 None None] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:29:00.762216 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.fernet_utils [None req-ac04134f-3343-4633-97ea-5e00c3dd5ba2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:29:00.911459 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac04134f-3343-4633-97ea-5e00c3dd5ba2 None None] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:29:00.918152 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1322aa27-0ac9-4d54-aaba-7f9064c10385 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1077289fedae43b6be47be7f716d573a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9f9c44db4984653b8d4b5f6b3b949f5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:29:00.918913 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1322aa27-0ac9-4d54-aaba-7f9064c10385 service nova] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:29:00.919302 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1322aa27-0ac9-4d54-aaba-7f9064c10385 service nova] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:29:00.919641 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1322aa27-0ac9-4d54-aaba-7f9064c10385 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:29:01.018232 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1322aa27-0ac9-4d54-aaba-7f9064c10385 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:29:01.020097 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1322aa27-0ac9-4d54-aaba-7f9064c10385 service nova] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:29:01.031982 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 1186/2382] 10.222.0.21 () {60 vars in 1365 bytes} [Wed May 4 07:29:00 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 273 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 07:29:02.618736 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9a5f5d-ef88-4c0a-b741-8ce0646a6735 None None] REQUEST_METHOD: `POST` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:29:02.619379 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9a5f5d-ef88-4c0a-b741-8ce0646a6735 None None] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:29:02.619379 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9a5f5d-ef88-4c0a-b741-8ce0646a6735 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:29:02.638307 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.auth.core [None req-fe9a5f5d-ef88-4c0a-b741-8ce0646a6735 None None] MFA Rules not processed for user `d7a13fbe7a9146ad95a9e732ef34eda4`. Rule list: `[]` (Enabled: `True`). {{(pid=79744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:29:02.639715 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.fernet_utils [None req-fe9a5f5d-ef88-4c0a-b741-8ce0646a6735 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:29:02.647196 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 1197/2383] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 07:29:02 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 07:29:20.666056 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1322aa27-0ac9-4d54-aaba-7f9064c10385 service nova] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:29:20.667551 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.fernet_utils [None req-1322aa27-0ac9-4d54-aaba-7f9064c10385 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:29:20.724863 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1322aa27-0ac9-4d54-aaba-7f9064c10385 service nova] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:29:20.729169 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ae92e4-2993-4bf8-9134-feaef23214e2 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7538f5cab3364625a3e909f5f117ef2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9f9c44db4984653b8d4b5f6b3b949f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:29:20.729821 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ae92e4-2993-4bf8-9134-feaef23214e2 service glance] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:29:20.730102 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ae92e4-2993-4bf8-9134-feaef23214e2 service glance] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:29:20.730378 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ae92e4-2993-4bf8-9134-feaef23214e2 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:29:20.732238 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.fernet_utils [None req-c0ae92e4-2993-4bf8-9134-feaef23214e2 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:29:20.746469 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ae92e4-2993-4bf8-9134-feaef23214e2 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:29:20.747931 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ae92e4-2993-4bf8-9134-feaef23214e2 service glance] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:29:20.760697 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 1187/2384] 10.222.0.21 () {60 vars in 1365 bytes} [Wed May 4 07:29:20 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 07:29:21.025935 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9a5f5d-ef88-4c0a-b741-8ce0646a6735 None None] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:29:21.083353 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9a5f5d-ef88-4c0a-b741-8ce0646a6735 None None] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:29:21.086966 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286c33f0-9ea1-407c-a678-b784184bd50a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91cb92d00273402b837cb29b37325101', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9f9c44db4984653b8d4b5f6b3b949f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:29:21.087725 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286c33f0-9ea1-407c-a678-b784184bd50a service neutron] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:29:21.088013 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286c33f0-9ea1-407c-a678-b784184bd50a service neutron] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:29:21.088288 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286c33f0-9ea1-407c-a678-b784184bd50a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:29:21.090205 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.fernet_utils [None req-286c33f0-9ea1-407c-a678-b784184bd50a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:29:21.108127 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286c33f0-9ea1-407c-a678-b784184bd50a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:29:21.110577 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286c33f0-9ea1-407c-a678-b784184bd50a service neutron] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:29:21.122400 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 1198/2385] 10.222.0.21 () {60 vars in 1365 bytes} [Wed May 4 07:29:21 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 04 07:29:37.187523 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ae92e4-2993-4bf8-9134-feaef23214e2 service glance] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:29:37.197591 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ae92e4-2993-4bf8-9134-feaef23214e2 service glance] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:29:37.201653 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54418019-d087-429d-8aaf-b903d1f7c52b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91cb92d00273402b837cb29b37325101', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9f9c44db4984653b8d4b5f6b3b949f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:29:37.202324 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54418019-d087-429d-8aaf-b903d1f7c52b service neutron] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:29:37.202602 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54418019-d087-429d-8aaf-b903d1f7c52b service neutron] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:29:37.202864 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54418019-d087-429d-8aaf-b903d1f7c52b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:29:37.204750 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.fernet_utils [None req-54418019-d087-429d-8aaf-b903d1f7c52b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:29:37.214775 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54418019-d087-429d-8aaf-b903d1f7c52b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:29:37.216238 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54418019-d087-429d-8aaf-b903d1f7c52b service neutron] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:29:37.224967 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 1188/2386] 10.222.0.21 () {60 vars in 1365 bytes} [Wed May 4 07:29:37 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 07:29:37.706065 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286c33f0-9ea1-407c-a678-b784184bd50a service neutron] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:29:37.709315 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.fernet_utils [None req-286c33f0-9ea1-407c-a678-b784184bd50a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:29:37.804262 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286c33f0-9ea1-407c-a678-b784184bd50a service neutron] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:29:37.809598 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154a4fc4-839a-4686-b080-bb80a3a11c9f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef28e980e8664d3eba4304e4589ea2df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9f9c44db4984653b8d4b5f6b3b949f5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:29:37.810258 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154a4fc4-839a-4686-b080-bb80a3a11c9f service placement] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:29:37.810539 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154a4fc4-839a-4686-b080-bb80a3a11c9f service placement] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:29:37.810816 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154a4fc4-839a-4686-b080-bb80a3a11c9f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:29:37.812653 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.fernet_utils [None req-154a4fc4-839a-4686-b080-bb80a3a11c9f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:29:37.826026 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154a4fc4-839a-4686-b080-bb80a3a11c9f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:29:37.827657 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154a4fc4-839a-4686-b080-bb80a3a11c9f service placement] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:29:37.838589 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 1199/2387] 10.222.0.21 () {60 vars in 1365 bytes} [Wed May 4 07:29:37 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 07:29:41.493932 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54418019-d087-429d-8aaf-b903d1f7c52b service neutron] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:29:41.495725 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.fernet_utils [None req-54418019-d087-429d-8aaf-b903d1f7c52b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:29:41.511346 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54418019-d087-429d-8aaf-b903d1f7c52b service neutron] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:29:41.516397 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff40ba0f-bc9e-4c05-8801-ef9374915913 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91cb92d00273402b837cb29b37325101', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9f9c44db4984653b8d4b5f6b3b949f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:29:41.517343 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff40ba0f-bc9e-4c05-8801-ef9374915913 service neutron] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:29:41.517760 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff40ba0f-bc9e-4c05-8801-ef9374915913 service neutron] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:29:41.518170 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff40ba0f-bc9e-4c05-8801-ef9374915913 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:29:41.521946 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.fernet_utils [None req-ff40ba0f-bc9e-4c05-8801-ef9374915913 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:29:41.536014 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff40ba0f-bc9e-4c05-8801-ef9374915913 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:29:41.537463 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff40ba0f-bc9e-4c05-8801-ef9374915913 service neutron] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:29:41.552163 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 1189/2388] 10.222.0.21 () {60 vars in 1365 bytes} [Wed May 4 07:29:41 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 07:29:42.889290 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154a4fc4-839a-4686-b080-bb80a3a11c9f service placement] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:29:42.890805 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.fernet_utils [None req-154a4fc4-839a-4686-b080-bb80a3a11c9f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:29:42.906931 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154a4fc4-839a-4686-b080-bb80a3a11c9f service placement] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:29:42.913270 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daaefafc-d1e5-43b9-9ff6-53bd486b27e9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1077289fedae43b6be47be7f716d573a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9f9c44db4984653b8d4b5f6b3b949f5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:29:42.913903 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daaefafc-d1e5-43b9-9ff6-53bd486b27e9 service nova] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:29:42.914181 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daaefafc-d1e5-43b9-9ff6-53bd486b27e9 service nova] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:29:42.914472 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daaefafc-d1e5-43b9-9ff6-53bd486b27e9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:29:42.916217 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.fernet_utils [None req-daaefafc-d1e5-43b9-9ff6-53bd486b27e9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:29:42.928673 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daaefafc-d1e5-43b9-9ff6-53bd486b27e9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:29:42.930377 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daaefafc-d1e5-43b9-9ff6-53bd486b27e9 service nova] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:29:42.942018 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 1200/2389] 10.222.0.21 () {60 vars in 1365 bytes} [Wed May 4 07:29:42 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 07:29:48.605432 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff40ba0f-bc9e-4c05-8801-ef9374915913 service neutron] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:29:48.618930 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff40ba0f-bc9e-4c05-8801-ef9374915913 service neutron] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:29:48.624558 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653e739c-69dd-420e-b6b4-d9611fe00bdb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1077289fedae43b6be47be7f716d573a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9f9c44db4984653b8d4b5f6b3b949f5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:29:48.625210 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653e739c-69dd-420e-b6b4-d9611fe00bdb service nova] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:29:48.625488 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653e739c-69dd-420e-b6b4-d9611fe00bdb service nova] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:29:48.625761 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653e739c-69dd-420e-b6b4-d9611fe00bdb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:29:48.628551 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.fernet_utils [None req-653e739c-69dd-420e-b6b4-d9611fe00bdb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:29:48.689548 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653e739c-69dd-420e-b6b4-d9611fe00bdb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:29:48.692045 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653e739c-69dd-420e-b6b4-d9611fe00bdb service nova] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:29:48.702279 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 1190/2390] 10.222.0.21 () {60 vars in 1365 bytes} [Wed May 4 07:29:48 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 07:29:56.823069 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec6256d-a721-42ff-bb94-177b1253627d None None] REQUEST_METHOD: `POST` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:29:56.823631 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec6256d-a721-42ff-bb94-177b1253627d None None] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:29:56.823737 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec6256d-a721-42ff-bb94-177b1253627d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:29:56.899059 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.auth.core [None req-eec6256d-a721-42ff-bb94-177b1253627d None None] MFA Rules not processed for user `704cdbc22849413baa4e0189947ebebc`. Rule list: `[]` (Enabled: `True`). {{(pid=79744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:29:56.900482 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.fernet_utils [None req-eec6256d-a721-42ff-bb94-177b1253627d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:29:56.993085 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 1201/2391] 10.222.0.21 () {58 vars in 1009 bytes} [Wed May 4 07:29:56 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 07:29:57.044449 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653e739c-69dd-420e-b6b4-d9611fe00bdb service nova] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:29:57.045893 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.fernet_utils [None req-653e739c-69dd-420e-b6b4-d9611fe00bdb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:29:57.162235 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653e739c-69dd-420e-b6b4-d9611fe00bdb service nova] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:29:57.167417 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4b7f35-5462-48f8-95b1-61730efd0838 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '084c9245d1da4e698c9c3945fa089e85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9f9c44db4984653b8d4b5f6b3b949f5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:29:57.168059 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4b7f35-5462-48f8-95b1-61730efd0838 service swift] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:29:57.168337 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4b7f35-5462-48f8-95b1-61730efd0838 service swift] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:29:57.168609 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4b7f35-5462-48f8-95b1-61730efd0838 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:29:57.178125 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4b7f35-5462-48f8-95b1-61730efd0838 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:29:57.179419 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4b7f35-5462-48f8-95b1-61730efd0838 service swift] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:29:57.188028 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 1191/2392] 10.222.0.21 () {60 vars in 1384 bytes} [Wed May 4 07:29:57 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 04 07:30:00.703433 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec6256d-a721-42ff-bb94-177b1253627d None None] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:30:00.732895 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec6256d-a721-42ff-bb94-177b1253627d None None] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:30:00.744641 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfd5b44-199f-467e-8241-2f9298d18f24 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91cb92d00273402b837cb29b37325101', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9f9c44db4984653b8d4b5f6b3b949f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:30:00.748457 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfd5b44-199f-467e-8241-2f9298d18f24 service neutron] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:30:00.748823 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfd5b44-199f-467e-8241-2f9298d18f24 service neutron] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:30:00.749665 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfd5b44-199f-467e-8241-2f9298d18f24 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:30:00.774744 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebfd5b44-199f-467e-8241-2f9298d18f24 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:30:00.776276 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebfd5b44-199f-467e-8241-2f9298d18f24 service neutron] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:30:00.790255 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 1202/2393] 10.222.0.21 () {60 vars in 1365 bytes} [Wed May 4 07:30:00 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 07:30:03.008745 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4b7f35-5462-48f8-95b1-61730efd0838 service swift] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:30:03.027288 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4b7f35-5462-48f8-95b1-61730efd0838 service swift] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:30:03.040228 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fdd003-561c-4499-b0f9-67f889992960 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1077289fedae43b6be47be7f716d573a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9f9c44db4984653b8d4b5f6b3b949f5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:30:03.040884 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fdd003-561c-4499-b0f9-67f889992960 service nova] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:30:03.041332 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fdd003-561c-4499-b0f9-67f889992960 service nova] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:30:03.041960 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fdd003-561c-4499-b0f9-67f889992960 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:30:03.047849 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.fernet_utils [None req-62fdd003-561c-4499-b0f9-67f889992960 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:30:03.067458 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62fdd003-561c-4499-b0f9-67f889992960 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:30:03.069760 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62fdd003-561c-4499-b0f9-67f889992960 service nova] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:30:03.086340 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 1192/2394] 10.222.0.21 () {60 vars in 1365 bytes} [Wed May 4 07:30:03 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 78 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 07:30:13.546936 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef99c0e7-9ccb-40f9-8b1f-c895133d5f2f None None] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:30:13.554876 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef99c0e7-9ccb-40f9-8b1f-c895133d5f2f None None] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:30:13.555313 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef99c0e7-9ccb-40f9-8b1f-c895133d5f2f None None] PATH_INFO: `/` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:30:13.556906 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 1203/2395] 10.222.0.21 () {54 vars in 921 bytes} [Wed May 4 07:30:13 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 07:30:13.567779 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a252d1f1-c703-4740-92b3-302c34ce2349 None None] REQUEST_METHOD: `POST` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:30:13.568726 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a252d1f1-c703-4740-92b3-302c34ce2349 None None] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:30:13.569479 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a252d1f1-c703-4740-92b3-302c34ce2349 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:30:13.618218 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.auth.core [None req-a252d1f1-c703-4740-92b3-302c34ce2349 None None] MFA Rules not processed for user `1077289fedae43b6be47be7f716d573a`. Rule list: `[]` (Enabled: `True`). {{(pid=79745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:30:13.619464 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.fernet_utils [None req-a252d1f1-c703-4740-92b3-302c34ce2349 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:30:13.630530 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 1193/2396] 10.222.0.21 () {58 vars in 1018 bytes} [Wed May 4 07:30:13 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 07:30:13.648375 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef99c0e7-9ccb-40f9-8b1f-c895133d5f2f None None] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:30:13.660720 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef99c0e7-9ccb-40f9-8b1f-c895133d5f2f None None] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:30:13.665890 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afecc814-2095-4a74-ac81-77d87560e237 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7538f5cab3364625a3e909f5f117ef2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9f9c44db4984653b8d4b5f6b3b949f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:30:13.666547 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afecc814-2095-4a74-ac81-77d87560e237 service glance] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:30:13.667011 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afecc814-2095-4a74-ac81-77d87560e237 service glance] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:30:13.667468 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afecc814-2095-4a74-ac81-77d87560e237 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:30:13.679245 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afecc814-2095-4a74-ac81-77d87560e237 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:30:13.680683 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afecc814-2095-4a74-ac81-77d87560e237 service glance] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:30:13.696687 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 1204/2397] 10.222.0.21 () {60 vars in 1365 bytes} [Wed May 4 07:30:13 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 07:30:13.767576 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f00127-e4a1-427e-951b-314f3787c4ee None None] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:30:13.767860 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f00127-e4a1-427e-951b-314f3787c4ee None None] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:30:13.768134 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f00127-e4a1-427e-951b-314f3787c4ee None None] PATH_INFO: `/` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:30:13.769497 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 1194/2398] 10.222.0.21 () {54 vars in 921 bytes} [Wed May 4 07:30:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 04 07:30:13.776749 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbfaa41-36a9-44d6-aaff-9766ab6a1a4f None None] REQUEST_METHOD: `POST` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:30:13.777037 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbfaa41-36a9-44d6-aaff-9766ab6a1a4f None None] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:30:13.777314 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbfaa41-36a9-44d6-aaff-9766ab6a1a4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:30:13.797492 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.auth.core [None req-fdbfaa41-36a9-44d6-aaff-9766ab6a1a4f None None] MFA Rules not processed for user `91cb92d00273402b837cb29b37325101`. Rule list: `[]` (Enabled: `True`). {{(pid=79744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:30:13.798730 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.fernet_utils [None req-fdbfaa41-36a9-44d6-aaff-9766ab6a1a4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:30:13.806718 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 1205/2399] 10.222.0.21 () {58 vars in 1018 bytes} [Wed May 4 07:30:13 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 07:30:13.818528 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f00127-e4a1-427e-951b-314f3787c4ee None None] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:30:13.829649 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f00127-e4a1-427e-951b-314f3787c4ee None None] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:30:13.833337 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2331ed-d8d6-474c-814b-06fa8d665331 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91cb92d00273402b837cb29b37325101', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9f9c44db4984653b8d4b5f6b3b949f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:30:13.833970 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2331ed-d8d6-474c-814b-06fa8d665331 service neutron] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:30:13.834250 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2331ed-d8d6-474c-814b-06fa8d665331 service neutron] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:30:13.834522 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2331ed-d8d6-474c-814b-06fa8d665331 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:30:13.842304 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2331ed-d8d6-474c-814b-06fa8d665331 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:30:13.843781 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2331ed-d8d6-474c-814b-06fa8d665331 service neutron] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:30:13.852849 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 1195/2400] 10.222.0.21 () {60 vars in 1365 bytes} [Wed May 4 07:30:13 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 07:30:13.941039 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ce4665-35bb-4f80-93d4-254e2ce22f07 None None] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:30:13.941331 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ce4665-35bb-4f80-93d4-254e2ce22f07 None None] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:30:13.941612 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ce4665-35bb-4f80-93d4-254e2ce22f07 None None] PATH_INFO: `/` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:30:13.943011 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 1206/2401] 10.222.0.21 () {54 vars in 921 bytes} [Wed May 4 07:30:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 07:30:13.948667 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039a98c7-31dd-4cc7-a737-de488b150936 None None] REQUEST_METHOD: `POST` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:30:13.948956 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039a98c7-31dd-4cc7-a737-de488b150936 None None] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:30:13.949268 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039a98c7-31dd-4cc7-a737-de488b150936 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:30:13.967651 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.auth.core [None req-039a98c7-31dd-4cc7-a737-de488b150936 None None] MFA Rules not processed for user `1077289fedae43b6be47be7f716d573a`. Rule list: `[]` (Enabled: `True`). {{(pid=79745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:30:13.968763 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.fernet_utils [None req-039a98c7-31dd-4cc7-a737-de488b150936 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:30:13.978972 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 1196/2402] 10.222.0.21 () {58 vars in 1018 bytes} [Wed May 4 07:30:13 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 07:30:13.990599 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ce4665-35bb-4f80-93d4-254e2ce22f07 None None] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:30:14.002147 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ce4665-35bb-4f80-93d4-254e2ce22f07 None None] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:30:14.008194 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920e7470-acac-45e4-af27-90814ad6a0f5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91cb92d00273402b837cb29b37325101', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9f9c44db4984653b8d4b5f6b3b949f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:30:14.008850 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920e7470-acac-45e4-af27-90814ad6a0f5 service neutron] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:30:14.009158 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920e7470-acac-45e4-af27-90814ad6a0f5 service neutron] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:30:14.009429 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920e7470-acac-45e4-af27-90814ad6a0f5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:30:14.020708 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920e7470-acac-45e4-af27-90814ad6a0f5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:30:14.022147 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920e7470-acac-45e4-af27-90814ad6a0f5 service neutron] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:30:14.033762 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 1207/2403] 10.222.0.21 () {60 vars in 1365 bytes} [Wed May 4 07:30:13 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 07:30:17.326849 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25bc3c4-5350-428a-8c2a-cbde50d1d93e None None] REQUEST_METHOD: `POST` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:30:17.327367 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25bc3c4-5350-428a-8c2a-cbde50d1d93e None None] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:30:17.327462 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25bc3c4-5350-428a-8c2a-cbde50d1d93e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:30:17.348976 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.auth.core [None req-a25bc3c4-5350-428a-8c2a-cbde50d1d93e None None] MFA Rules not processed for user `704cdbc22849413baa4e0189947ebebc`. Rule list: `[]` (Enabled: `True`). {{(pid=79745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:30:17.350220 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.fernet_utils [None req-a25bc3c4-5350-428a-8c2a-cbde50d1d93e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:30:17.357452 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 1197/2404] 10.222.0.21 () {58 vars in 1009 bytes} [Wed May 4 07:30:17 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 07:30:17.369554 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920e7470-acac-45e4-af27-90814ad6a0f5 service neutron] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:30:17.383482 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920e7470-acac-45e4-af27-90814ad6a0f5 service neutron] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:30:17.388583 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e3e770-9933-4f8d-a53b-8735cd96e320 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '084c9245d1da4e698c9c3945fa089e85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9f9c44db4984653b8d4b5f6b3b949f5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:30:17.389350 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e3e770-9933-4f8d-a53b-8735cd96e320 service swift] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:30:17.389633 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e3e770-9933-4f8d-a53b-8735cd96e320 service swift] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:30:17.389907 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e3e770-9933-4f8d-a53b-8735cd96e320 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:30:17.399852 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e3e770-9933-4f8d-a53b-8735cd96e320 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:30:17.401704 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e3e770-9933-4f8d-a53b-8735cd96e320 service swift] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:30:17.411103 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 1208/2405] 10.222.0.21 () {60 vars in 1384 bytes} [Wed May 4 07:30:17 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 04 07:30:18.692468 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25bc3c4-5350-428a-8c2a-cbde50d1d93e None None] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:30:18.694625 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.fernet_utils [None req-a25bc3c4-5350-428a-8c2a-cbde50d1d93e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:30:18.780601 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25bc3c4-5350-428a-8c2a-cbde50d1d93e None None] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:30:18.786084 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83980d1-77e5-4aeb-b383-e828d2184ce1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:30:18.786954 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83980d1-77e5-4aeb-b383-e828d2184ce1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:30:18.787279 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83980d1-77e5-4aeb-b383-e828d2184ce1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:30:18.787546 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83980d1-77e5-4aeb-b383-e828d2184ce1 admin admin] PATH_INFO: `/v3/users/feebf5b36f7d46fc80adcd2d5318c4a0` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:30:18.788730 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83980d1-77e5-4aeb-b383-e828d2184ce1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=feebf5b36f7d46fc80adcd2d5318c4a0)` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:30:18.790671 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83980d1-77e5-4aeb-b383-e828d2184ce1 admin admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:30:18.854612 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-d83980d1-77e5-4aeb-b383-e828d2184ce1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'feebf5b36f7d46fc80adcd2d5318c4a0'} {{(pid=79745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:30:18.866507 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-d83980d1-77e5-4aeb-b383-e828d2184ce1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'feebf5b36f7d46fc80adcd2d5318c4a0'} {{(pid=79745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:30:18.867258 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-d83980d1-77e5-4aeb-b383-e828d2184ce1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'feebf5b36f7d46fc80adcd2d5318c4a0'} {{(pid=79745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:30:18.867859 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-d83980d1-77e5-4aeb-b383-e828d2184ce1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'feebf5b36f7d46fc80adcd2d5318c4a0'} {{(pid=79745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:30:18.875101 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-d83980d1-77e5-4aeb-b383-e828d2184ce1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'feebf5b36f7d46fc80adcd2d5318c4a0'} {{(pid=79745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:30:18.894806 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 1198/2406] 10.222.0.21 () {58 vars in 1223 bytes} [Wed May 4 07:30:18 2022] DELETE /identity/v3/users/feebf5b36f7d46fc80adcd2d5318c4a0 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 07:30:19.088914 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e3e770-9933-4f8d-a53b-8735cd96e320 service swift] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:30:19.105078 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e3e770-9933-4f8d-a53b-8735cd96e320 service swift] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:30:19.177145 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce159f8-14ab-470f-8588-62d4ae84deb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:30:19.178175 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce159f8-14ab-470f-8588-62d4ae84deb6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:30:19.178549 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce159f8-14ab-470f-8588-62d4ae84deb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:30:19.178916 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce159f8-14ab-470f-8588-62d4ae84deb6 admin admin] PATH_INFO: `/v3/projects/5454654e735d406cb8b3aea4dd45d770` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:30:19.181974 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce159f8-14ab-470f-8588-62d4ae84deb6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5454654e735d406cb8b3aea4dd45d770)` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:30:19.182754 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce159f8-14ab-470f-8588-62d4ae84deb6 admin admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:30:19.233379 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-6ce159f8-14ab-470f-8588-62d4ae84deb6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5454654e735d406cb8b3aea4dd45d770', 'request_id': 'req-6ce159f8-14ab-470f-8588-62d4ae84deb6'} {{(pid=79744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:30:19.240663 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-6ce159f8-14ab-470f-8588-62d4ae84deb6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5454654e735d406cb8b3aea4dd45d770', 'request_id': 'req-6ce159f8-14ab-470f-8588-62d4ae84deb6'} {{(pid=79744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:30:19.247616 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-6ce159f8-14ab-470f-8588-62d4ae84deb6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5454654e735d406cb8b3aea4dd45d770', 'request_id': 'req-6ce159f8-14ab-470f-8588-62d4ae84deb6'} {{(pid=79744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:30:19.260791 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-6ce159f8-14ab-470f-8588-62d4ae84deb6 admin admin] The token cache is being invalidate because project 5454654e735d406cb8b3aea4dd45d770 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79744) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 07:30:19.261078 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-6ce159f8-14ab-470f-8588-62d4ae84deb6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:30:19.261739 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-6ce159f8-14ab-470f-8588-62d4ae84deb6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:30:19.263322 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 1209/2407] 10.222.0.21 () {58 vars in 1232 bytes} [Wed May 4 07:30:19 2022] DELETE /identity/v3/projects/5454654e735d406cb8b3aea4dd45d770 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 07:30:19.269004 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbbf2c4-43b2-41be-abf6-0d6bb880adc9 None None] REQUEST_METHOD: `POST` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:30:19.269286 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbbf2c4-43b2-41be-abf6-0d6bb880adc9 None None] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:30:19.269565 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbbf2c4-43b2-41be-abf6-0d6bb880adc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:30:19.290428 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.auth.core [None req-4dbbf2c4-43b2-41be-abf6-0d6bb880adc9 None None] MFA Rules not processed for user `83c5e0dcb991496ea6dee38384514508`. Rule list: `[]` (Enabled: `True`). {{(pid=79745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:30:19.291878 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.fernet_utils [None req-4dbbf2c4-43b2-41be-abf6-0d6bb880adc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:30:19.381720 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 1199/2408] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 07:30:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 07:30:19.384666 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7343d7ff-c6d5-435c-a2f3-4b91d1024206 None None] REQUEST_METHOD: `POST` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:30:19.385033 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7343d7ff-c6d5-435c-a2f3-4b91d1024206 None None] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:30:19.385338 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7343d7ff-c6d5-435c-a2f3-4b91d1024206 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:30:19.408672 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.auth.core [None req-7343d7ff-c6d5-435c-a2f3-4b91d1024206 None None] MFA Rules not processed for user `83c5e0dcb991496ea6dee38384514508`. Rule list: `[]` (Enabled: `True`). {{(pid=79744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:30:19.410072 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.fernet_utils [None req-7343d7ff-c6d5-435c-a2f3-4b91d1024206 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:30:19.418789 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 1210/2409] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 07:30:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 07:30:19.422888 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbbf2c4-43b2-41be-abf6-0d6bb880adc9 None None] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:30:19.437012 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbbf2c4-43b2-41be-abf6-0d6bb880adc9 None None] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:30:19.443177 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392d6b2a-214b-4289-8012-aa5da9396ce8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:30:19.444409 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392d6b2a-214b-4289-8012-aa5da9396ce8 admin admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:30:19.444789 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392d6b2a-214b-4289-8012-aa5da9396ce8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:30:19.445162 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392d6b2a-214b-4289-8012-aa5da9396ce8 admin admin] PATH_INFO: `/v3/domains` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:30:19.446027 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392d6b2a-214b-4289-8012-aa5da9396ce8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 07:30:19.446443 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392d6b2a-214b-4289-8012-aa5da9396ce8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:30:19.448196 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392d6b2a-214b-4289-8012-aa5da9396ce8 admin admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:30:19.469202 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 1200/2410] 10.222.0.21 () {58 vars in 1152 bytes} [Wed May 4 07:30:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 07:30:19.474025 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7343d7ff-c6d5-435c-a2f3-4b91d1024206 None None] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:30:19.484554 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7343d7ff-c6d5-435c-a2f3-4b91d1024206 None None] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:30:19.491344 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7fc10e-cd31-453c-bcc4-b7d4f893b992 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:30:19.492291 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7fc10e-cd31-453c-bcc4-b7d4f893b992 admin admin] REQUEST_METHOD: `POST` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:30:19.492524 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7fc10e-cd31-453c-bcc4-b7d4f893b992 admin admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:30:19.492862 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7fc10e-cd31-453c-bcc4-b7d4f893b992 admin admin] PATH_INFO: `/v3/projects` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:30:19.493575 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7fc10e-cd31-453c-bcc4-b7d4f893b992 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:30:19.495661 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7fc10e-cd31-453c-bcc4-b7d4f893b992 admin admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:30:19.546623 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 1211/2411] 10.222.0.21 () {60 vars in 1152 bytes} [Wed May 4 07:30:19 2022] POST /identity/v3/projects => generated 385 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 07:30:19.547820 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392d6b2a-214b-4289-8012-aa5da9396ce8 admin admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:30:19.560153 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392d6b2a-214b-4289-8012-aa5da9396ce8 admin admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:30:19.636849 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93dbd1ee-264f-40dc-a6d5-9e9784eb3132 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:30:19.637428 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dbd1ee-264f-40dc-a6d5-9e9784eb3132 admin admin] REQUEST_METHOD: `POST` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:30:19.637734 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dbd1ee-264f-40dc-a6d5-9e9784eb3132 admin admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:30:19.638004 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dbd1ee-264f-40dc-a6d5-9e9784eb3132 admin admin] PATH_INFO: `/v3/users` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:30:19.638689 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93dbd1ee-264f-40dc-a6d5-9e9784eb3132 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:30:19.640685 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93dbd1ee-264f-40dc-a6d5-9e9784eb3132 admin admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:30:19.669504 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 1201/2412] 10.222.0.21 () {60 vars in 1143 bytes} [Wed May 4 07:30:19 2022] POST /identity/v3/users => generated 293 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 07:30:19.676328 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7fc10e-cd31-453c-bcc4-b7d4f893b992 admin admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:30:19.703524 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7fc10e-cd31-453c-bcc4-b7d4f893b992 admin admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:30:19.719934 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aaf8f79-7b0e-4b8c-87c5-3cf220089e29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:30:19.722802 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aaf8f79-7b0e-4b8c-87c5-3cf220089e29 admin admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:30:19.723333 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aaf8f79-7b0e-4b8c-87c5-3cf220089e29 admin admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:30:19.723775 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aaf8f79-7b0e-4b8c-87c5-3cf220089e29 admin admin] PATH_INFO: `/v3/roles` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:30:19.724648 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aaf8f79-7b0e-4b8c-87c5-3cf220089e29 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:30:19.727433 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aaf8f79-7b0e-4b8c-87c5-3cf220089e29 admin admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:30:19.755180 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 1212/2413] 10.222.0.21 () {58 vars in 1121 bytes} [Wed May 4 07:30:19 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 07:30:19.765815 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93dbd1ee-264f-40dc-a6d5-9e9784eb3132 admin admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:30:19.778185 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93dbd1ee-264f-40dc-a6d5-9e9784eb3132 admin admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:30:19.788050 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae308bbd-5b31-4f02-8b97-1efe60ff47c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:30:19.791645 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae308bbd-5b31-4f02-8b97-1efe60ff47c4 admin admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:30:19.792274 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae308bbd-5b31-4f02-8b97-1efe60ff47c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:30:19.792684 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae308bbd-5b31-4f02-8b97-1efe60ff47c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:30:19.800245 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae308bbd-5b31-4f02-8b97-1efe60ff47c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:30:19.802232 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae308bbd-5b31-4f02-8b97-1efe60ff47c4 admin admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:30:19.816715 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 1202/2414] 10.222.0.21 () {58 vars in 1121 bytes} [Wed May 4 07:30:19 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 07:30:19.821105 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aaf8f79-7b0e-4b8c-87c5-3cf220089e29 admin admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:30:19.832301 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aaf8f79-7b0e-4b8c-87c5-3cf220089e29 admin admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:30:19.837706 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f800cc-1c80-40d3-8d8e-ef60e615ebc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:30:19.838690 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f800cc-1c80-40d3-8d8e-ef60e615ebc8 admin admin] REQUEST_METHOD: `PUT` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:30:19.839189 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f800cc-1c80-40d3-8d8e-ef60e615ebc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:30:19.839371 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f800cc-1c80-40d3-8d8e-ef60e615ebc8 admin admin] PATH_INFO: `/v3/projects/489c922d94f946908770992d288abbe2/users/30f3c4305a3a4f7ea60a6e4e6e8b7668/roles/9f89c07b05a14f18836116af22cba5f6` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:30:19.856913 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f800cc-1c80-40d3-8d8e-ef60e615ebc8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=489c922d94f946908770992d288abbe2, user_id=30f3c4305a3a4f7ea60a6e4e6e8b7668, role_id=9f89c07b05a14f18836116af22cba5f6)` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:30:19.860172 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f800cc-1c80-40d3-8d8e-ef60e615ebc8 admin admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:30:19.877639 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 1213/2415] 10.222.0.21 () {60 vars in 1482 bytes} [Wed May 4 07:30:19 2022] PUT /identity/v3/projects/489c922d94f946908770992d288abbe2/users/30f3c4305a3a4f7ea60a6e4e6e8b7668/roles/9f89c07b05a14f18836116af22cba5f6 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 07:30:19.882991 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470a5a79-e1af-4577-a28c-9c048b64cfad None None] REQUEST_METHOD: `POST` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:30:19.883313 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470a5a79-e1af-4577-a28c-9c048b64cfad None None] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:30:19.883596 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470a5a79-e1af-4577-a28c-9c048b64cfad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:30:19.905551 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.auth.core [None req-470a5a79-e1af-4577-a28c-9c048b64cfad None None] MFA Rules not processed for user `83c5e0dcb991496ea6dee38384514508`. Rule list: `[]` (Enabled: `True`). {{(pid=79745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:30:19.906678 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.fernet_utils [None req-470a5a79-e1af-4577-a28c-9c048b64cfad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:30:19.992889 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 1203/2416] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 07:30:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 07:30:20.003700 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f800cc-1c80-40d3-8d8e-ef60e615ebc8 admin admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:30:20.005503 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.fernet_utils [None req-a7f800cc-1c80-40d3-8d8e-ef60e615ebc8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:30:20.074409 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f800cc-1c80-40d3-8d8e-ef60e615ebc8 admin admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:30:20.078860 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f1a0b5-8675-4607-b04c-0037f274b9ad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91cb92d00273402b837cb29b37325101', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9f9c44db4984653b8d4b5f6b3b949f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:30:20.080714 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f1a0b5-8675-4607-b04c-0037f274b9ad service neutron] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:30:20.081178 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f1a0b5-8675-4607-b04c-0037f274b9ad service neutron] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:30:20.081644 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f1a0b5-8675-4607-b04c-0037f274b9ad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:30:20.100300 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f1a0b5-8675-4607-b04c-0037f274b9ad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:30:20.102959 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f1a0b5-8675-4607-b04c-0037f274b9ad service neutron] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:30:20.118915 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 1214/2417] 10.222.0.21 () {60 vars in 1365 bytes} [Wed May 4 07:30:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 07:30:26.134074 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c928f2-72d7-4c44-85ab-1f9e5abb9342 None None] REQUEST_METHOD: `POST` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:30:26.134629 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c928f2-72d7-4c44-85ab-1f9e5abb9342 None None] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:30:26.134629 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c928f2-72d7-4c44-85ab-1f9e5abb9342 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:30:26.188089 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.auth.core [None req-c2c928f2-72d7-4c44-85ab-1f9e5abb9342 None None] MFA Rules not processed for user `30f3c4305a3a4f7ea60a6e4e6e8b7668`. Rule list: `[]` (Enabled: `True`). {{(pid=79745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:30:26.190282 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.fernet_utils [None req-c2c928f2-72d7-4c44-85ab-1f9e5abb9342 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:30:26.328241 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f1a0b5-8675-4607-b04c-0037f274b9ad service neutron] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:30:26.329082 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 1204/2418] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 07:30:26 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 07:30:26.340918 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f1a0b5-8675-4607-b04c-0037f274b9ad service neutron] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:30:26.353851 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d375b3-afea-41a9-8080-eac22588fa64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:30:26.354880 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d375b3-afea-41a9-8080-eac22588fa64 admin admin] REQUEST_METHOD: `POST` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:30:26.355387 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d375b3-afea-41a9-8080-eac22588fa64 admin admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:30:26.355841 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d375b3-afea-41a9-8080-eac22588fa64 admin admin] PATH_INFO: `/v3/projects` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:30:26.357820 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d375b3-afea-41a9-8080-eac22588fa64 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:30:26.358924 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d375b3-afea-41a9-8080-eac22588fa64 admin admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:30:26.424870 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c928f2-72d7-4c44-85ab-1f9e5abb9342 None None] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:30:26.431379 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 1215/2419] 10.222.0.21 () {60 vars in 1152 bytes} [Wed May 4 07:30:26 2022] POST /identity/v3/projects => generated 385 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 07:30:26.443187 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c928f2-72d7-4c44-85ab-1f9e5abb9342 None None] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:30:26.587947 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754cf9e3-823b-4af9-ae8a-dd65d61161cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:30:26.588889 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754cf9e3-823b-4af9-ae8a-dd65d61161cd admin admin] REQUEST_METHOD: `POST` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:30:26.589361 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754cf9e3-823b-4af9-ae8a-dd65d61161cd admin admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:30:26.589867 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754cf9e3-823b-4af9-ae8a-dd65d61161cd admin admin] PATH_INFO: `/v3/users` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:30:26.590775 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754cf9e3-823b-4af9-ae8a-dd65d61161cd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:30:26.592981 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754cf9e3-823b-4af9-ae8a-dd65d61161cd admin admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:30:26.642678 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 1205/2420] 10.222.0.21 () {60 vars in 1143 bytes} [Wed May 4 07:30:26 2022] POST /identity/v3/users => generated 299 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 07:30:26.652622 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d375b3-afea-41a9-8080-eac22588fa64 admin admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:30:26.673017 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d375b3-afea-41a9-8080-eac22588fa64 admin admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:30:26.681962 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d382b8a-71ed-4479-a845-246686b9ee95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:30:26.683816 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d382b8a-71ed-4479-a845-246686b9ee95 admin admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:30:26.684270 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d382b8a-71ed-4479-a845-246686b9ee95 admin admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:30:26.684812 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d382b8a-71ed-4479-a845-246686b9ee95 admin admin] PATH_INFO: `/v3/roles` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:30:26.685745 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d382b8a-71ed-4479-a845-246686b9ee95 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:30:26.687799 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d382b8a-71ed-4479-a845-246686b9ee95 admin admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:30:26.701858 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 1216/2421] 10.222.0.21 () {58 vars in 1121 bytes} [Wed May 4 07:30:26 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 07:30:26.706513 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754cf9e3-823b-4af9-ae8a-dd65d61161cd admin admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:30:26.726162 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754cf9e3-823b-4af9-ae8a-dd65d61161cd admin admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:30:26.731930 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ed3e55-4a57-4c5b-a1ed-4890e2f5f0a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:30:26.733434 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ed3e55-4a57-4c5b-a1ed-4890e2f5f0a5 admin admin] REQUEST_METHOD: `PUT` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:30:26.733886 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ed3e55-4a57-4c5b-a1ed-4890e2f5f0a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:30:26.734353 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ed3e55-4a57-4c5b-a1ed-4890e2f5f0a5 admin admin] PATH_INFO: `/v3/projects/709bfe8332eb47ffb4d03313abeff046/users/23ddf99780d1472a858b8a3ed550557f/roles/eb54c9cea2774a25b1fe8c79724408ee` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:30:26.758557 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ed3e55-4a57-4c5b-a1ed-4890e2f5f0a5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=709bfe8332eb47ffb4d03313abeff046, user_id=23ddf99780d1472a858b8a3ed550557f, role_id=eb54c9cea2774a25b1fe8c79724408ee)` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:30:26.761577 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ed3e55-4a57-4c5b-a1ed-4890e2f5f0a5 admin admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:30:26.808283 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 1206/2422] 10.222.0.21 () {60 vars in 1482 bytes} [Wed May 4 07:30:26 2022] PUT /identity/v3/projects/709bfe8332eb47ffb4d03313abeff046/users/23ddf99780d1472a858b8a3ed550557f/roles/eb54c9cea2774a25b1fe8c79724408ee => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 07:30:26.812002 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d382b8a-71ed-4479-a845-246686b9ee95 admin admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:30:26.826297 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d382b8a-71ed-4479-a845-246686b9ee95 admin admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:30:26.915853 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9f9c76-d5d0-4c32-8487-77db3620d6b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:30:26.917104 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9f9c76-d5d0-4c32-8487-77db3620d6b8 admin admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:30:26.917629 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9f9c76-d5d0-4c32-8487-77db3620d6b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:30:26.918117 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9f9c76-d5d0-4c32-8487-77db3620d6b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:30:26.919077 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9f9c76-d5d0-4c32-8487-77db3620d6b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:30:26.921404 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9f9c76-d5d0-4c32-8487-77db3620d6b8 admin admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:30:26.937933 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 1217/2423] 10.222.0.21 () {58 vars in 1121 bytes} [Wed May 4 07:30:26 2022] GET /identity/v3/roles => generated 1420 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 07:30:26.940326 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ed3e55-4a57-4c5b-a1ed-4890e2f5f0a5 admin admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:30:26.961940 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ed3e55-4a57-4c5b-a1ed-4890e2f5f0a5 admin admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:30:26.967813 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2bd3a7-ea2b-4fa0-991e-cb220ecede75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:30:26.969689 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2bd3a7-ea2b-4fa0-991e-cb220ecede75 admin admin] REQUEST_METHOD: `PUT` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:30:26.970051 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2bd3a7-ea2b-4fa0-991e-cb220ecede75 admin admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:30:26.971557 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2bd3a7-ea2b-4fa0-991e-cb220ecede75 admin admin] PATH_INFO: `/v3/projects/709bfe8332eb47ffb4d03313abeff046/users/23ddf99780d1472a858b8a3ed550557f/roles/eb54c9cea2774a25b1fe8c79724408ee` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:30:26.973783 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2bd3a7-ea2b-4fa0-991e-cb220ecede75 admin admin] RBAC: Authorizing `identity:create_grant(project_id=709bfe8332eb47ffb4d03313abeff046, user_id=23ddf99780d1472a858b8a3ed550557f, role_id=eb54c9cea2774a25b1fe8c79724408ee)` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:30:26.977069 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2bd3a7-ea2b-4fa0-991e-cb220ecede75 admin admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:30:26.995205 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 1207/2424] 10.222.0.21 () {60 vars in 1482 bytes} [Wed May 4 07:30:26 2022] PUT /identity/v3/projects/709bfe8332eb47ffb4d03313abeff046/users/23ddf99780d1472a858b8a3ed550557f/roles/eb54c9cea2774a25b1fe8c79724408ee => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 07:30:33.165877 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb695c9-39f2-486a-a24b-683fd4524463 None None] REQUEST_METHOD: `POST` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:30:33.165877 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb695c9-39f2-486a-a24b-683fd4524463 None None] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:30:33.165877 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb695c9-39f2-486a-a24b-683fd4524463 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:30:33.205545 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.auth.core [None req-8eb695c9-39f2-486a-a24b-683fd4524463 None None] MFA Rules not processed for user `23ddf99780d1472a858b8a3ed550557f`. Rule list: `[]` (Enabled: `True`). {{(pid=79744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:30:33.206783 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.fernet_utils [None req-8eb695c9-39f2-486a-a24b-683fd4524463 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:30:33.322814 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 1218/2425] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 07:30:33 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 07:30:33.345449 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2bd3a7-ea2b-4fa0-991e-cb220ecede75 admin admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:30:33.348251 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.fernet_utils [None req-ee2bd3a7-ea2b-4fa0-991e-cb220ecede75 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:30:33.421771 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2bd3a7-ea2b-4fa0-991e-cb220ecede75 admin admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:30:33.429068 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e99634-5809-4be5-ac1b-94b493bd6895 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7538f5cab3364625a3e909f5f117ef2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9f9c44db4984653b8d4b5f6b3b949f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:30:33.431877 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e99634-5809-4be5-ac1b-94b493bd6895 service glance] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:30:33.432552 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e99634-5809-4be5-ac1b-94b493bd6895 service glance] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:30:33.432900 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e99634-5809-4be5-ac1b-94b493bd6895 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:30:33.530618 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e99634-5809-4be5-ac1b-94b493bd6895 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:30:33.532299 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e99634-5809-4be5-ac1b-94b493bd6895 service glance] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:30:33.547378 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 1208/2426] 10.222.0.21 () {60 vars in 1365 bytes} [Wed May 4 07:30:33 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 07:30:33.705804 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84766aa3-cf14-460e-a3b0-99d3a34ddc98 None None] REQUEST_METHOD: `POST` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:30:33.706072 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84766aa3-cf14-460e-a3b0-99d3a34ddc98 None None] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:30:33.706343 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84766aa3-cf14-460e-a3b0-99d3a34ddc98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:30:33.725560 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.auth.core [None req-84766aa3-cf14-460e-a3b0-99d3a34ddc98 None None] MFA Rules not processed for user `704cdbc22849413baa4e0189947ebebc`. Rule list: `[]` (Enabled: `True`). {{(pid=79744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:30:33.726760 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.fernet_utils [None req-84766aa3-cf14-460e-a3b0-99d3a34ddc98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:30:33.804137 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 1219/2427] 10.222.0.21 () {58 vars in 1009 bytes} [Wed May 4 07:30:33 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 07:30:33.832086 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e99634-5809-4be5-ac1b-94b493bd6895 service glance] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:30:33.833624 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.fernet_utils [None req-e9e99634-5809-4be5-ac1b-94b493bd6895 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:30:33.920910 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e99634-5809-4be5-ac1b-94b493bd6895 service glance] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:30:33.928413 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f273ba3-6b2d-4bcd-80c3-e1e1465a20db service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '084c9245d1da4e698c9c3945fa089e85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9f9c44db4984653b8d4b5f6b3b949f5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:30:33.929075 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f273ba3-6b2d-4bcd-80c3-e1e1465a20db service swift] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:30:33.929350 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f273ba3-6b2d-4bcd-80c3-e1e1465a20db service swift] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:30:33.929620 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f273ba3-6b2d-4bcd-80c3-e1e1465a20db service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:30:33.939317 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f273ba3-6b2d-4bcd-80c3-e1e1465a20db service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:30:33.941021 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f273ba3-6b2d-4bcd-80c3-e1e1465a20db service swift] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:30:33.950138 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 1209/2428] 10.222.0.21 () {60 vars in 1384 bytes} [Wed May 4 07:30:33 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 04 07:30:37.154450 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f701d585-3475-4710-80ca-93115dc96e61 None None] REQUEST_METHOD: `POST` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:30:37.155308 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f701d585-3475-4710-80ca-93115dc96e61 None None] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:30:37.155308 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f701d585-3475-4710-80ca-93115dc96e61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:30:37.202858 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.auth.core [None req-f701d585-3475-4710-80ca-93115dc96e61 None None] MFA Rules not processed for user `20497d01a7c34e2eb5a56bfabf95dced`. Rule list: `[]` (Enabled: `True`). {{(pid=79744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:30:37.205744 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.fernet_utils [None req-f701d585-3475-4710-80ca-93115dc96e61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:30:37.330104 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 1220/2429] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 07:30:37 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 07:30:43.220041 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f273ba3-6b2d-4bcd-80c3-e1e1465a20db service swift] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:30:43.223066 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.fernet_utils [None req-9f273ba3-6b2d-4bcd-80c3-e1e1465a20db service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:30:43.321482 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f273ba3-6b2d-4bcd-80c3-e1e1465a20db service swift] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:30:43.328305 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3117091e-9e23-48f3-8550-d6689e58bc1a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1077289fedae43b6be47be7f716d573a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9f9c44db4984653b8d4b5f6b3b949f5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:30:43.329026 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3117091e-9e23-48f3-8550-d6689e58bc1a service nova] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:30:43.329487 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3117091e-9e23-48f3-8550-d6689e58bc1a service nova] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:30:43.330382 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3117091e-9e23-48f3-8550-d6689e58bc1a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:30:43.332378 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.fernet_utils [None req-3117091e-9e23-48f3-8550-d6689e58bc1a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:30:43.351967 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3117091e-9e23-48f3-8550-d6689e58bc1a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:30:43.354291 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3117091e-9e23-48f3-8550-d6689e58bc1a service nova] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:30:43.387454 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 1210/2430] 10.222.0.21 () {60 vars in 1365 bytes} [Wed May 4 07:30:43 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 07:30:46.254781 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583f8c60-43bd-43e9-b0a4-9ebe68cdd879 None None] REQUEST_METHOD: `POST` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:30:46.255398 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583f8c60-43bd-43e9-b0a4-9ebe68cdd879 None None] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:30:46.255398 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583f8c60-43bd-43e9-b0a4-9ebe68cdd879 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:30:46.272984 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.auth.core [None req-583f8c60-43bd-43e9-b0a4-9ebe68cdd879 None None] MFA Rules not processed for user `30f3c4305a3a4f7ea60a6e4e6e8b7668`. Rule list: `[]` (Enabled: `True`). {{(pid=79744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:30:46.274177 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.fernet_utils [None req-583f8c60-43bd-43e9-b0a4-9ebe68cdd879 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:30:46.281235 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 1221/2431] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 07:30:46 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 07:30:46.539704 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef6851d-c348-4dab-a161-264e88b6e834 None None] REQUEST_METHOD: `POST` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:30:46.542643 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef6851d-c348-4dab-a161-264e88b6e834 None None] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:30:46.543113 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef6851d-c348-4dab-a161-264e88b6e834 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:30:46.592694 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.auth.core [None req-eef6851d-c348-4dab-a161-264e88b6e834 None None] MFA Rules not processed for user `704cdbc22849413baa4e0189947ebebc`. Rule list: `[]` (Enabled: `True`). {{(pid=79745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:30:46.593931 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.fernet_utils [None req-eef6851d-c348-4dab-a161-264e88b6e834 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:30:46.601822 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 1211/2432] 10.222.0.21 () {58 vars in 967 bytes} [Wed May 4 07:30:46 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 07:30:46.618148 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583f8c60-43bd-43e9-b0a4-9ebe68cdd879 None None] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:30:46.632690 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583f8c60-43bd-43e9-b0a4-9ebe68cdd879 None None] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:30:46.640329 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa974632-bc59-4c63-bd01-037734c6bf55 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '084c9245d1da4e698c9c3945fa089e85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9f9c44db4984653b8d4b5f6b3b949f5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:30:46.641774 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa974632-bc59-4c63-bd01-037734c6bf55 service swift] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:30:46.642140 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa974632-bc59-4c63-bd01-037734c6bf55 service swift] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:30:46.642463 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa974632-bc59-4c63-bd01-037734c6bf55 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:30:46.655304 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa974632-bc59-4c63-bd01-037734c6bf55 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:30:46.657904 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa974632-bc59-4c63-bd01-037734c6bf55 service swift] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:30:46.681293 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 1222/2433] 10.222.0.21 () {60 vars in 1384 bytes} [Wed May 4 07:30:46 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 04 07:30:48.334656 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edd577d-be30-4615-84e5-b138954e896e None None] REQUEST_METHOD: `POST` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:30:48.335212 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edd577d-be30-4615-84e5-b138954e896e None None] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:30:48.335212 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edd577d-be30-4615-84e5-b138954e896e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:30:48.354121 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.auth.core [None req-8edd577d-be30-4615-84e5-b138954e896e None None] MFA Rules not processed for user `704cdbc22849413baa4e0189947ebebc`. Rule list: `[]` (Enabled: `True`). {{(pid=79745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:30:48.355341 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.fernet_utils [None req-8edd577d-be30-4615-84e5-b138954e896e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:30:48.363401 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 1212/2434] 10.222.0.21 () {58 vars in 1009 bytes} [Wed May 4 07:30:48 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 07:30:48.376936 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa974632-bc59-4c63-bd01-037734c6bf55 service swift] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:30:48.387623 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa974632-bc59-4c63-bd01-037734c6bf55 service swift] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:30:48.394724 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a2012e-6d56-42f4-99a6-2b4788303773 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '084c9245d1da4e698c9c3945fa089e85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9f9c44db4984653b8d4b5f6b3b949f5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:30:48.395646 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a2012e-6d56-42f4-99a6-2b4788303773 service swift] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:30:48.396094 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a2012e-6d56-42f4-99a6-2b4788303773 service swift] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:30:48.396524 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a2012e-6d56-42f4-99a6-2b4788303773 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:30:48.405815 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a2012e-6d56-42f4-99a6-2b4788303773 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:30:48.408230 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a2012e-6d56-42f4-99a6-2b4788303773 service swift] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:30:48.418875 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 1223/2435] 10.222.0.21 () {60 vars in 1384 bytes} [Wed May 4 07:30:48 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 04 07:31:03.343069 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8edd577d-be30-4615-84e5-b138954e896e None None] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:31:03.345413 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.fernet_utils [None req-8edd577d-be30-4615-84e5-b138954e896e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:31:03.368904 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8edd577d-be30-4615-84e5-b138954e896e None None] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:31:03.384402 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b84d51-685a-4f08-99ba-244b4b8d50dd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1077289fedae43b6be47be7f716d573a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9f9c44db4984653b8d4b5f6b3b949f5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:31:03.387766 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b84d51-685a-4f08-99ba-244b4b8d50dd service nova] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:31:03.388300 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b84d51-685a-4f08-99ba-244b4b8d50dd service nova] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:31:03.388798 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b84d51-685a-4f08-99ba-244b4b8d50dd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:31:03.396242 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.fernet_utils [None req-86b84d51-685a-4f08-99ba-244b4b8d50dd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:31:03.496981 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b84d51-685a-4f08-99ba-244b4b8d50dd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:31:03.498694 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b84d51-685a-4f08-99ba-244b4b8d50dd service nova] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:31:03.509991 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 1213/2436] 10.222.0.21 () {60 vars in 1365 bytes} [Wed May 4 07:31:03 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 07:31:22.020208 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f997fcc-a574-43f5-ad71-4343ebb6caff None None] REQUEST_METHOD: `POST` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:31:22.020778 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f997fcc-a574-43f5-ad71-4343ebb6caff None None] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:31:22.020778 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f997fcc-a574-43f5-ad71-4343ebb6caff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:31:22.038235 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.auth.core [None req-6f997fcc-a574-43f5-ad71-4343ebb6caff None None] MFA Rules not processed for user `10265d473a5c49e6960740b21114fee1`. Rule list: `[]` (Enabled: `True`). {{(pid=79744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:31:22.039433 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.fernet_utils [None req-6f997fcc-a574-43f5-ad71-4343ebb6caff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:31:22.046162 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 1224/2437] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 07:31:22 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 07:31:25.196412 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b84d51-685a-4f08-99ba-244b4b8d50dd service nova] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:31:25.263734 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b84d51-685a-4f08-99ba-244b4b8d50dd service nova] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:31:25.268721 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ab275b-8242-4430-88e4-45dd2352ea47 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91cb92d00273402b837cb29b37325101', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9f9c44db4984653b8d4b5f6b3b949f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:31:25.269656 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ab275b-8242-4430-88e4-45dd2352ea47 service neutron] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:31:25.270045 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ab275b-8242-4430-88e4-45dd2352ea47 service neutron] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:31:25.270322 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ab275b-8242-4430-88e4-45dd2352ea47 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:31:25.281344 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ab275b-8242-4430-88e4-45dd2352ea47 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:31:25.282770 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ab275b-8242-4430-88e4-45dd2352ea47 service neutron] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:31:25.292765 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 1214/2438] 10.222.0.21 () {60 vars in 1365 bytes} [Wed May 4 07:31:25 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 07:31:55.021454 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f997fcc-a574-43f5-ad71-4343ebb6caff None None] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:31:55.036130 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f997fcc-a574-43f5-ad71-4343ebb6caff None None] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:31:55.041771 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127e0715-bf06-4969-b129-5c027d489a58 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1077289fedae43b6be47be7f716d573a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9f9c44db4984653b8d4b5f6b3b949f5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:31:55.042551 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127e0715-bf06-4969-b129-5c027d489a58 service nova] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:31:55.042834 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127e0715-bf06-4969-b129-5c027d489a58 service nova] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:31:55.043113 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127e0715-bf06-4969-b129-5c027d489a58 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:31:55.044927 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.fernet_utils [None req-127e0715-bf06-4969-b129-5c027d489a58 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:31:55.107326 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127e0715-bf06-4969-b129-5c027d489a58 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:31:55.108899 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127e0715-bf06-4969-b129-5c027d489a58 service nova] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:31:55.118309 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 1225/2439] 10.222.0.21 () {60 vars in 1365 bytes} [Wed May 4 07:31:55 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 07:32:05.156050 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760c8813-27a9-433a-9610-123308abd915 None None] REQUEST_METHOD: `POST` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:32:05.156570 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760c8813-27a9-433a-9610-123308abd915 None None] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:32:05.156669 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760c8813-27a9-433a-9610-123308abd915 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:32:05.174355 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.auth.core [None req-760c8813-27a9-433a-9610-123308abd915 None None] MFA Rules not processed for user `c0d8468db2524d76b712b831f83d2cbe`. Rule list: `[]` (Enabled: `True`). {{(pid=79745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:32:05.175784 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.fernet_utils [None req-760c8813-27a9-433a-9610-123308abd915 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:32:05.182558 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 1215/2440] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 07:32:05 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 07:32:05.482620 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127e0715-bf06-4969-b129-5c027d489a58 service nova] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:32:05.484090 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.fernet_utils [None req-127e0715-bf06-4969-b129-5c027d489a58 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:32:05.496013 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127e0715-bf06-4969-b129-5c027d489a58 service nova] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:32:05.499562 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3016e146-d285-4114-8b08-29c1eb563f3c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91cb92d00273402b837cb29b37325101', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9f9c44db4984653b8d4b5f6b3b949f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:32:05.500194 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3016e146-d285-4114-8b08-29c1eb563f3c service neutron] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:32:05.500467 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3016e146-d285-4114-8b08-29c1eb563f3c service neutron] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:32:05.500734 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3016e146-d285-4114-8b08-29c1eb563f3c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:32:05.503267 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.fernet_utils [None req-3016e146-d285-4114-8b08-29c1eb563f3c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:32:05.512388 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3016e146-d285-4114-8b08-29c1eb563f3c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:32:05.513785 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3016e146-d285-4114-8b08-29c1eb563f3c service neutron] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:32:05.521538 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 1226/2441] 10.222.0.21 () {60 vars in 1365 bytes} [Wed May 4 07:32:05 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 07:32:13.070816 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760c8813-27a9-433a-9610-123308abd915 None None] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:32:13.080457 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760c8813-27a9-433a-9610-123308abd915 None None] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:32:13.084202 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eca0d43-5555-4122-b7c2-16e62ad4243a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91cb92d00273402b837cb29b37325101', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9f9c44db4984653b8d4b5f6b3b949f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:32:13.084845 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eca0d43-5555-4122-b7c2-16e62ad4243a service neutron] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:32:13.085125 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eca0d43-5555-4122-b7c2-16e62ad4243a service neutron] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:32:13.085407 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eca0d43-5555-4122-b7c2-16e62ad4243a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:32:13.087791 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.fernet_utils [None req-2eca0d43-5555-4122-b7c2-16e62ad4243a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:32:13.150222 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eca0d43-5555-4122-b7c2-16e62ad4243a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:32:13.151489 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eca0d43-5555-4122-b7c2-16e62ad4243a service neutron] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:32:13.161607 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 1216/2442] 10.222.0.21 () {60 vars in 1365 bytes} [Wed May 4 07:32:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 07:32:16.869712 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3016e146-d285-4114-8b08-29c1eb563f3c service neutron] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:32:16.871275 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.fernet_utils [None req-3016e146-d285-4114-8b08-29c1eb563f3c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:32:16.894370 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3016e146-d285-4114-8b08-29c1eb563f3c service neutron] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:32:16.898953 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3adfc3-da7b-43bd-8d45-0307f7046f2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:32:16.900397 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3adfc3-da7b-43bd-8d45-0307f7046f2f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:32:16.900731 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3adfc3-da7b-43bd-8d45-0307f7046f2f admin admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:32:16.901001 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3adfc3-da7b-43bd-8d45-0307f7046f2f admin admin] PATH_INFO: `/v3/users/20497d01a7c34e2eb5a56bfabf95dced` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:32:16.902271 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3adfc3-da7b-43bd-8d45-0307f7046f2f admin admin] RBAC: Authorizing `identity:delete_user(user_id=20497d01a7c34e2eb5a56bfabf95dced)` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:32:16.904460 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3adfc3-da7b-43bd-8d45-0307f7046f2f admin admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:32:16.953390 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-ad3adfc3-da7b-43bd-8d45-0307f7046f2f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '20497d01a7c34e2eb5a56bfabf95dced'} {{(pid=79744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:32:16.954039 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-ad3adfc3-da7b-43bd-8d45-0307f7046f2f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '20497d01a7c34e2eb5a56bfabf95dced'} {{(pid=79744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:32:16.961332 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-ad3adfc3-da7b-43bd-8d45-0307f7046f2f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '20497d01a7c34e2eb5a56bfabf95dced'} {{(pid=79744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:32:16.961967 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-ad3adfc3-da7b-43bd-8d45-0307f7046f2f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '20497d01a7c34e2eb5a56bfabf95dced'} {{(pid=79744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:32:16.973483 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-ad3adfc3-da7b-43bd-8d45-0307f7046f2f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '20497d01a7c34e2eb5a56bfabf95dced'} {{(pid=79744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:32:16.987980 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 1227/2443] 10.222.0.21 () {58 vars in 1223 bytes} [Wed May 4 07:32:16 2022] DELETE /identity/v3/users/20497d01a7c34e2eb5a56bfabf95dced => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 07:32:17.156920 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eca0d43-5555-4122-b7c2-16e62ad4243a service neutron] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:32:17.167780 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eca0d43-5555-4122-b7c2-16e62ad4243a service neutron] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:32:17.226786 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a27cb7-a4e0-4470-80d0-3747bfcbbb3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:32:17.227676 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a27cb7-a4e0-4470-80d0-3747bfcbbb3f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:32:17.227954 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a27cb7-a4e0-4470-80d0-3747bfcbbb3f admin admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:32:17.228225 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a27cb7-a4e0-4470-80d0-3747bfcbbb3f admin admin] PATH_INFO: `/v3/projects/4f0a51ac1da141dba1d58c7ec9c5a15f` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:32:17.229411 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a27cb7-a4e0-4470-80d0-3747bfcbbb3f admin admin] RBAC: Authorizing `identity:delete_project(project_id=4f0a51ac1da141dba1d58c7ec9c5a15f)` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:32:17.231438 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a27cb7-a4e0-4470-80d0-3747bfcbbb3f admin admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:32:17.280622 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-a8a27cb7-a4e0-4470-80d0-3747bfcbbb3f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4f0a51ac1da141dba1d58c7ec9c5a15f', 'request_id': 'req-a8a27cb7-a4e0-4470-80d0-3747bfcbbb3f'} {{(pid=79745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:32:17.287496 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-a8a27cb7-a4e0-4470-80d0-3747bfcbbb3f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4f0a51ac1da141dba1d58c7ec9c5a15f', 'request_id': 'req-a8a27cb7-a4e0-4470-80d0-3747bfcbbb3f'} {{(pid=79745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:32:17.295213 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-a8a27cb7-a4e0-4470-80d0-3747bfcbbb3f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4f0a51ac1da141dba1d58c7ec9c5a15f', 'request_id': 'req-a8a27cb7-a4e0-4470-80d0-3747bfcbbb3f'} {{(pid=79745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:32:17.306626 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-a8a27cb7-a4e0-4470-80d0-3747bfcbbb3f admin admin] The token cache is being invalidate because project 4f0a51ac1da141dba1d58c7ec9c5a15f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79745) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 07:32:17.307011 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-a8a27cb7-a4e0-4470-80d0-3747bfcbbb3f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:32:17.307860 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-a8a27cb7-a4e0-4470-80d0-3747bfcbbb3f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:32:17.309487 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 1217/2444] 10.222.0.21 () {58 vars in 1232 bytes} [Wed May 4 07:32:17 2022] DELETE /identity/v3/projects/4f0a51ac1da141dba1d58c7ec9c5a15f => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 07:32:17.314382 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8f8848-b8d2-483c-967c-ecd5e0470212 None None] REQUEST_METHOD: `POST` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:32:17.315321 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8f8848-b8d2-483c-967c-ecd5e0470212 None None] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:32:17.315601 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8f8848-b8d2-483c-967c-ecd5e0470212 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:32:17.333266 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.auth.core [None req-ac8f8848-b8d2-483c-967c-ecd5e0470212 None None] MFA Rules not processed for user `83c5e0dcb991496ea6dee38384514508`. Rule list: `[]` (Enabled: `True`). {{(pid=79744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:32:17.334464 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.fernet_utils [None req-ac8f8848-b8d2-483c-967c-ecd5e0470212 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:32:17.395535 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 1228/2445] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 07:32:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 07:32:17.403264 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93635a6-a6a4-434c-8fd6-50c2a3be9a34 None None] REQUEST_METHOD: `POST` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:32:17.403429 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93635a6-a6a4-434c-8fd6-50c2a3be9a34 None None] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:32:17.403706 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93635a6-a6a4-434c-8fd6-50c2a3be9a34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:32:17.422858 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.auth.core [None req-b93635a6-a6a4-434c-8fd6-50c2a3be9a34 None None] MFA Rules not processed for user `83c5e0dcb991496ea6dee38384514508`. Rule list: `[]` (Enabled: `True`). {{(pid=79745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:32:17.424927 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.fernet_utils [None req-b93635a6-a6a4-434c-8fd6-50c2a3be9a34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:32:17.433141 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 1218/2446] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 07:32:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 07:32:17.437388 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8f8848-b8d2-483c-967c-ecd5e0470212 None None] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:32:17.448077 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8f8848-b8d2-483c-967c-ecd5e0470212 None None] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:32:17.452696 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7b49ee-5e54-4512-b51f-0aaa48a84b52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:32:17.453639 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7b49ee-5e54-4512-b51f-0aaa48a84b52 admin admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:32:17.454560 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7b49ee-5e54-4512-b51f-0aaa48a84b52 admin admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:32:17.456496 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7b49ee-5e54-4512-b51f-0aaa48a84b52 admin admin] PATH_INFO: `/v3/domains` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:32:17.457288 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7b49ee-5e54-4512-b51f-0aaa48a84b52 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79744) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 07:32:17.457603 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7b49ee-5e54-4512-b51f-0aaa48a84b52 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:32:17.459284 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7b49ee-5e54-4512-b51f-0aaa48a84b52 admin admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:32:17.474983 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 1229/2447] 10.222.0.21 () {58 vars in 1152 bytes} [Wed May 4 07:32:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 07:32:17.476283 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93635a6-a6a4-434c-8fd6-50c2a3be9a34 None None] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:32:17.485748 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93635a6-a6a4-434c-8fd6-50c2a3be9a34 None None] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:32:17.491227 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c725e683-1c7a-45b0-8193-98a1639779ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:32:17.491911 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c725e683-1c7a-45b0-8193-98a1639779ad admin admin] REQUEST_METHOD: `POST` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:32:17.492188 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c725e683-1c7a-45b0-8193-98a1639779ad admin admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:32:17.492456 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c725e683-1c7a-45b0-8193-98a1639779ad admin admin] PATH_INFO: `/v3/projects` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:32:17.493138 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c725e683-1c7a-45b0-8193-98a1639779ad admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:32:17.495031 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c725e683-1c7a-45b0-8193-98a1639779ad admin admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:32:17.523830 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 1219/2448] 10.222.0.21 () {60 vars in 1152 bytes} [Wed May 4 07:32:17 2022] POST /identity/v3/projects => generated 377 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 07:32:17.524947 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7b49ee-5e54-4512-b51f-0aaa48a84b52 admin admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:32:17.536557 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7b49ee-5e54-4512-b51f-0aaa48a84b52 admin admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:32:17.592955 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86fb8eb3-087d-4d88-84c9-fb77d75bf760 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:32:17.593734 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fb8eb3-087d-4d88-84c9-fb77d75bf760 admin admin] REQUEST_METHOD: `POST` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:32:17.594016 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fb8eb3-087d-4d88-84c9-fb77d75bf760 admin admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:32:17.594307 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fb8eb3-087d-4d88-84c9-fb77d75bf760 admin admin] PATH_INFO: `/v3/users` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:32:17.594995 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86fb8eb3-087d-4d88-84c9-fb77d75bf760 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:32:17.597639 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86fb8eb3-087d-4d88-84c9-fb77d75bf760 admin admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:32:17.621434 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 1230/2449] 10.222.0.21 () {60 vars in 1143 bytes} [Wed May 4 07:32:17 2022] POST /identity/v3/users => generated 289 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 07:32:17.622708 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c725e683-1c7a-45b0-8193-98a1639779ad admin admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:32:17.634122 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c725e683-1c7a-45b0-8193-98a1639779ad admin admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:32:17.639083 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb30daa-7fe8-4c6b-a0ae-478c3eb99948 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:32:17.639910 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb30daa-7fe8-4c6b-a0ae-478c3eb99948 admin admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:32:17.640292 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb30daa-7fe8-4c6b-a0ae-478c3eb99948 admin admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:32:17.640665 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb30daa-7fe8-4c6b-a0ae-478c3eb99948 admin admin] PATH_INFO: `/v3/roles` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:32:17.641508 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb30daa-7fe8-4c6b-a0ae-478c3eb99948 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:32:17.643924 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb30daa-7fe8-4c6b-a0ae-478c3eb99948 admin admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:32:17.659393 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 1220/2450] 10.222.0.21 () {58 vars in 1121 bytes} [Wed May 4 07:32:17 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 07:32:17.660616 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86fb8eb3-087d-4d88-84c9-fb77d75bf760 admin admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:32:17.670957 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86fb8eb3-087d-4d88-84c9-fb77d75bf760 admin admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:32:17.676653 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a244667b-8ace-4e79-b547-d90e821bb073 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:32:17.677333 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a244667b-8ace-4e79-b547-d90e821bb073 admin admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:32:17.677614 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a244667b-8ace-4e79-b547-d90e821bb073 admin admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:32:17.677891 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a244667b-8ace-4e79-b547-d90e821bb073 admin admin] PATH_INFO: `/v3/roles` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:32:17.678633 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a244667b-8ace-4e79-b547-d90e821bb073 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:32:17.680289 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a244667b-8ace-4e79-b547-d90e821bb073 admin admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:32:17.695664 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 1231/2451] 10.222.0.21 () {58 vars in 1121 bytes} [Wed May 4 07:32:17 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 07:32:17.696869 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb30daa-7fe8-4c6b-a0ae-478c3eb99948 admin admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:32:17.709286 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb30daa-7fe8-4c6b-a0ae-478c3eb99948 admin admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:32:17.714240 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af49d484-7859-4567-bd71-3fa0df32bf53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:32:17.715176 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af49d484-7859-4567-bd71-3fa0df32bf53 admin admin] REQUEST_METHOD: `PUT` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:32:17.715462 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af49d484-7859-4567-bd71-3fa0df32bf53 admin admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:32:17.715738 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af49d484-7859-4567-bd71-3fa0df32bf53 admin admin] PATH_INFO: `/v3/projects/67ba7d23d29d4a7983ba1cfe0ac4863d/users/9623c2fad43a4f49aeeb824a1b7fbc6e/roles/9f89c07b05a14f18836116af22cba5f6` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:32:17.735162 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af49d484-7859-4567-bd71-3fa0df32bf53 admin admin] RBAC: Authorizing `identity:create_grant(project_id=67ba7d23d29d4a7983ba1cfe0ac4863d, user_id=9623c2fad43a4f49aeeb824a1b7fbc6e, role_id=9f89c07b05a14f18836116af22cba5f6)` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:32:17.739239 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af49d484-7859-4567-bd71-3fa0df32bf53 admin admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:32:17.760207 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 1221/2452] 10.222.0.21 () {60 vars in 1482 bytes} [Wed May 4 07:32:17 2022] PUT /identity/v3/projects/67ba7d23d29d4a7983ba1cfe0ac4863d/users/9623c2fad43a4f49aeeb824a1b7fbc6e/roles/9f89c07b05a14f18836116af22cba5f6 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 07:32:17.761878 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c69f307-884a-41c5-9332-d1d066cc70f1 None None] REQUEST_METHOD: `POST` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:32:17.762238 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c69f307-884a-41c5-9332-d1d066cc70f1 None None] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:32:17.762517 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c69f307-884a-41c5-9332-d1d066cc70f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:32:17.782145 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.auth.core [None req-0c69f307-884a-41c5-9332-d1d066cc70f1 None None] MFA Rules not processed for user `83c5e0dcb991496ea6dee38384514508`. Rule list: `[]` (Enabled: `True`). {{(pid=79744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:32:17.783572 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.fernet_utils [None req-0c69f307-884a-41c5-9332-d1d066cc70f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:32:17.855088 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 1232/2453] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 07:32:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 07:32:17.863320 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af49d484-7859-4567-bd71-3fa0df32bf53 admin admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:32:17.865242 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.fernet_utils [None req-af49d484-7859-4567-bd71-3fa0df32bf53 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:32:17.931607 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af49d484-7859-4567-bd71-3fa0df32bf53 admin admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:32:17.935290 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffcd777-9624-4a8c-a4be-831633c2725a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91cb92d00273402b837cb29b37325101', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9f9c44db4984653b8d4b5f6b3b949f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:32:17.935947 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffcd777-9624-4a8c-a4be-831633c2725a service neutron] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:32:17.936226 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffcd777-9624-4a8c-a4be-831633c2725a service neutron] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:32:17.936502 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffcd777-9624-4a8c-a4be-831633c2725a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:32:17.946441 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dffcd777-9624-4a8c-a4be-831633c2725a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:32:17.947901 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dffcd777-9624-4a8c-a4be-831633c2725a service neutron] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:32:17.957337 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 1222/2454] 10.222.0.21 () {60 vars in 1365 bytes} [Wed May 4 07:32:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 07:32:22.373790 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5313cd1f-1390-4a06-96b0-d2ce8a92ad7e None None] REQUEST_METHOD: `POST` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:32:22.374239 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5313cd1f-1390-4a06-96b0-d2ce8a92ad7e None None] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:32:22.374430 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5313cd1f-1390-4a06-96b0-d2ce8a92ad7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:32:22.420195 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.auth.core [None req-5313cd1f-1390-4a06-96b0-d2ce8a92ad7e None None] MFA Rules not processed for user `9623c2fad43a4f49aeeb824a1b7fbc6e`. Rule list: `[]` (Enabled: `True`). {{(pid=79744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:32:22.421799 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.fernet_utils [None req-5313cd1f-1390-4a06-96b0-d2ce8a92ad7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:32:22.507190 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 1233/2455] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 07:32:22 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 07:32:22.515018 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffcd777-9624-4a8c-a4be-831633c2725a service neutron] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:32:22.516482 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.fernet_utils [None req-dffcd777-9624-4a8c-a4be-831633c2725a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:32:22.601079 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffcd777-9624-4a8c-a4be-831633c2725a service neutron] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:32:22.608617 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a400f7e1-89a6-4dbb-93bf-445cfe2a67ad service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1077289fedae43b6be47be7f716d573a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9f9c44db4984653b8d4b5f6b3b949f5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:32:22.609604 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a400f7e1-89a6-4dbb-93bf-445cfe2a67ad service nova] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:32:22.609958 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a400f7e1-89a6-4dbb-93bf-445cfe2a67ad service nova] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:32:22.610305 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a400f7e1-89a6-4dbb-93bf-445cfe2a67ad service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:32:22.619242 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a400f7e1-89a6-4dbb-93bf-445cfe2a67ad service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:32:22.620965 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a400f7e1-89a6-4dbb-93bf-445cfe2a67ad service nova] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:32:22.633199 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 1223/2456] 10.222.0.21 () {60 vars in 1365 bytes} [Wed May 4 07:32:22 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 07:32:23.973067 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d674a355-dc12-4058-a1b4-981fc3793790 None None] REQUEST_METHOD: `POST` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:32:23.973733 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d674a355-dc12-4058-a1b4-981fc3793790 None None] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:32:23.973733 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d674a355-dc12-4058-a1b4-981fc3793790 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:32:23.991966 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.auth.core [None req-d674a355-dc12-4058-a1b4-981fc3793790 None None] MFA Rules not processed for user `9623c2fad43a4f49aeeb824a1b7fbc6e`. Rule list: `[]` (Enabled: `True`). {{(pid=79744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:32:23.993164 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.fernet_utils [None req-d674a355-dc12-4058-a1b4-981fc3793790 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:32:24.000499 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 1234/2457] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 07:32:23 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 07:32:47.193627 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8252a8-1b4e-4a5e-8beb-e67f6a460865 None None] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:32:47.194245 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8252a8-1b4e-4a5e-8beb-e67f6a460865 None None] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:32:47.194245 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8252a8-1b4e-4a5e-8beb-e67f6a460865 None None] PATH_INFO: `/` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:32:47.195814 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 1224/2458] 10.222.0.21 () {54 vars in 921 bytes} [Wed May 4 07:32:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 07:32:47.206264 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385f98d3-6fd4-4de9-ae2a-87f77a72ae5e None None] REQUEST_METHOD: `POST` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:32:47.206848 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385f98d3-6fd4-4de9-ae2a-87f77a72ae5e None None] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:32:47.207668 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385f98d3-6fd4-4de9-ae2a-87f77a72ae5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:32:47.226719 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.auth.core [None req-385f98d3-6fd4-4de9-ae2a-87f77a72ae5e None None] MFA Rules not processed for user `91cb92d00273402b837cb29b37325101`. Rule list: `[]` (Enabled: `True`). {{(pid=79744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:32:47.228058 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.fernet_utils [None req-385f98d3-6fd4-4de9-ae2a-87f77a72ae5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:32:47.235189 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 1235/2459] 10.222.0.21 () {58 vars in 1018 bytes} [Wed May 4 07:32:47 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 07:32:47.248079 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8252a8-1b4e-4a5e-8beb-e67f6a460865 None None] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:32:47.259270 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8252a8-1b4e-4a5e-8beb-e67f6a460865 None None] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:32:47.262922 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa019cb8-6627-4947-b2e9-0e12b5dc1e86 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91cb92d00273402b837cb29b37325101', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9f9c44db4984653b8d4b5f6b3b949f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:32:47.263596 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa019cb8-6627-4947-b2e9-0e12b5dc1e86 service neutron] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:32:47.263872 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa019cb8-6627-4947-b2e9-0e12b5dc1e86 service neutron] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:32:47.264144 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa019cb8-6627-4947-b2e9-0e12b5dc1e86 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:32:47.272277 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa019cb8-6627-4947-b2e9-0e12b5dc1e86 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:32:47.273933 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa019cb8-6627-4947-b2e9-0e12b5dc1e86 service neutron] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:32:47.281959 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 1225/2460] 10.222.0.21 () {60 vars in 1365 bytes} [Wed May 4 07:32:47 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 07:32:47.365817 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a581623-8eed-4e19-96ec-9f00d910307f None None] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:32:47.366137 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a581623-8eed-4e19-96ec-9f00d910307f None None] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:32:47.366420 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a581623-8eed-4e19-96ec-9f00d910307f None None] PATH_INFO: `/` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:32:47.367816 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 1236/2461] 10.222.0.21 () {54 vars in 921 bytes} [Wed May 4 07:32:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 07:32:47.372627 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a4e194-47e3-4d78-baeb-e675962e25be None None] REQUEST_METHOD: `POST` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:32:47.372917 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a4e194-47e3-4d78-baeb-e675962e25be None None] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:32:47.373195 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a4e194-47e3-4d78-baeb-e675962e25be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:32:47.393116 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.auth.core [None req-f7a4e194-47e3-4d78-baeb-e675962e25be None None] MFA Rules not processed for user `1077289fedae43b6be47be7f716d573a`. Rule list: `[]` (Enabled: `True`). {{(pid=79745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:32:47.394295 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.fernet_utils [None req-f7a4e194-47e3-4d78-baeb-e675962e25be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:32:47.403768 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 1226/2462] 10.222.0.21 () {58 vars in 1018 bytes} [Wed May 4 07:32:47 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 07:32:47.415025 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a581623-8eed-4e19-96ec-9f00d910307f None None] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:32:47.426974 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a581623-8eed-4e19-96ec-9f00d910307f None None] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:32:47.431602 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef6951e-fdc2-4541-a5f5-9b4834c3dc44 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91cb92d00273402b837cb29b37325101', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9f9c44db4984653b8d4b5f6b3b949f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:32:47.432255 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef6951e-fdc2-4541-a5f5-9b4834c3dc44 service neutron] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:32:47.432628 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef6951e-fdc2-4541-a5f5-9b4834c3dc44 service neutron] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:32:47.433232 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef6951e-fdc2-4541-a5f5-9b4834c3dc44 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:32:47.448840 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef6951e-fdc2-4541-a5f5-9b4834c3dc44 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:32:47.451328 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef6951e-fdc2-4541-a5f5-9b4834c3dc44 service neutron] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:32:47.464529 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 1237/2463] 10.222.0.21 () {60 vars in 1365 bytes} [Wed May 4 07:32:47 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 04 07:33:11.375817 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33e47b1-9084-43c6-9ba4-6f4fcff4e459 None None] REQUEST_METHOD: `POST` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:33:11.375817 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33e47b1-9084-43c6-9ba4-6f4fcff4e459 None None] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:33:11.375817 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33e47b1-9084-43c6-9ba4-6f4fcff4e459 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:33:11.393204 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.auth.core [None req-f33e47b1-9084-43c6-9ba4-6f4fcff4e459 None None] MFA Rules not processed for user `10265d473a5c49e6960740b21114fee1`. Rule list: `[]` (Enabled: `True`). {{(pid=79745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:33:11.394381 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.fernet_utils [None req-f33e47b1-9084-43c6-9ba4-6f4fcff4e459 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:33:11.449818 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 1227/2464] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 07:33:11 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 07:33:12.536521 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef6951e-fdc2-4541-a5f5-9b4834c3dc44 service neutron] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:33:12.537976 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.fernet_utils [None req-2ef6951e-fdc2-4541-a5f5-9b4834c3dc44 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:33:12.605343 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef6951e-fdc2-4541-a5f5-9b4834c3dc44 service neutron] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:33:12.610846 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df1c436-5616-4fcb-bdfb-0465bdca7c56 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef28e980e8664d3eba4304e4589ea2df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9f9c44db4984653b8d4b5f6b3b949f5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:33:12.611472 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df1c436-5616-4fcb-bdfb-0465bdca7c56 service placement] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:33:12.611752 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df1c436-5616-4fcb-bdfb-0465bdca7c56 service placement] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:33:12.612023 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df1c436-5616-4fcb-bdfb-0465bdca7c56 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:33:12.613842 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.fernet_utils [None req-8df1c436-5616-4fcb-bdfb-0465bdca7c56 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:33:12.626563 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df1c436-5616-4fcb-bdfb-0465bdca7c56 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:33:12.628421 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df1c436-5616-4fcb-bdfb-0465bdca7c56 service placement] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:33:12.638208 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 1238/2465] 10.222.0.21 () {60 vars in 1365 bytes} [Wed May 4 07:33:12 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 07:34:06.096715 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097d80e6-bcd0-4fe3-b780-bf28279d3656 None None] REQUEST_METHOD: `POST` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:34:06.097226 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097d80e6-bcd0-4fe3-b780-bf28279d3656 None None] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:34:06.097329 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097d80e6-bcd0-4fe3-b780-bf28279d3656 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:34:06.115882 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.auth.core [None req-097d80e6-bcd0-4fe3-b780-bf28279d3656 None None] MFA Rules not processed for user `704cdbc22849413baa4e0189947ebebc`. Rule list: `[]` (Enabled: `True`). {{(pid=79745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:34:06.117054 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.fernet_utils [None req-097d80e6-bcd0-4fe3-b780-bf28279d3656 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:34:06.170589 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 1228/2466] 10.222.0.21 () {58 vars in 967 bytes} [Wed May 4 07:34:06 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 07:34:06.212194 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df1c436-5616-4fcb-bdfb-0465bdca7c56 service placement] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:34:06.214258 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.fernet_utils [None req-8df1c436-5616-4fcb-bdfb-0465bdca7c56 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:34:06.282640 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df1c436-5616-4fcb-bdfb-0465bdca7c56 service placement] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:34:06.288249 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a6da85-8cda-436f-bb83-c8fb40575f96 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '084c9245d1da4e698c9c3945fa089e85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9f9c44db4984653b8d4b5f6b3b949f5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:34:06.288902 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a6da85-8cda-436f-bb83-c8fb40575f96 service swift] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:34:06.289185 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a6da85-8cda-436f-bb83-c8fb40575f96 service swift] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:34:06.289461 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a6da85-8cda-436f-bb83-c8fb40575f96 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:34:06.298026 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a6da85-8cda-436f-bb83-c8fb40575f96 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:34:06.299633 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a6da85-8cda-436f-bb83-c8fb40575f96 service swift] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:34:06.308566 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 1239/2467] 10.222.0.21 () {60 vars in 1384 bytes} [Wed May 4 07:34:06 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 04 07:34:07.413828 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41038e0f-3e38-49f7-9c25-95bc93f29b2f None None] REQUEST_METHOD: `POST` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:34:07.414319 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41038e0f-3e38-49f7-9c25-95bc93f29b2f None None] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:34:07.414417 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41038e0f-3e38-49f7-9c25-95bc93f29b2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:34:07.434913 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.auth.core [None req-41038e0f-3e38-49f7-9c25-95bc93f29b2f None None] MFA Rules not processed for user `704cdbc22849413baa4e0189947ebebc`. Rule list: `[]` (Enabled: `True`). {{(pid=79745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:34:07.436045 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.fernet_utils [None req-41038e0f-3e38-49f7-9c25-95bc93f29b2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:34:07.447587 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 1229/2468] 10.222.0.21 () {58 vars in 1009 bytes} [Wed May 4 07:34:07 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 07:34:07.457896 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a6da85-8cda-436f-bb83-c8fb40575f96 service swift] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:34:07.468693 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a6da85-8cda-436f-bb83-c8fb40575f96 service swift] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:34:07.473825 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e841d9a1-8d32-4f0d-b689-c7d0104cc54f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '084c9245d1da4e698c9c3945fa089e85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9f9c44db4984653b8d4b5f6b3b949f5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:34:07.474462 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e841d9a1-8d32-4f0d-b689-c7d0104cc54f service swift] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:34:07.474740 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e841d9a1-8d32-4f0d-b689-c7d0104cc54f service swift] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:34:07.475010 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e841d9a1-8d32-4f0d-b689-c7d0104cc54f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:34:07.484120 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e841d9a1-8d32-4f0d-b689-c7d0104cc54f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:34:07.485690 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e841d9a1-8d32-4f0d-b689-c7d0104cc54f service swift] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:34:07.494526 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 1240/2469] 10.222.0.21 () {60 vars in 1384 bytes} [Wed May 4 07:34:07 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 04 07:34:14.815279 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41038e0f-3e38-49f7-9c25-95bc93f29b2f None None] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:34:14.816691 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.fernet_utils [None req-41038e0f-3e38-49f7-9c25-95bc93f29b2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:34:14.840542 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41038e0f-3e38-49f7-9c25-95bc93f29b2f None None] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:34:14.846462 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c5bae8-0c86-4141-9ccc-15ac58c6ba45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:34:14.847765 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c5bae8-0c86-4141-9ccc-15ac58c6ba45 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:34:14.847993 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c5bae8-0c86-4141-9ccc-15ac58c6ba45 admin admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:34:14.848365 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c5bae8-0c86-4141-9ccc-15ac58c6ba45 admin admin] PATH_INFO: `/v3/users/30f3c4305a3a4f7ea60a6e4e6e8b7668` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:34:14.849698 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c5bae8-0c86-4141-9ccc-15ac58c6ba45 admin admin] RBAC: Authorizing `identity:delete_user(user_id=30f3c4305a3a4f7ea60a6e4e6e8b7668)` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:34:14.851760 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c5bae8-0c86-4141-9ccc-15ac58c6ba45 admin admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:34:14.907012 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-e5c5bae8-0c86-4141-9ccc-15ac58c6ba45 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '30f3c4305a3a4f7ea60a6e4e6e8b7668'} {{(pid=79745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:34:14.919411 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-e5c5bae8-0c86-4141-9ccc-15ac58c6ba45 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '30f3c4305a3a4f7ea60a6e4e6e8b7668'} {{(pid=79745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:34:14.920148 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-e5c5bae8-0c86-4141-9ccc-15ac58c6ba45 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '30f3c4305a3a4f7ea60a6e4e6e8b7668'} {{(pid=79745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:34:14.920794 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-e5c5bae8-0c86-4141-9ccc-15ac58c6ba45 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '30f3c4305a3a4f7ea60a6e4e6e8b7668'} {{(pid=79745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:34:14.927877 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-e5c5bae8-0c86-4141-9ccc-15ac58c6ba45 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '30f3c4305a3a4f7ea60a6e4e6e8b7668'} {{(pid=79745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:34:14.941934 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 1230/2470] 10.222.0.21 () {58 vars in 1223 bytes} [Wed May 4 07:34:14 2022] DELETE /identity/v3/users/30f3c4305a3a4f7ea60a6e4e6e8b7668 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 07:34:15.138601 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e841d9a1-8d32-4f0d-b689-c7d0104cc54f service swift] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:34:15.149661 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e841d9a1-8d32-4f0d-b689-c7d0104cc54f service swift] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:34:15.235192 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54e4b4c-8805-421a-bf4c-1161e0a3785a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:34:15.235192 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54e4b4c-8805-421a-bf4c-1161e0a3785a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:34:15.235192 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54e4b4c-8805-421a-bf4c-1161e0a3785a admin admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:34:15.235192 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54e4b4c-8805-421a-bf4c-1161e0a3785a admin admin] PATH_INFO: `/v3/projects/489c922d94f946908770992d288abbe2` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:34:15.235662 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54e4b4c-8805-421a-bf4c-1161e0a3785a admin admin] RBAC: Authorizing `identity:delete_project(project_id=489c922d94f946908770992d288abbe2)` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:34:15.236349 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54e4b4c-8805-421a-bf4c-1161e0a3785a admin admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:34:15.291112 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-d54e4b4c-8805-421a-bf4c-1161e0a3785a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '489c922d94f946908770992d288abbe2', 'request_id': 'req-d54e4b4c-8805-421a-bf4c-1161e0a3785a'} {{(pid=79744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:34:15.299173 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-d54e4b4c-8805-421a-bf4c-1161e0a3785a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '489c922d94f946908770992d288abbe2', 'request_id': 'req-d54e4b4c-8805-421a-bf4c-1161e0a3785a'} {{(pid=79744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:34:15.331439 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-d54e4b4c-8805-421a-bf4c-1161e0a3785a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '489c922d94f946908770992d288abbe2', 'request_id': 'req-d54e4b4c-8805-421a-bf4c-1161e0a3785a'} {{(pid=79744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:34:15.343669 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-d54e4b4c-8805-421a-bf4c-1161e0a3785a admin admin] The token cache is being invalidate because project 489c922d94f946908770992d288abbe2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79744) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 07:34:15.343957 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-d54e4b4c-8805-421a-bf4c-1161e0a3785a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:34:15.344643 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-d54e4b4c-8805-421a-bf4c-1161e0a3785a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:34:15.346417 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 1241/2471] 10.222.0.21 () {58 vars in 1232 bytes} [Wed May 4 07:34:15 2022] DELETE /identity/v3/projects/489c922d94f946908770992d288abbe2 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 07:34:15.350433 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c5bae8-0c86-4141-9ccc-15ac58c6ba45 admin admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:34:15.352009 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.fernet_utils [None req-e5c5bae8-0c86-4141-9ccc-15ac58c6ba45 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:34:15.365529 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c5bae8-0c86-4141-9ccc-15ac58c6ba45 admin admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:34:15.428617 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aea1f2f-6ccf-4dfb-89d1-49993a224616 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:34:15.429493 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aea1f2f-6ccf-4dfb-89d1-49993a224616 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:34:15.429795 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aea1f2f-6ccf-4dfb-89d1-49993a224616 admin admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:34:15.430091 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aea1f2f-6ccf-4dfb-89d1-49993a224616 admin admin] PATH_INFO: `/v3/users/23ddf99780d1472a858b8a3ed550557f` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:34:15.432618 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aea1f2f-6ccf-4dfb-89d1-49993a224616 admin admin] RBAC: Authorizing `identity:delete_user(user_id=23ddf99780d1472a858b8a3ed550557f)` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:34:15.434601 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aea1f2f-6ccf-4dfb-89d1-49993a224616 admin admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:34:15.496758 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-9aea1f2f-6ccf-4dfb-89d1-49993a224616 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '23ddf99780d1472a858b8a3ed550557f'} {{(pid=79745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:34:15.514612 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-9aea1f2f-6ccf-4dfb-89d1-49993a224616 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '23ddf99780d1472a858b8a3ed550557f'} {{(pid=79745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:34:15.515376 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-9aea1f2f-6ccf-4dfb-89d1-49993a224616 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '23ddf99780d1472a858b8a3ed550557f'} {{(pid=79745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:34:15.516038 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-9aea1f2f-6ccf-4dfb-89d1-49993a224616 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '23ddf99780d1472a858b8a3ed550557f'} {{(pid=79745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:34:15.523376 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-9aea1f2f-6ccf-4dfb-89d1-49993a224616 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '23ddf99780d1472a858b8a3ed550557f'} {{(pid=79745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:34:15.541357 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 1231/2472] 10.222.0.21 () {58 vars in 1223 bytes} [Wed May 4 07:34:15 2022] DELETE /identity/v3/users/23ddf99780d1472a858b8a3ed550557f => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 07:34:15.731733 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54e4b4c-8805-421a-bf4c-1161e0a3785a admin admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:34:15.733282 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.fernet_utils [None req-d54e4b4c-8805-421a-bf4c-1161e0a3785a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:34:15.746447 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54e4b4c-8805-421a-bf4c-1161e0a3785a admin admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:34:15.811506 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1acab9e5-77e6-486f-889e-0ff876e399e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:34:15.812509 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acab9e5-77e6-486f-889e-0ff876e399e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:34:15.812780 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acab9e5-77e6-486f-889e-0ff876e399e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:34:15.813046 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acab9e5-77e6-486f-889e-0ff876e399e4 admin admin] PATH_INFO: `/v3/projects/709bfe8332eb47ffb4d03313abeff046` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:34:15.814214 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1acab9e5-77e6-486f-889e-0ff876e399e4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=709bfe8332eb47ffb4d03313abeff046)` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:34:15.816145 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1acab9e5-77e6-486f-889e-0ff876e399e4 admin admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:34:15.865256 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-1acab9e5-77e6-486f-889e-0ff876e399e4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '709bfe8332eb47ffb4d03313abeff046', 'request_id': 'req-1acab9e5-77e6-486f-889e-0ff876e399e4'} {{(pid=79744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:34:15.871507 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-1acab9e5-77e6-486f-889e-0ff876e399e4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '709bfe8332eb47ffb4d03313abeff046', 'request_id': 'req-1acab9e5-77e6-486f-889e-0ff876e399e4'} {{(pid=79744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:34:15.880353 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-1acab9e5-77e6-486f-889e-0ff876e399e4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '709bfe8332eb47ffb4d03313abeff046', 'request_id': 'req-1acab9e5-77e6-486f-889e-0ff876e399e4'} {{(pid=79744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:34:15.892954 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-1acab9e5-77e6-486f-889e-0ff876e399e4 admin admin] The token cache is being invalidate because project 709bfe8332eb47ffb4d03313abeff046 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79744) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 07:34:15.893403 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-1acab9e5-77e6-486f-889e-0ff876e399e4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:34:15.894049 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-1acab9e5-77e6-486f-889e-0ff876e399e4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:34:15.895862 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 1242/2473] 10.222.0.21 () {58 vars in 1232 bytes} [Wed May 4 07:34:15 2022] DELETE /identity/v3/projects/709bfe8332eb47ffb4d03313abeff046 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 07:34:15.900684 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9158de-9959-4029-bdb6-e6434ce53a3a None None] REQUEST_METHOD: `POST` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:34:15.901198 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9158de-9959-4029-bdb6-e6434ce53a3a None None] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:34:15.901300 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9158de-9959-4029-bdb6-e6434ce53a3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:34:15.930301 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.auth.core [None req-6f9158de-9959-4029-bdb6-e6434ce53a3a None None] MFA Rules not processed for user `83c5e0dcb991496ea6dee38384514508`. Rule list: `[]` (Enabled: `True`). {{(pid=79745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:34:15.933298 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.fernet_utils [None req-6f9158de-9959-4029-bdb6-e6434ce53a3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:34:16.005592 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 1232/2474] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 07:34:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 07:34:16.012598 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51040ee4-00e2-47cb-8488-2c45259b3fdb None None] REQUEST_METHOD: `POST` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:34:16.012880 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51040ee4-00e2-47cb-8488-2c45259b3fdb None None] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:34:16.013159 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51040ee4-00e2-47cb-8488-2c45259b3fdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:34:16.034507 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.auth.core [None req-51040ee4-00e2-47cb-8488-2c45259b3fdb None None] MFA Rules not processed for user `83c5e0dcb991496ea6dee38384514508`. Rule list: `[]` (Enabled: `True`). {{(pid=79744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:34:16.035828 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.fernet_utils [None req-51040ee4-00e2-47cb-8488-2c45259b3fdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:34:16.048636 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 1243/2475] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 07:34:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 07:34:16.049558 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9158de-9959-4029-bdb6-e6434ce53a3a None None] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:34:16.061970 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9158de-9959-4029-bdb6-e6434ce53a3a None None] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:34:16.069215 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46400de7-4d36-4aec-a69a-97b5cee74291 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:34:16.069968 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46400de7-4d36-4aec-a69a-97b5cee74291 admin admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:34:16.070333 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46400de7-4d36-4aec-a69a-97b5cee74291 admin admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:34:16.070621 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46400de7-4d36-4aec-a69a-97b5cee74291 admin admin] PATH_INFO: `/v3/domains` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:34:16.071472 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46400de7-4d36-4aec-a69a-97b5cee74291 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 07:34:16.071885 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46400de7-4d36-4aec-a69a-97b5cee74291 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:34:16.073863 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46400de7-4d36-4aec-a69a-97b5cee74291 admin admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:34:16.089149 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 1233/2476] 10.222.0.21 () {58 vars in 1152 bytes} [Wed May 4 07:34:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 07:34:16.092718 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51040ee4-00e2-47cb-8488-2c45259b3fdb None None] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:34:16.105888 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51040ee4-00e2-47cb-8488-2c45259b3fdb None None] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:34:16.112303 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d87235-80ed-41b1-9e26-e76abc8c4fea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:34:16.113113 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d87235-80ed-41b1-9e26-e76abc8c4fea admin admin] REQUEST_METHOD: `POST` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:34:16.113417 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d87235-80ed-41b1-9e26-e76abc8c4fea admin admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:34:16.113764 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d87235-80ed-41b1-9e26-e76abc8c4fea admin admin] PATH_INFO: `/v3/projects` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:34:16.114910 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d87235-80ed-41b1-9e26-e76abc8c4fea admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:34:16.116879 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d87235-80ed-41b1-9e26-e76abc8c4fea admin admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:34:16.144789 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 1244/2477] 10.222.0.21 () {60 vars in 1152 bytes} [Wed May 4 07:34:16 2022] POST /identity/v3/projects => generated 377 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 07:34:16.148861 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46400de7-4d36-4aec-a69a-97b5cee74291 admin admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:34:16.159750 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46400de7-4d36-4aec-a69a-97b5cee74291 admin admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:34:16.218696 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96f4071-de94-4a58-896e-5c12ca9cddfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:34:16.219522 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96f4071-de94-4a58-896e-5c12ca9cddfe admin admin] REQUEST_METHOD: `POST` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:34:16.219833 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96f4071-de94-4a58-896e-5c12ca9cddfe admin admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:34:16.220138 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96f4071-de94-4a58-896e-5c12ca9cddfe admin admin] PATH_INFO: `/v3/users` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:34:16.220841 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96f4071-de94-4a58-896e-5c12ca9cddfe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:34:16.222868 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96f4071-de94-4a58-896e-5c12ca9cddfe admin admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:34:16.244955 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 1234/2478] 10.222.0.21 () {60 vars in 1143 bytes} [Wed May 4 07:34:16 2022] POST /identity/v3/users => generated 289 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 07:34:16.249044 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d87235-80ed-41b1-9e26-e76abc8c4fea admin admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:34:16.259739 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d87235-80ed-41b1-9e26-e76abc8c4fea admin admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:34:16.265005 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f9c5f5-815e-4038-be2e-139fd488859c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:34:16.265664 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f9c5f5-815e-4038-be2e-139fd488859c admin admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:34:16.265943 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f9c5f5-815e-4038-be2e-139fd488859c admin admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:34:16.266213 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f9c5f5-815e-4038-be2e-139fd488859c admin admin] PATH_INFO: `/v3/roles` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:34:16.266927 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f9c5f5-815e-4038-be2e-139fd488859c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:34:16.268611 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f9c5f5-815e-4038-be2e-139fd488859c admin admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:34:16.282957 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 1245/2479] 10.222.0.21 () {58 vars in 1121 bytes} [Wed May 4 07:34:16 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 07:34:16.286914 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96f4071-de94-4a58-896e-5c12ca9cddfe admin admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:34:16.298221 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96f4071-de94-4a58-896e-5c12ca9cddfe admin admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:34:16.302954 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d220743a-2272-45c5-8ee4-46c253b37c01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:34:16.303850 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d220743a-2272-45c5-8ee4-46c253b37c01 admin admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:34:16.304141 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d220743a-2272-45c5-8ee4-46c253b37c01 admin admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:34:16.304462 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d220743a-2272-45c5-8ee4-46c253b37c01 admin admin] PATH_INFO: `/v3/roles` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:34:16.305223 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d220743a-2272-45c5-8ee4-46c253b37c01 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:34:16.307506 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d220743a-2272-45c5-8ee4-46c253b37c01 admin admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:34:16.323934 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 1235/2480] 10.222.0.21 () {58 vars in 1121 bytes} [Wed May 4 07:34:16 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 07:34:16.325938 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f9c5f5-815e-4038-be2e-139fd488859c admin admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:34:16.338268 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f9c5f5-815e-4038-be2e-139fd488859c admin admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:34:16.344029 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a7480a-a6cf-4bd2-ba75-2640c61c2bf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:34:16.345027 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a7480a-a6cf-4bd2-ba75-2640c61c2bf0 admin admin] REQUEST_METHOD: `PUT` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:34:16.345504 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a7480a-a6cf-4bd2-ba75-2640c61c2bf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:34:16.345838 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a7480a-a6cf-4bd2-ba75-2640c61c2bf0 admin admin] PATH_INFO: `/v3/projects/9d6226b93983480291474f504b5b560f/users/098825a2c57749299ee5b9e083dab0d2/roles/9f89c07b05a14f18836116af22cba5f6` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:34:16.372438 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a7480a-a6cf-4bd2-ba75-2640c61c2bf0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9d6226b93983480291474f504b5b560f, user_id=098825a2c57749299ee5b9e083dab0d2, role_id=9f89c07b05a14f18836116af22cba5f6)` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:34:16.375224 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a7480a-a6cf-4bd2-ba75-2640c61c2bf0 admin admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:34:16.396779 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 1246/2481] 10.222.0.21 () {60 vars in 1482 bytes} [Wed May 4 07:34:16 2022] PUT /identity/v3/projects/9d6226b93983480291474f504b5b560f/users/098825a2c57749299ee5b9e083dab0d2/roles/9f89c07b05a14f18836116af22cba5f6 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 07:34:16.402937 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130d1e09-4c44-4a0c-bcdd-529788823448 None None] REQUEST_METHOD: `POST` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:34:16.403301 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130d1e09-4c44-4a0c-bcdd-529788823448 None None] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:34:16.403582 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130d1e09-4c44-4a0c-bcdd-529788823448 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:34:16.423266 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.auth.core [None req-130d1e09-4c44-4a0c-bcdd-529788823448 None None] MFA Rules not processed for user `83c5e0dcb991496ea6dee38384514508`. Rule list: `[]` (Enabled: `True`). {{(pid=79745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:34:16.424637 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.fernet_utils [None req-130d1e09-4c44-4a0c-bcdd-529788823448 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:34:16.506297 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 1236/2482] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 07:34:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 07:34:16.517686 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a7480a-a6cf-4bd2-ba75-2640c61c2bf0 admin admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:34:16.519508 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.fernet_utils [None req-e1a7480a-a6cf-4bd2-ba75-2640c61c2bf0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:34:16.588590 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a7480a-a6cf-4bd2-ba75-2640c61c2bf0 admin admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:34:16.593691 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd051115-e44c-42cb-8853-8eb442303896 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91cb92d00273402b837cb29b37325101', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9f9c44db4984653b8d4b5f6b3b949f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:34:16.594439 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd051115-e44c-42cb-8853-8eb442303896 service neutron] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:34:16.594646 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd051115-e44c-42cb-8853-8eb442303896 service neutron] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:34:16.594915 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd051115-e44c-42cb-8853-8eb442303896 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:34:16.605402 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd051115-e44c-42cb-8853-8eb442303896 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:34:16.606817 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd051115-e44c-42cb-8853-8eb442303896 service neutron] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:34:16.616453 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 1247/2483] 10.222.0.21 () {60 vars in 1365 bytes} [Wed May 4 07:34:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 07:34:21.891979 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130d1e09-4c44-4a0c-bcdd-529788823448 None None] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:34:21.893922 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.fernet_utils [None req-130d1e09-4c44-4a0c-bcdd-529788823448 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:34:21.908837 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130d1e09-4c44-4a0c-bcdd-529788823448 None None] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:34:21.912979 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0117d5-2576-4605-a68b-af2174eb5d77 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91cb92d00273402b837cb29b37325101', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9f9c44db4984653b8d4b5f6b3b949f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:34:21.913629 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0117d5-2576-4605-a68b-af2174eb5d77 service neutron] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:34:21.913905 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0117d5-2576-4605-a68b-af2174eb5d77 service neutron] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:34:21.914174 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0117d5-2576-4605-a68b-af2174eb5d77 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:34:21.916420 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.fernet_utils [None req-fe0117d5-2576-4605-a68b-af2174eb5d77 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:34:21.956461 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd051115-e44c-42cb-8853-8eb442303896 service neutron] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:34:21.967587 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd051115-e44c-42cb-8853-8eb442303896 service neutron] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:34:21.971806 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b7ae73-84e1-4cf9-bf72-24e6b89c54b5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91cb92d00273402b837cb29b37325101', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9f9c44db4984653b8d4b5f6b3b949f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:34:21.972680 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b7ae73-84e1-4cf9-bf72-24e6b89c54b5 service neutron] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:34:21.973139 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b7ae73-84e1-4cf9-bf72-24e6b89c54b5 service neutron] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:34:21.973562 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b7ae73-84e1-4cf9-bf72-24e6b89c54b5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:34:21.975782 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.fernet_utils [None req-18b7ae73-84e1-4cf9-bf72-24e6b89c54b5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:34:22.016116 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0117d5-2576-4605-a68b-af2174eb5d77 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:34:22.017631 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0117d5-2576-4605-a68b-af2174eb5d77 service neutron] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:34:22.036420 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 1237/2484] 10.222.0.21 () {60 vars in 1365 bytes} [Wed May 4 07:34:21 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 07:34:22.085752 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b7ae73-84e1-4cf9-bf72-24e6b89c54b5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:34:22.087415 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b7ae73-84e1-4cf9-bf72-24e6b89c54b5 service neutron] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:34:22.100564 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 1248/2485] 10.222.0.21 () {60 vars in 1365 bytes} [Wed May 4 07:34:21 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 04 07:34:22.636016 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35d509b-541d-4841-b625-7f6ba9efc8e3 None None] REQUEST_METHOD: `POST` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:34:22.636495 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35d509b-541d-4841-b625-7f6ba9efc8e3 None None] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:34:22.637038 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35d509b-541d-4841-b625-7f6ba9efc8e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:34:22.667065 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.auth.core [None req-f35d509b-541d-4841-b625-7f6ba9efc8e3 None None] MFA Rules not processed for user `098825a2c57749299ee5b9e083dab0d2`. Rule list: `[]` (Enabled: `True`). {{(pid=79745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:34:22.668780 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.fernet_utils [None req-f35d509b-541d-4841-b625-7f6ba9efc8e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:34:22.741420 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 1238/2486] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 07:34:22 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 07:34:22.746560 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b7ae73-84e1-4cf9-bf72-24e6b89c54b5 service neutron] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:34:22.757012 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b7ae73-84e1-4cf9-bf72-24e6b89c54b5 service neutron] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:34:22.762147 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516d8a1e-8b15-4d17-bd47-ffc42d7f96be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:34:22.762802 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516d8a1e-8b15-4d17-bd47-ffc42d7f96be admin admin] REQUEST_METHOD: `POST` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:34:22.763108 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516d8a1e-8b15-4d17-bd47-ffc42d7f96be admin admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:34:22.763414 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516d8a1e-8b15-4d17-bd47-ffc42d7f96be admin admin] PATH_INFO: `/v3/projects` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:34:22.764122 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516d8a1e-8b15-4d17-bd47-ffc42d7f96be admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:34:22.766018 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516d8a1e-8b15-4d17-bd47-ffc42d7f96be admin admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:34:22.792284 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 1249/2487] 10.222.0.21 () {60 vars in 1152 bytes} [Wed May 4 07:34:22 2022] POST /identity/v3/projects => generated 379 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 07:34:22.796208 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35d509b-541d-4841-b625-7f6ba9efc8e3 None None] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:34:22.809295 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35d509b-541d-4841-b625-7f6ba9efc8e3 None None] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:34:22.868038 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807a3514-3439-466c-8900-d5cdb2e130a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:34:22.869287 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807a3514-3439-466c-8900-d5cdb2e130a2 admin admin] REQUEST_METHOD: `POST` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:34:22.869567 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807a3514-3439-466c-8900-d5cdb2e130a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:34:22.869840 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807a3514-3439-466c-8900-d5cdb2e130a2 admin admin] PATH_INFO: `/v3/users` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:34:22.870581 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807a3514-3439-466c-8900-d5cdb2e130a2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:34:22.872604 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807a3514-3439-466c-8900-d5cdb2e130a2 admin admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:34:22.898246 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 1239/2488] 10.222.0.21 () {60 vars in 1143 bytes} [Wed May 4 07:34:22 2022] POST /identity/v3/users => generated 296 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 07:34:22.899619 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516d8a1e-8b15-4d17-bd47-ffc42d7f96be admin admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:34:22.910496 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516d8a1e-8b15-4d17-bd47-ffc42d7f96be admin admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:34:22.916050 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212732fe-e209-49ea-9f60-62fb62d503f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:34:22.916734 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212732fe-e209-49ea-9f60-62fb62d503f3 admin admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:34:22.917004 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212732fe-e209-49ea-9f60-62fb62d503f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:34:22.917283 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212732fe-e209-49ea-9f60-62fb62d503f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:34:22.918013 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212732fe-e209-49ea-9f60-62fb62d503f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:34:22.919663 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212732fe-e209-49ea-9f60-62fb62d503f3 admin admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:34:22.930867 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 1250/2489] 10.222.0.21 () {58 vars in 1121 bytes} [Wed May 4 07:34:22 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 07:34:22.935324 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807a3514-3439-466c-8900-d5cdb2e130a2 admin admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:34:22.944971 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807a3514-3439-466c-8900-d5cdb2e130a2 admin admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:34:22.949479 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bc6e62-0313-43bc-b5fb-5f35df9175c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:34:22.950350 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bc6e62-0313-43bc-b5fb-5f35df9175c3 admin admin] REQUEST_METHOD: `PUT` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:34:22.950625 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bc6e62-0313-43bc-b5fb-5f35df9175c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:34:22.950893 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bc6e62-0313-43bc-b5fb-5f35df9175c3 admin admin] PATH_INFO: `/v3/projects/2d33ef8f18b246449cf69fd495cae2d6/users/94949b76d059498f9c3702dd26bb6326/roles/eb54c9cea2774a25b1fe8c79724408ee` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:34:22.965987 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2bc6e62-0313-43bc-b5fb-5f35df9175c3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2d33ef8f18b246449cf69fd495cae2d6, user_id=94949b76d059498f9c3702dd26bb6326, role_id=eb54c9cea2774a25b1fe8c79724408ee)` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:34:22.968807 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2bc6e62-0313-43bc-b5fb-5f35df9175c3 admin admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:34:22.984475 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 1240/2490] 10.222.0.21 () {60 vars in 1482 bytes} [Wed May 4 07:34:22 2022] PUT /identity/v3/projects/2d33ef8f18b246449cf69fd495cae2d6/users/94949b76d059498f9c3702dd26bb6326/roles/eb54c9cea2774a25b1fe8c79724408ee => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 07:34:22.988430 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212732fe-e209-49ea-9f60-62fb62d503f3 admin admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:34:22.999307 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212732fe-e209-49ea-9f60-62fb62d503f3 admin admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:34:23.059580 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26888223-16eb-40e1-a95a-6908abf9f39d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:34:23.060171 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26888223-16eb-40e1-a95a-6908abf9f39d admin admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:34:23.060448 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26888223-16eb-40e1-a95a-6908abf9f39d admin admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:34:23.060719 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26888223-16eb-40e1-a95a-6908abf9f39d admin admin] PATH_INFO: `/v3/roles` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:34:23.061471 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26888223-16eb-40e1-a95a-6908abf9f39d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:34:23.063078 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26888223-16eb-40e1-a95a-6908abf9f39d admin admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:34:23.073252 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 1251/2491] 10.222.0.21 () {58 vars in 1121 bytes} [Wed May 4 07:34:22 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 07:34:23.077359 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bc6e62-0313-43bc-b5fb-5f35df9175c3 admin admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:34:23.087918 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bc6e62-0313-43bc-b5fb-5f35df9175c3 admin admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:34:23.092791 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ccb99a-6176-4c81-9c79-216b0d55beae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:34:23.093688 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ccb99a-6176-4c81-9c79-216b0d55beae admin admin] REQUEST_METHOD: `PUT` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:34:23.093964 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ccb99a-6176-4c81-9c79-216b0d55beae admin admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:34:23.094236 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ccb99a-6176-4c81-9c79-216b0d55beae admin admin] PATH_INFO: `/v3/projects/2d33ef8f18b246449cf69fd495cae2d6/users/94949b76d059498f9c3702dd26bb6326/roles/eb54c9cea2774a25b1fe8c79724408ee` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:34:23.096276 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ccb99a-6176-4c81-9c79-216b0d55beae admin admin] RBAC: Authorizing `identity:create_grant(project_id=2d33ef8f18b246449cf69fd495cae2d6, user_id=94949b76d059498f9c3702dd26bb6326, role_id=eb54c9cea2774a25b1fe8c79724408ee)` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:34:23.099069 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ccb99a-6176-4c81-9c79-216b0d55beae admin admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:34:23.111188 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 1241/2492] 10.222.0.21 () {60 vars in 1482 bytes} [Wed May 4 07:34:23 2022] PUT /identity/v3/projects/2d33ef8f18b246449cf69fd495cae2d6/users/94949b76d059498f9c3702dd26bb6326/roles/eb54c9cea2774a25b1fe8c79724408ee => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 07:34:27.725284 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917a2aa5-ea7f-487a-9f32-2dce7cf5b2ed None None] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:34:27.725769 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917a2aa5-ea7f-487a-9f32-2dce7cf5b2ed None None] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:34:27.725898 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917a2aa5-ea7f-487a-9f32-2dce7cf5b2ed None None] PATH_INFO: `/` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:34:27.727494 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 1252/2493] 10.222.0.21 () {54 vars in 921 bytes} [Wed May 4 07:34:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 07:34:27.734535 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038ddb5c-f1a2-46f1-a746-e46e7c279707 None None] REQUEST_METHOD: `POST` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:34:27.735443 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038ddb5c-f1a2-46f1-a746-e46e7c279707 None None] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:34:27.736014 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038ddb5c-f1a2-46f1-a746-e46e7c279707 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:34:27.762996 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.auth.core [None req-038ddb5c-f1a2-46f1-a746-e46e7c279707 None None] MFA Rules not processed for user `1077289fedae43b6be47be7f716d573a`. Rule list: `[]` (Enabled: `True`). {{(pid=79745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:34:27.768115 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.fernet_utils [None req-038ddb5c-f1a2-46f1-a746-e46e7c279707 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:34:27.943104 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 1242/2494] 10.222.0.21 () {58 vars in 1018 bytes} [Wed May 4 07:34:27 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 07:34:27.966302 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917a2aa5-ea7f-487a-9f32-2dce7cf5b2ed None None] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:34:27.968691 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.fernet_utils [None req-917a2aa5-ea7f-487a-9f32-2dce7cf5b2ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:34:28.059485 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917a2aa5-ea7f-487a-9f32-2dce7cf5b2ed None None] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:34:28.065247 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed11e6f8-11ba-4280-b81a-d35ebb92c713 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7538f5cab3364625a3e909f5f117ef2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9f9c44db4984653b8d4b5f6b3b949f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:34:28.066414 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed11e6f8-11ba-4280-b81a-d35ebb92c713 service glance] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:34:28.066911 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed11e6f8-11ba-4280-b81a-d35ebb92c713 service glance] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:34:28.067559 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed11e6f8-11ba-4280-b81a-d35ebb92c713 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:34:28.081039 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed11e6f8-11ba-4280-b81a-d35ebb92c713 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:34:28.082613 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed11e6f8-11ba-4280-b81a-d35ebb92c713 service glance] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:34:28.097024 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 1253/2495] 10.222.0.21 () {60 vars in 1365 bytes} [Wed May 4 07:34:27 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 07:34:29.189158 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292452c4-4ac3-4f93-8e2e-b1905941010f None None] REQUEST_METHOD: `POST` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:34:29.189788 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292452c4-4ac3-4f93-8e2e-b1905941010f None None] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:34:29.190563 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292452c4-4ac3-4f93-8e2e-b1905941010f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:34:29.265463 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.auth.core [None req-292452c4-4ac3-4f93-8e2e-b1905941010f None None] MFA Rules not processed for user `94949b76d059498f9c3702dd26bb6326`. Rule list: `[]` (Enabled: `True`). {{(pid=79745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:34:29.267141 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.fernet_utils [None req-292452c4-4ac3-4f93-8e2e-b1905941010f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:34:29.373444 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 1243/2496] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 07:34:29 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 07:34:29.384567 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed11e6f8-11ba-4280-b81a-d35ebb92c713 service glance] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:34:29.386298 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.fernet_utils [None req-ed11e6f8-11ba-4280-b81a-d35ebb92c713 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:34:29.400839 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed11e6f8-11ba-4280-b81a-d35ebb92c713 service glance] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:34:29.406488 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18cc3872-7875-438a-99fb-3d8b55cd6753 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1077289fedae43b6be47be7f716d573a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9f9c44db4984653b8d4b5f6b3b949f5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:34:29.407140 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cc3872-7875-438a-99fb-3d8b55cd6753 service nova] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:34:29.407455 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cc3872-7875-438a-99fb-3d8b55cd6753 service nova] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:34:29.407728 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cc3872-7875-438a-99fb-3d8b55cd6753 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:34:29.464812 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18cc3872-7875-438a-99fb-3d8b55cd6753 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:34:29.466369 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18cc3872-7875-438a-99fb-3d8b55cd6753 service nova] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:34:29.475263 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 1254/2497] 10.222.0.21 () {60 vars in 1365 bytes} [Wed May 4 07:34:29 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 07:34:30.929431 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63ea1da-125b-4238-a123-fc4ac526f0d5 None None] REQUEST_METHOD: `POST` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:34:30.929970 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63ea1da-125b-4238-a123-fc4ac526f0d5 None None] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:34:30.930074 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63ea1da-125b-4238-a123-fc4ac526f0d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:34:30.952144 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.auth.core [None req-f63ea1da-125b-4238-a123-fc4ac526f0d5 None None] MFA Rules not processed for user `704cdbc22849413baa4e0189947ebebc`. Rule list: `[]` (Enabled: `True`). {{(pid=79745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:34:30.953668 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.fernet_utils [None req-f63ea1da-125b-4238-a123-fc4ac526f0d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:34:31.039414 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 1244/2498] 10.222.0.21 () {58 vars in 1009 bytes} [Wed May 4 07:34:30 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 07:34:31.050856 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18cc3872-7875-438a-99fb-3d8b55cd6753 service nova] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:34:31.053074 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.fernet_utils [None req-18cc3872-7875-438a-99fb-3d8b55cd6753 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:34:31.154867 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18cc3872-7875-438a-99fb-3d8b55cd6753 service nova] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:34:31.166074 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91d2c34-631b-4383-ab4c-93b515f8cc61 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '084c9245d1da4e698c9c3945fa089e85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9f9c44db4984653b8d4b5f6b3b949f5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:34:31.168193 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91d2c34-631b-4383-ab4c-93b515f8cc61 service swift] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:34:31.168846 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91d2c34-631b-4383-ab4c-93b515f8cc61 service swift] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:34:31.169375 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91d2c34-631b-4383-ab4c-93b515f8cc61 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:34:31.193496 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91d2c34-631b-4383-ab4c-93b515f8cc61 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:34:31.197437 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91d2c34-631b-4383-ab4c-93b515f8cc61 service swift] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:34:31.210624 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 1255/2499] 10.222.0.21 () {60 vars in 1384 bytes} [Wed May 4 07:34:31 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 04 07:34:42.069685 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63ea1da-125b-4238-a123-fc4ac526f0d5 None None] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:34:42.125136 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63ea1da-125b-4238-a123-fc4ac526f0d5 None None] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:34:42.128969 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3dc8e72-77cb-4bbb-b1c7-90e539c9accc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91cb92d00273402b837cb29b37325101', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9f9c44db4984653b8d4b5f6b3b949f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:34:42.129586 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3dc8e72-77cb-4bbb-b1c7-90e539c9accc service neutron] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:34:42.129863 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3dc8e72-77cb-4bbb-b1c7-90e539c9accc service neutron] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:34:42.130133 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3dc8e72-77cb-4bbb-b1c7-90e539c9accc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:34:42.131923 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.fernet_utils [None req-d3dc8e72-77cb-4bbb-b1c7-90e539c9accc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:34:42.190175 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3dc8e72-77cb-4bbb-b1c7-90e539c9accc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:34:42.191690 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3dc8e72-77cb-4bbb-b1c7-90e539c9accc service neutron] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:34:42.200448 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 1245/2500] 10.222.0.21 () {60 vars in 1365 bytes} [Wed May 4 07:34:42 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 07:34:45.184923 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91d2c34-631b-4383-ab4c-93b515f8cc61 service swift] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:34:45.196309 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91d2c34-631b-4383-ab4c-93b515f8cc61 service swift] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:34:45.202059 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfca089-1fb2-4301-9f8a-38a0fec1ba4f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91cb92d00273402b837cb29b37325101', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9f9c44db4984653b8d4b5f6b3b949f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:34:45.202720 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfca089-1fb2-4301-9f8a-38a0fec1ba4f service neutron] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:34:45.203000 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfca089-1fb2-4301-9f8a-38a0fec1ba4f service neutron] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:34:45.203302 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfca089-1fb2-4301-9f8a-38a0fec1ba4f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:34:45.205588 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.fernet_utils [None req-7bfca089-1fb2-4301-9f8a-38a0fec1ba4f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:34:45.217507 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bfca089-1fb2-4301-9f8a-38a0fec1ba4f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:34:45.218861 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bfca089-1fb2-4301-9f8a-38a0fec1ba4f service neutron] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:34:45.228898 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 1256/2501] 10.222.0.21 () {60 vars in 1365 bytes} [Wed May 4 07:34:45 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 07:34:52.810301 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3dc8e72-77cb-4bbb-b1c7-90e539c9accc service neutron] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:34:52.821652 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3dc8e72-77cb-4bbb-b1c7-90e539c9accc service neutron] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:34:52.825959 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955f9eaa-5f0a-41de-b793-d84ae8cdd4ce service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91cb92d00273402b837cb29b37325101', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9f9c44db4984653b8d4b5f6b3b949f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:34:52.826606 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955f9eaa-5f0a-41de-b793-d84ae8cdd4ce service neutron] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:34:52.826885 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955f9eaa-5f0a-41de-b793-d84ae8cdd4ce service neutron] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:34:52.827219 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955f9eaa-5f0a-41de-b793-d84ae8cdd4ce service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:34:52.828997 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.fernet_utils [None req-955f9eaa-5f0a-41de-b793-d84ae8cdd4ce service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:34:52.896242 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955f9eaa-5f0a-41de-b793-d84ae8cdd4ce service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:34:52.897581 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955f9eaa-5f0a-41de-b793-d84ae8cdd4ce service neutron] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:34:52.907751 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 1246/2502] 10.222.0.21 () {60 vars in 1365 bytes} [Wed May 4 07:34:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 07:34:55.195602 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2134ad-62b6-4037-8289-7effc774c5c3 None None] REQUEST_METHOD: `POST` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:34:55.196096 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2134ad-62b6-4037-8289-7effc774c5c3 None None] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:34:55.196096 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2134ad-62b6-4037-8289-7effc774c5c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:34:55.214823 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.auth.core [None req-8a2134ad-62b6-4037-8289-7effc774c5c3 None None] MFA Rules not processed for user `098825a2c57749299ee5b9e083dab0d2`. Rule list: `[]` (Enabled: `True`). {{(pid=79744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:34:55.217728 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.fernet_utils [None req-8a2134ad-62b6-4037-8289-7effc774c5c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:34:55.223543 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 1257/2503] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 07:34:55 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 07:34:55.354354 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbec5242-5ad6-4300-a349-b260e4c005c6 None None] REQUEST_METHOD: `POST` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:34:55.355013 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbec5242-5ad6-4300-a349-b260e4c005c6 None None] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:34:55.355013 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbec5242-5ad6-4300-a349-b260e4c005c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:34:55.382705 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.auth.core [None req-bbec5242-5ad6-4300-a349-b260e4c005c6 None None] MFA Rules not processed for user `704cdbc22849413baa4e0189947ebebc`. Rule list: `[]` (Enabled: `True`). {{(pid=79745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:34:55.386066 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.fernet_utils [None req-bbec5242-5ad6-4300-a349-b260e4c005c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:34:55.404007 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 1247/2504] 10.222.0.21 () {58 vars in 967 bytes} [Wed May 4 07:34:55 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 07:34:55.420134 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2134ad-62b6-4037-8289-7effc774c5c3 None None] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:34:55.449614 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2134ad-62b6-4037-8289-7effc774c5c3 None None] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:34:55.455765 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857d9e25-13f0-4cf5-ac84-f1e845f4bd87 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '084c9245d1da4e698c9c3945fa089e85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9f9c44db4984653b8d4b5f6b3b949f5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:34:55.456697 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857d9e25-13f0-4cf5-ac84-f1e845f4bd87 service swift] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:34:55.457192 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857d9e25-13f0-4cf5-ac84-f1e845f4bd87 service swift] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:34:55.458330 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857d9e25-13f0-4cf5-ac84-f1e845f4bd87 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:34:55.468770 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857d9e25-13f0-4cf5-ac84-f1e845f4bd87 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:34:55.470568 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857d9e25-13f0-4cf5-ac84-f1e845f4bd87 service swift] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:34:55.479256 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 1258/2505] 10.222.0.21 () {60 vars in 1384 bytes} [Wed May 4 07:34:55 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 04 07:34:56.364338 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbec5242-5ad6-4300-a349-b260e4c005c6 None None] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:34:56.370209 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.fernet_utils [None req-bbec5242-5ad6-4300-a349-b260e4c005c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:34:56.521775 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbec5242-5ad6-4300-a349-b260e4c005c6 None None] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:34:56.535074 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17456d3a-e962-4a5a-9b35-07cf786167e7 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef28e980e8664d3eba4304e4589ea2df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9f9c44db4984653b8d4b5f6b3b949f5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:34:56.536057 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17456d3a-e962-4a5a-9b35-07cf786167e7 service placement] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:34:56.536961 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17456d3a-e962-4a5a-9b35-07cf786167e7 service placement] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:34:56.537397 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17456d3a-e962-4a5a-9b35-07cf786167e7 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:34:56.541808 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.fernet_utils [None req-17456d3a-e962-4a5a-9b35-07cf786167e7 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:34:56.563304 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17456d3a-e962-4a5a-9b35-07cf786167e7 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:34:56.566081 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17456d3a-e962-4a5a-9b35-07cf786167e7 service placement] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:34:56.581435 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 1248/2506] 10.222.0.21 () {60 vars in 1365 bytes} [Wed May 4 07:34:56 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 218 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 07:35:00.678899 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857d9e25-13f0-4cf5-ac84-f1e845f4bd87 service swift] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:35:00.680541 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.fernet_utils [None req-857d9e25-13f0-4cf5-ac84-f1e845f4bd87 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:35:00.698212 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857d9e25-13f0-4cf5-ac84-f1e845f4bd87 service swift] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:35:00.702709 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96922520-5e1d-45dc-ae9e-8d049977849b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:35:00.703622 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96922520-5e1d-45dc-ae9e-8d049977849b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:35:00.703897 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96922520-5e1d-45dc-ae9e-8d049977849b admin admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:35:00.704167 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96922520-5e1d-45dc-ae9e-8d049977849b admin admin] PATH_INFO: `/v3/users/d7a13fbe7a9146ad95a9e732ef34eda4` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:35:00.705493 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96922520-5e1d-45dc-ae9e-8d049977849b admin admin] RBAC: Authorizing `identity:delete_user(user_id=d7a13fbe7a9146ad95a9e732ef34eda4)` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:35:00.707550 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96922520-5e1d-45dc-ae9e-8d049977849b admin admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:35:00.753202 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-96922520-5e1d-45dc-ae9e-8d049977849b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd7a13fbe7a9146ad95a9e732ef34eda4'} {{(pid=79744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:35:00.753772 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-96922520-5e1d-45dc-ae9e-8d049977849b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd7a13fbe7a9146ad95a9e732ef34eda4'} {{(pid=79744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:35:00.760520 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-96922520-5e1d-45dc-ae9e-8d049977849b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd7a13fbe7a9146ad95a9e732ef34eda4'} {{(pid=79744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:35:00.761133 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-96922520-5e1d-45dc-ae9e-8d049977849b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd7a13fbe7a9146ad95a9e732ef34eda4'} {{(pid=79744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:35:00.772196 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-96922520-5e1d-45dc-ae9e-8d049977849b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd7a13fbe7a9146ad95a9e732ef34eda4'} {{(pid=79744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:35:00.784829 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 1259/2507] 10.222.0.21 () {58 vars in 1223 bytes} [Wed May 4 07:35:00 2022] DELETE /identity/v3/users/d7a13fbe7a9146ad95a9e732ef34eda4 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 07:35:00.959501 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17456d3a-e962-4a5a-9b35-07cf786167e7 service placement] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:35:00.973297 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17456d3a-e962-4a5a-9b35-07cf786167e7 service placement] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:35:01.045127 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d2c7e5-da7c-4074-9ec0-8e125791a892 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:35:01.046023 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d2c7e5-da7c-4074-9ec0-8e125791a892 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:35:01.046336 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d2c7e5-da7c-4074-9ec0-8e125791a892 admin admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:35:01.046621 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d2c7e5-da7c-4074-9ec0-8e125791a892 admin admin] PATH_INFO: `/v3/projects/9490d418deac48d399051367f238b312` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:35:01.047808 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d2c7e5-da7c-4074-9ec0-8e125791a892 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9490d418deac48d399051367f238b312)` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:35:01.049732 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d2c7e5-da7c-4074-9ec0-8e125791a892 admin admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:35:01.097978 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-c7d2c7e5-da7c-4074-9ec0-8e125791a892 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9490d418deac48d399051367f238b312', 'request_id': 'req-c7d2c7e5-da7c-4074-9ec0-8e125791a892'} {{(pid=79745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:35:01.104368 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-c7d2c7e5-da7c-4074-9ec0-8e125791a892 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9490d418deac48d399051367f238b312', 'request_id': 'req-c7d2c7e5-da7c-4074-9ec0-8e125791a892'} {{(pid=79745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:35:01.111534 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-c7d2c7e5-da7c-4074-9ec0-8e125791a892 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9490d418deac48d399051367f238b312', 'request_id': 'req-c7d2c7e5-da7c-4074-9ec0-8e125791a892'} {{(pid=79745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:35:01.122051 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-c7d2c7e5-da7c-4074-9ec0-8e125791a892 admin admin] The token cache is being invalidate because project 9490d418deac48d399051367f238b312 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79745) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 07:35:01.122336 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-c7d2c7e5-da7c-4074-9ec0-8e125791a892 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:35:01.122948 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-c7d2c7e5-da7c-4074-9ec0-8e125791a892 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:35:01.124493 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 1249/2508] 10.222.0.21 () {58 vars in 1232 bytes} [Wed May 4 07:35:00 2022] DELETE /identity/v3/projects/9490d418deac48d399051367f238b312 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 07:35:01.128705 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96922520-5e1d-45dc-ae9e-8d049977849b admin admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:35:01.130132 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.fernet_utils [None req-96922520-5e1d-45dc-ae9e-8d049977849b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:35:01.142984 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96922520-5e1d-45dc-ae9e-8d049977849b admin admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:35:01.196815 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65140c96-06ad-4ac9-a193-d22d7b4d5a27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:35:01.198236 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65140c96-06ad-4ac9-a193-d22d7b4d5a27 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:35:01.198516 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65140c96-06ad-4ac9-a193-d22d7b4d5a27 admin admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:35:01.198784 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65140c96-06ad-4ac9-a193-d22d7b4d5a27 admin admin] PATH_INFO: `/v3/users/313bcf20c61942fdb55e584b501d48a4` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:35:01.199988 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65140c96-06ad-4ac9-a193-d22d7b4d5a27 admin admin] RBAC: Authorizing `identity:delete_user(user_id=313bcf20c61942fdb55e584b501d48a4)` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:35:01.201873 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65140c96-06ad-4ac9-a193-d22d7b4d5a27 admin admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:35:01.245655 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-65140c96-06ad-4ac9-a193-d22d7b4d5a27 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '313bcf20c61942fdb55e584b501d48a4'} {{(pid=79744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:35:01.246535 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-65140c96-06ad-4ac9-a193-d22d7b4d5a27 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '313bcf20c61942fdb55e584b501d48a4'} {{(pid=79744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:35:01.253751 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-65140c96-06ad-4ac9-a193-d22d7b4d5a27 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '313bcf20c61942fdb55e584b501d48a4'} {{(pid=79744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:35:01.254402 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-65140c96-06ad-4ac9-a193-d22d7b4d5a27 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '313bcf20c61942fdb55e584b501d48a4'} {{(pid=79744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:35:01.266609 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-65140c96-06ad-4ac9-a193-d22d7b4d5a27 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '313bcf20c61942fdb55e584b501d48a4'} {{(pid=79744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:35:01.280599 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 1260/2509] 10.222.0.21 () {58 vars in 1223 bytes} [Wed May 4 07:35:01 2022] DELETE /identity/v3/users/313bcf20c61942fdb55e584b501d48a4 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 07:35:01.456294 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d2c7e5-da7c-4074-9ec0-8e125791a892 admin admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:35:01.457796 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.fernet_utils [None req-c7d2c7e5-da7c-4074-9ec0-8e125791a892 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:35:01.472405 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d2c7e5-da7c-4074-9ec0-8e125791a892 admin admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:35:01.531951 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8777e8d1-e15d-40fe-846c-d1e750afd338 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:35:01.532799 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8777e8d1-e15d-40fe-846c-d1e750afd338 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:35:01.533075 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8777e8d1-e15d-40fe-846c-d1e750afd338 admin admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:35:01.533346 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8777e8d1-e15d-40fe-846c-d1e750afd338 admin admin] PATH_INFO: `/v3/projects/53f0c604ec744193ba812e2ce6647254` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:35:01.534504 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8777e8d1-e15d-40fe-846c-d1e750afd338 admin admin] RBAC: Authorizing `identity:delete_project(project_id=53f0c604ec744193ba812e2ce6647254)` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:35:01.536476 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8777e8d1-e15d-40fe-846c-d1e750afd338 admin admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:35:01.581214 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-8777e8d1-e15d-40fe-846c-d1e750afd338 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '53f0c604ec744193ba812e2ce6647254', 'request_id': 'req-8777e8d1-e15d-40fe-846c-d1e750afd338'} {{(pid=79745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:35:01.587219 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-8777e8d1-e15d-40fe-846c-d1e750afd338 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '53f0c604ec744193ba812e2ce6647254', 'request_id': 'req-8777e8d1-e15d-40fe-846c-d1e750afd338'} {{(pid=79745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:35:01.594930 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-8777e8d1-e15d-40fe-846c-d1e750afd338 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '53f0c604ec744193ba812e2ce6647254', 'request_id': 'req-8777e8d1-e15d-40fe-846c-d1e750afd338'} {{(pid=79745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:35:01.605733 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-8777e8d1-e15d-40fe-846c-d1e750afd338 admin admin] The token cache is being invalidate because project 53f0c604ec744193ba812e2ce6647254 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79745) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 07:35:01.606025 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-8777e8d1-e15d-40fe-846c-d1e750afd338 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:35:01.606655 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-8777e8d1-e15d-40fe-846c-d1e750afd338 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:35:01.608257 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 1250/2510] 10.222.0.21 () {58 vars in 1232 bytes} [Wed May 4 07:35:01 2022] DELETE /identity/v3/projects/53f0c604ec744193ba812e2ce6647254 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 07:35:07.870682 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65140c96-06ad-4ac9-a193-d22d7b4d5a27 admin admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:35:07.872111 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.fernet_utils [None req-65140c96-06ad-4ac9-a193-d22d7b4d5a27 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:35:07.950773 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65140c96-06ad-4ac9-a193-d22d7b4d5a27 admin admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:35:08.046285 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eafda70-67b5-4682-9b35-da025ad6b8ee service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1077289fedae43b6be47be7f716d573a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9f9c44db4984653b8d4b5f6b3b949f5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:35:08.047062 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eafda70-67b5-4682-9b35-da025ad6b8ee service nova] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:35:08.047501 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eafda70-67b5-4682-9b35-da025ad6b8ee service nova] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:35:08.047860 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eafda70-67b5-4682-9b35-da025ad6b8ee service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:35:08.049872 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.fernet_utils [None req-2eafda70-67b5-4682-9b35-da025ad6b8ee service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:35:08.065823 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eafda70-67b5-4682-9b35-da025ad6b8ee service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:35:08.067691 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eafda70-67b5-4682-9b35-da025ad6b8ee service nova] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:35:08.079659 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 1261/2511] 10.222.0.21 () {60 vars in 1365 bytes} [Wed May 4 07:35:07 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 07:35:13.641395 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8777e8d1-e15d-40fe-846c-d1e750afd338 admin admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:35:13.642899 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.fernet_utils [None req-8777e8d1-e15d-40fe-846c-d1e750afd338 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:35:13.699865 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8777e8d1-e15d-40fe-846c-d1e750afd338 admin admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:35:13.703577 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b883b75-9e21-4d86-b330-516667e6af6d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91cb92d00273402b837cb29b37325101', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9f9c44db4984653b8d4b5f6b3b949f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:35:13.704224 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b883b75-9e21-4d86-b330-516667e6af6d service neutron] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:35:13.704500 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b883b75-9e21-4d86-b330-516667e6af6d service neutron] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:35:13.704767 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b883b75-9e21-4d86-b330-516667e6af6d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:35:13.706509 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.fernet_utils [None req-7b883b75-9e21-4d86-b330-516667e6af6d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:35:13.771289 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b883b75-9e21-4d86-b330-516667e6af6d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:35:13.772754 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b883b75-9e21-4d86-b330-516667e6af6d service neutron] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:35:13.783582 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 1251/2512] 10.222.0.21 () {60 vars in 1365 bytes} [Wed May 4 07:35:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 07:35:16.913832 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eafda70-67b5-4682-9b35-da025ad6b8ee service nova] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:35:16.915359 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.fernet_utils [None req-2eafda70-67b5-4682-9b35-da025ad6b8ee service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:35:16.930724 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eafda70-67b5-4682-9b35-da025ad6b8ee service nova] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:35:16.935825 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d4ccc9-b6af-4714-b94d-0be74a80b76a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:35:16.936689 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d4ccc9-b6af-4714-b94d-0be74a80b76a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:35:16.936964 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d4ccc9-b6af-4714-b94d-0be74a80b76a admin admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:35:16.937235 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d4ccc9-b6af-4714-b94d-0be74a80b76a admin admin] PATH_INFO: `/v3/users/10265d473a5c49e6960740b21114fee1` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:35:16.953316 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d4ccc9-b6af-4714-b94d-0be74a80b76a admin admin] RBAC: Authorizing `identity:delete_user(user_id=10265d473a5c49e6960740b21114fee1)` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:35:16.956031 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d4ccc9-b6af-4714-b94d-0be74a80b76a admin admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:35:17.001316 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-90d4ccc9-b6af-4714-b94d-0be74a80b76a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '10265d473a5c49e6960740b21114fee1'} {{(pid=79744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:35:17.001962 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-90d4ccc9-b6af-4714-b94d-0be74a80b76a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '10265d473a5c49e6960740b21114fee1'} {{(pid=79744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:35:17.008782 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-90d4ccc9-b6af-4714-b94d-0be74a80b76a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '10265d473a5c49e6960740b21114fee1'} {{(pid=79744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:35:17.009502 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-90d4ccc9-b6af-4714-b94d-0be74a80b76a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '10265d473a5c49e6960740b21114fee1'} {{(pid=79744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:35:17.020901 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-90d4ccc9-b6af-4714-b94d-0be74a80b76a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '10265d473a5c49e6960740b21114fee1'} {{(pid=79744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:35:17.034688 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 1262/2513] 10.222.0.21 () {58 vars in 1223 bytes} [Wed May 4 07:35:16 2022] DELETE /identity/v3/users/10265d473a5c49e6960740b21114fee1 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 07:35:17.211963 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b883b75-9e21-4d86-b330-516667e6af6d service neutron] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:35:17.222576 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b883b75-9e21-4d86-b330-516667e6af6d service neutron] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:35:17.285351 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2dbc453-671a-4ecf-9a08-3892cbbe6627 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:35:17.286207 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dbc453-671a-4ecf-9a08-3892cbbe6627 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:35:17.286487 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dbc453-671a-4ecf-9a08-3892cbbe6627 admin admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:35:17.286760 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dbc453-671a-4ecf-9a08-3892cbbe6627 admin admin] PATH_INFO: `/v3/projects/0f0c5ea01f6041f8a293df107ceb208e` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:35:17.297305 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2dbc453-671a-4ecf-9a08-3892cbbe6627 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0f0c5ea01f6041f8a293df107ceb208e)` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:35:17.299252 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2dbc453-671a-4ecf-9a08-3892cbbe6627 admin admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:35:17.343316 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-d2dbc453-671a-4ecf-9a08-3892cbbe6627 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0f0c5ea01f6041f8a293df107ceb208e', 'request_id': 'req-d2dbc453-671a-4ecf-9a08-3892cbbe6627'} {{(pid=79745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:35:17.349604 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-d2dbc453-671a-4ecf-9a08-3892cbbe6627 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0f0c5ea01f6041f8a293df107ceb208e', 'request_id': 'req-d2dbc453-671a-4ecf-9a08-3892cbbe6627'} {{(pid=79745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:35:17.357406 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-d2dbc453-671a-4ecf-9a08-3892cbbe6627 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0f0c5ea01f6041f8a293df107ceb208e', 'request_id': 'req-d2dbc453-671a-4ecf-9a08-3892cbbe6627'} {{(pid=79745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:35:17.367216 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-d2dbc453-671a-4ecf-9a08-3892cbbe6627 admin admin] The token cache is being invalidate because project 0f0c5ea01f6041f8a293df107ceb208e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79745) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 07:35:17.367498 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-d2dbc453-671a-4ecf-9a08-3892cbbe6627 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:35:17.368112 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-d2dbc453-671a-4ecf-9a08-3892cbbe6627 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:35:17.369663 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 1252/2514] 10.222.0.21 () {58 vars in 1232 bytes} [Wed May 4 07:35:17 2022] DELETE /identity/v3/projects/0f0c5ea01f6041f8a293df107ceb208e => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 07:35:17.374592 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2862eab8-36ea-480c-b894-7349bbe90276 None None] REQUEST_METHOD: `POST` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:35:17.374897 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2862eab8-36ea-480c-b894-7349bbe90276 None None] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:35:17.375169 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2862eab8-36ea-480c-b894-7349bbe90276 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:35:17.394088 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.auth.core [None req-2862eab8-36ea-480c-b894-7349bbe90276 None None] MFA Rules not processed for user `83c5e0dcb991496ea6dee38384514508`. Rule list: `[]` (Enabled: `True`). {{(pid=79744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:35:17.395309 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.fernet_utils [None req-2862eab8-36ea-480c-b894-7349bbe90276 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:35:17.453890 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 1263/2515] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 07:35:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 07:35:17.461543 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70588c13-ebf4-4674-a665-d5a23229c94c None None] REQUEST_METHOD: `POST` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:35:17.461834 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70588c13-ebf4-4674-a665-d5a23229c94c None None] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:35:17.462111 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70588c13-ebf4-4674-a665-d5a23229c94c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:35:17.480812 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.auth.core [None req-70588c13-ebf4-4674-a665-d5a23229c94c None None] MFA Rules not processed for user `83c5e0dcb991496ea6dee38384514508`. Rule list: `[]` (Enabled: `True`). {{(pid=79745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:35:17.482009 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.fernet_utils [None req-70588c13-ebf4-4674-a665-d5a23229c94c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:35:17.489811 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 1253/2516] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 07:35:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 07:35:17.493868 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2862eab8-36ea-480c-b894-7349bbe90276 None None] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:35:17.503683 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2862eab8-36ea-480c-b894-7349bbe90276 None None] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:35:17.508249 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c4c039-f098-48f7-8fb5-e676d07c9992 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:35:17.508888 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c4c039-f098-48f7-8fb5-e676d07c9992 admin admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:35:17.509731 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c4c039-f098-48f7-8fb5-e676d07c9992 admin admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:35:17.509952 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c4c039-f098-48f7-8fb5-e676d07c9992 admin admin] PATH_INFO: `/v3/domains` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:35:17.510674 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c4c039-f098-48f7-8fb5-e676d07c9992 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79744) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 07:35:17.510980 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c4c039-f098-48f7-8fb5-e676d07c9992 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:35:17.512600 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c4c039-f098-48f7-8fb5-e676d07c9992 admin admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:35:17.523683 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 1264/2517] 10.222.0.21 () {58 vars in 1152 bytes} [Wed May 4 07:35:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 07:35:17.528629 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70588c13-ebf4-4674-a665-d5a23229c94c None None] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:35:17.537569 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70588c13-ebf4-4674-a665-d5a23229c94c None None] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:35:17.542719 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38c6b69-c424-4aed-9345-0747e3246acd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:35:17.543389 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38c6b69-c424-4aed-9345-0747e3246acd admin admin] REQUEST_METHOD: `POST` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:35:17.543671 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38c6b69-c424-4aed-9345-0747e3246acd admin admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:35:17.543944 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38c6b69-c424-4aed-9345-0747e3246acd admin admin] PATH_INFO: `/v3/projects` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:35:17.544625 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38c6b69-c424-4aed-9345-0747e3246acd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:35:17.546511 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38c6b69-c424-4aed-9345-0747e3246acd admin admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:35:17.570960 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 1254/2518] 10.222.0.21 () {60 vars in 1152 bytes} [Wed May 4 07:35:17 2022] POST /identity/v3/projects => generated 383 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 07:35:17.575712 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c4c039-f098-48f7-8fb5-e676d07c9992 admin admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:35:17.586260 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c4c039-f098-48f7-8fb5-e676d07c9992 admin admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:35:17.642694 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371efe83-3c44-44ac-bd4b-43503b099c4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:35:17.643392 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371efe83-3c44-44ac-bd4b-43503b099c4b admin admin] REQUEST_METHOD: `POST` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:35:17.643697 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371efe83-3c44-44ac-bd4b-43503b099c4b admin admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:35:17.643963 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371efe83-3c44-44ac-bd4b-43503b099c4b admin admin] PATH_INFO: `/v3/users` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:35:17.644636 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371efe83-3c44-44ac-bd4b-43503b099c4b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:35:17.646560 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371efe83-3c44-44ac-bd4b-43503b099c4b admin admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:35:17.667104 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 1265/2519] 10.222.0.21 () {60 vars in 1143 bytes} [Wed May 4 07:35:17 2022] POST /identity/v3/users => generated 292 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 07:35:17.671687 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38c6b69-c424-4aed-9345-0747e3246acd admin admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:35:17.682756 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38c6b69-c424-4aed-9345-0747e3246acd admin admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:35:17.687989 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75916104-564d-40bf-a21f-2345f96e0d45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:35:17.688647 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75916104-564d-40bf-a21f-2345f96e0d45 admin admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:35:17.688927 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75916104-564d-40bf-a21f-2345f96e0d45 admin admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:35:17.689201 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75916104-564d-40bf-a21f-2345f96e0d45 admin admin] PATH_INFO: `/v3/roles` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:35:17.689917 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75916104-564d-40bf-a21f-2345f96e0d45 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:35:17.691573 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75916104-564d-40bf-a21f-2345f96e0d45 admin admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:35:17.702509 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 1255/2520] 10.222.0.21 () {58 vars in 1121 bytes} [Wed May 4 07:35:17 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 07:35:17.706742 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371efe83-3c44-44ac-bd4b-43503b099c4b admin admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:35:17.717074 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371efe83-3c44-44ac-bd4b-43503b099c4b admin admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:35:17.721954 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd45c316-bb30-4b3e-931e-ddd785afbf1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:35:17.722608 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd45c316-bb30-4b3e-931e-ddd785afbf1f admin admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:35:17.722886 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd45c316-bb30-4b3e-931e-ddd785afbf1f admin admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:35:17.723231 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd45c316-bb30-4b3e-931e-ddd785afbf1f admin admin] PATH_INFO: `/v3/roles` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:35:17.723920 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd45c316-bb30-4b3e-931e-ddd785afbf1f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:35:17.725483 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd45c316-bb30-4b3e-931e-ddd785afbf1f admin admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:35:17.735906 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 1266/2521] 10.222.0.21 () {58 vars in 1121 bytes} [Wed May 4 07:35:17 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 07:35:17.739672 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75916104-564d-40bf-a21f-2345f96e0d45 admin admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:35:17.750559 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75916104-564d-40bf-a21f-2345f96e0d45 admin admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:35:17.755413 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c7f5ed-2767-4484-b4c9-69d96e01722f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:35:17.756276 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c7f5ed-2767-4484-b4c9-69d96e01722f admin admin] REQUEST_METHOD: `PUT` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:35:17.756558 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c7f5ed-2767-4484-b4c9-69d96e01722f admin admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:35:17.756858 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c7f5ed-2767-4484-b4c9-69d96e01722f admin admin] PATH_INFO: `/v3/projects/56c2f4f9561749bda0659889cb8ef4b8/users/e41c04a23d3a441c8340ad5e41c3ff74/roles/9f89c07b05a14f18836116af22cba5f6` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:35:17.771488 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c7f5ed-2767-4484-b4c9-69d96e01722f admin admin] RBAC: Authorizing `identity:create_grant(project_id=56c2f4f9561749bda0659889cb8ef4b8, user_id=e41c04a23d3a441c8340ad5e41c3ff74, role_id=9f89c07b05a14f18836116af22cba5f6)` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:35:17.774115 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c7f5ed-2767-4484-b4c9-69d96e01722f admin admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:35:17.787249 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 1256/2522] 10.222.0.21 () {60 vars in 1482 bytes} [Wed May 4 07:35:17 2022] PUT /identity/v3/projects/56c2f4f9561749bda0659889cb8ef4b8/users/e41c04a23d3a441c8340ad5e41c3ff74/roles/9f89c07b05a14f18836116af22cba5f6 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 07:35:17.797288 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa85f5c2-e707-47c4-87e1-786daafbd28b None None] REQUEST_METHOD: `POST` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:35:17.797645 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa85f5c2-e707-47c4-87e1-786daafbd28b None None] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:35:17.797928 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa85f5c2-e707-47c4-87e1-786daafbd28b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:35:17.824026 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.auth.core [None req-fa85f5c2-e707-47c4-87e1-786daafbd28b None None] MFA Rules not processed for user `e41c04a23d3a441c8340ad5e41c3ff74`. Rule list: `[]` (Enabled: `True`). {{(pid=79744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:35:17.825204 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.fernet_utils [None req-fa85f5c2-e707-47c4-87e1-786daafbd28b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:35:17.887300 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 1267/2523] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 07:35:17 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 07:35:17.898074 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c7f5ed-2767-4484-b4c9-69d96e01722f admin admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:35:17.900412 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.fernet_utils [None req-02c7f5ed-2767-4484-b4c9-69d96e01722f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:35:17.976549 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c7f5ed-2767-4484-b4c9-69d96e01722f admin admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:35:17.982307 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0249b0f5-ad7e-4085-bbb0-90082ca7653a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1077289fedae43b6be47be7f716d573a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9f9c44db4984653b8d4b5f6b3b949f5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:35:17.982966 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0249b0f5-ad7e-4085-bbb0-90082ca7653a service nova] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:35:17.983275 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0249b0f5-ad7e-4085-bbb0-90082ca7653a service nova] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:35:17.983550 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0249b0f5-ad7e-4085-bbb0-90082ca7653a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:35:17.991548 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0249b0f5-ad7e-4085-bbb0-90082ca7653a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:35:17.993135 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0249b0f5-ad7e-4085-bbb0-90082ca7653a service nova] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:35:18.002906 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 1257/2524] 10.222.0.21 () {60 vars in 1365 bytes} [Wed May 4 07:35:17 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 07:35:18.248020 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa85f5c2-e707-47c4-87e1-786daafbd28b None None] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:35:18.249992 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.fernet_utils [None req-fa85f5c2-e707-47c4-87e1-786daafbd28b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:35:18.313188 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa85f5c2-e707-47c4-87e1-786daafbd28b None None] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:35:18.316965 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84004500-2f43-470d-9567-b9d9f1f70526 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91cb92d00273402b837cb29b37325101', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9f9c44db4984653b8d4b5f6b3b949f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:35:18.317646 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84004500-2f43-470d-9567-b9d9f1f70526 service neutron] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:35:18.317922 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84004500-2f43-470d-9567-b9d9f1f70526 service neutron] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:35:18.318194 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84004500-2f43-470d-9567-b9d9f1f70526 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:35:18.320031 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.fernet_utils [None req-84004500-2f43-470d-9567-b9d9f1f70526 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:35:18.389531 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84004500-2f43-470d-9567-b9d9f1f70526 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:35:18.391062 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84004500-2f43-470d-9567-b9d9f1f70526 service neutron] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:35:18.400591 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 1268/2525] 10.222.0.21 () {60 vars in 1365 bytes} [Wed May 4 07:35:18 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 07:35:27.392832 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0249b0f5-ad7e-4085-bbb0-90082ca7653a service nova] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:35:27.452806 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0249b0f5-ad7e-4085-bbb0-90082ca7653a service nova] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:35:27.457516 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180da656-2bf6-466e-99f1-a59a91c5fdec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:35:27.458371 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180da656-2bf6-466e-99f1-a59a91c5fdec admin admin] REQUEST_METHOD: `DELETE` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:35:27.458646 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180da656-2bf6-466e-99f1-a59a91c5fdec admin admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:35:27.458938 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180da656-2bf6-466e-99f1-a59a91c5fdec admin admin] PATH_INFO: `/v3/users/e41c04a23d3a441c8340ad5e41c3ff74` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:35:27.460144 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180da656-2bf6-466e-99f1-a59a91c5fdec admin admin] RBAC: Authorizing `identity:delete_user(user_id=e41c04a23d3a441c8340ad5e41c3ff74)` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:35:27.462074 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180da656-2bf6-466e-99f1-a59a91c5fdec admin admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:35:27.511449 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-180da656-2bf6-466e-99f1-a59a91c5fdec admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e41c04a23d3a441c8340ad5e41c3ff74'} {{(pid=79745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:35:27.523286 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-180da656-2bf6-466e-99f1-a59a91c5fdec admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e41c04a23d3a441c8340ad5e41c3ff74'} {{(pid=79745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:35:27.523958 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-180da656-2bf6-466e-99f1-a59a91c5fdec admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e41c04a23d3a441c8340ad5e41c3ff74'} {{(pid=79745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:35:27.524557 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-180da656-2bf6-466e-99f1-a59a91c5fdec admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e41c04a23d3a441c8340ad5e41c3ff74'} {{(pid=79745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:35:27.531380 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-180da656-2bf6-466e-99f1-a59a91c5fdec admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e41c04a23d3a441c8340ad5e41c3ff74'} {{(pid=79745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:35:27.548261 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 1258/2526] 10.222.0.21 () {58 vars in 1223 bytes} [Wed May 4 07:35:27 2022] DELETE /identity/v3/users/e41c04a23d3a441c8340ad5e41c3ff74 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 07:35:27.552913 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a98512-801c-4a94-9af9-3dec182f5c33 None None] REQUEST_METHOD: `POST` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:35:27.553432 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a98512-801c-4a94-9af9-3dec182f5c33 None None] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:35:27.553550 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a98512-801c-4a94-9af9-3dec182f5c33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:35:27.572690 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.auth.core [None req-97a98512-801c-4a94-9af9-3dec182f5c33 None None] MFA Rules not processed for user `83c5e0dcb991496ea6dee38384514508`. Rule list: `[]` (Enabled: `True`). {{(pid=79744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:35:27.573873 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.fernet_utils [None req-97a98512-801c-4a94-9af9-3dec182f5c33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:35:27.632664 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 1269/2527] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 07:35:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 07:35:27.642666 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180da656-2bf6-466e-99f1-a59a91c5fdec admin admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:35:27.644082 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.fernet_utils [None req-180da656-2bf6-466e-99f1-a59a91c5fdec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:35:27.701291 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180da656-2bf6-466e-99f1-a59a91c5fdec admin admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:35:27.704992 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac091c0-b92d-4544-9e0f-fa47b3ee0460 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91cb92d00273402b837cb29b37325101', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9f9c44db4984653b8d4b5f6b3b949f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:35:27.705657 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac091c0-b92d-4544-9e0f-fa47b3ee0460 service neutron] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:35:27.705940 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac091c0-b92d-4544-9e0f-fa47b3ee0460 service neutron] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:35:27.706212 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac091c0-b92d-4544-9e0f-fa47b3ee0460 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:35:27.716795 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac091c0-b92d-4544-9e0f-fa47b3ee0460 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:35:27.718230 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac091c0-b92d-4544-9e0f-fa47b3ee0460 service neutron] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:35:27.729375 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 1259/2528] 10.222.0.21 () {60 vars in 1365 bytes} [Wed May 4 07:35:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 07:35:28.002790 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a98512-801c-4a94-9af9-3dec182f5c33 None None] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:35:28.004380 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.fernet_utils [None req-97a98512-801c-4a94-9af9-3dec182f5c33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:35:28.017026 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a98512-801c-4a94-9af9-3dec182f5c33 None None] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:35:28.021777 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df73ce4d-585a-494d-a395-3da062a89f8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:35:28.022643 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df73ce4d-585a-494d-a395-3da062a89f8b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:35:28.022922 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df73ce4d-585a-494d-a395-3da062a89f8b admin admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:35:28.023218 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df73ce4d-585a-494d-a395-3da062a89f8b admin admin] PATH_INFO: `/v3/projects/56c2f4f9561749bda0659889cb8ef4b8` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:35:28.024413 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df73ce4d-585a-494d-a395-3da062a89f8b admin admin] RBAC: Authorizing `identity:delete_project(project_id=56c2f4f9561749bda0659889cb8ef4b8)` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:35:28.027178 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df73ce4d-585a-494d-a395-3da062a89f8b admin admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:35:28.076064 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-df73ce4d-585a-494d-a395-3da062a89f8b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '56c2f4f9561749bda0659889cb8ef4b8', 'request_id': 'req-df73ce4d-585a-494d-a395-3da062a89f8b'} {{(pid=79744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:35:28.081259 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-df73ce4d-585a-494d-a395-3da062a89f8b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '56c2f4f9561749bda0659889cb8ef4b8', 'request_id': 'req-df73ce4d-585a-494d-a395-3da062a89f8b'} {{(pid=79744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:35:28.089220 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-df73ce4d-585a-494d-a395-3da062a89f8b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '56c2f4f9561749bda0659889cb8ef4b8', 'request_id': 'req-df73ce4d-585a-494d-a395-3da062a89f8b'} {{(pid=79744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:35:28.100007 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-df73ce4d-585a-494d-a395-3da062a89f8b admin admin] The token cache is being invalidate because project 56c2f4f9561749bda0659889cb8ef4b8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79744) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 07:35:28.100294 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-df73ce4d-585a-494d-a395-3da062a89f8b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:35:28.100919 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-df73ce4d-585a-494d-a395-3da062a89f8b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:35:28.102475 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 1270/2529] 10.222.0.21 () {58 vars in 1232 bytes} [Wed May 4 07:35:28 2022] DELETE /identity/v3/projects/56c2f4f9561749bda0659889cb8ef4b8 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 07:35:28.108209 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12731462-b2a5-433e-abb2-bb0ed7a6bc73 None None] REQUEST_METHOD: `POST` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:35:28.108497 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12731462-b2a5-433e-abb2-bb0ed7a6bc73 None None] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:35:28.108771 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12731462-b2a5-433e-abb2-bb0ed7a6bc73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:35:28.126453 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.auth.core [None req-12731462-b2a5-433e-abb2-bb0ed7a6bc73 None None] MFA Rules not processed for user `83c5e0dcb991496ea6dee38384514508`. Rule list: `[]` (Enabled: `True`). {{(pid=79745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:35:28.127928 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.fernet_utils [None req-12731462-b2a5-433e-abb2-bb0ed7a6bc73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:35:28.187556 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 1260/2530] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 07:35:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 07:35:28.198334 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3072223-3a11-49a5-a3dd-656eab652ef4 None None] REQUEST_METHOD: `POST` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:35:28.198617 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3072223-3a11-49a5-a3dd-656eab652ef4 None None] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:35:28.198891 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3072223-3a11-49a5-a3dd-656eab652ef4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:35:28.217705 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.auth.core [None req-e3072223-3a11-49a5-a3dd-656eab652ef4 None None] MFA Rules not processed for user `83c5e0dcb991496ea6dee38384514508`. Rule list: `[]` (Enabled: `True`). {{(pid=79744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:35:28.218897 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.fernet_utils [None req-e3072223-3a11-49a5-a3dd-656eab652ef4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:35:28.226982 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 1271/2531] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 07:35:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 07:35:28.231174 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12731462-b2a5-433e-abb2-bb0ed7a6bc73 None None] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:35:28.241436 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12731462-b2a5-433e-abb2-bb0ed7a6bc73 None None] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:35:28.246283 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7822d2bc-bf21-4332-87fe-f390cee909a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:35:28.246908 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7822d2bc-bf21-4332-87fe-f390cee909a5 admin admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:35:28.247210 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7822d2bc-bf21-4332-87fe-f390cee909a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:35:28.247482 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7822d2bc-bf21-4332-87fe-f390cee909a5 admin admin] PATH_INFO: `/v3/domains` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:35:28.248193 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7822d2bc-bf21-4332-87fe-f390cee909a5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 07:35:28.248499 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7822d2bc-bf21-4332-87fe-f390cee909a5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:35:28.250107 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7822d2bc-bf21-4332-87fe-f390cee909a5 admin admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:35:28.262377 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 1261/2532] 10.222.0.21 () {58 vars in 1152 bytes} [Wed May 4 07:35:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 07:35:28.267513 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3072223-3a11-49a5-a3dd-656eab652ef4 None None] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:35:28.278299 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3072223-3a11-49a5-a3dd-656eab652ef4 None None] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:35:28.283403 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ad7f7a-abb9-4854-93bb-f923912183ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:35:28.284045 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ad7f7a-abb9-4854-93bb-f923912183ed admin admin] REQUEST_METHOD: `POST` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:35:28.284317 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ad7f7a-abb9-4854-93bb-f923912183ed admin admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:35:28.284583 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ad7f7a-abb9-4854-93bb-f923912183ed admin admin] PATH_INFO: `/v3/projects` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:35:28.285268 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ad7f7a-abb9-4854-93bb-f923912183ed admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:35:28.287190 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ad7f7a-abb9-4854-93bb-f923912183ed admin admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:35:28.313010 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 1272/2533] 10.222.0.21 () {60 vars in 1152 bytes} [Wed May 4 07:35:28 2022] POST /identity/v3/projects => generated 371 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 07:35:28.317110 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7822d2bc-bf21-4332-87fe-f390cee909a5 admin admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:35:28.327541 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7822d2bc-bf21-4332-87fe-f390cee909a5 admin admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:35:28.388341 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5f195e-992a-4666-a696-f951c0d77d20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:35:28.389046 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5f195e-992a-4666-a696-f951c0d77d20 admin admin] REQUEST_METHOD: `POST` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:35:28.389387 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5f195e-992a-4666-a696-f951c0d77d20 admin admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:35:28.389702 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5f195e-992a-4666-a696-f951c0d77d20 admin admin] PATH_INFO: `/v3/users` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:35:28.390461 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5f195e-992a-4666-a696-f951c0d77d20 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:35:28.392618 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5f195e-992a-4666-a696-f951c0d77d20 admin admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:35:28.413302 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 1262/2534] 10.222.0.21 () {60 vars in 1143 bytes} [Wed May 4 07:35:28 2022] POST /identity/v3/users => generated 286 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 07:35:28.417547 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ad7f7a-abb9-4854-93bb-f923912183ed admin admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:35:28.427537 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ad7f7a-abb9-4854-93bb-f923912183ed admin admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:35:28.432704 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76cdfd86-86a1-4ccf-9d13-7dc85c396f68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:35:28.433345 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cdfd86-86a1-4ccf-9d13-7dc85c396f68 admin admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:35:28.433624 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cdfd86-86a1-4ccf-9d13-7dc85c396f68 admin admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:35:28.433888 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cdfd86-86a1-4ccf-9d13-7dc85c396f68 admin admin] PATH_INFO: `/v3/roles` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:35:28.434606 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76cdfd86-86a1-4ccf-9d13-7dc85c396f68 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:35:28.436211 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76cdfd86-86a1-4ccf-9d13-7dc85c396f68 admin admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:35:28.447960 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 1273/2535] 10.222.0.21 () {58 vars in 1121 bytes} [Wed May 4 07:35:28 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 07:35:28.452105 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5f195e-992a-4666-a696-f951c0d77d20 admin admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:35:28.463175 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5f195e-992a-4666-a696-f951c0d77d20 admin admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:35:28.468098 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3adb04e-a062-46de-9c00-66a4b0693bb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:35:28.468743 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3adb04e-a062-46de-9c00-66a4b0693bb4 admin admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:35:28.469016 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3adb04e-a062-46de-9c00-66a4b0693bb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:35:28.469282 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3adb04e-a062-46de-9c00-66a4b0693bb4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:35:28.470026 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3adb04e-a062-46de-9c00-66a4b0693bb4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:35:28.471637 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3adb04e-a062-46de-9c00-66a4b0693bb4 admin admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:35:28.481366 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 1263/2536] 10.222.0.21 () {58 vars in 1121 bytes} [Wed May 4 07:35:28 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 07:35:28.486231 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76cdfd86-86a1-4ccf-9d13-7dc85c396f68 admin admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:35:28.496717 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76cdfd86-86a1-4ccf-9d13-7dc85c396f68 admin admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:35:28.501427 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c931881-366f-4764-850d-f867abb44bca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:35:28.502531 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c931881-366f-4764-850d-f867abb44bca admin admin] REQUEST_METHOD: `PUT` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:35:28.502807 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c931881-366f-4764-850d-f867abb44bca admin admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:35:28.503077 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c931881-366f-4764-850d-f867abb44bca admin admin] PATH_INFO: `/v3/projects/ecd568dc6d7d48c189316a5a6746cd26/users/34fa7afa24474c1c9ed54e3a77436c11/roles/9f89c07b05a14f18836116af22cba5f6` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:35:28.519428 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c931881-366f-4764-850d-f867abb44bca admin admin] RBAC: Authorizing `identity:create_grant(project_id=ecd568dc6d7d48c189316a5a6746cd26, user_id=34fa7afa24474c1c9ed54e3a77436c11, role_id=9f89c07b05a14f18836116af22cba5f6)` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:35:28.522116 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c931881-366f-4764-850d-f867abb44bca admin admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:35:28.536056 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 1274/2537] 10.222.0.21 () {60 vars in 1482 bytes} [Wed May 4 07:35:28 2022] PUT /identity/v3/projects/ecd568dc6d7d48c189316a5a6746cd26/users/34fa7afa24474c1c9ed54e3a77436c11/roles/9f89c07b05a14f18836116af22cba5f6 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 07:35:28.546606 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e952b6-d6b3-4aee-b2c0-9132e359e2a1 None None] REQUEST_METHOD: `POST` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:35:28.546891 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e952b6-d6b3-4aee-b2c0-9132e359e2a1 None None] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:35:28.547242 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e952b6-d6b3-4aee-b2c0-9132e359e2a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:35:28.575621 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.auth.core [None req-e5e952b6-d6b3-4aee-b2c0-9132e359e2a1 None None] MFA Rules not processed for user `34fa7afa24474c1c9ed54e3a77436c11`. Rule list: `[]` (Enabled: `True`). {{(pid=79745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:35:28.576867 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.fernet_utils [None req-e5e952b6-d6b3-4aee-b2c0-9132e359e2a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:35:28.638586 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 1264/2538] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 07:35:28 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 07:35:28.643137 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c931881-366f-4764-850d-f867abb44bca admin admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:35:28.703575 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c931881-366f-4764-850d-f867abb44bca admin admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:35:28.708158 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe1c167-cce6-4c33-a70e-d1e46ffecbdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:35:28.708812 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe1c167-cce6-4c33-a70e-d1e46ffecbdb admin admin] REQUEST_METHOD: `POST` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:35:28.709089 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe1c167-cce6-4c33-a70e-d1e46ffecbdb admin admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:35:28.709462 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe1c167-cce6-4c33-a70e-d1e46ffecbdb admin admin] PATH_INFO: `/v3/projects` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:35:28.710051 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe1c167-cce6-4c33-a70e-d1e46ffecbdb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:35:28.712024 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe1c167-cce6-4c33-a70e-d1e46ffecbdb admin admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:35:28.737298 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 1275/2539] 10.222.0.21 () {60 vars in 1152 bytes} [Wed May 4 07:35:28 2022] POST /identity/v3/projects => generated 371 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 07:35:28.742538 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e952b6-d6b3-4aee-b2c0-9132e359e2a1 None None] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:35:28.754022 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e952b6-d6b3-4aee-b2c0-9132e359e2a1 None None] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:35:28.808438 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2aa271-a648-4fdc-abd1-292a899e3c2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:35:28.809157 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2aa271-a648-4fdc-abd1-292a899e3c2a admin admin] REQUEST_METHOD: `POST` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:35:28.809366 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2aa271-a648-4fdc-abd1-292a899e3c2a admin admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:35:28.809721 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2aa271-a648-4fdc-abd1-292a899e3c2a admin admin] PATH_INFO: `/v3/users` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:35:28.810357 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2aa271-a648-4fdc-abd1-292a899e3c2a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:35:28.812436 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2aa271-a648-4fdc-abd1-292a899e3c2a admin admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:35:28.831708 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 1265/2540] 10.222.0.21 () {60 vars in 1143 bytes} [Wed May 4 07:35:28 2022] POST /identity/v3/users => generated 292 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 07:35:28.835712 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe1c167-cce6-4c33-a70e-d1e46ffecbdb admin admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:35:28.846223 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe1c167-cce6-4c33-a70e-d1e46ffecbdb admin admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:35:28.850789 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80afa47f-1499-4fa1-925a-2b2682e882d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:35:28.851474 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80afa47f-1499-4fa1-925a-2b2682e882d5 admin admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:35:28.851807 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80afa47f-1499-4fa1-925a-2b2682e882d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:35:28.852076 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80afa47f-1499-4fa1-925a-2b2682e882d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:35:28.853313 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80afa47f-1499-4fa1-925a-2b2682e882d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:35:28.854880 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80afa47f-1499-4fa1-925a-2b2682e882d5 admin admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:35:28.865380 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 1276/2541] 10.222.0.21 () {58 vars in 1121 bytes} [Wed May 4 07:35:28 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 07:35:28.870323 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2aa271-a648-4fdc-abd1-292a899e3c2a admin admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:35:28.880639 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2aa271-a648-4fdc-abd1-292a899e3c2a admin admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:35:28.886831 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7015bd58-4f6d-4be1-bf01-06700b87ba63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:35:28.887921 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7015bd58-4f6d-4be1-bf01-06700b87ba63 admin admin] REQUEST_METHOD: `PUT` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:35:28.888196 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7015bd58-4f6d-4be1-bf01-06700b87ba63 admin admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:35:28.888465 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7015bd58-4f6d-4be1-bf01-06700b87ba63 admin admin] PATH_INFO: `/v3/projects/2e0f4da003314feba423a0cbc0d72d2e/users/e291b93d677e4841bde0d65b9820904c/roles/eb54c9cea2774a25b1fe8c79724408ee` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:35:28.904207 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7015bd58-4f6d-4be1-bf01-06700b87ba63 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2e0f4da003314feba423a0cbc0d72d2e, user_id=e291b93d677e4841bde0d65b9820904c, role_id=eb54c9cea2774a25b1fe8c79724408ee)` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:35:28.906836 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7015bd58-4f6d-4be1-bf01-06700b87ba63 admin admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:35:28.920600 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 1266/2542] 10.222.0.21 () {60 vars in 1482 bytes} [Wed May 4 07:35:28 2022] PUT /identity/v3/projects/2e0f4da003314feba423a0cbc0d72d2e/users/e291b93d677e4841bde0d65b9820904c/roles/eb54c9cea2774a25b1fe8c79724408ee => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 07:35:28.924638 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80afa47f-1499-4fa1-925a-2b2682e882d5 admin admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:35:28.934575 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80afa47f-1499-4fa1-925a-2b2682e882d5 admin admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:35:28.990836 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e115c6fa-65f9-494d-83fa-7f3e9ad74bef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:35:28.991438 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e115c6fa-65f9-494d-83fa-7f3e9ad74bef admin admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:35:28.991716 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e115c6fa-65f9-494d-83fa-7f3e9ad74bef admin admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:35:28.991985 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e115c6fa-65f9-494d-83fa-7f3e9ad74bef admin admin] PATH_INFO: `/v3/roles` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:35:28.992703 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e115c6fa-65f9-494d-83fa-7f3e9ad74bef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:35:28.994345 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e115c6fa-65f9-494d-83fa-7f3e9ad74bef admin admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:35:29.004251 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 1277/2543] 10.222.0.21 () {58 vars in 1121 bytes} [Wed May 4 07:35:28 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 07:35:29.009887 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7015bd58-4f6d-4be1-bf01-06700b87ba63 admin admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:35:29.020414 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7015bd58-4f6d-4be1-bf01-06700b87ba63 admin admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:35:29.025871 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00583f2-3459-4836-9b18-9403106e5c4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:35:29.026728 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00583f2-3459-4836-9b18-9403106e5c4a admin admin] REQUEST_METHOD: `PUT` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:35:29.027011 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00583f2-3459-4836-9b18-9403106e5c4a admin admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:35:29.027307 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00583f2-3459-4836-9b18-9403106e5c4a admin admin] PATH_INFO: `/v3/projects/2e0f4da003314feba423a0cbc0d72d2e/users/e291b93d677e4841bde0d65b9820904c/roles/eb54c9cea2774a25b1fe8c79724408ee` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:35:29.029238 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00583f2-3459-4836-9b18-9403106e5c4a admin admin] RBAC: Authorizing `identity:create_grant(project_id=2e0f4da003314feba423a0cbc0d72d2e, user_id=e291b93d677e4841bde0d65b9820904c, role_id=eb54c9cea2774a25b1fe8c79724408ee)` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:35:29.031881 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00583f2-3459-4836-9b18-9403106e5c4a admin admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:35:29.042653 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 1267/2544] 10.222.0.21 () {60 vars in 1482 bytes} [Wed May 4 07:35:29 2022] PUT /identity/v3/projects/2e0f4da003314feba423a0cbc0d72d2e/users/e291b93d677e4841bde0d65b9820904c/roles/eb54c9cea2774a25b1fe8c79724408ee => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 07:35:29.053357 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0aed0e2-9c88-4cfc-940f-f3b0816f3de5 None None] REQUEST_METHOD: `POST` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:35:29.053774 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0aed0e2-9c88-4cfc-940f-f3b0816f3de5 None None] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:35:29.054091 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0aed0e2-9c88-4cfc-940f-f3b0816f3de5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:35:29.081178 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.auth.core [None req-a0aed0e2-9c88-4cfc-940f-f3b0816f3de5 None None] MFA Rules not processed for user `e291b93d677e4841bde0d65b9820904c`. Rule list: `[]` (Enabled: `True`). {{(pid=79744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:35:29.082374 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.fernet_utils [None req-a0aed0e2-9c88-4cfc-940f-f3b0816f3de5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:35:29.150773 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 1278/2545] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 07:35:29 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 07:35:29.163462 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00583f2-3459-4836-9b18-9403106e5c4a admin admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:35:29.166242 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.fernet_utils [None req-e00583f2-3459-4836-9b18-9403106e5c4a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:35:29.223964 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00583f2-3459-4836-9b18-9403106e5c4a admin admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:35:29.229002 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d59036-f9c2-495b-baeb-0e4975ceb1da service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb341257aa8246b6847561e2fe1fa385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9f9c44db4984653b8d4b5f6b3b949f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:35:29.229654 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d59036-f9c2-495b-baeb-0e4975ceb1da service cinder] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:35:29.229942 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d59036-f9c2-495b-baeb-0e4975ceb1da service cinder] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:35:29.230213 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d59036-f9c2-495b-baeb-0e4975ceb1da service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:35:29.240112 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d59036-f9c2-495b-baeb-0e4975ceb1da service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:35:29.241979 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d59036-f9c2-495b-baeb-0e4975ceb1da service cinder] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:35:29.252821 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 1268/2546] 10.222.0.21 () {60 vars in 1365 bytes} [Wed May 4 07:35:29 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 04 07:35:29.649084 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0aed0e2-9c88-4cfc-940f-f3b0816f3de5 None None] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:35:29.708809 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0aed0e2-9c88-4cfc-940f-f3b0816f3de5 None None] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:35:29.713670 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336ca461-0628-445d-9257-bf5c53384557 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:35:29.714536 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336ca461-0628-445d-9257-bf5c53384557 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:35:29.714810 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336ca461-0628-445d-9257-bf5c53384557 admin admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:35:29.715079 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336ca461-0628-445d-9257-bf5c53384557 admin admin] PATH_INFO: `/v3/users/34fa7afa24474c1c9ed54e3a77436c11` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:35:29.716273 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336ca461-0628-445d-9257-bf5c53384557 admin admin] RBAC: Authorizing `identity:delete_user(user_id=34fa7afa24474c1c9ed54e3a77436c11)` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:35:29.718167 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336ca461-0628-445d-9257-bf5c53384557 admin admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:35:29.766307 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-336ca461-0628-445d-9257-bf5c53384557 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '34fa7afa24474c1c9ed54e3a77436c11'} {{(pid=79744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:35:29.766885 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-336ca461-0628-445d-9257-bf5c53384557 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '34fa7afa24474c1c9ed54e3a77436c11'} {{(pid=79744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:35:29.773420 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-336ca461-0628-445d-9257-bf5c53384557 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '34fa7afa24474c1c9ed54e3a77436c11'} {{(pid=79744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:35:29.774118 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-336ca461-0628-445d-9257-bf5c53384557 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '34fa7afa24474c1c9ed54e3a77436c11'} {{(pid=79744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:35:29.785654 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-336ca461-0628-445d-9257-bf5c53384557 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '34fa7afa24474c1c9ed54e3a77436c11'} {{(pid=79744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:35:29.798532 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 1279/2547] 10.222.0.21 () {58 vars in 1223 bytes} [Wed May 4 07:35:29 2022] DELETE /identity/v3/users/34fa7afa24474c1c9ed54e3a77436c11 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 07:35:29.803300 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603023ab-8e3a-4e67-905b-3fbf6f91527f None None] REQUEST_METHOD: `POST` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:35:29.803793 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603023ab-8e3a-4e67-905b-3fbf6f91527f None None] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:35:29.804048 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603023ab-8e3a-4e67-905b-3fbf6f91527f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:35:29.822514 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.auth.core [None req-603023ab-8e3a-4e67-905b-3fbf6f91527f None None] MFA Rules not processed for user `83c5e0dcb991496ea6dee38384514508`. Rule list: `[]` (Enabled: `True`). {{(pid=79745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:35:29.823729 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.fernet_utils [None req-603023ab-8e3a-4e67-905b-3fbf6f91527f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:35:29.881864 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 1269/2548] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 07:35:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 07:35:29.891638 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336ca461-0628-445d-9257-bf5c53384557 admin admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:35:29.893275 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.fernet_utils [None req-336ca461-0628-445d-9257-bf5c53384557 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:35:29.950097 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336ca461-0628-445d-9257-bf5c53384557 admin admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:35:29.953706 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4db7c1-9140-4f0a-b12a-dab39a0f95a7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91cb92d00273402b837cb29b37325101', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9f9c44db4984653b8d4b5f6b3b949f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:35:29.954344 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4db7c1-9140-4f0a-b12a-dab39a0f95a7 service neutron] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:35:29.954617 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4db7c1-9140-4f0a-b12a-dab39a0f95a7 service neutron] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:35:29.954885 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4db7c1-9140-4f0a-b12a-dab39a0f95a7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:35:29.964402 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4db7c1-9140-4f0a-b12a-dab39a0f95a7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:35:29.965810 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4db7c1-9140-4f0a-b12a-dab39a0f95a7 service neutron] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:35:29.975107 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 1280/2549] 10.222.0.21 () {60 vars in 1365 bytes} [Wed May 4 07:35:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 07:35:30.253095 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603023ab-8e3a-4e67-905b-3fbf6f91527f None None] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:35:30.254523 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.fernet_utils [None req-603023ab-8e3a-4e67-905b-3fbf6f91527f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:35:30.267666 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603023ab-8e3a-4e67-905b-3fbf6f91527f None None] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:35:30.272406 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed80975-65ef-4a98-902d-774524ef9fb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:35:30.273498 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed80975-65ef-4a98-902d-774524ef9fb1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:35:30.273771 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed80975-65ef-4a98-902d-774524ef9fb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:35:30.274240 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed80975-65ef-4a98-902d-774524ef9fb1 admin admin] PATH_INFO: `/v3/projects/ecd568dc6d7d48c189316a5a6746cd26` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:35:30.276611 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed80975-65ef-4a98-902d-774524ef9fb1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ecd568dc6d7d48c189316a5a6746cd26)` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:35:30.278546 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed80975-65ef-4a98-902d-774524ef9fb1 admin admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:35:30.328249 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-4ed80975-65ef-4a98-902d-774524ef9fb1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ecd568dc6d7d48c189316a5a6746cd26', 'request_id': 'req-4ed80975-65ef-4a98-902d-774524ef9fb1'} {{(pid=79745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:35:30.334249 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-4ed80975-65ef-4a98-902d-774524ef9fb1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ecd568dc6d7d48c189316a5a6746cd26', 'request_id': 'req-4ed80975-65ef-4a98-902d-774524ef9fb1'} {{(pid=79745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:35:30.341795 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-4ed80975-65ef-4a98-902d-774524ef9fb1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ecd568dc6d7d48c189316a5a6746cd26', 'request_id': 'req-4ed80975-65ef-4a98-902d-774524ef9fb1'} {{(pid=79745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:35:30.351912 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-4ed80975-65ef-4a98-902d-774524ef9fb1 admin admin] The token cache is being invalidate because project ecd568dc6d7d48c189316a5a6746cd26 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79745) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 07:35:30.352196 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-4ed80975-65ef-4a98-902d-774524ef9fb1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:35:30.353095 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-4ed80975-65ef-4a98-902d-774524ef9fb1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:35:30.354874 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 1270/2550] 10.222.0.21 () {58 vars in 1232 bytes} [Wed May 4 07:35:30 2022] DELETE /identity/v3/projects/ecd568dc6d7d48c189316a5a6746cd26 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 07:35:30.359140 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4db7c1-9140-4f0a-b12a-dab39a0f95a7 service neutron] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:35:30.369070 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4db7c1-9140-4f0a-b12a-dab39a0f95a7 service neutron] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:35:30.424116 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0e81bd-82ee-44d6-b45c-038133d49562 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:35:30.425066 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0e81bd-82ee-44d6-b45c-038133d49562 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:35:30.425370 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0e81bd-82ee-44d6-b45c-038133d49562 admin admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:35:30.425704 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0e81bd-82ee-44d6-b45c-038133d49562 admin admin] PATH_INFO: `/v3/users/e291b93d677e4841bde0d65b9820904c` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:35:30.427015 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0e81bd-82ee-44d6-b45c-038133d49562 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e291b93d677e4841bde0d65b9820904c)` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:35:30.429170 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0e81bd-82ee-44d6-b45c-038133d49562 admin admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:35:30.480658 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-4a0e81bd-82ee-44d6-b45c-038133d49562 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e291b93d677e4841bde0d65b9820904c'} {{(pid=79744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:35:30.481480 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-4a0e81bd-82ee-44d6-b45c-038133d49562 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e291b93d677e4841bde0d65b9820904c'} {{(pid=79744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:35:30.489178 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-4a0e81bd-82ee-44d6-b45c-038133d49562 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e291b93d677e4841bde0d65b9820904c'} {{(pid=79744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:35:30.489811 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-4a0e81bd-82ee-44d6-b45c-038133d49562 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e291b93d677e4841bde0d65b9820904c'} {{(pid=79744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:35:30.501648 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-4a0e81bd-82ee-44d6-b45c-038133d49562 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e291b93d677e4841bde0d65b9820904c'} {{(pid=79744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:35:30.515828 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 1281/2551] 10.222.0.21 () {58 vars in 1223 bytes} [Wed May 4 07:35:30 2022] DELETE /identity/v3/users/e291b93d677e4841bde0d65b9820904c => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 07:35:30.780660 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed80975-65ef-4a98-902d-774524ef9fb1 admin admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:35:30.782402 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.fernet_utils [None req-4ed80975-65ef-4a98-902d-774524ef9fb1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:35:30.796595 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed80975-65ef-4a98-902d-774524ef9fb1 admin admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:35:30.861593 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7508fb7-77d1-469c-b7fc-74e80fa92908 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:35:30.862369 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7508fb7-77d1-469c-b7fc-74e80fa92908 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:35:30.862654 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7508fb7-77d1-469c-b7fc-74e80fa92908 admin admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:35:30.862931 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7508fb7-77d1-469c-b7fc-74e80fa92908 admin admin] PATH_INFO: `/v3/projects/2e0f4da003314feba423a0cbc0d72d2e` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:35:30.864148 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7508fb7-77d1-469c-b7fc-74e80fa92908 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2e0f4da003314feba423a0cbc0d72d2e)` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:35:30.866068 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7508fb7-77d1-469c-b7fc-74e80fa92908 admin admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:35:30.913738 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-b7508fb7-77d1-469c-b7fc-74e80fa92908 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2e0f4da003314feba423a0cbc0d72d2e', 'request_id': 'req-b7508fb7-77d1-469c-b7fc-74e80fa92908'} {{(pid=79745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:35:30.919659 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-b7508fb7-77d1-469c-b7fc-74e80fa92908 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2e0f4da003314feba423a0cbc0d72d2e', 'request_id': 'req-b7508fb7-77d1-469c-b7fc-74e80fa92908'} {{(pid=79745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:35:30.927712 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-b7508fb7-77d1-469c-b7fc-74e80fa92908 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2e0f4da003314feba423a0cbc0d72d2e', 'request_id': 'req-b7508fb7-77d1-469c-b7fc-74e80fa92908'} {{(pid=79745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:35:30.938618 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-b7508fb7-77d1-469c-b7fc-74e80fa92908 admin admin] The token cache is being invalidate because project 2e0f4da003314feba423a0cbc0d72d2e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79745) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 07:35:30.938896 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-b7508fb7-77d1-469c-b7fc-74e80fa92908 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:35:30.939529 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-b7508fb7-77d1-469c-b7fc-74e80fa92908 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:35:30.941070 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 1271/2552] 10.222.0.21 () {58 vars in 1232 bytes} [Wed May 4 07:35:30 2022] DELETE /identity/v3/projects/2e0f4da003314feba423a0cbc0d72d2e => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 07:35:30.946359 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178ae6d2-38cb-47e4-a9ba-a601d5020e5d None None] REQUEST_METHOD: `POST` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:35:30.947450 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178ae6d2-38cb-47e4-a9ba-a601d5020e5d None None] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:35:30.947712 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178ae6d2-38cb-47e4-a9ba-a601d5020e5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:35:30.965381 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.auth.core [None req-178ae6d2-38cb-47e4-a9ba-a601d5020e5d None None] MFA Rules not processed for user `83c5e0dcb991496ea6dee38384514508`. Rule list: `[]` (Enabled: `True`). {{(pid=79744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:35:30.966554 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.fernet_utils [None req-178ae6d2-38cb-47e4-a9ba-a601d5020e5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:35:31.029786 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 1282/2553] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 07:35:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 07:35:31.038158 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615555ab-8f9f-42f9-a487-b198aab37084 None None] REQUEST_METHOD: `POST` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:35:31.038477 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615555ab-8f9f-42f9-a487-b198aab37084 None None] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:35:31.038757 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615555ab-8f9f-42f9-a487-b198aab37084 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:35:31.058358 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.auth.core [None req-615555ab-8f9f-42f9-a487-b198aab37084 None None] MFA Rules not processed for user `83c5e0dcb991496ea6dee38384514508`. Rule list: `[]` (Enabled: `True`). {{(pid=79745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:35:31.059601 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.fernet_utils [None req-615555ab-8f9f-42f9-a487-b198aab37084 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:35:31.067501 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 1272/2554] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 07:35:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 07:35:31.071905 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178ae6d2-38cb-47e4-a9ba-a601d5020e5d None None] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:35:31.081513 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178ae6d2-38cb-47e4-a9ba-a601d5020e5d None None] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:35:31.086082 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20fdda8-e904-4fdc-8057-d68b72204973 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:35:31.086756 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20fdda8-e904-4fdc-8057-d68b72204973 admin admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:35:31.087032 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20fdda8-e904-4fdc-8057-d68b72204973 admin admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:35:31.087332 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20fdda8-e904-4fdc-8057-d68b72204973 admin admin] PATH_INFO: `/v3/domains` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:35:31.088059 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20fdda8-e904-4fdc-8057-d68b72204973 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79744) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 07:35:31.088387 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20fdda8-e904-4fdc-8057-d68b72204973 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:35:31.089990 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20fdda8-e904-4fdc-8057-d68b72204973 admin admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:35:31.101574 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 1283/2555] 10.222.0.21 () {58 vars in 1152 bytes} [Wed May 4 07:35:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 07:35:31.106389 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615555ab-8f9f-42f9-a487-b198aab37084 None None] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:35:31.115623 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615555ab-8f9f-42f9-a487-b198aab37084 None None] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:35:31.120954 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ba76bd-54e5-4d6b-8a84-a6e94d7f624f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:35:31.121596 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ba76bd-54e5-4d6b-8a84-a6e94d7f624f admin admin] REQUEST_METHOD: `POST` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:35:31.121876 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ba76bd-54e5-4d6b-8a84-a6e94d7f624f admin admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:35:31.122148 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ba76bd-54e5-4d6b-8a84-a6e94d7f624f admin admin] PATH_INFO: `/v3/projects` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:35:31.122837 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ba76bd-54e5-4d6b-8a84-a6e94d7f624f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:35:31.124778 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ba76bd-54e5-4d6b-8a84-a6e94d7f624f admin admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:35:31.151238 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 1273/2556] 10.222.0.21 () {60 vars in 1152 bytes} [Wed May 4 07:35:31 2022] POST /identity/v3/projects => generated 355 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 07:35:31.155513 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20fdda8-e904-4fdc-8057-d68b72204973 admin admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:35:31.166236 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20fdda8-e904-4fdc-8057-d68b72204973 admin admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:35:31.223412 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f589ffcd-4b75-4528-8fb0-1104e583239c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:35:31.224070 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f589ffcd-4b75-4528-8fb0-1104e583239c admin admin] REQUEST_METHOD: `POST` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:35:31.224346 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f589ffcd-4b75-4528-8fb0-1104e583239c admin admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:35:31.224613 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f589ffcd-4b75-4528-8fb0-1104e583239c admin admin] PATH_INFO: `/v3/users` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:35:31.225293 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f589ffcd-4b75-4528-8fb0-1104e583239c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:35:31.227257 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f589ffcd-4b75-4528-8fb0-1104e583239c admin admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:35:31.245825 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 1284/2557] 10.222.0.21 () {60 vars in 1143 bytes} [Wed May 4 07:35:31 2022] POST /identity/v3/users => generated 278 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 07:35:31.249927 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ba76bd-54e5-4d6b-8a84-a6e94d7f624f admin admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:35:31.261070 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ba76bd-54e5-4d6b-8a84-a6e94d7f624f admin admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:35:31.265615 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7224c409-71f7-4c36-8b3e-b1f08bab30a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:35:31.266219 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7224c409-71f7-4c36-8b3e-b1f08bab30a2 admin admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:35:31.266483 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7224c409-71f7-4c36-8b3e-b1f08bab30a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:35:31.266752 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7224c409-71f7-4c36-8b3e-b1f08bab30a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:35:31.267606 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7224c409-71f7-4c36-8b3e-b1f08bab30a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:35:31.269146 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7224c409-71f7-4c36-8b3e-b1f08bab30a2 admin admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:35:31.281370 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 1274/2558] 10.222.0.21 () {58 vars in 1121 bytes} [Wed May 4 07:35:31 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 07:35:31.285578 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f589ffcd-4b75-4528-8fb0-1104e583239c admin admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:35:31.296251 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f589ffcd-4b75-4528-8fb0-1104e583239c admin admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:35:31.300928 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d263b8-a704-4db5-9afb-521aea7ae416 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:35:31.301610 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d263b8-a704-4db5-9afb-521aea7ae416 admin admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:35:31.301892 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d263b8-a704-4db5-9afb-521aea7ae416 admin admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:35:31.302161 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d263b8-a704-4db5-9afb-521aea7ae416 admin admin] PATH_INFO: `/v3/roles` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:35:31.302876 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d263b8-a704-4db5-9afb-521aea7ae416 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:35:31.304497 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d263b8-a704-4db5-9afb-521aea7ae416 admin admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:35:31.314764 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 1285/2559] 10.222.0.21 () {58 vars in 1121 bytes} [Wed May 4 07:35:31 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 07:35:31.319082 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7224c409-71f7-4c36-8b3e-b1f08bab30a2 admin admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:35:31.330506 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7224c409-71f7-4c36-8b3e-b1f08bab30a2 admin admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:35:31.335212 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf27e84-b04b-4ad9-8cd8-a0b79e54615b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:35:31.336031 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf27e84-b04b-4ad9-8cd8-a0b79e54615b admin admin] REQUEST_METHOD: `PUT` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:35:31.336306 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf27e84-b04b-4ad9-8cd8-a0b79e54615b admin admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:35:31.336578 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf27e84-b04b-4ad9-8cd8-a0b79e54615b admin admin] PATH_INFO: `/v3/projects/48df4480bef54ae793699050cee3a7f3/users/fe93e728d7b044c7b62b1d9634d4c354/roles/9f89c07b05a14f18836116af22cba5f6` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:35:31.351432 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf27e84-b04b-4ad9-8cd8-a0b79e54615b admin admin] RBAC: Authorizing `identity:create_grant(project_id=48df4480bef54ae793699050cee3a7f3, user_id=fe93e728d7b044c7b62b1d9634d4c354, role_id=9f89c07b05a14f18836116af22cba5f6)` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:35:31.354231 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf27e84-b04b-4ad9-8cd8-a0b79e54615b admin admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:35:31.367997 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 1275/2560] 10.222.0.21 () {60 vars in 1482 bytes} [Wed May 4 07:35:31 2022] PUT /identity/v3/projects/48df4480bef54ae793699050cee3a7f3/users/fe93e728d7b044c7b62b1d9634d4c354/roles/9f89c07b05a14f18836116af22cba5f6 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 07:35:31.379896 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a34134-752f-448e-8d0a-00ead5caf6ff None None] REQUEST_METHOD: `POST` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:35:31.380185 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a34134-752f-448e-8d0a-00ead5caf6ff None None] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:35:31.380461 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a34134-752f-448e-8d0a-00ead5caf6ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:35:31.408643 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.auth.core [None req-b7a34134-752f-448e-8d0a-00ead5caf6ff None None] MFA Rules not processed for user `fe93e728d7b044c7b62b1d9634d4c354`. Rule list: `[]` (Enabled: `True`). {{(pid=79744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:35:31.410071 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.fernet_utils [None req-b7a34134-752f-448e-8d0a-00ead5caf6ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:35:31.481492 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 1286/2561] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 07:35:31 2022] POST /identity/v3/auth/tokens => generated 3222 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 07:35:31.486217 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf27e84-b04b-4ad9-8cd8-a0b79e54615b admin admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:35:31.547765 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf27e84-b04b-4ad9-8cd8-a0b79e54615b admin admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:35:31.552383 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f57223-9ec2-480f-9109-23411822349d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:35:31.553029 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f57223-9ec2-480f-9109-23411822349d admin admin] REQUEST_METHOD: `POST` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:35:31.553306 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f57223-9ec2-480f-9109-23411822349d admin admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:35:31.554122 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f57223-9ec2-480f-9109-23411822349d admin admin] PATH_INFO: `/v3/projects` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:35:31.554968 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f57223-9ec2-480f-9109-23411822349d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:35:31.557809 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f57223-9ec2-480f-9109-23411822349d admin admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:35:31.584768 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 1276/2562] 10.222.0.21 () {60 vars in 1152 bytes} [Wed May 4 07:35:31 2022] POST /identity/v3/projects => generated 357 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 07:35:31.589375 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a34134-752f-448e-8d0a-00ead5caf6ff None None] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:35:31.599829 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a34134-752f-448e-8d0a-00ead5caf6ff None None] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:35:31.657289 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0dc437-7cc9-4c28-be34-7beb36f9b9b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:35:31.657850 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0dc437-7cc9-4c28-be34-7beb36f9b9b4 admin admin] REQUEST_METHOD: `POST` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:35:31.658126 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0dc437-7cc9-4c28-be34-7beb36f9b9b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:35:31.658397 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0dc437-7cc9-4c28-be34-7beb36f9b9b4 admin admin] PATH_INFO: `/v3/users` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:35:31.659076 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0dc437-7cc9-4c28-be34-7beb36f9b9b4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:35:31.660994 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0dc437-7cc9-4c28-be34-7beb36f9b9b4 admin admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:35:31.681568 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 1287/2563] 10.222.0.21 () {60 vars in 1143 bytes} [Wed May 4 07:35:31 2022] POST /identity/v3/users => generated 285 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 07:35:31.686281 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f57223-9ec2-480f-9109-23411822349d admin admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:35:31.697053 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f57223-9ec2-480f-9109-23411822349d admin admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:35:31.701902 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37338d49-cf31-43ae-a2e7-7ed6bbfd25a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:35:31.702541 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37338d49-cf31-43ae-a2e7-7ed6bbfd25a0 admin admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:35:31.702814 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37338d49-cf31-43ae-a2e7-7ed6bbfd25a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:35:31.703080 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37338d49-cf31-43ae-a2e7-7ed6bbfd25a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:35:31.703822 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37338d49-cf31-43ae-a2e7-7ed6bbfd25a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:35:31.705387 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37338d49-cf31-43ae-a2e7-7ed6bbfd25a0 admin admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:35:31.715831 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 1277/2564] 10.222.0.21 () {58 vars in 1121 bytes} [Wed May 4 07:35:31 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 04 07:35:31.720792 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0dc437-7cc9-4c28-be34-7beb36f9b9b4 admin admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:35:31.732653 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0dc437-7cc9-4c28-be34-7beb36f9b9b4 admin admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:35:31.737954 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f601e832-3b9f-4a01-a2fb-127e03379141 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:35:31.738819 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f601e832-3b9f-4a01-a2fb-127e03379141 admin admin] REQUEST_METHOD: `PUT` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:35:31.739096 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f601e832-3b9f-4a01-a2fb-127e03379141 admin admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:35:31.739402 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f601e832-3b9f-4a01-a2fb-127e03379141 admin admin] PATH_INFO: `/v3/projects/3d1ec603c16b46aeb3e6a2ce952030b9/users/3a5cbe43dff442a39aa66bab5efb253c/roles/eb54c9cea2774a25b1fe8c79724408ee` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:35:31.754553 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f601e832-3b9f-4a01-a2fb-127e03379141 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3d1ec603c16b46aeb3e6a2ce952030b9, user_id=3a5cbe43dff442a39aa66bab5efb253c, role_id=eb54c9cea2774a25b1fe8c79724408ee)` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:35:31.757229 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f601e832-3b9f-4a01-a2fb-127e03379141 admin admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:35:31.769714 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 1288/2565] 10.222.0.21 () {60 vars in 1482 bytes} [Wed May 4 07:35:31 2022] PUT /identity/v3/projects/3d1ec603c16b46aeb3e6a2ce952030b9/users/3a5cbe43dff442a39aa66bab5efb253c/roles/eb54c9cea2774a25b1fe8c79724408ee => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 07:35:31.773683 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37338d49-cf31-43ae-a2e7-7ed6bbfd25a0 admin admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:35:31.783394 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37338d49-cf31-43ae-a2e7-7ed6bbfd25a0 admin admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:35:31.837934 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe93a16-49c4-40b1-b3a4-19841b349341 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:35:31.838595 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe93a16-49c4-40b1-b3a4-19841b349341 admin admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:35:31.838898 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe93a16-49c4-40b1-b3a4-19841b349341 admin admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:35:31.839192 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe93a16-49c4-40b1-b3a4-19841b349341 admin admin] PATH_INFO: `/v3/roles` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:35:31.839911 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe93a16-49c4-40b1-b3a4-19841b349341 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:35:31.841512 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe93a16-49c4-40b1-b3a4-19841b349341 admin admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:35:31.850992 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 1278/2566] 10.222.0.21 () {58 vars in 1121 bytes} [Wed May 4 07:35:31 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 07:35:31.856492 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f601e832-3b9f-4a01-a2fb-127e03379141 admin admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:35:31.866559 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f601e832-3b9f-4a01-a2fb-127e03379141 admin admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:35:31.872501 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8539244f-1438-418e-92d0-0c8918d97d46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:35:31.873371 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8539244f-1438-418e-92d0-0c8918d97d46 admin admin] REQUEST_METHOD: `PUT` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:35:31.873650 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8539244f-1438-418e-92d0-0c8918d97d46 admin admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:35:31.873923 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8539244f-1438-418e-92d0-0c8918d97d46 admin admin] PATH_INFO: `/v3/projects/3d1ec603c16b46aeb3e6a2ce952030b9/users/3a5cbe43dff442a39aa66bab5efb253c/roles/eb54c9cea2774a25b1fe8c79724408ee` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:35:31.875914 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8539244f-1438-418e-92d0-0c8918d97d46 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3d1ec603c16b46aeb3e6a2ce952030b9, user_id=3a5cbe43dff442a39aa66bab5efb253c, role_id=eb54c9cea2774a25b1fe8c79724408ee)` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:35:31.878852 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8539244f-1438-418e-92d0-0c8918d97d46 admin admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:35:31.889423 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 1289/2567] 10.222.0.21 () {60 vars in 1482 bytes} [Wed May 4 07:35:31 2022] PUT /identity/v3/projects/3d1ec603c16b46aeb3e6a2ce952030b9/users/3a5cbe43dff442a39aa66bab5efb253c/roles/eb54c9cea2774a25b1fe8c79724408ee => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 07:35:31.900829 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0041fc-7346-42b3-86ba-7ff87da2a0d6 None None] REQUEST_METHOD: `POST` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:35:31.901380 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0041fc-7346-42b3-86ba-7ff87da2a0d6 None None] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:35:31.901380 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0041fc-7346-42b3-86ba-7ff87da2a0d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:35:31.927533 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.auth.core [None req-ba0041fc-7346-42b3-86ba-7ff87da2a0d6 None None] MFA Rules not processed for user `3a5cbe43dff442a39aa66bab5efb253c`. Rule list: `[]` (Enabled: `True`). {{(pid=79745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:35:31.928726 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.fernet_utils [None req-ba0041fc-7346-42b3-86ba-7ff87da2a0d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:35:31.996049 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 1279/2568] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 07:35:31 2022] POST /identity/v3/auth/tokens => generated 3291 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 07:35:32.008134 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8539244f-1438-418e-92d0-0c8918d97d46 admin admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:35:32.010177 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.fernet_utils [None req-8539244f-1438-418e-92d0-0c8918d97d46 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:35:32.066590 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8539244f-1438-418e-92d0-0c8918d97d46 admin admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:35:32.070153 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4138533e-6f7b-499a-b89d-e90d2cdde1ca service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb341257aa8246b6847561e2fe1fa385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9f9c44db4984653b8d4b5f6b3b949f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:35:32.070783 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4138533e-6f7b-499a-b89d-e90d2cdde1ca service cinder] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:35:32.071058 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4138533e-6f7b-499a-b89d-e90d2cdde1ca service cinder] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:35:32.071400 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4138533e-6f7b-499a-b89d-e90d2cdde1ca service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:35:32.080169 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4138533e-6f7b-499a-b89d-e90d2cdde1ca service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:35:32.081574 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4138533e-6f7b-499a-b89d-e90d2cdde1ca service cinder] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:35:32.090670 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 1290/2569] 10.222.0.21 () {60 vars in 1365 bytes} [Wed May 4 07:35:32 2022] GET /identity/v3/auth/tokens => generated 3291 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 07:35:32.167621 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0041fc-7346-42b3-86ba-7ff87da2a0d6 None None] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:35:32.177157 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0041fc-7346-42b3-86ba-7ff87da2a0d6 None None] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:35:32.181455 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5740a613-fbb5-40b2-86c4-f20ffec4a3d9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb341257aa8246b6847561e2fe1fa385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9f9c44db4984653b8d4b5f6b3b949f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:35:32.182093 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5740a613-fbb5-40b2-86c4-f20ffec4a3d9 service cinder] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:35:32.182373 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5740a613-fbb5-40b2-86c4-f20ffec4a3d9 service cinder] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:35:32.182646 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5740a613-fbb5-40b2-86c4-f20ffec4a3d9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:35:32.239323 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5740a613-fbb5-40b2-86c4-f20ffec4a3d9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:35:32.240753 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5740a613-fbb5-40b2-86c4-f20ffec4a3d9 service cinder] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:35:32.249455 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 1280/2570] 10.222.0.21 () {60 vars in 1365 bytes} [Wed May 4 07:35:32 2022] GET /identity/v3/auth/tokens => generated 3222 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 07:35:47.075384 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4138533e-6f7b-499a-b89d-e90d2cdde1ca service cinder] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:35:47.136915 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4138533e-6f7b-499a-b89d-e90d2cdde1ca service cinder] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:35:47.141364 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ccde8a-b8ae-4f0f-8fab-e67907c45f50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:35:47.142219 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ccde8a-b8ae-4f0f-8fab-e67907c45f50 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:35:47.142494 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ccde8a-b8ae-4f0f-8fab-e67907c45f50 admin admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:35:47.142761 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ccde8a-b8ae-4f0f-8fab-e67907c45f50 admin admin] PATH_INFO: `/v3/users/fe93e728d7b044c7b62b1d9634d4c354` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:35:47.143963 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ccde8a-b8ae-4f0f-8fab-e67907c45f50 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fe93e728d7b044c7b62b1d9634d4c354)` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:35:47.145855 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ccde8a-b8ae-4f0f-8fab-e67907c45f50 admin admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:35:47.191412 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-e8ccde8a-b8ae-4f0f-8fab-e67907c45f50 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fe93e728d7b044c7b62b1d9634d4c354'} {{(pid=79744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:35:47.192060 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-e8ccde8a-b8ae-4f0f-8fab-e67907c45f50 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fe93e728d7b044c7b62b1d9634d4c354'} {{(pid=79744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:35:47.199102 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-e8ccde8a-b8ae-4f0f-8fab-e67907c45f50 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fe93e728d7b044c7b62b1d9634d4c354'} {{(pid=79744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:35:47.199765 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-e8ccde8a-b8ae-4f0f-8fab-e67907c45f50 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fe93e728d7b044c7b62b1d9634d4c354'} {{(pid=79744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:35:47.210707 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-e8ccde8a-b8ae-4f0f-8fab-e67907c45f50 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fe93e728d7b044c7b62b1d9634d4c354'} {{(pid=79744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:35:47.225010 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 1291/2571] 10.222.0.21 () {58 vars in 1223 bytes} [Wed May 4 07:35:47 2022] DELETE /identity/v3/users/fe93e728d7b044c7b62b1d9634d4c354 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 07:35:47.230297 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b12e00-b29e-4d9d-9004-f9c8f20e1a2f None None] REQUEST_METHOD: `POST` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:35:47.230831 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b12e00-b29e-4d9d-9004-f9c8f20e1a2f None None] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:35:47.230831 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b12e00-b29e-4d9d-9004-f9c8f20e1a2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:35:47.248911 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.auth.core [None req-d7b12e00-b29e-4d9d-9004-f9c8f20e1a2f None None] MFA Rules not processed for user `83c5e0dcb991496ea6dee38384514508`. Rule list: `[]` (Enabled: `True`). {{(pid=79745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:35:47.250091 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.fernet_utils [None req-d7b12e00-b29e-4d9d-9004-f9c8f20e1a2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:35:47.308500 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 1281/2572] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 07:35:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 07:35:47.318018 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ccde8a-b8ae-4f0f-8fab-e67907c45f50 admin admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:35:47.319486 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.fernet_utils [None req-e8ccde8a-b8ae-4f0f-8fab-e67907c45f50 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:35:47.376756 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ccde8a-b8ae-4f0f-8fab-e67907c45f50 admin admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:35:47.380636 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a1acf0-1667-4577-822e-8b5d828e37fd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91cb92d00273402b837cb29b37325101', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9f9c44db4984653b8d4b5f6b3b949f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:35:47.381316 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a1acf0-1667-4577-822e-8b5d828e37fd service neutron] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:35:47.381595 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a1acf0-1667-4577-822e-8b5d828e37fd service neutron] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:35:47.381866 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a1acf0-1667-4577-822e-8b5d828e37fd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:35:47.391275 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a1acf0-1667-4577-822e-8b5d828e37fd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:35:47.392703 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a1acf0-1667-4577-822e-8b5d828e37fd service neutron] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:35:47.403232 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 1292/2573] 10.222.0.21 () {60 vars in 1365 bytes} [Wed May 4 07:35:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 07:35:47.668449 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b12e00-b29e-4d9d-9004-f9c8f20e1a2f None None] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:35:47.670111 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.fernet_utils [None req-d7b12e00-b29e-4d9d-9004-f9c8f20e1a2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:35:47.683220 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b12e00-b29e-4d9d-9004-f9c8f20e1a2f None None] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:35:47.688308 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6fdf6c-5b6c-4c7b-9b7c-71c9cd7626d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:35:47.689223 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6fdf6c-5b6c-4c7b-9b7c-71c9cd7626d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:35:47.689525 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6fdf6c-5b6c-4c7b-9b7c-71c9cd7626d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:35:47.689800 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6fdf6c-5b6c-4c7b-9b7c-71c9cd7626d2 admin admin] PATH_INFO: `/v3/projects/48df4480bef54ae793699050cee3a7f3` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:35:47.690993 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6fdf6c-5b6c-4c7b-9b7c-71c9cd7626d2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=48df4480bef54ae793699050cee3a7f3)` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:35:47.692992 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6fdf6c-5b6c-4c7b-9b7c-71c9cd7626d2 admin admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:35:47.741068 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-da6fdf6c-5b6c-4c7b-9b7c-71c9cd7626d2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '48df4480bef54ae793699050cee3a7f3', 'request_id': 'req-da6fdf6c-5b6c-4c7b-9b7c-71c9cd7626d2'} {{(pid=79745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:35:47.747418 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-da6fdf6c-5b6c-4c7b-9b7c-71c9cd7626d2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '48df4480bef54ae793699050cee3a7f3', 'request_id': 'req-da6fdf6c-5b6c-4c7b-9b7c-71c9cd7626d2'} {{(pid=79745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:35:47.755174 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-da6fdf6c-5b6c-4c7b-9b7c-71c9cd7626d2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '48df4480bef54ae793699050cee3a7f3', 'request_id': 'req-da6fdf6c-5b6c-4c7b-9b7c-71c9cd7626d2'} {{(pid=79745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:35:47.766175 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-da6fdf6c-5b6c-4c7b-9b7c-71c9cd7626d2 admin admin] The token cache is being invalidate because project 48df4480bef54ae793699050cee3a7f3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79745) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 07:35:47.766457 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-da6fdf6c-5b6c-4c7b-9b7c-71c9cd7626d2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:35:47.767083 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-da6fdf6c-5b6c-4c7b-9b7c-71c9cd7626d2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:35:47.768652 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 1282/2574] 10.222.0.21 () {58 vars in 1232 bytes} [Wed May 4 07:35:47 2022] DELETE /identity/v3/projects/48df4480bef54ae793699050cee3a7f3 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 07:35:47.772790 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a1acf0-1667-4577-822e-8b5d828e37fd service neutron] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:35:47.782968 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a1acf0-1667-4577-822e-8b5d828e37fd service neutron] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:35:47.838230 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f98ab3-b2ce-4206-967d-1a4858924323 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:35:47.839098 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f98ab3-b2ce-4206-967d-1a4858924323 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:35:47.839416 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f98ab3-b2ce-4206-967d-1a4858924323 admin admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:35:47.839719 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f98ab3-b2ce-4206-967d-1a4858924323 admin admin] PATH_INFO: `/v3/users/3a5cbe43dff442a39aa66bab5efb253c` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:35:47.840908 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f98ab3-b2ce-4206-967d-1a4858924323 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3a5cbe43dff442a39aa66bab5efb253c)` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:35:47.842897 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f98ab3-b2ce-4206-967d-1a4858924323 admin admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:35:47.889401 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-e6f98ab3-b2ce-4206-967d-1a4858924323 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3a5cbe43dff442a39aa66bab5efb253c'} {{(pid=79744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:35:47.890122 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-e6f98ab3-b2ce-4206-967d-1a4858924323 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3a5cbe43dff442a39aa66bab5efb253c'} {{(pid=79744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:35:47.896876 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-e6f98ab3-b2ce-4206-967d-1a4858924323 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3a5cbe43dff442a39aa66bab5efb253c'} {{(pid=79744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:35:47.897501 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-e6f98ab3-b2ce-4206-967d-1a4858924323 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3a5cbe43dff442a39aa66bab5efb253c'} {{(pid=79744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:35:47.909636 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-e6f98ab3-b2ce-4206-967d-1a4858924323 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3a5cbe43dff442a39aa66bab5efb253c'} {{(pid=79744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:35:47.923164 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 1293/2575] 10.222.0.21 () {58 vars in 1223 bytes} [Wed May 4 07:35:47 2022] DELETE /identity/v3/users/3a5cbe43dff442a39aa66bab5efb253c => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 07:35:48.206031 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6fdf6c-5b6c-4c7b-9b7c-71c9cd7626d2 admin admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:35:48.207586 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.fernet_utils [None req-da6fdf6c-5b6c-4c7b-9b7c-71c9cd7626d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:35:48.225991 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6fdf6c-5b6c-4c7b-9b7c-71c9cd7626d2 admin admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:35:48.285033 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faab364c-315e-4189-bc64-4aa4dc9c054a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:35:48.285899 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faab364c-315e-4189-bc64-4aa4dc9c054a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:35:48.286179 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faab364c-315e-4189-bc64-4aa4dc9c054a admin admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:35:48.286455 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faab364c-315e-4189-bc64-4aa4dc9c054a admin admin] PATH_INFO: `/v3/projects/3d1ec603c16b46aeb3e6a2ce952030b9` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:35:48.287719 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faab364c-315e-4189-bc64-4aa4dc9c054a admin admin] RBAC: Authorizing `identity:delete_project(project_id=3d1ec603c16b46aeb3e6a2ce952030b9)` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:35:48.290193 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faab364c-315e-4189-bc64-4aa4dc9c054a admin admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:35:48.335212 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-faab364c-315e-4189-bc64-4aa4dc9c054a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3d1ec603c16b46aeb3e6a2ce952030b9', 'request_id': 'req-faab364c-315e-4189-bc64-4aa4dc9c054a'} {{(pid=79745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:35:48.341324 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-faab364c-315e-4189-bc64-4aa4dc9c054a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3d1ec603c16b46aeb3e6a2ce952030b9', 'request_id': 'req-faab364c-315e-4189-bc64-4aa4dc9c054a'} {{(pid=79745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:35:48.348711 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-faab364c-315e-4189-bc64-4aa4dc9c054a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3d1ec603c16b46aeb3e6a2ce952030b9', 'request_id': 'req-faab364c-315e-4189-bc64-4aa4dc9c054a'} {{(pid=79745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:35:48.359663 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-faab364c-315e-4189-bc64-4aa4dc9c054a admin admin] The token cache is being invalidate because project 3d1ec603c16b46aeb3e6a2ce952030b9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79745) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 07:35:48.359946 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-faab364c-315e-4189-bc64-4aa4dc9c054a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:35:48.360571 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-faab364c-315e-4189-bc64-4aa4dc9c054a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:35:48.362120 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 1283/2576] 10.222.0.21 () {58 vars in 1232 bytes} [Wed May 4 07:35:48 2022] DELETE /identity/v3/projects/3d1ec603c16b46aeb3e6a2ce952030b9 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 07:35:48.367213 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7059daa1-c838-40b3-8a6d-e4dd65c94c13 None None] REQUEST_METHOD: `POST` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:35:48.368462 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7059daa1-c838-40b3-8a6d-e4dd65c94c13 None None] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:35:48.368462 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7059daa1-c838-40b3-8a6d-e4dd65c94c13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:35:48.388035 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.auth.core [None req-7059daa1-c838-40b3-8a6d-e4dd65c94c13 None None] MFA Rules not processed for user `83c5e0dcb991496ea6dee38384514508`. Rule list: `[]` (Enabled: `True`). {{(pid=79744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:35:48.389249 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.fernet_utils [None req-7059daa1-c838-40b3-8a6d-e4dd65c94c13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:35:48.447333 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 1294/2577] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 07:35:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 07:35:48.455043 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402cbe8f-086f-4b6d-acc4-bd2cb8fc45e6 None None] REQUEST_METHOD: `POST` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:35:48.455370 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402cbe8f-086f-4b6d-acc4-bd2cb8fc45e6 None None] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:35:48.455644 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402cbe8f-086f-4b6d-acc4-bd2cb8fc45e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:35:48.474250 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.auth.core [None req-402cbe8f-086f-4b6d-acc4-bd2cb8fc45e6 None None] MFA Rules not processed for user `83c5e0dcb991496ea6dee38384514508`. Rule list: `[]` (Enabled: `True`). {{(pid=79745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:35:48.475552 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.fernet_utils [None req-402cbe8f-086f-4b6d-acc4-bd2cb8fc45e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:35:48.484599 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 1284/2578] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 07:35:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 07:35:48.488587 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7059daa1-c838-40b3-8a6d-e4dd65c94c13 None None] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:35:48.499428 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7059daa1-c838-40b3-8a6d-e4dd65c94c13 None None] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:35:48.504369 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eddbcc9-6cfc-47f1-a90f-6e97fcc2336c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:35:48.505044 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eddbcc9-6cfc-47f1-a90f-6e97fcc2336c admin admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:35:48.505320 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eddbcc9-6cfc-47f1-a90f-6e97fcc2336c admin admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:35:48.505594 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eddbcc9-6cfc-47f1-a90f-6e97fcc2336c admin admin] PATH_INFO: `/v3/domains` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:35:48.506343 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eddbcc9-6cfc-47f1-a90f-6e97fcc2336c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79744) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 07:35:48.506653 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eddbcc9-6cfc-47f1-a90f-6e97fcc2336c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:35:48.508317 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eddbcc9-6cfc-47f1-a90f-6e97fcc2336c admin admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:35:48.520095 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 1295/2579] 10.222.0.21 () {58 vars in 1152 bytes} [Wed May 4 07:35:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 07:35:48.524839 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402cbe8f-086f-4b6d-acc4-bd2cb8fc45e6 None None] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:35:48.534123 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402cbe8f-086f-4b6d-acc4-bd2cb8fc45e6 None None] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:35:48.538752 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e792a71-cae3-41cf-ae9b-f384fb75ca43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:35:48.539949 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e792a71-cae3-41cf-ae9b-f384fb75ca43 admin admin] REQUEST_METHOD: `POST` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:35:48.540229 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e792a71-cae3-41cf-ae9b-f384fb75ca43 admin admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:35:48.540595 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e792a71-cae3-41cf-ae9b-f384fb75ca43 admin admin] PATH_INFO: `/v3/projects` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:35:48.541281 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e792a71-cae3-41cf-ae9b-f384fb75ca43 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:35:48.543207 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e792a71-cae3-41cf-ae9b-f384fb75ca43 admin admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:35:48.570601 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 1285/2580] 10.222.0.21 () {60 vars in 1152 bytes} [Wed May 4 07:35:48 2022] POST /identity/v3/projects => generated 367 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 07:35:48.575032 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eddbcc9-6cfc-47f1-a90f-6e97fcc2336c admin admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:35:48.585366 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eddbcc9-6cfc-47f1-a90f-6e97fcc2336c admin admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:35:48.642239 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96d12e9-4f9e-47c4-ba42-e4daf16a2c5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:35:48.642818 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96d12e9-4f9e-47c4-ba42-e4daf16a2c5a admin admin] REQUEST_METHOD: `POST` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:35:48.643123 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96d12e9-4f9e-47c4-ba42-e4daf16a2c5a admin admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:35:48.643460 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96d12e9-4f9e-47c4-ba42-e4daf16a2c5a admin admin] PATH_INFO: `/v3/users` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:35:48.644158 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96d12e9-4f9e-47c4-ba42-e4daf16a2c5a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:35:48.646062 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96d12e9-4f9e-47c4-ba42-e4daf16a2c5a admin admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:35:48.668328 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 1296/2581] 10.222.0.21 () {60 vars in 1143 bytes} [Wed May 4 07:35:48 2022] POST /identity/v3/users => generated 284 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 07:35:48.671003 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e792a71-cae3-41cf-ae9b-f384fb75ca43 admin admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:35:48.683460 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e792a71-cae3-41cf-ae9b-f384fb75ca43 admin admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:35:48.688927 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70973af-5275-4759-ab1b-36ef9521b3d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:35:48.689594 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70973af-5275-4759-ab1b-36ef9521b3d0 admin admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:35:48.689878 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70973af-5275-4759-ab1b-36ef9521b3d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:35:48.690155 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70973af-5275-4759-ab1b-36ef9521b3d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:35:48.690898 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70973af-5275-4759-ab1b-36ef9521b3d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:35:48.692604 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70973af-5275-4759-ab1b-36ef9521b3d0 admin admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:35:48.704288 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 1286/2582] 10.222.0.21 () {58 vars in 1121 bytes} [Wed May 4 07:35:48 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 04 07:35:48.708157 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96d12e9-4f9e-47c4-ba42-e4daf16a2c5a admin admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:35:48.718861 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96d12e9-4f9e-47c4-ba42-e4daf16a2c5a admin admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:35:48.723523 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11010fe-241a-41cf-bd56-3e5ff74df0ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:35:48.724174 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11010fe-241a-41cf-bd56-3e5ff74df0ed admin admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:35:48.724450 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11010fe-241a-41cf-bd56-3e5ff74df0ed admin admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:35:48.724724 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11010fe-241a-41cf-bd56-3e5ff74df0ed admin admin] PATH_INFO: `/v3/roles` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:35:48.725440 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11010fe-241a-41cf-bd56-3e5ff74df0ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:35:48.727623 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11010fe-241a-41cf-bd56-3e5ff74df0ed admin admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:35:48.737905 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 1297/2583] 10.222.0.21 () {58 vars in 1121 bytes} [Wed May 4 07:35:48 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 04 07:35:48.742138 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70973af-5275-4759-ab1b-36ef9521b3d0 admin admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:35:48.752627 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70973af-5275-4759-ab1b-36ef9521b3d0 admin admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:35:48.757374 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bba727e-9b36-49b4-bd4f-ec5bb0c8eb5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:35:48.758301 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bba727e-9b36-49b4-bd4f-ec5bb0c8eb5d admin admin] REQUEST_METHOD: `PUT` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:35:48.758576 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bba727e-9b36-49b4-bd4f-ec5bb0c8eb5d admin admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:35:48.758849 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bba727e-9b36-49b4-bd4f-ec5bb0c8eb5d admin admin] PATH_INFO: `/v3/projects/cc88a29005374d9b80c3c35f0b925a57/users/10af2fb2ae4a434880f8a9fecc056412/roles/9f89c07b05a14f18836116af22cba5f6` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:35:48.774833 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bba727e-9b36-49b4-bd4f-ec5bb0c8eb5d admin admin] RBAC: Authorizing `identity:create_grant(project_id=cc88a29005374d9b80c3c35f0b925a57, user_id=10af2fb2ae4a434880f8a9fecc056412, role_id=9f89c07b05a14f18836116af22cba5f6)` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:35:48.777508 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bba727e-9b36-49b4-bd4f-ec5bb0c8eb5d admin admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:35:48.790970 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 1287/2584] 10.222.0.21 () {60 vars in 1482 bytes} [Wed May 4 07:35:48 2022] PUT /identity/v3/projects/cc88a29005374d9b80c3c35f0b925a57/users/10af2fb2ae4a434880f8a9fecc056412/roles/9f89c07b05a14f18836116af22cba5f6 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 07:35:48.802808 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb07fb99-3d49-4458-a616-77e716c43c9c None None] REQUEST_METHOD: `POST` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:35:48.803096 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb07fb99-3d49-4458-a616-77e716c43c9c None None] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:35:48.803409 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb07fb99-3d49-4458-a616-77e716c43c9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:35:48.829472 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.auth.core [None req-fb07fb99-3d49-4458-a616-77e716c43c9c None None] MFA Rules not processed for user `10af2fb2ae4a434880f8a9fecc056412`. Rule list: `[]` (Enabled: `True`). {{(pid=79744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:35:48.830665 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.fernet_utils [None req-fb07fb99-3d49-4458-a616-77e716c43c9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:35:48.893885 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 1298/2585] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 07:35:48 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 07:35:48.898310 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bba727e-9b36-49b4-bd4f-ec5bb0c8eb5d admin admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:35:48.958600 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bba727e-9b36-49b4-bd4f-ec5bb0c8eb5d admin admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:35:48.964298 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d456d4-59a1-4336-9bb2-7e4b4306e174 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:35:48.964944 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d456d4-59a1-4336-9bb2-7e4b4306e174 admin admin] REQUEST_METHOD: `POST` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:35:48.965220 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d456d4-59a1-4336-9bb2-7e4b4306e174 admin admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:35:48.965512 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d456d4-59a1-4336-9bb2-7e4b4306e174 admin admin] PATH_INFO: `/v3/projects` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:35:48.966203 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d456d4-59a1-4336-9bb2-7e4b4306e174 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:35:48.968119 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d456d4-59a1-4336-9bb2-7e4b4306e174 admin admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:35:48.994743 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 1288/2586] 10.222.0.21 () {60 vars in 1152 bytes} [Wed May 4 07:35:48 2022] POST /identity/v3/projects => generated 367 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 07:35:48.998935 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb07fb99-3d49-4458-a616-77e716c43c9c None None] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:35:49.010536 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb07fb99-3d49-4458-a616-77e716c43c9c None None] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:35:49.065972 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b58c3a4-c53d-449a-9033-3168594cb0d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:35:49.066640 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b58c3a4-c53d-449a-9033-3168594cb0d0 admin admin] REQUEST_METHOD: `POST` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:35:49.066914 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b58c3a4-c53d-449a-9033-3168594cb0d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:35:49.067204 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b58c3a4-c53d-449a-9033-3168594cb0d0 admin admin] PATH_INFO: `/v3/users` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:35:49.067898 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b58c3a4-c53d-449a-9033-3168594cb0d0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:35:49.069786 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b58c3a4-c53d-449a-9033-3168594cb0d0 admin admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:35:49.089510 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 1299/2587] 10.222.0.21 () {60 vars in 1143 bytes} [Wed May 4 07:35:48 2022] POST /identity/v3/users => generated 290 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 07:35:49.093415 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d456d4-59a1-4336-9bb2-7e4b4306e174 admin admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:35:49.103553 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d456d4-59a1-4336-9bb2-7e4b4306e174 admin admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:35:49.108210 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b20447a-9599-4bb2-a0bf-7486c50ccc02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:35:49.108862 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b20447a-9599-4bb2-a0bf-7486c50ccc02 admin admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:35:49.109138 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b20447a-9599-4bb2-a0bf-7486c50ccc02 admin admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:35:49.109410 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b20447a-9599-4bb2-a0bf-7486c50ccc02 admin admin] PATH_INFO: `/v3/roles` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:35:49.110151 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b20447a-9599-4bb2-a0bf-7486c50ccc02 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:35:49.111765 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b20447a-9599-4bb2-a0bf-7486c50ccc02 admin admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:35:49.122278 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 1289/2588] 10.222.0.21 () {58 vars in 1121 bytes} [Wed May 4 07:35:49 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 07:35:49.126630 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b58c3a4-c53d-449a-9033-3168594cb0d0 admin admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:35:49.137231 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b58c3a4-c53d-449a-9033-3168594cb0d0 admin admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:35:49.141946 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3c0d96-e2bd-476a-b128-2867a97b4fcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:35:49.142816 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3c0d96-e2bd-476a-b128-2867a97b4fcd admin admin] REQUEST_METHOD: `PUT` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:35:49.143091 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3c0d96-e2bd-476a-b128-2867a97b4fcd admin admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:35:49.143387 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3c0d96-e2bd-476a-b128-2867a97b4fcd admin admin] PATH_INFO: `/v3/projects/4471791fdfcf461db7e3af125dff1f8f/users/0eec7638e896433d907688ac4260a9e6/roles/eb54c9cea2774a25b1fe8c79724408ee` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:35:49.159361 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3c0d96-e2bd-476a-b128-2867a97b4fcd admin admin] RBAC: Authorizing `identity:create_grant(project_id=4471791fdfcf461db7e3af125dff1f8f, user_id=0eec7638e896433d907688ac4260a9e6, role_id=eb54c9cea2774a25b1fe8c79724408ee)` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:35:49.161979 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3c0d96-e2bd-476a-b128-2867a97b4fcd admin admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:35:49.175138 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 1300/2589] 10.222.0.21 () {60 vars in 1482 bytes} [Wed May 4 07:35:49 2022] PUT /identity/v3/projects/4471791fdfcf461db7e3af125dff1f8f/users/0eec7638e896433d907688ac4260a9e6/roles/eb54c9cea2774a25b1fe8c79724408ee => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 07:35:49.179092 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b20447a-9599-4bb2-a0bf-7486c50ccc02 admin admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:35:49.189122 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b20447a-9599-4bb2-a0bf-7486c50ccc02 admin admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:35:49.245960 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d021d691-abc3-439b-9305-7a11bfef9fda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:35:49.246740 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d021d691-abc3-439b-9305-7a11bfef9fda admin admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:35:49.247579 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d021d691-abc3-439b-9305-7a11bfef9fda admin admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:35:49.247579 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d021d691-abc3-439b-9305-7a11bfef9fda admin admin] PATH_INFO: `/v3/roles` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:35:49.248280 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d021d691-abc3-439b-9305-7a11bfef9fda admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:35:49.250458 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d021d691-abc3-439b-9305-7a11bfef9fda admin admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:35:49.266618 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 1290/2590] 10.222.0.21 () {58 vars in 1121 bytes} [Wed May 4 07:35:49 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 07:35:49.271325 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3c0d96-e2bd-476a-b128-2867a97b4fcd admin admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:35:49.282404 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3c0d96-e2bd-476a-b128-2867a97b4fcd admin admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:35:49.287051 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8b5ded-c672-4b8b-9563-b7db6d659d6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:35:49.287951 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8b5ded-c672-4b8b-9563-b7db6d659d6f admin admin] REQUEST_METHOD: `PUT` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:35:49.288227 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8b5ded-c672-4b8b-9563-b7db6d659d6f admin admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:35:49.288496 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8b5ded-c672-4b8b-9563-b7db6d659d6f admin admin] PATH_INFO: `/v3/projects/4471791fdfcf461db7e3af125dff1f8f/users/0eec7638e896433d907688ac4260a9e6/roles/eb54c9cea2774a25b1fe8c79724408ee` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:35:49.290473 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8b5ded-c672-4b8b-9563-b7db6d659d6f admin admin] RBAC: Authorizing `identity:create_grant(project_id=4471791fdfcf461db7e3af125dff1f8f, user_id=0eec7638e896433d907688ac4260a9e6, role_id=eb54c9cea2774a25b1fe8c79724408ee)` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:35:49.293122 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8b5ded-c672-4b8b-9563-b7db6d659d6f admin admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:35:49.303130 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 1301/2591] 10.222.0.21 () {60 vars in 1482 bytes} [Wed May 4 07:35:49 2022] PUT /identity/v3/projects/4471791fdfcf461db7e3af125dff1f8f/users/0eec7638e896433d907688ac4260a9e6/roles/eb54c9cea2774a25b1fe8c79724408ee => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 07:35:49.313173 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca224e3-ccb9-4fd2-a411-296efb892d84 None None] REQUEST_METHOD: `POST` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:35:49.313677 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca224e3-ccb9-4fd2-a411-296efb892d84 None None] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:35:49.313775 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca224e3-ccb9-4fd2-a411-296efb892d84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:35:49.341964 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.auth.core [None req-bca224e3-ccb9-4fd2-a411-296efb892d84 None None] MFA Rules not processed for user `0eec7638e896433d907688ac4260a9e6`. Rule list: `[]` (Enabled: `True`). {{(pid=79745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:35:49.343258 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.fernet_utils [None req-bca224e3-ccb9-4fd2-a411-296efb892d84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:35:49.409819 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 1291/2592] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 07:35:49 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 07:35:49.420598 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8b5ded-c672-4b8b-9563-b7db6d659d6f admin admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:35:49.422294 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.fernet_utils [None req-2b8b5ded-c672-4b8b-9563-b7db6d659d6f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:35:49.481010 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8b5ded-c672-4b8b-9563-b7db6d659d6f admin admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:35:49.484841 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735e4de9-f0c2-49b6-9b51-3160dc1d440b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb341257aa8246b6847561e2fe1fa385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9f9c44db4984653b8d4b5f6b3b949f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:35:49.485481 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735e4de9-f0c2-49b6-9b51-3160dc1d440b service cinder] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:35:49.485759 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735e4de9-f0c2-49b6-9b51-3160dc1d440b service cinder] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:35:49.486025 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735e4de9-f0c2-49b6-9b51-3160dc1d440b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:35:49.495603 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735e4de9-f0c2-49b6-9b51-3160dc1d440b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:35:49.497030 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735e4de9-f0c2-49b6-9b51-3160dc1d440b service cinder] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:35:49.506808 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 1302/2593] 10.222.0.21 () {60 vars in 1365 bytes} [Wed May 4 07:35:49 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 07:35:50.849413 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca224e3-ccb9-4fd2-a411-296efb892d84 None None] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:35:50.911026 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca224e3-ccb9-4fd2-a411-296efb892d84 None None] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:35:50.915807 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6abe619-6a44-4203-9628-12722176deaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:35:50.916675 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6abe619-6a44-4203-9628-12722176deaf admin admin] REQUEST_METHOD: `DELETE` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:35:50.916951 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6abe619-6a44-4203-9628-12722176deaf admin admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:35:50.917220 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6abe619-6a44-4203-9628-12722176deaf admin admin] PATH_INFO: `/v3/users/10af2fb2ae4a434880f8a9fecc056412` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:35:50.918417 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6abe619-6a44-4203-9628-12722176deaf admin admin] RBAC: Authorizing `identity:delete_user(user_id=10af2fb2ae4a434880f8a9fecc056412)` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:35:50.920413 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6abe619-6a44-4203-9628-12722176deaf admin admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:35:50.968626 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-c6abe619-6a44-4203-9628-12722176deaf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '10af2fb2ae4a434880f8a9fecc056412'} {{(pid=79745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:35:50.980322 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-c6abe619-6a44-4203-9628-12722176deaf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '10af2fb2ae4a434880f8a9fecc056412'} {{(pid=79745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:35:50.981021 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-c6abe619-6a44-4203-9628-12722176deaf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '10af2fb2ae4a434880f8a9fecc056412'} {{(pid=79745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:35:50.981647 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-c6abe619-6a44-4203-9628-12722176deaf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '10af2fb2ae4a434880f8a9fecc056412'} {{(pid=79745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:35:50.989353 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-c6abe619-6a44-4203-9628-12722176deaf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '10af2fb2ae4a434880f8a9fecc056412'} {{(pid=79745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:35:51.002508 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 1292/2594] 10.222.0.21 () {58 vars in 1223 bytes} [Wed May 4 07:35:50 2022] DELETE /identity/v3/users/10af2fb2ae4a434880f8a9fecc056412 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 07:35:51.007036 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1519d436-f41f-45e8-8973-aaee73b57c2f None None] REQUEST_METHOD: `POST` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:35:51.007563 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1519d436-f41f-45e8-8973-aaee73b57c2f None None] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:35:51.007661 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1519d436-f41f-45e8-8973-aaee73b57c2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:35:51.025437 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.auth.core [None req-1519d436-f41f-45e8-8973-aaee73b57c2f None None] MFA Rules not processed for user `83c5e0dcb991496ea6dee38384514508`. Rule list: `[]` (Enabled: `True`). {{(pid=79744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:35:51.026558 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.fernet_utils [None req-1519d436-f41f-45e8-8973-aaee73b57c2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:35:51.084410 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 1303/2595] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 07:35:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 07:35:51.094438 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6abe619-6a44-4203-9628-12722176deaf admin admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:35:51.095851 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.fernet_utils [None req-c6abe619-6a44-4203-9628-12722176deaf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:35:51.155725 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6abe619-6a44-4203-9628-12722176deaf admin admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:35:51.159539 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7173e9-18aa-4152-9f21-3def2885667a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91cb92d00273402b837cb29b37325101', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9f9c44db4984653b8d4b5f6b3b949f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:35:51.160212 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7173e9-18aa-4152-9f21-3def2885667a service neutron] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:35:51.160465 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7173e9-18aa-4152-9f21-3def2885667a service neutron] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:35:51.160742 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7173e9-18aa-4152-9f21-3def2885667a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:35:51.170566 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7173e9-18aa-4152-9f21-3def2885667a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:35:51.172028 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7173e9-18aa-4152-9f21-3def2885667a service neutron] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:35:51.182051 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 1293/2596] 10.222.0.21 () {60 vars in 1365 bytes} [Wed May 4 07:35:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 07:35:51.470588 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1519d436-f41f-45e8-8973-aaee73b57c2f None None] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:35:51.472093 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.fernet_utils [None req-1519d436-f41f-45e8-8973-aaee73b57c2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:35:51.486755 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1519d436-f41f-45e8-8973-aaee73b57c2f None None] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:35:51.492414 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eaa7473-b542-487a-b489-9a10dbc2f7ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:35:51.494179 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eaa7473-b542-487a-b489-9a10dbc2f7ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:35:51.494278 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eaa7473-b542-487a-b489-9a10dbc2f7ed admin admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:35:51.494554 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eaa7473-b542-487a-b489-9a10dbc2f7ed admin admin] PATH_INFO: `/v3/projects/cc88a29005374d9b80c3c35f0b925a57` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:35:51.495795 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eaa7473-b542-487a-b489-9a10dbc2f7ed admin admin] RBAC: Authorizing `identity:delete_project(project_id=cc88a29005374d9b80c3c35f0b925a57)` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:35:51.497715 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eaa7473-b542-487a-b489-9a10dbc2f7ed admin admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:35:51.552361 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-1eaa7473-b542-487a-b489-9a10dbc2f7ed admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cc88a29005374d9b80c3c35f0b925a57', 'request_id': 'req-1eaa7473-b542-487a-b489-9a10dbc2f7ed'} {{(pid=79744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:35:51.558302 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-1eaa7473-b542-487a-b489-9a10dbc2f7ed admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cc88a29005374d9b80c3c35f0b925a57', 'request_id': 'req-1eaa7473-b542-487a-b489-9a10dbc2f7ed'} {{(pid=79744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:35:51.565730 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-1eaa7473-b542-487a-b489-9a10dbc2f7ed admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cc88a29005374d9b80c3c35f0b925a57', 'request_id': 'req-1eaa7473-b542-487a-b489-9a10dbc2f7ed'} {{(pid=79744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:35:51.582080 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-1eaa7473-b542-487a-b489-9a10dbc2f7ed admin admin] The token cache is being invalidate because project cc88a29005374d9b80c3c35f0b925a57 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79744) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 07:35:51.582502 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-1eaa7473-b542-487a-b489-9a10dbc2f7ed admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:35:51.583422 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-1eaa7473-b542-487a-b489-9a10dbc2f7ed admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:35:51.585623 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 1304/2597] 10.222.0.21 () {58 vars in 1232 bytes} [Wed May 4 07:35:51 2022] DELETE /identity/v3/projects/cc88a29005374d9b80c3c35f0b925a57 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 07:35:51.590952 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7173e9-18aa-4152-9f21-3def2885667a service neutron] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:35:51.603851 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7173e9-18aa-4152-9f21-3def2885667a service neutron] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:35:51.665734 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d28784-a1a3-458b-bd67-12c532bdfb51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:35:51.666583 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d28784-a1a3-458b-bd67-12c532bdfb51 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:35:51.666853 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d28784-a1a3-458b-bd67-12c532bdfb51 admin admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:35:51.667116 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d28784-a1a3-458b-bd67-12c532bdfb51 admin admin] PATH_INFO: `/v3/users/0eec7638e896433d907688ac4260a9e6` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:35:51.668341 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d28784-a1a3-458b-bd67-12c532bdfb51 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0eec7638e896433d907688ac4260a9e6)` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:35:51.670252 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d28784-a1a3-458b-bd67-12c532bdfb51 admin admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:35:51.719081 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-f9d28784-a1a3-458b-bd67-12c532bdfb51 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0eec7638e896433d907688ac4260a9e6'} {{(pid=79745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:35:51.730990 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-f9d28784-a1a3-458b-bd67-12c532bdfb51 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0eec7638e896433d907688ac4260a9e6'} {{(pid=79745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:35:51.731700 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-f9d28784-a1a3-458b-bd67-12c532bdfb51 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0eec7638e896433d907688ac4260a9e6'} {{(pid=79745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:35:51.732294 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-f9d28784-a1a3-458b-bd67-12c532bdfb51 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0eec7638e896433d907688ac4260a9e6'} {{(pid=79745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:35:51.738767 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-f9d28784-a1a3-458b-bd67-12c532bdfb51 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0eec7638e896433d907688ac4260a9e6'} {{(pid=79745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:35:51.756222 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 1294/2598] 10.222.0.21 () {58 vars in 1223 bytes} [Wed May 4 07:35:51 2022] DELETE /identity/v3/users/0eec7638e896433d907688ac4260a9e6 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 07:35:52.030704 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eaa7473-b542-487a-b489-9a10dbc2f7ed admin admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:35:52.032407 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.fernet_utils [None req-1eaa7473-b542-487a-b489-9a10dbc2f7ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:35:52.046440 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eaa7473-b542-487a-b489-9a10dbc2f7ed admin admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:35:52.109667 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abb039a-4c9e-4991-b4c9-e7692b86128c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:35:52.110451 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abb039a-4c9e-4991-b4c9-e7692b86128c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:35:52.110718 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abb039a-4c9e-4991-b4c9-e7692b86128c admin admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:35:52.111000 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abb039a-4c9e-4991-b4c9-e7692b86128c admin admin] PATH_INFO: `/v3/projects/4471791fdfcf461db7e3af125dff1f8f` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:35:52.112225 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7abb039a-4c9e-4991-b4c9-e7692b86128c admin admin] RBAC: Authorizing `identity:delete_project(project_id=4471791fdfcf461db7e3af125dff1f8f)` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:35:52.114132 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7abb039a-4c9e-4991-b4c9-e7692b86128c admin admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:35:52.162643 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-7abb039a-4c9e-4991-b4c9-e7692b86128c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4471791fdfcf461db7e3af125dff1f8f', 'request_id': 'req-7abb039a-4c9e-4991-b4c9-e7692b86128c'} {{(pid=79744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:35:52.168356 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-7abb039a-4c9e-4991-b4c9-e7692b86128c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4471791fdfcf461db7e3af125dff1f8f', 'request_id': 'req-7abb039a-4c9e-4991-b4c9-e7692b86128c'} {{(pid=79744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:35:52.174899 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-7abb039a-4c9e-4991-b4c9-e7692b86128c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4471791fdfcf461db7e3af125dff1f8f', 'request_id': 'req-7abb039a-4c9e-4991-b4c9-e7692b86128c'} {{(pid=79744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:35:52.185917 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-7abb039a-4c9e-4991-b4c9-e7692b86128c admin admin] The token cache is being invalidate because project 4471791fdfcf461db7e3af125dff1f8f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79744) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 07:35:52.186201 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-7abb039a-4c9e-4991-b4c9-e7692b86128c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:35:52.186841 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-7abb039a-4c9e-4991-b4c9-e7692b86128c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:35:52.188498 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 1305/2599] 10.222.0.21 () {58 vars in 1232 bytes} [Wed May 4 07:35:52 2022] DELETE /identity/v3/projects/4471791fdfcf461db7e3af125dff1f8f => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 07:35:52.194495 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247bb2f1-5654-41e7-8ae8-8d662408c6d6 None None] REQUEST_METHOD: `POST` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:35:52.195096 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247bb2f1-5654-41e7-8ae8-8d662408c6d6 None None] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:35:52.195241 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247bb2f1-5654-41e7-8ae8-8d662408c6d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:35:52.214752 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.auth.core [None req-247bb2f1-5654-41e7-8ae8-8d662408c6d6 None None] MFA Rules not processed for user `83c5e0dcb991496ea6dee38384514508`. Rule list: `[]` (Enabled: `True`). {{(pid=79745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:35:52.215996 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.fernet_utils [None req-247bb2f1-5654-41e7-8ae8-8d662408c6d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:35:52.287907 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 1295/2600] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 07:35:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 07:35:52.296248 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d76cb1-bcba-49b9-a8dc-22b4d9c7ecf3 None None] REQUEST_METHOD: `POST` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:35:52.296516 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d76cb1-bcba-49b9-a8dc-22b4d9c7ecf3 None None] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:35:52.296793 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d76cb1-bcba-49b9-a8dc-22b4d9c7ecf3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:35:52.316145 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.auth.core [None req-d5d76cb1-bcba-49b9-a8dc-22b4d9c7ecf3 None None] MFA Rules not processed for user `83c5e0dcb991496ea6dee38384514508`. Rule list: `[]` (Enabled: `True`). {{(pid=79744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:35:52.317365 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.fernet_utils [None req-d5d76cb1-bcba-49b9-a8dc-22b4d9c7ecf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:35:52.326673 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 1306/2601] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 07:35:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 07:35:52.331207 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247bb2f1-5654-41e7-8ae8-8d662408c6d6 None None] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:35:52.344934 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247bb2f1-5654-41e7-8ae8-8d662408c6d6 None None] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:35:52.349594 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2247080e-40ff-4907-b795-f3c778205018 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:35:52.350246 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2247080e-40ff-4907-b795-f3c778205018 admin admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:35:52.350584 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2247080e-40ff-4907-b795-f3c778205018 admin admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:35:52.350988 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2247080e-40ff-4907-b795-f3c778205018 admin admin] PATH_INFO: `/v3/domains` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:35:52.351740 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2247080e-40ff-4907-b795-f3c778205018 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 07:35:52.352052 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2247080e-40ff-4907-b795-f3c778205018 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:35:52.353646 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2247080e-40ff-4907-b795-f3c778205018 admin admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:35:52.365531 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 1296/2602] 10.222.0.21 () {58 vars in 1152 bytes} [Wed May 4 07:35:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 07:35:52.370583 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d76cb1-bcba-49b9-a8dc-22b4d9c7ecf3 None None] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:35:52.386133 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d76cb1-bcba-49b9-a8dc-22b4d9c7ecf3 None None] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:35:52.393724 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147bff13-fbbe-4b7d-a892-162fcde67e74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:35:52.394811 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147bff13-fbbe-4b7d-a892-162fcde67e74 admin admin] REQUEST_METHOD: `POST` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:35:52.395349 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147bff13-fbbe-4b7d-a892-162fcde67e74 admin admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:35:52.395842 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147bff13-fbbe-4b7d-a892-162fcde67e74 admin admin] PATH_INFO: `/v3/projects` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:35:52.397091 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147bff13-fbbe-4b7d-a892-162fcde67e74 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:35:52.401489 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147bff13-fbbe-4b7d-a892-162fcde67e74 admin admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:35:52.444279 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 1307/2603] 10.222.0.21 () {60 vars in 1152 bytes} [Wed May 4 07:35:52 2022] POST /identity/v3/projects => generated 377 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 07:35:52.447408 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2247080e-40ff-4907-b795-f3c778205018 admin admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:35:52.463667 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2247080e-40ff-4907-b795-f3c778205018 admin admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:35:52.518592 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d370dd3b-6554-49d4-950e-415a058f6801 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:35:52.519290 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d370dd3b-6554-49d4-950e-415a058f6801 admin admin] REQUEST_METHOD: `POST` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:35:52.519568 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d370dd3b-6554-49d4-950e-415a058f6801 admin admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:35:52.519838 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d370dd3b-6554-49d4-950e-415a058f6801 admin admin] PATH_INFO: `/v3/users` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:35:52.520547 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d370dd3b-6554-49d4-950e-415a058f6801 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:35:52.522443 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d370dd3b-6554-49d4-950e-415a058f6801 admin admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:35:52.542241 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 1297/2604] 10.222.0.21 () {60 vars in 1143 bytes} [Wed May 4 07:35:52 2022] POST /identity/v3/users => generated 289 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 07:35:52.546185 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147bff13-fbbe-4b7d-a892-162fcde67e74 admin admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:35:52.557280 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147bff13-fbbe-4b7d-a892-162fcde67e74 admin admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:35:52.561884 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055f59dd-c492-479c-9bde-bbad7b19a55d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:35:52.562541 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055f59dd-c492-479c-9bde-bbad7b19a55d admin admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:35:52.562816 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055f59dd-c492-479c-9bde-bbad7b19a55d admin admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:35:52.563083 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055f59dd-c492-479c-9bde-bbad7b19a55d admin admin] PATH_INFO: `/v3/roles` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:35:52.563839 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055f59dd-c492-479c-9bde-bbad7b19a55d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:35:52.565492 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055f59dd-c492-479c-9bde-bbad7b19a55d admin admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:35:52.577633 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 1308/2605] 10.222.0.21 () {58 vars in 1121 bytes} [Wed May 4 07:35:52 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 07:35:52.581684 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d370dd3b-6554-49d4-950e-415a058f6801 admin admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:35:52.593547 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d370dd3b-6554-49d4-950e-415a058f6801 admin admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:35:52.599084 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2cdf02-3a08-4b88-825f-e3ede3ae8a61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:35:52.599779 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2cdf02-3a08-4b88-825f-e3ede3ae8a61 admin admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:35:52.600058 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2cdf02-3a08-4b88-825f-e3ede3ae8a61 admin admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:35:52.600333 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2cdf02-3a08-4b88-825f-e3ede3ae8a61 admin admin] PATH_INFO: `/v3/roles` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:35:52.601195 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2cdf02-3a08-4b88-825f-e3ede3ae8a61 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:35:52.602952 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2cdf02-3a08-4b88-825f-e3ede3ae8a61 admin admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:35:52.614406 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 1298/2606] 10.222.0.21 () {58 vars in 1121 bytes} [Wed May 4 07:35:52 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 07:35:52.627433 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055f59dd-c492-479c-9bde-bbad7b19a55d admin admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:35:52.640490 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055f59dd-c492-479c-9bde-bbad7b19a55d admin admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:35:52.646147 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ea0bcf-a5fe-4a14-86c5-b5ef52e929f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:35:52.647352 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ea0bcf-a5fe-4a14-86c5-b5ef52e929f1 admin admin] REQUEST_METHOD: `PUT` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:35:52.647632 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ea0bcf-a5fe-4a14-86c5-b5ef52e929f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:35:52.647904 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ea0bcf-a5fe-4a14-86c5-b5ef52e929f1 admin admin] PATH_INFO: `/v3/projects/3d406d236a6b4fc6a7d8d87c94521344/users/d7dea1a9c3c74c8e8b2d228dbfc309ab/roles/9f89c07b05a14f18836116af22cba5f6` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:35:52.665179 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ea0bcf-a5fe-4a14-86c5-b5ef52e929f1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3d406d236a6b4fc6a7d8d87c94521344, user_id=d7dea1a9c3c74c8e8b2d228dbfc309ab, role_id=9f89c07b05a14f18836116af22cba5f6)` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:35:52.667976 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ea0bcf-a5fe-4a14-86c5-b5ef52e929f1 admin admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:35:52.681238 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 1309/2607] 10.222.0.21 () {60 vars in 1482 bytes} [Wed May 4 07:35:52 2022] PUT /identity/v3/projects/3d406d236a6b4fc6a7d8d87c94521344/users/d7dea1a9c3c74c8e8b2d228dbfc309ab/roles/9f89c07b05a14f18836116af22cba5f6 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 07:35:52.692488 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985bbfc8-733f-407b-b2e0-c287bf280aef None None] REQUEST_METHOD: `POST` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:35:52.692775 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985bbfc8-733f-407b-b2e0-c287bf280aef None None] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:35:52.693049 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985bbfc8-733f-407b-b2e0-c287bf280aef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:35:52.719553 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.auth.core [None req-985bbfc8-733f-407b-b2e0-c287bf280aef None None] MFA Rules not processed for user `d7dea1a9c3c74c8e8b2d228dbfc309ab`. Rule list: `[]` (Enabled: `True`). {{(pid=79745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:35:52.720748 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.fernet_utils [None req-985bbfc8-733f-407b-b2e0-c287bf280aef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:35:52.783321 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 1299/2608] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 07:35:52 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 07:35:52.788219 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ea0bcf-a5fe-4a14-86c5-b5ef52e929f1 admin admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:35:52.847507 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ea0bcf-a5fe-4a14-86c5-b5ef52e929f1 admin admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:35:52.852803 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb51dee4-96e4-4ea5-a881-de4b38156a79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:35:52.853443 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb51dee4-96e4-4ea5-a881-de4b38156a79 admin admin] REQUEST_METHOD: `POST` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:35:52.853717 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb51dee4-96e4-4ea5-a881-de4b38156a79 admin admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:35:52.853985 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb51dee4-96e4-4ea5-a881-de4b38156a79 admin admin] PATH_INFO: `/v3/projects` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:35:52.854673 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb51dee4-96e4-4ea5-a881-de4b38156a79 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:35:52.856596 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb51dee4-96e4-4ea5-a881-de4b38156a79 admin admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:35:52.881919 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 1310/2609] 10.222.0.21 () {60 vars in 1152 bytes} [Wed May 4 07:35:52 2022] POST /identity/v3/projects => generated 379 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 07:35:52.886778 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985bbfc8-733f-407b-b2e0-c287bf280aef None None] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:35:52.897343 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985bbfc8-733f-407b-b2e0-c287bf280aef None None] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:35:52.956478 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b5fb4d-4f27-4752-b560-b0e11d5648a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:35:52.957148 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b5fb4d-4f27-4752-b560-b0e11d5648a9 admin admin] REQUEST_METHOD: `POST` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:35:52.957429 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b5fb4d-4f27-4752-b560-b0e11d5648a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:35:52.957704 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b5fb4d-4f27-4752-b560-b0e11d5648a9 admin admin] PATH_INFO: `/v3/users` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:35:52.958402 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b5fb4d-4f27-4752-b560-b0e11d5648a9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:35:52.960356 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b5fb4d-4f27-4752-b560-b0e11d5648a9 admin admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:35:52.982415 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 1300/2610] 10.222.0.21 () {60 vars in 1143 bytes} [Wed May 4 07:35:52 2022] POST /identity/v3/users => generated 290 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 07:35:52.986434 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb51dee4-96e4-4ea5-a881-de4b38156a79 admin admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:35:52.997375 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb51dee4-96e4-4ea5-a881-de4b38156a79 admin admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:35:53.002015 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662908dd-5117-48e6-9c9d-9bf1e41b93fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:35:53.002922 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662908dd-5117-48e6-9c9d-9bf1e41b93fd admin admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:35:53.003232 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662908dd-5117-48e6-9c9d-9bf1e41b93fd admin admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:35:53.003507 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662908dd-5117-48e6-9c9d-9bf1e41b93fd admin admin] PATH_INFO: `/v3/roles` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:35:53.004231 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662908dd-5117-48e6-9c9d-9bf1e41b93fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:35:53.005808 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662908dd-5117-48e6-9c9d-9bf1e41b93fd admin admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:35:53.016226 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 1311/2611] 10.222.0.21 () {58 vars in 1121 bytes} [Wed May 4 07:35:52 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 07:35:53.020239 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b5fb4d-4f27-4752-b560-b0e11d5648a9 admin admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:35:53.030425 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b5fb4d-4f27-4752-b560-b0e11d5648a9 admin admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:35:53.034939 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59a9e71-0d42-4536-9b42-4794958efe58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:35:53.035639 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59a9e71-0d42-4536-9b42-4794958efe58 admin admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:35:53.035914 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59a9e71-0d42-4536-9b42-4794958efe58 admin admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:35:53.036190 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59a9e71-0d42-4536-9b42-4794958efe58 admin admin] PATH_INFO: `/v3/roles` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:35:53.036899 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59a9e71-0d42-4536-9b42-4794958efe58 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:35:53.038478 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59a9e71-0d42-4536-9b42-4794958efe58 admin admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:35:53.049610 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 1301/2612] 10.222.0.21 () {58 vars in 1121 bytes} [Wed May 4 07:35:53 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 07:35:53.053927 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662908dd-5117-48e6-9c9d-9bf1e41b93fd admin admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:35:53.064750 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662908dd-5117-48e6-9c9d-9bf1e41b93fd admin admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:35:53.069713 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880d7e18-ac0f-4a44-973b-d19752215830 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:35:53.070641 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880d7e18-ac0f-4a44-973b-d19752215830 admin admin] REQUEST_METHOD: `PUT` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:35:53.071015 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880d7e18-ac0f-4a44-973b-d19752215830 admin admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:35:53.071409 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880d7e18-ac0f-4a44-973b-d19752215830 admin admin] PATH_INFO: `/v3/projects/b4f28c54614e402d8e27022ea2ec0a19/users/872c9cd317ca485385b83a6a8a83d2d6/roles/9f89c07b05a14f18836116af22cba5f6` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:35:53.085918 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880d7e18-ac0f-4a44-973b-d19752215830 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b4f28c54614e402d8e27022ea2ec0a19, user_id=872c9cd317ca485385b83a6a8a83d2d6, role_id=9f89c07b05a14f18836116af22cba5f6)` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:35:53.088889 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880d7e18-ac0f-4a44-973b-d19752215830 admin admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:35:53.101060 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 1312/2613] 10.222.0.21 () {60 vars in 1482 bytes} [Wed May 4 07:35:53 2022] PUT /identity/v3/projects/b4f28c54614e402d8e27022ea2ec0a19/users/872c9cd317ca485385b83a6a8a83d2d6/roles/9f89c07b05a14f18836116af22cba5f6 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 07:35:53.111914 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd431ed-e928-4bb9-8e7b-b476ddc7b961 None None] REQUEST_METHOD: `POST` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:35:53.112195 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd431ed-e928-4bb9-8e7b-b476ddc7b961 None None] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:35:53.112465 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd431ed-e928-4bb9-8e7b-b476ddc7b961 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:35:53.139393 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.auth.core [None req-ccd431ed-e928-4bb9-8e7b-b476ddc7b961 None None] MFA Rules not processed for user `872c9cd317ca485385b83a6a8a83d2d6`. Rule list: `[]` (Enabled: `True`). {{(pid=79745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:35:53.140515 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.fernet_utils [None req-ccd431ed-e928-4bb9-8e7b-b476ddc7b961 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:35:53.207651 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 1302/2614] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 07:35:53 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 07:35:53.212954 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880d7e18-ac0f-4a44-973b-d19752215830 admin admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:35:53.273510 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880d7e18-ac0f-4a44-973b-d19752215830 admin admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:35:53.278695 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58f4832-8775-4b92-aaef-ac2b5b1b5baa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:35:53.279394 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58f4832-8775-4b92-aaef-ac2b5b1b5baa admin admin] REQUEST_METHOD: `POST` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:35:53.279661 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58f4832-8775-4b92-aaef-ac2b5b1b5baa admin admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:35:53.279937 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58f4832-8775-4b92-aaef-ac2b5b1b5baa admin admin] PATH_INFO: `/v3/projects` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:35:53.280657 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58f4832-8775-4b92-aaef-ac2b5b1b5baa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:35:53.282565 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58f4832-8775-4b92-aaef-ac2b5b1b5baa admin admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:35:53.307797 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 1313/2615] 10.222.0.21 () {60 vars in 1152 bytes} [Wed May 4 07:35:53 2022] POST /identity/v3/projects => generated 379 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 07:35:53.311911 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd431ed-e928-4bb9-8e7b-b476ddc7b961 None None] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:35:53.322857 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd431ed-e928-4bb9-8e7b-b476ddc7b961 None None] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:35:53.377946 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f566f27-e095-494c-88ac-03bd88b82399 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:35:53.378570 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f566f27-e095-494c-88ac-03bd88b82399 admin admin] REQUEST_METHOD: `POST` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:35:53.378848 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f566f27-e095-494c-88ac-03bd88b82399 admin admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:35:53.379113 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f566f27-e095-494c-88ac-03bd88b82399 admin admin] PATH_INFO: `/v3/users` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:35:53.379831 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f566f27-e095-494c-88ac-03bd88b82399 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:35:53.381746 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f566f27-e095-494c-88ac-03bd88b82399 admin admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:35:53.401771 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 1303/2616] 10.222.0.21 () {60 vars in 1143 bytes} [Wed May 4 07:35:53 2022] POST /identity/v3/users => generated 296 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 07:35:53.405799 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58f4832-8775-4b92-aaef-ac2b5b1b5baa admin admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:35:53.416549 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58f4832-8775-4b92-aaef-ac2b5b1b5baa admin admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:35:53.421259 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff2f851-801e-425e-85f6-bcb3dc69390e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:35:53.421914 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff2f851-801e-425e-85f6-bcb3dc69390e admin admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:35:53.422191 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff2f851-801e-425e-85f6-bcb3dc69390e admin admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:35:53.422475 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff2f851-801e-425e-85f6-bcb3dc69390e admin admin] PATH_INFO: `/v3/roles` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:35:53.423247 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff2f851-801e-425e-85f6-bcb3dc69390e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:35:53.424889 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff2f851-801e-425e-85f6-bcb3dc69390e admin admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:35:53.436148 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 1314/2617] 10.222.0.21 () {58 vars in 1121 bytes} [Wed May 4 07:35:53 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 07:35:53.440551 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f566f27-e095-494c-88ac-03bd88b82399 admin admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:35:53.451003 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f566f27-e095-494c-88ac-03bd88b82399 admin admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:35:53.455795 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5a996c-2253-4d58-b14d-aa1f72488a7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:35:53.456680 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5a996c-2253-4d58-b14d-aa1f72488a7d admin admin] REQUEST_METHOD: `PUT` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:35:53.456959 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5a996c-2253-4d58-b14d-aa1f72488a7d admin admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:35:53.457233 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5a996c-2253-4d58-b14d-aa1f72488a7d admin admin] PATH_INFO: `/v3/projects/64a8944b8f3b4215b352a6a9308d4645/users/f4a03a4a00644073836f509e5101f227/roles/eb54c9cea2774a25b1fe8c79724408ee` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:35:53.472845 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5a996c-2253-4d58-b14d-aa1f72488a7d admin admin] RBAC: Authorizing `identity:create_grant(project_id=64a8944b8f3b4215b352a6a9308d4645, user_id=f4a03a4a00644073836f509e5101f227, role_id=eb54c9cea2774a25b1fe8c79724408ee)` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:35:53.475610 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5a996c-2253-4d58-b14d-aa1f72488a7d admin admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:35:53.489068 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 1304/2618] 10.222.0.21 () {60 vars in 1482 bytes} [Wed May 4 07:35:53 2022] PUT /identity/v3/projects/64a8944b8f3b4215b352a6a9308d4645/users/f4a03a4a00644073836f509e5101f227/roles/eb54c9cea2774a25b1fe8c79724408ee => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 07:35:53.493037 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff2f851-801e-425e-85f6-bcb3dc69390e admin admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:35:53.503338 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff2f851-801e-425e-85f6-bcb3dc69390e admin admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:35:53.557360 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757ce79f-f848-4344-b6f1-913f0867e00f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:35:53.558028 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757ce79f-f848-4344-b6f1-913f0867e00f admin admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:35:53.558307 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757ce79f-f848-4344-b6f1-913f0867e00f admin admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:35:53.558578 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757ce79f-f848-4344-b6f1-913f0867e00f admin admin] PATH_INFO: `/v3/roles` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:35:53.559325 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757ce79f-f848-4344-b6f1-913f0867e00f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:35:53.560910 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757ce79f-f848-4344-b6f1-913f0867e00f admin admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:35:53.571127 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 1315/2619] 10.222.0.21 () {58 vars in 1121 bytes} [Wed May 4 07:35:53 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 07:35:53.575529 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5a996c-2253-4d58-b14d-aa1f72488a7d admin admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:35:53.586721 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5a996c-2253-4d58-b14d-aa1f72488a7d admin admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:35:53.591610 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028b6e1b-bbcd-462a-ab04-790813e0a75f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:35:53.592484 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028b6e1b-bbcd-462a-ab04-790813e0a75f admin admin] REQUEST_METHOD: `PUT` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:35:53.592752 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028b6e1b-bbcd-462a-ab04-790813e0a75f admin admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:35:53.593017 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028b6e1b-bbcd-462a-ab04-790813e0a75f admin admin] PATH_INFO: `/v3/projects/64a8944b8f3b4215b352a6a9308d4645/users/f4a03a4a00644073836f509e5101f227/roles/eb54c9cea2774a25b1fe8c79724408ee` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:35:53.594960 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028b6e1b-bbcd-462a-ab04-790813e0a75f admin admin] RBAC: Authorizing `identity:create_grant(project_id=64a8944b8f3b4215b352a6a9308d4645, user_id=f4a03a4a00644073836f509e5101f227, role_id=eb54c9cea2774a25b1fe8c79724408ee)` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:35:53.597603 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028b6e1b-bbcd-462a-ab04-790813e0a75f admin admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:35:53.608182 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 1305/2620] 10.222.0.21 () {60 vars in 1482 bytes} [Wed May 4 07:35:53 2022] PUT /identity/v3/projects/64a8944b8f3b4215b352a6a9308d4645/users/f4a03a4a00644073836f509e5101f227/roles/eb54c9cea2774a25b1fe8c79724408ee => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 07:35:53.618492 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d513951-4a2f-4f8f-98ed-48c0b60892ff None None] REQUEST_METHOD: `POST` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:35:53.618776 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d513951-4a2f-4f8f-98ed-48c0b60892ff None None] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:35:53.619052 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d513951-4a2f-4f8f-98ed-48c0b60892ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:35:53.652335 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.auth.core [None req-9d513951-4a2f-4f8f-98ed-48c0b60892ff None None] MFA Rules not processed for user `f4a03a4a00644073836f509e5101f227`. Rule list: `[]` (Enabled: `True`). {{(pid=79744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:35:53.653452 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.fernet_utils [None req-9d513951-4a2f-4f8f-98ed-48c0b60892ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:35:53.730146 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 1316/2621] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 07:35:53 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 07:35:53.741382 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028b6e1b-bbcd-462a-ab04-790813e0a75f admin admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:35:53.743469 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.fernet_utils [None req-028b6e1b-bbcd-462a-ab04-790813e0a75f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:35:53.811622 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028b6e1b-bbcd-462a-ab04-790813e0a75f admin admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:35:53.815304 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf46721-350c-406d-a617-0e2e28e06b2b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb341257aa8246b6847561e2fe1fa385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9f9c44db4984653b8d4b5f6b3b949f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:35:53.815950 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf46721-350c-406d-a617-0e2e28e06b2b service cinder] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:35:53.816232 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf46721-350c-406d-a617-0e2e28e06b2b service cinder] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:35:53.816503 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf46721-350c-406d-a617-0e2e28e06b2b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:35:53.826509 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf46721-350c-406d-a617-0e2e28e06b2b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:35:53.827986 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf46721-350c-406d-a617-0e2e28e06b2b service cinder] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:35:53.838275 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 1306/2622] 10.222.0.21 () {60 vars in 1365 bytes} [Wed May 4 07:35:53 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 07:35:53.891401 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d513951-4a2f-4f8f-98ed-48c0b60892ff None None] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:35:53.893183 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.fernet_utils [None req-9d513951-4a2f-4f8f-98ed-48c0b60892ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:35:53.906766 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d513951-4a2f-4f8f-98ed-48c0b60892ff None None] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:35:53.910282 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346ff49b-4ca9-40ca-93f9-a285594ef99f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb341257aa8246b6847561e2fe1fa385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9f9c44db4984653b8d4b5f6b3b949f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:35:53.910927 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346ff49b-4ca9-40ca-93f9-a285594ef99f service cinder] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:35:53.911232 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346ff49b-4ca9-40ca-93f9-a285594ef99f service cinder] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:35:53.911505 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346ff49b-4ca9-40ca-93f9-a285594ef99f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:35:53.973978 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346ff49b-4ca9-40ca-93f9-a285594ef99f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:35:53.975525 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346ff49b-4ca9-40ca-93f9-a285594ef99f service cinder] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:35:53.985091 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 1317/2623] 10.222.0.21 () {60 vars in 1365 bytes} [Wed May 4 07:35:53 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 07:35:56.853130 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf46721-350c-406d-a617-0e2e28e06b2b service cinder] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:35:56.913118 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf46721-350c-406d-a617-0e2e28e06b2b service cinder] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:35:56.917901 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2da4b8-8c6c-43cc-b3cb-3a4998c13186 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:35:56.918755 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2da4b8-8c6c-43cc-b3cb-3a4998c13186 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:35:56.919034 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2da4b8-8c6c-43cc-b3cb-3a4998c13186 admin admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:35:56.919337 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2da4b8-8c6c-43cc-b3cb-3a4998c13186 admin admin] PATH_INFO: `/v3/users/d7dea1a9c3c74c8e8b2d228dbfc309ab` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:35:56.920634 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2da4b8-8c6c-43cc-b3cb-3a4998c13186 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d7dea1a9c3c74c8e8b2d228dbfc309ab)` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:35:56.922543 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2da4b8-8c6c-43cc-b3cb-3a4998c13186 admin admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:35:56.967015 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-2e2da4b8-8c6c-43cc-b3cb-3a4998c13186 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd7dea1a9c3c74c8e8b2d228dbfc309ab'} {{(pid=79745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:35:56.978583 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-2e2da4b8-8c6c-43cc-b3cb-3a4998c13186 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd7dea1a9c3c74c8e8b2d228dbfc309ab'} {{(pid=79745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:35:56.979328 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-2e2da4b8-8c6c-43cc-b3cb-3a4998c13186 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd7dea1a9c3c74c8e8b2d228dbfc309ab'} {{(pid=79745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:35:56.979935 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-2e2da4b8-8c6c-43cc-b3cb-3a4998c13186 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd7dea1a9c3c74c8e8b2d228dbfc309ab'} {{(pid=79745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:35:56.986462 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-2e2da4b8-8c6c-43cc-b3cb-3a4998c13186 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd7dea1a9c3c74c8e8b2d228dbfc309ab'} {{(pid=79745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:35:56.999695 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 1307/2624] 10.222.0.21 () {58 vars in 1223 bytes} [Wed May 4 07:35:56 2022] DELETE /identity/v3/users/d7dea1a9c3c74c8e8b2d228dbfc309ab => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 07:35:57.004517 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a4d252-4db1-4a30-b718-c124632c16bc None None] REQUEST_METHOD: `POST` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:35:57.005175 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a4d252-4db1-4a30-b718-c124632c16bc None None] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:35:57.005175 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a4d252-4db1-4a30-b718-c124632c16bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:35:57.022729 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.auth.core [None req-f7a4d252-4db1-4a30-b718-c124632c16bc None None] MFA Rules not processed for user `83c5e0dcb991496ea6dee38384514508`. Rule list: `[]` (Enabled: `True`). {{(pid=79744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:35:57.023886 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.fernet_utils [None req-f7a4d252-4db1-4a30-b718-c124632c16bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:35:57.091725 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 1318/2625] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 07:35:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 07:35:57.101273 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2da4b8-8c6c-43cc-b3cb-3a4998c13186 admin admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:35:57.102862 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.fernet_utils [None req-2e2da4b8-8c6c-43cc-b3cb-3a4998c13186 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:35:57.159021 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2da4b8-8c6c-43cc-b3cb-3a4998c13186 admin admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:35:57.162643 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58cb1afd-5745-40f6-8ee3-0047dbf33475 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91cb92d00273402b837cb29b37325101', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9f9c44db4984653b8d4b5f6b3b949f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:35:57.163305 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cb1afd-5745-40f6-8ee3-0047dbf33475 service neutron] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:35:57.163580 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cb1afd-5745-40f6-8ee3-0047dbf33475 service neutron] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:35:57.163899 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cb1afd-5745-40f6-8ee3-0047dbf33475 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:35:57.173388 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58cb1afd-5745-40f6-8ee3-0047dbf33475 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:35:57.174837 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58cb1afd-5745-40f6-8ee3-0047dbf33475 service neutron] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:35:57.184624 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 1308/2626] 10.222.0.21 () {60 vars in 1365 bytes} [Wed May 4 07:35:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 07:35:57.457294 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a4d252-4db1-4a30-b718-c124632c16bc None None] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:35:57.460244 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.fernet_utils [None req-f7a4d252-4db1-4a30-b718-c124632c16bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:35:57.472406 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a4d252-4db1-4a30-b718-c124632c16bc None None] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:35:57.480207 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ad8bc0-eef7-42ec-955e-f54c083fcd8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:35:57.481163 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ad8bc0-eef7-42ec-955e-f54c083fcd8b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:35:57.481431 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ad8bc0-eef7-42ec-955e-f54c083fcd8b admin admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:35:57.481712 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ad8bc0-eef7-42ec-955e-f54c083fcd8b admin admin] PATH_INFO: `/v3/projects/3d406d236a6b4fc6a7d8d87c94521344` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:35:57.483124 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ad8bc0-eef7-42ec-955e-f54c083fcd8b admin admin] RBAC: Authorizing `identity:delete_project(project_id=3d406d236a6b4fc6a7d8d87c94521344)` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:35:57.485143 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ad8bc0-eef7-42ec-955e-f54c083fcd8b admin admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:35:57.534931 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-f8ad8bc0-eef7-42ec-955e-f54c083fcd8b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3d406d236a6b4fc6a7d8d87c94521344', 'request_id': 'req-f8ad8bc0-eef7-42ec-955e-f54c083fcd8b'} {{(pid=79744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:35:57.541007 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-f8ad8bc0-eef7-42ec-955e-f54c083fcd8b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3d406d236a6b4fc6a7d8d87c94521344', 'request_id': 'req-f8ad8bc0-eef7-42ec-955e-f54c083fcd8b'} {{(pid=79744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:35:57.548468 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-f8ad8bc0-eef7-42ec-955e-f54c083fcd8b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3d406d236a6b4fc6a7d8d87c94521344', 'request_id': 'req-f8ad8bc0-eef7-42ec-955e-f54c083fcd8b'} {{(pid=79744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:35:57.559323 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-f8ad8bc0-eef7-42ec-955e-f54c083fcd8b admin admin] The token cache is being invalidate because project 3d406d236a6b4fc6a7d8d87c94521344 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79744) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 07:35:57.559607 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-f8ad8bc0-eef7-42ec-955e-f54c083fcd8b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:35:57.560840 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-f8ad8bc0-eef7-42ec-955e-f54c083fcd8b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:35:57.562390 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 1319/2627] 10.222.0.21 () {58 vars in 1232 bytes} [Wed May 4 07:35:57 2022] DELETE /identity/v3/projects/3d406d236a6b4fc6a7d8d87c94521344 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 07:35:57.566495 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58cb1afd-5745-40f6-8ee3-0047dbf33475 service neutron] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:35:57.576981 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58cb1afd-5745-40f6-8ee3-0047dbf33475 service neutron] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:35:57.633377 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17854099-b764-49c5-9ecd-ef872a67dba1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:35:57.634238 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17854099-b764-49c5-9ecd-ef872a67dba1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:35:57.634511 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17854099-b764-49c5-9ecd-ef872a67dba1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:35:57.634778 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17854099-b764-49c5-9ecd-ef872a67dba1 admin admin] PATH_INFO: `/v3/users/872c9cd317ca485385b83a6a8a83d2d6` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:35:57.635981 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17854099-b764-49c5-9ecd-ef872a67dba1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=872c9cd317ca485385b83a6a8a83d2d6)` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:35:57.637872 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17854099-b764-49c5-9ecd-ef872a67dba1 admin admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:35:57.681989 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-17854099-b764-49c5-9ecd-ef872a67dba1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '872c9cd317ca485385b83a6a8a83d2d6'} {{(pid=79745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:35:57.693267 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-17854099-b764-49c5-9ecd-ef872a67dba1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '872c9cd317ca485385b83a6a8a83d2d6'} {{(pid=79745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:35:57.693928 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-17854099-b764-49c5-9ecd-ef872a67dba1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '872c9cd317ca485385b83a6a8a83d2d6'} {{(pid=79745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:35:57.694571 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-17854099-b764-49c5-9ecd-ef872a67dba1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '872c9cd317ca485385b83a6a8a83d2d6'} {{(pid=79745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:35:57.701259 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-17854099-b764-49c5-9ecd-ef872a67dba1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '872c9cd317ca485385b83a6a8a83d2d6'} {{(pid=79745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:35:57.716177 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 1309/2628] 10.222.0.21 () {58 vars in 1223 bytes} [Wed May 4 07:35:57 2022] DELETE /identity/v3/users/872c9cd317ca485385b83a6a8a83d2d6 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 07:35:57.988912 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ad8bc0-eef7-42ec-955e-f54c083fcd8b admin admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:35:57.990340 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.fernet_utils [None req-f8ad8bc0-eef7-42ec-955e-f54c083fcd8b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:35:58.015513 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ad8bc0-eef7-42ec-955e-f54c083fcd8b admin admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:35:58.070228 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a3fcdf-a797-4fce-b797-2b00e775ffd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:35:58.071847 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a3fcdf-a797-4fce-b797-2b00e775ffd8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:35:58.072076 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a3fcdf-a797-4fce-b797-2b00e775ffd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:35:58.072349 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a3fcdf-a797-4fce-b797-2b00e775ffd8 admin admin] PATH_INFO: `/v3/projects/b4f28c54614e402d8e27022ea2ec0a19` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:35:58.073538 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a3fcdf-a797-4fce-b797-2b00e775ffd8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b4f28c54614e402d8e27022ea2ec0a19)` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:35:58.075486 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a3fcdf-a797-4fce-b797-2b00e775ffd8 admin admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:35:58.124594 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-b8a3fcdf-a797-4fce-b797-2b00e775ffd8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b4f28c54614e402d8e27022ea2ec0a19', 'request_id': 'req-b8a3fcdf-a797-4fce-b797-2b00e775ffd8'} {{(pid=79744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:35:58.127017 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-b8a3fcdf-a797-4fce-b797-2b00e775ffd8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b4f28c54614e402d8e27022ea2ec0a19', 'request_id': 'req-b8a3fcdf-a797-4fce-b797-2b00e775ffd8'} {{(pid=79744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:35:58.139621 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-b8a3fcdf-a797-4fce-b797-2b00e775ffd8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b4f28c54614e402d8e27022ea2ec0a19', 'request_id': 'req-b8a3fcdf-a797-4fce-b797-2b00e775ffd8'} {{(pid=79744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:35:58.150741 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-b8a3fcdf-a797-4fce-b797-2b00e775ffd8 admin admin] The token cache is being invalidate because project b4f28c54614e402d8e27022ea2ec0a19 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79744) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 07:35:58.151034 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-b8a3fcdf-a797-4fce-b797-2b00e775ffd8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:35:58.151717 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-b8a3fcdf-a797-4fce-b797-2b00e775ffd8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:35:58.153271 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 1320/2629] 10.222.0.21 () {58 vars in 1232 bytes} [Wed May 4 07:35:57 2022] DELETE /identity/v3/projects/b4f28c54614e402d8e27022ea2ec0a19 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 07:35:58.157377 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17854099-b764-49c5-9ecd-ef872a67dba1 admin admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:35:58.158777 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.fernet_utils [None req-17854099-b764-49c5-9ecd-ef872a67dba1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:35:58.171581 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17854099-b764-49c5-9ecd-ef872a67dba1 admin admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:35:58.228818 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd3a3e8-9612-4ee2-8355-4be1d1cbbf5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:35:58.229682 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd3a3e8-9612-4ee2-8355-4be1d1cbbf5e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:35:58.229962 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd3a3e8-9612-4ee2-8355-4be1d1cbbf5e admin admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:35:58.230263 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd3a3e8-9612-4ee2-8355-4be1d1cbbf5e admin admin] PATH_INFO: `/v3/users/f4a03a4a00644073836f509e5101f227` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:35:58.231506 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd3a3e8-9612-4ee2-8355-4be1d1cbbf5e admin admin] RBAC: Authorizing `identity:delete_user(user_id=f4a03a4a00644073836f509e5101f227)` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:35:58.233436 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd3a3e8-9612-4ee2-8355-4be1d1cbbf5e admin admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:35:58.280838 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-bdd3a3e8-9612-4ee2-8355-4be1d1cbbf5e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f4a03a4a00644073836f509e5101f227'} {{(pid=79745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:35:58.294836 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-bdd3a3e8-9612-4ee2-8355-4be1d1cbbf5e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f4a03a4a00644073836f509e5101f227'} {{(pid=79745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:35:58.295524 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-bdd3a3e8-9612-4ee2-8355-4be1d1cbbf5e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f4a03a4a00644073836f509e5101f227'} {{(pid=79745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:35:58.296114 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-bdd3a3e8-9612-4ee2-8355-4be1d1cbbf5e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f4a03a4a00644073836f509e5101f227'} {{(pid=79745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:35:58.302641 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-bdd3a3e8-9612-4ee2-8355-4be1d1cbbf5e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f4a03a4a00644073836f509e5101f227'} {{(pid=79745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:35:58.316600 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 1310/2630] 10.222.0.21 () {58 vars in 1223 bytes} [Wed May 4 07:35:58 2022] DELETE /identity/v3/users/f4a03a4a00644073836f509e5101f227 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 07:35:58.590820 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a3fcdf-a797-4fce-b797-2b00e775ffd8 admin admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:35:58.592459 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.fernet_utils [None req-b8a3fcdf-a797-4fce-b797-2b00e775ffd8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:35:58.612376 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a3fcdf-a797-4fce-b797-2b00e775ffd8 admin admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:35:58.674310 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbcbcd4-04c9-4dea-bfaa-b858f53e8a2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:35:58.675216 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbcbcd4-04c9-4dea-bfaa-b858f53e8a2c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:35:58.675743 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbcbcd4-04c9-4dea-bfaa-b858f53e8a2c admin admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:35:58.676063 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbcbcd4-04c9-4dea-bfaa-b858f53e8a2c admin admin] PATH_INFO: `/v3/projects/64a8944b8f3b4215b352a6a9308d4645` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:35:58.677312 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bbcbcd4-04c9-4dea-bfaa-b858f53e8a2c admin admin] RBAC: Authorizing `identity:delete_project(project_id=64a8944b8f3b4215b352a6a9308d4645)` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:35:58.679259 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bbcbcd4-04c9-4dea-bfaa-b858f53e8a2c admin admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:35:58.731724 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-1bbcbcd4-04c9-4dea-bfaa-b858f53e8a2c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '64a8944b8f3b4215b352a6a9308d4645', 'request_id': 'req-1bbcbcd4-04c9-4dea-bfaa-b858f53e8a2c'} {{(pid=79744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:35:58.736915 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-1bbcbcd4-04c9-4dea-bfaa-b858f53e8a2c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '64a8944b8f3b4215b352a6a9308d4645', 'request_id': 'req-1bbcbcd4-04c9-4dea-bfaa-b858f53e8a2c'} {{(pid=79744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:35:58.744275 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-1bbcbcd4-04c9-4dea-bfaa-b858f53e8a2c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '64a8944b8f3b4215b352a6a9308d4645', 'request_id': 'req-1bbcbcd4-04c9-4dea-bfaa-b858f53e8a2c'} {{(pid=79744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:35:58.761251 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-1bbcbcd4-04c9-4dea-bfaa-b858f53e8a2c admin admin] The token cache is being invalidate because project 64a8944b8f3b4215b352a6a9308d4645 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79744) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 07:35:58.761532 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-1bbcbcd4-04c9-4dea-bfaa-b858f53e8a2c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:35:58.762182 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-1bbcbcd4-04c9-4dea-bfaa-b858f53e8a2c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:35:58.763768 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 1321/2631] 10.222.0.21 () {58 vars in 1232 bytes} [Wed May 4 07:35:58 2022] DELETE /identity/v3/projects/64a8944b8f3b4215b352a6a9308d4645 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 07:35:58.769785 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47abd345-174b-4603-84cc-8107cdafbe2e None None] REQUEST_METHOD: `POST` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:35:58.770128 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47abd345-174b-4603-84cc-8107cdafbe2e None None] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:35:58.770525 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47abd345-174b-4603-84cc-8107cdafbe2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:35:58.791570 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.auth.core [None req-47abd345-174b-4603-84cc-8107cdafbe2e None None] MFA Rules not processed for user `83c5e0dcb991496ea6dee38384514508`. Rule list: `[]` (Enabled: `True`). {{(pid=79745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:35:58.792793 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.fernet_utils [None req-47abd345-174b-4603-84cc-8107cdafbe2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:35:58.849586 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 1311/2632] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 07:35:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 07:35:58.859290 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2179e09-90d1-4457-9d89-35f168c34bdb None None] REQUEST_METHOD: `POST` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:35:58.859570 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2179e09-90d1-4457-9d89-35f168c34bdb None None] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:35:58.859840 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2179e09-90d1-4457-9d89-35f168c34bdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:35:58.878507 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.auth.core [None req-f2179e09-90d1-4457-9d89-35f168c34bdb None None] MFA Rules not processed for user `83c5e0dcb991496ea6dee38384514508`. Rule list: `[]` (Enabled: `True`). {{(pid=79744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:35:58.879715 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.fernet_utils [None req-f2179e09-90d1-4457-9d89-35f168c34bdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:35:58.887985 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 1322/2633] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 07:35:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 07:35:58.892124 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47abd345-174b-4603-84cc-8107cdafbe2e None None] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:35:58.902339 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47abd345-174b-4603-84cc-8107cdafbe2e None None] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:35:58.906907 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38a20fb-be54-45a3-99d6-204267c42000 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:35:58.907638 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38a20fb-be54-45a3-99d6-204267c42000 admin admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:35:58.907920 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38a20fb-be54-45a3-99d6-204267c42000 admin admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:35:58.908226 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38a20fb-be54-45a3-99d6-204267c42000 admin admin] PATH_INFO: `/v3/domains` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:35:58.908983 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38a20fb-be54-45a3-99d6-204267c42000 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 07:35:58.909291 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38a20fb-be54-45a3-99d6-204267c42000 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:35:58.910984 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38a20fb-be54-45a3-99d6-204267c42000 admin admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:35:58.922093 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 1312/2634] 10.222.0.21 () {58 vars in 1152 bytes} [Wed May 4 07:35:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 07:35:58.926424 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2179e09-90d1-4457-9d89-35f168c34bdb None None] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:35:58.935621 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2179e09-90d1-4457-9d89-35f168c34bdb None None] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:35:58.940168 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1314d7-d40c-4053-9a0a-03a95d57f10a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:35:58.940799 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1314d7-d40c-4053-9a0a-03a95d57f10a admin admin] REQUEST_METHOD: `POST` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:35:58.941075 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1314d7-d40c-4053-9a0a-03a95d57f10a admin admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:35:58.941345 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1314d7-d40c-4053-9a0a-03a95d57f10a admin admin] PATH_INFO: `/v3/projects` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:35:58.942030 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1314d7-d40c-4053-9a0a-03a95d57f10a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:35:58.943944 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1314d7-d40c-4053-9a0a-03a95d57f10a admin admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:35:58.969719 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 1323/2635] 10.222.0.21 () {60 vars in 1152 bytes} [Wed May 4 07:35:58 2022] POST /identity/v3/projects => generated 373 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 07:35:58.973876 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38a20fb-be54-45a3-99d6-204267c42000 admin admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:35:58.984368 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38a20fb-be54-45a3-99d6-204267c42000 admin admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:35:59.040194 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b203bc6-a876-4edd-8c31-010d5e424abb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:35:59.040850 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b203bc6-a876-4edd-8c31-010d5e424abb admin admin] REQUEST_METHOD: `POST` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:35:59.041132 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b203bc6-a876-4edd-8c31-010d5e424abb admin admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:35:59.041400 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b203bc6-a876-4edd-8c31-010d5e424abb admin admin] PATH_INFO: `/v3/users` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:35:59.042083 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b203bc6-a876-4edd-8c31-010d5e424abb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:35:59.044006 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b203bc6-a876-4edd-8c31-010d5e424abb admin admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:35:59.063725 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 1313/2636] 10.222.0.21 () {60 vars in 1143 bytes} [Wed May 4 07:35:58 2022] POST /identity/v3/users => generated 287 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 07:35:59.067771 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1314d7-d40c-4053-9a0a-03a95d57f10a admin admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:35:59.080070 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1314d7-d40c-4053-9a0a-03a95d57f10a admin admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:35:59.084869 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1346228-534e-4562-907d-6a91313799f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:35:59.085527 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1346228-534e-4562-907d-6a91313799f7 admin admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:35:59.085800 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1346228-534e-4562-907d-6a91313799f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:35:59.086756 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1346228-534e-4562-907d-6a91313799f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:35:59.087516 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1346228-534e-4562-907d-6a91313799f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:35:59.089093 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1346228-534e-4562-907d-6a91313799f7 admin admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:35:59.102654 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 1324/2637] 10.222.0.21 () {58 vars in 1121 bytes} [Wed May 4 07:35:59 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 07:35:59.103877 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b203bc6-a876-4edd-8c31-010d5e424abb admin admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:35:59.113643 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b203bc6-a876-4edd-8c31-010d5e424abb admin admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:35:59.118498 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbfd8b0c-83fd-4827-84a9-63f16c31a6a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:35:59.119171 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfd8b0c-83fd-4827-84a9-63f16c31a6a8 admin admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:35:59.119459 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfd8b0c-83fd-4827-84a9-63f16c31a6a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:35:59.119735 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfd8b0c-83fd-4827-84a9-63f16c31a6a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:35:59.120454 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbfd8b0c-83fd-4827-84a9-63f16c31a6a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:35:59.122019 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbfd8b0c-83fd-4827-84a9-63f16c31a6a8 admin admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:35:59.135235 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 1314/2638] 10.222.0.21 () {58 vars in 1121 bytes} [Wed May 4 07:35:59 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 04 07:35:59.137862 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1346228-534e-4562-907d-6a91313799f7 admin admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:35:59.150742 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1346228-534e-4562-907d-6a91313799f7 admin admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:35:59.155608 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa460d32-83d3-4167-b6f3-187b130c23ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:35:59.156498 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa460d32-83d3-4167-b6f3-187b130c23ac admin admin] REQUEST_METHOD: `PUT` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:35:59.156708 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa460d32-83d3-4167-b6f3-187b130c23ac admin admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:35:59.156994 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa460d32-83d3-4167-b6f3-187b130c23ac admin admin] PATH_INFO: `/v3/projects/a8e0b926bca446e3a7e58e0729b13b2b/users/0b52c5bf492240cbbbbbc87cb90a2d34/roles/9f89c07b05a14f18836116af22cba5f6` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:35:59.173367 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa460d32-83d3-4167-b6f3-187b130c23ac admin admin] RBAC: Authorizing `identity:create_grant(project_id=a8e0b926bca446e3a7e58e0729b13b2b, user_id=0b52c5bf492240cbbbbbc87cb90a2d34, role_id=9f89c07b05a14f18836116af22cba5f6)` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:35:59.176186 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa460d32-83d3-4167-b6f3-187b130c23ac admin admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:35:59.190519 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 1325/2639] 10.222.0.21 () {60 vars in 1482 bytes} [Wed May 4 07:35:59 2022] PUT /identity/v3/projects/a8e0b926bca446e3a7e58e0729b13b2b/users/0b52c5bf492240cbbbbbc87cb90a2d34/roles/9f89c07b05a14f18836116af22cba5f6 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 07:35:59.202957 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39d6da6-a623-497b-8da3-cea742290356 None None] REQUEST_METHOD: `POST` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:35:59.203504 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39d6da6-a623-497b-8da3-cea742290356 None None] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:35:59.203617 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39d6da6-a623-497b-8da3-cea742290356 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:35:59.236364 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.auth.core [None req-d39d6da6-a623-497b-8da3-cea742290356 None None] MFA Rules not processed for user `0b52c5bf492240cbbbbbc87cb90a2d34`. Rule list: `[]` (Enabled: `True`). {{(pid=79745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:35:59.237566 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.fernet_utils [None req-d39d6da6-a623-497b-8da3-cea742290356 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:35:59.300964 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 1315/2640] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 07:35:59 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 07:35:59.313720 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa460d32-83d3-4167-b6f3-187b130c23ac admin admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:35:59.315502 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.fernet_utils [None req-fa460d32-83d3-4167-b6f3-187b130c23ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:35:59.370894 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa460d32-83d3-4167-b6f3-187b130c23ac admin admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:35:59.374465 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49639328-4dba-47b6-9394-6f5e16a5cf56 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb341257aa8246b6847561e2fe1fa385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9f9c44db4984653b8d4b5f6b3b949f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:35:59.375099 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49639328-4dba-47b6-9394-6f5e16a5cf56 service cinder] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:35:59.375409 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49639328-4dba-47b6-9394-6f5e16a5cf56 service cinder] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:35:59.375683 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49639328-4dba-47b6-9394-6f5e16a5cf56 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:35:59.385395 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49639328-4dba-47b6-9394-6f5e16a5cf56 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:35:59.386798 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49639328-4dba-47b6-9394-6f5e16a5cf56 service cinder] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:35:59.395360 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 1326/2641] 10.222.0.21 () {60 vars in 1365 bytes} [Wed May 4 07:35:59 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 07:36:02.352018 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39d6da6-a623-497b-8da3-cea742290356 None None] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:36:02.418255 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39d6da6-a623-497b-8da3-cea742290356 None None] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:36:02.422687 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e82968-9c8f-40c9-b1b4-7329736fdf32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:36:02.423571 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e82968-9c8f-40c9-b1b4-7329736fdf32 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:36:02.423847 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e82968-9c8f-40c9-b1b4-7329736fdf32 admin admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:36:02.424113 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e82968-9c8f-40c9-b1b4-7329736fdf32 admin admin] PATH_INFO: `/v3/users/0b52c5bf492240cbbbbbc87cb90a2d34` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:36:02.425280 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e82968-9c8f-40c9-b1b4-7329736fdf32 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0b52c5bf492240cbbbbbc87cb90a2d34)` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:36:02.427170 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e82968-9c8f-40c9-b1b4-7329736fdf32 admin admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:36:02.472118 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-09e82968-9c8f-40c9-b1b4-7329736fdf32 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0b52c5bf492240cbbbbbc87cb90a2d34'} {{(pid=79745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:36:02.485213 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-09e82968-9c8f-40c9-b1b4-7329736fdf32 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0b52c5bf492240cbbbbbc87cb90a2d34'} {{(pid=79745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:36:02.485898 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-09e82968-9c8f-40c9-b1b4-7329736fdf32 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0b52c5bf492240cbbbbbc87cb90a2d34'} {{(pid=79745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:36:02.486550 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-09e82968-9c8f-40c9-b1b4-7329736fdf32 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0b52c5bf492240cbbbbbc87cb90a2d34'} {{(pid=79745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:36:02.493882 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-09e82968-9c8f-40c9-b1b4-7329736fdf32 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0b52c5bf492240cbbbbbc87cb90a2d34'} {{(pid=79745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:36:02.506607 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 1316/2642] 10.222.0.21 () {58 vars in 1223 bytes} [Wed May 4 07:36:02 2022] DELETE /identity/v3/users/0b52c5bf492240cbbbbbc87cb90a2d34 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 07:36:02.511014 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87ac8b0-8d4c-41bf-87b6-5306e1ae6810 None None] REQUEST_METHOD: `POST` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:36:02.511524 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87ac8b0-8d4c-41bf-87b6-5306e1ae6810 None None] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:36:02.511621 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87ac8b0-8d4c-41bf-87b6-5306e1ae6810 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:36:02.528982 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.auth.core [None req-b87ac8b0-8d4c-41bf-87b6-5306e1ae6810 None None] MFA Rules not processed for user `83c5e0dcb991496ea6dee38384514508`. Rule list: `[]` (Enabled: `True`). {{(pid=79744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:36:02.530167 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.fernet_utils [None req-b87ac8b0-8d4c-41bf-87b6-5306e1ae6810 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:36:02.586551 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 1327/2643] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 07:36:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 07:36:02.596648 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e82968-9c8f-40c9-b1b4-7329736fdf32 admin admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:36:02.598049 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.fernet_utils [None req-09e82968-9c8f-40c9-b1b4-7329736fdf32 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:36:02.656408 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e82968-9c8f-40c9-b1b4-7329736fdf32 admin admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:36:02.659991 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68376726-dd51-4a3b-bbcc-6fd8493a1a73 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91cb92d00273402b837cb29b37325101', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9f9c44db4984653b8d4b5f6b3b949f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:36:02.660652 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68376726-dd51-4a3b-bbcc-6fd8493a1a73 service neutron] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:36:02.660931 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68376726-dd51-4a3b-bbcc-6fd8493a1a73 service neutron] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:36:02.661206 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68376726-dd51-4a3b-bbcc-6fd8493a1a73 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:36:02.671308 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68376726-dd51-4a3b-bbcc-6fd8493a1a73 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:36:02.672730 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68376726-dd51-4a3b-bbcc-6fd8493a1a73 service neutron] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:36:02.682218 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 1317/2644] 10.222.0.21 () {60 vars in 1365 bytes} [Wed May 4 07:36:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 07:36:02.959854 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87ac8b0-8d4c-41bf-87b6-5306e1ae6810 None None] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:36:02.961369 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.fernet_utils [None req-b87ac8b0-8d4c-41bf-87b6-5306e1ae6810 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:36:02.974316 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87ac8b0-8d4c-41bf-87b6-5306e1ae6810 None None] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:36:02.979706 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb61e45-85bf-448f-83d4-82d3a3d32fcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:36:02.980571 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb61e45-85bf-448f-83d4-82d3a3d32fcc admin admin] REQUEST_METHOD: `DELETE` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:36:02.980849 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb61e45-85bf-448f-83d4-82d3a3d32fcc admin admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:36:02.981123 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb61e45-85bf-448f-83d4-82d3a3d32fcc admin admin] PATH_INFO: `/v3/projects/a8e0b926bca446e3a7e58e0729b13b2b` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:36:02.982434 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb61e45-85bf-448f-83d4-82d3a3d32fcc admin admin] RBAC: Authorizing `identity:delete_project(project_id=a8e0b926bca446e3a7e58e0729b13b2b)` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:36:02.984258 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb61e45-85bf-448f-83d4-82d3a3d32fcc admin admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:36:03.030571 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-eeb61e45-85bf-448f-83d4-82d3a3d32fcc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a8e0b926bca446e3a7e58e0729b13b2b', 'request_id': 'req-eeb61e45-85bf-448f-83d4-82d3a3d32fcc'} {{(pid=79744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:36:03.036015 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-eeb61e45-85bf-448f-83d4-82d3a3d32fcc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a8e0b926bca446e3a7e58e0729b13b2b', 'request_id': 'req-eeb61e45-85bf-448f-83d4-82d3a3d32fcc'} {{(pid=79744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:36:03.043441 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-eeb61e45-85bf-448f-83d4-82d3a3d32fcc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a8e0b926bca446e3a7e58e0729b13b2b', 'request_id': 'req-eeb61e45-85bf-448f-83d4-82d3a3d32fcc'} {{(pid=79744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:36:03.054005 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-eeb61e45-85bf-448f-83d4-82d3a3d32fcc admin admin] The token cache is being invalidate because project a8e0b926bca446e3a7e58e0729b13b2b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79744) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 07:36:03.054288 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-eeb61e45-85bf-448f-83d4-82d3a3d32fcc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:36:03.054914 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-eeb61e45-85bf-448f-83d4-82d3a3d32fcc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:36:03.057230 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 1328/2645] 10.222.0.21 () {58 vars in 1232 bytes} [Wed May 4 07:36:02 2022] DELETE /identity/v3/projects/a8e0b926bca446e3a7e58e0729b13b2b => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 07:36:11.450866 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68376726-dd51-4a3b-bbcc-6fd8493a1a73 service neutron] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:36:11.486839 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68376726-dd51-4a3b-bbcc-6fd8493a1a73 service neutron] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:36:11.532645 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc2a54f-c4fa-4a9d-9055-9bc6206423a6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91cb92d00273402b837cb29b37325101', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9f9c44db4984653b8d4b5f6b3b949f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:36:11.533278 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc2a54f-c4fa-4a9d-9055-9bc6206423a6 service neutron] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:36:11.533556 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc2a54f-c4fa-4a9d-9055-9bc6206423a6 service neutron] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:36:11.533827 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc2a54f-c4fa-4a9d-9055-9bc6206423a6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:36:11.535616 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.fernet_utils [None req-adc2a54f-c4fa-4a9d-9055-9bc6206423a6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:36:11.643554 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc2a54f-c4fa-4a9d-9055-9bc6206423a6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:36:11.644918 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc2a54f-c4fa-4a9d-9055-9bc6206423a6 service neutron] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:36:11.665219 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 1318/2646] 10.222.0.21 () {60 vars in 1365 bytes} [Wed May 4 07:36:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 07:36:15.579687 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb61e45-85bf-448f-83d4-82d3a3d32fcc admin admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:36:15.581254 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.fernet_utils [None req-eeb61e45-85bf-448f-83d4-82d3a3d32fcc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:36:15.639602 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb61e45-85bf-448f-83d4-82d3a3d32fcc admin admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:36:15.644075 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb41d1a-100b-4585-a221-714d1e62d5dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:36:15.644930 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb41d1a-100b-4585-a221-714d1e62d5dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:36:15.645200 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb41d1a-100b-4585-a221-714d1e62d5dd admin admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:36:15.645463 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb41d1a-100b-4585-a221-714d1e62d5dd admin admin] PATH_INFO: `/v3/users/c0d8468db2524d76b712b831f83d2cbe` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:36:15.658943 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb41d1a-100b-4585-a221-714d1e62d5dd admin admin] RBAC: Authorizing `identity:delete_user(user_id=c0d8468db2524d76b712b831f83d2cbe)` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:36:15.660819 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb41d1a-100b-4585-a221-714d1e62d5dd admin admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:36:15.706368 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-0fb41d1a-100b-4585-a221-714d1e62d5dd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c0d8468db2524d76b712b831f83d2cbe'} {{(pid=79744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:36:15.707019 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-0fb41d1a-100b-4585-a221-714d1e62d5dd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c0d8468db2524d76b712b831f83d2cbe'} {{(pid=79744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:36:15.713564 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-0fb41d1a-100b-4585-a221-714d1e62d5dd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c0d8468db2524d76b712b831f83d2cbe'} {{(pid=79744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:36:15.714192 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-0fb41d1a-100b-4585-a221-714d1e62d5dd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c0d8468db2524d76b712b831f83d2cbe'} {{(pid=79744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:36:15.725889 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-0fb41d1a-100b-4585-a221-714d1e62d5dd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c0d8468db2524d76b712b831f83d2cbe'} {{(pid=79744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:36:15.739373 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 1329/2647] 10.222.0.21 () {58 vars in 1223 bytes} [Wed May 4 07:36:15 2022] DELETE /identity/v3/users/c0d8468db2524d76b712b831f83d2cbe => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 07:36:15.911557 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc2a54f-c4fa-4a9d-9055-9bc6206423a6 service neutron] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:36:15.922278 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc2a54f-c4fa-4a9d-9055-9bc6206423a6 service neutron] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:36:15.978860 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27b1613-cf44-41f3-8859-619fcd46b851 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:36:15.979916 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27b1613-cf44-41f3-8859-619fcd46b851 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:36:15.980389 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27b1613-cf44-41f3-8859-619fcd46b851 admin admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:36:15.980670 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27b1613-cf44-41f3-8859-619fcd46b851 admin admin] PATH_INFO: `/v3/projects/a183ac2391e141ca8ef0e7f7cc47daed` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:36:15.990731 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27b1613-cf44-41f3-8859-619fcd46b851 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a183ac2391e141ca8ef0e7f7cc47daed)` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:36:15.992670 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27b1613-cf44-41f3-8859-619fcd46b851 admin admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:36:16.037299 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-a27b1613-cf44-41f3-8859-619fcd46b851 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a183ac2391e141ca8ef0e7f7cc47daed', 'request_id': 'req-a27b1613-cf44-41f3-8859-619fcd46b851'} {{(pid=79745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:36:16.044261 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-a27b1613-cf44-41f3-8859-619fcd46b851 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a183ac2391e141ca8ef0e7f7cc47daed', 'request_id': 'req-a27b1613-cf44-41f3-8859-619fcd46b851'} {{(pid=79745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:36:16.051139 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-a27b1613-cf44-41f3-8859-619fcd46b851 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a183ac2391e141ca8ef0e7f7cc47daed', 'request_id': 'req-a27b1613-cf44-41f3-8859-619fcd46b851'} {{(pid=79745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:36:16.062138 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-a27b1613-cf44-41f3-8859-619fcd46b851 admin admin] The token cache is being invalidate because project a183ac2391e141ca8ef0e7f7cc47daed was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79745) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 07:36:16.062534 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-a27b1613-cf44-41f3-8859-619fcd46b851 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:36:16.063338 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-a27b1613-cf44-41f3-8859-619fcd46b851 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:36:16.064963 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 1319/2648] 10.222.0.21 () {58 vars in 1232 bytes} [Wed May 4 07:36:15 2022] DELETE /identity/v3/projects/a183ac2391e141ca8ef0e7f7cc47daed => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 07:36:16.069894 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc9eb67-8287-4803-815c-f5aa2fc52ece None None] REQUEST_METHOD: `POST` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:36:16.070192 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc9eb67-8287-4803-815c-f5aa2fc52ece None None] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:36:16.070462 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc9eb67-8287-4803-815c-f5aa2fc52ece None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:36:16.115594 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.auth.core [None req-acc9eb67-8287-4803-815c-f5aa2fc52ece None None] MFA Rules not processed for user `83c5e0dcb991496ea6dee38384514508`. Rule list: `[]` (Enabled: `True`). {{(pid=79744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:36:16.116833 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.fernet_utils [None req-acc9eb67-8287-4803-815c-f5aa2fc52ece None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:36:16.173020 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 1330/2649] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 07:36:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 07:36:16.181466 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e30da53-f48a-4174-b8aa-5d0298feaa20 None None] REQUEST_METHOD: `POST` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:36:16.181748 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e30da53-f48a-4174-b8aa-5d0298feaa20 None None] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:36:16.182047 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e30da53-f48a-4174-b8aa-5d0298feaa20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:36:16.201696 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.auth.core [None req-4e30da53-f48a-4174-b8aa-5d0298feaa20 None None] MFA Rules not processed for user `83c5e0dcb991496ea6dee38384514508`. Rule list: `[]` (Enabled: `True`). {{(pid=79745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:36:16.202877 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.fernet_utils [None req-4e30da53-f48a-4174-b8aa-5d0298feaa20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:36:16.210696 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 1320/2650] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 07:36:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 07:36:16.215583 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc9eb67-8287-4803-815c-f5aa2fc52ece None None] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:36:16.224972 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc9eb67-8287-4803-815c-f5aa2fc52ece None None] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:36:16.229495 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658ad804-43e7-4511-a423-c5874d92a7d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:36:16.230772 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658ad804-43e7-4511-a423-c5874d92a7d8 admin admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:36:16.231046 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658ad804-43e7-4511-a423-c5874d92a7d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:36:16.231345 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658ad804-43e7-4511-a423-c5874d92a7d8 admin admin] PATH_INFO: `/v3/domains` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:36:16.232059 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658ad804-43e7-4511-a423-c5874d92a7d8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79744) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 07:36:16.232359 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658ad804-43e7-4511-a423-c5874d92a7d8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:36:16.233923 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658ad804-43e7-4511-a423-c5874d92a7d8 admin admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:36:16.244943 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 1331/2651] 10.222.0.21 () {58 vars in 1152 bytes} [Wed May 4 07:36:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 07:36:16.249157 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e30da53-f48a-4174-b8aa-5d0298feaa20 None None] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:36:16.258366 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e30da53-f48a-4174-b8aa-5d0298feaa20 None None] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:36:16.263025 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d887b42-e941-4bdc-843a-d315f518a525 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:36:16.263686 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d887b42-e941-4bdc-843a-d315f518a525 admin admin] REQUEST_METHOD: `POST` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:36:16.263961 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d887b42-e941-4bdc-843a-d315f518a525 admin admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:36:16.264229 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d887b42-e941-4bdc-843a-d315f518a525 admin admin] PATH_INFO: `/v3/projects` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:36:16.264897 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d887b42-e941-4bdc-843a-d315f518a525 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:36:16.266813 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d887b42-e941-4bdc-843a-d315f518a525 admin admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:36:16.290947 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 1321/2652] 10.222.0.21 () {60 vars in 1152 bytes} [Wed May 4 07:36:16 2022] POST /identity/v3/projects => generated 379 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 07:36:16.295730 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658ad804-43e7-4511-a423-c5874d92a7d8 admin admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:36:16.306167 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658ad804-43e7-4511-a423-c5874d92a7d8 admin admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:36:16.360777 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333c3d8f-1736-444c-8c6b-2e1a38a03398 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:36:16.361420 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333c3d8f-1736-444c-8c6b-2e1a38a03398 admin admin] REQUEST_METHOD: `POST` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:36:16.361724 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333c3d8f-1736-444c-8c6b-2e1a38a03398 admin admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:36:16.361994 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333c3d8f-1736-444c-8c6b-2e1a38a03398 admin admin] PATH_INFO: `/v3/users` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:36:16.362663 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333c3d8f-1736-444c-8c6b-2e1a38a03398 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:36:16.364586 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333c3d8f-1736-444c-8c6b-2e1a38a03398 admin admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:36:16.383215 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 1332/2653] 10.222.0.21 () {60 vars in 1143 bytes} [Wed May 4 07:36:16 2022] POST /identity/v3/users => generated 290 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 07:36:16.387812 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d887b42-e941-4bdc-843a-d315f518a525 admin admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:36:16.398078 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d887b42-e941-4bdc-843a-d315f518a525 admin admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:36:16.403426 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6b9fe5-f26d-4ff6-8b9d-de7e3205646f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:36:16.404073 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6b9fe5-f26d-4ff6-8b9d-de7e3205646f admin admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:36:16.404338 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6b9fe5-f26d-4ff6-8b9d-de7e3205646f admin admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:36:16.404600 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6b9fe5-f26d-4ff6-8b9d-de7e3205646f admin admin] PATH_INFO: `/v3/roles` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:36:16.405323 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6b9fe5-f26d-4ff6-8b9d-de7e3205646f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:36:16.406942 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6b9fe5-f26d-4ff6-8b9d-de7e3205646f admin admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:36:16.419096 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 1322/2654] 10.222.0.21 () {58 vars in 1121 bytes} [Wed May 4 07:36:16 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 07:36:16.423202 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333c3d8f-1736-444c-8c6b-2e1a38a03398 admin admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:36:16.433214 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333c3d8f-1736-444c-8c6b-2e1a38a03398 admin admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:36:16.437830 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ee8699-d2e6-4f65-96cd-cdb53ccaa101 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:36:16.438487 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ee8699-d2e6-4f65-96cd-cdb53ccaa101 admin admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:36:16.439011 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ee8699-d2e6-4f65-96cd-cdb53ccaa101 admin admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:36:16.439011 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ee8699-d2e6-4f65-96cd-cdb53ccaa101 admin admin] PATH_INFO: `/v3/roles` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:36:16.439785 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ee8699-d2e6-4f65-96cd-cdb53ccaa101 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:36:16.441361 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ee8699-d2e6-4f65-96cd-cdb53ccaa101 admin admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:36:16.455496 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 1333/2655] 10.222.0.21 () {58 vars in 1121 bytes} [Wed May 4 07:36:16 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 07:36:16.459959 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6b9fe5-f26d-4ff6-8b9d-de7e3205646f admin admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:36:16.470639 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6b9fe5-f26d-4ff6-8b9d-de7e3205646f admin admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:36:16.475332 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563d8226-6a41-47dd-b115-be3b0313c6b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:36:16.476208 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563d8226-6a41-47dd-b115-be3b0313c6b4 admin admin] REQUEST_METHOD: `PUT` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:36:16.477357 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563d8226-6a41-47dd-b115-be3b0313c6b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:36:16.477357 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563d8226-6a41-47dd-b115-be3b0313c6b4 admin admin] PATH_INFO: `/v3/projects/edaeb5ddf47a4140a909478b9cc3b7a8/users/f68452d45f6046928cd235ca6a229a9b/roles/9f89c07b05a14f18836116af22cba5f6` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:36:16.491475 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563d8226-6a41-47dd-b115-be3b0313c6b4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=edaeb5ddf47a4140a909478b9cc3b7a8, user_id=f68452d45f6046928cd235ca6a229a9b, role_id=9f89c07b05a14f18836116af22cba5f6)` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:36:16.494155 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563d8226-6a41-47dd-b115-be3b0313c6b4 admin admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:36:16.508070 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 1323/2656] 10.222.0.21 () {60 vars in 1482 bytes} [Wed May 4 07:36:16 2022] PUT /identity/v3/projects/edaeb5ddf47a4140a909478b9cc3b7a8/users/f68452d45f6046928cd235ca6a229a9b/roles/9f89c07b05a14f18836116af22cba5f6 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 07:36:16.518874 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864547f5-7fe8-4206-adb8-e0b475b37569 None None] REQUEST_METHOD: `POST` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:36:16.519188 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864547f5-7fe8-4206-adb8-e0b475b37569 None None] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:36:16.519468 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864547f5-7fe8-4206-adb8-e0b475b37569 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:36:16.546276 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.auth.core [None req-864547f5-7fe8-4206-adb8-e0b475b37569 None None] MFA Rules not processed for user `f68452d45f6046928cd235ca6a229a9b`. Rule list: `[]` (Enabled: `True`). {{(pid=79744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:36:16.547541 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.fernet_utils [None req-864547f5-7fe8-4206-adb8-e0b475b37569 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:36:16.608751 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 1334/2657] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 07:36:16 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 07:36:16.613280 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563d8226-6a41-47dd-b115-be3b0313c6b4 admin admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:36:16.672679 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563d8226-6a41-47dd-b115-be3b0313c6b4 admin admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:36:16.677401 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4dc590-f586-45f0-9ec4-5fac53ac2de3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:36:16.677984 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4dc590-f586-45f0-9ec4-5fac53ac2de3 admin admin] REQUEST_METHOD: `POST` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:36:16.678286 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4dc590-f586-45f0-9ec4-5fac53ac2de3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:36:16.678539 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4dc590-f586-45f0-9ec4-5fac53ac2de3 admin admin] PATH_INFO: `/v3/projects` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:36:16.679250 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4dc590-f586-45f0-9ec4-5fac53ac2de3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:36:16.681135 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4dc590-f586-45f0-9ec4-5fac53ac2de3 admin admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:36:16.710358 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 1324/2658] 10.222.0.21 () {60 vars in 1152 bytes} [Wed May 4 07:36:16 2022] POST /identity/v3/projects => generated 379 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 07:36:16.713237 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864547f5-7fe8-4206-adb8-e0b475b37569 None None] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:36:16.724246 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864547f5-7fe8-4206-adb8-e0b475b37569 None None] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:36:16.780700 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bcfa991-6e27-4acf-b207-e3d0f048aedf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:36:16.781368 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcfa991-6e27-4acf-b207-e3d0f048aedf admin admin] REQUEST_METHOD: `POST` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:36:16.781647 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcfa991-6e27-4acf-b207-e3d0f048aedf admin admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:36:16.781923 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcfa991-6e27-4acf-b207-e3d0f048aedf admin admin] PATH_INFO: `/v3/users` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:36:16.782620 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bcfa991-6e27-4acf-b207-e3d0f048aedf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:36:16.784557 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bcfa991-6e27-4acf-b207-e3d0f048aedf admin admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:36:16.806591 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 1335/2659] 10.222.0.21 () {60 vars in 1143 bytes} [Wed May 4 07:36:16 2022] POST /identity/v3/users => generated 296 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 07:36:16.811268 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4dc590-f586-45f0-9ec4-5fac53ac2de3 admin admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:36:16.824066 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4dc590-f586-45f0-9ec4-5fac53ac2de3 admin admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:36:16.832402 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee90236f-fae3-421f-af88-f6f5053ebc6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:36:16.833449 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee90236f-fae3-421f-af88-f6f5053ebc6a admin admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:36:16.833825 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee90236f-fae3-421f-af88-f6f5053ebc6a admin admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:36:16.834191 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee90236f-fae3-421f-af88-f6f5053ebc6a admin admin] PATH_INFO: `/v3/roles` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:36:16.835245 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee90236f-fae3-421f-af88-f6f5053ebc6a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:36:16.836831 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee90236f-fae3-421f-af88-f6f5053ebc6a admin admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:36:16.847636 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 1325/2660] 10.222.0.21 () {58 vars in 1121 bytes} [Wed May 4 07:36:16 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 07:36:16.851831 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bcfa991-6e27-4acf-b207-e3d0f048aedf admin admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:36:16.862251 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bcfa991-6e27-4acf-b207-e3d0f048aedf admin admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:36:16.866908 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d64a0d-a873-4dcf-9768-365cdc60ddad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:36:16.867817 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d64a0d-a873-4dcf-9768-365cdc60ddad admin admin] REQUEST_METHOD: `PUT` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:36:16.868092 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d64a0d-a873-4dcf-9768-365cdc60ddad admin admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:36:16.868361 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d64a0d-a873-4dcf-9768-365cdc60ddad admin admin] PATH_INFO: `/v3/projects/0668111d75a84e45ab9edd5e20af2310/users/27b043f093404768868f8d6c7b8e08e6/roles/eb54c9cea2774a25b1fe8c79724408ee` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:36:16.883900 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d64a0d-a873-4dcf-9768-365cdc60ddad admin admin] RBAC: Authorizing `identity:create_grant(project_id=0668111d75a84e45ab9edd5e20af2310, user_id=27b043f093404768868f8d6c7b8e08e6, role_id=eb54c9cea2774a25b1fe8c79724408ee)` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:36:16.887389 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d64a0d-a873-4dcf-9768-365cdc60ddad admin admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:36:16.900001 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 1336/2661] 10.222.0.21 () {60 vars in 1482 bytes} [Wed May 4 07:36:16 2022] PUT /identity/v3/projects/0668111d75a84e45ab9edd5e20af2310/users/27b043f093404768868f8d6c7b8e08e6/roles/eb54c9cea2774a25b1fe8c79724408ee => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 07:36:16.904119 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee90236f-fae3-421f-af88-f6f5053ebc6a admin admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:36:16.914457 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee90236f-fae3-421f-af88-f6f5053ebc6a admin admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:36:16.969645 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7621b6-2bc1-45a1-8ff7-c70549f00b4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:36:16.970214 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7621b6-2bc1-45a1-8ff7-c70549f00b4e admin admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:36:16.970492 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7621b6-2bc1-45a1-8ff7-c70549f00b4e admin admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:36:16.970764 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7621b6-2bc1-45a1-8ff7-c70549f00b4e admin admin] PATH_INFO: `/v3/roles` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:36:16.971506 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7621b6-2bc1-45a1-8ff7-c70549f00b4e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:36:16.973082 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7621b6-2bc1-45a1-8ff7-c70549f00b4e admin admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:36:16.982963 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 1326/2662] 10.222.0.21 () {58 vars in 1121 bytes} [Wed May 4 07:36:16 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 04 07:36:16.988012 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d64a0d-a873-4dcf-9768-365cdc60ddad admin admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:36:17.000439 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d64a0d-a873-4dcf-9768-365cdc60ddad admin admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:36:17.005623 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde70581-5863-46ae-afca-423ab5f9ee9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:36:17.006504 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde70581-5863-46ae-afca-423ab5f9ee9d admin admin] REQUEST_METHOD: `PUT` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:36:17.006782 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde70581-5863-46ae-afca-423ab5f9ee9d admin admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:36:17.007062 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde70581-5863-46ae-afca-423ab5f9ee9d admin admin] PATH_INFO: `/v3/projects/0668111d75a84e45ab9edd5e20af2310/users/27b043f093404768868f8d6c7b8e08e6/roles/eb54c9cea2774a25b1fe8c79724408ee` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:36:17.009099 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde70581-5863-46ae-afca-423ab5f9ee9d admin admin] RBAC: Authorizing `identity:create_grant(project_id=0668111d75a84e45ab9edd5e20af2310, user_id=27b043f093404768868f8d6c7b8e08e6, role_id=eb54c9cea2774a25b1fe8c79724408ee)` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:36:17.012499 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde70581-5863-46ae-afca-423ab5f9ee9d admin admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:36:17.023269 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 1337/2663] 10.222.0.21 () {60 vars in 1482 bytes} [Wed May 4 07:36:16 2022] PUT /identity/v3/projects/0668111d75a84e45ab9edd5e20af2310/users/27b043f093404768868f8d6c7b8e08e6/roles/eb54c9cea2774a25b1fe8c79724408ee => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 07:36:17.034822 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266db7cc-78cb-4397-919f-c2f95a8f102b None None] REQUEST_METHOD: `POST` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:36:17.035110 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266db7cc-78cb-4397-919f-c2f95a8f102b None None] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:36:17.035422 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266db7cc-78cb-4397-919f-c2f95a8f102b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:36:17.064108 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.auth.core [None req-266db7cc-78cb-4397-919f-c2f95a8f102b None None] MFA Rules not processed for user `27b043f093404768868f8d6c7b8e08e6`. Rule list: `[]` (Enabled: `True`). {{(pid=79745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:36:17.065307 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.fernet_utils [None req-266db7cc-78cb-4397-919f-c2f95a8f102b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:36:17.140748 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 1327/2664] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 07:36:17 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 07:36:17.152947 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde70581-5863-46ae-afca-423ab5f9ee9d admin admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:36:17.154673 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.fernet_utils [None req-dde70581-5863-46ae-afca-423ab5f9ee9d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:36:17.217764 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde70581-5863-46ae-afca-423ab5f9ee9d admin admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:36:17.221519 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4fc29e4-cdfb-484c-adc1-97562b6fd9b0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb341257aa8246b6847561e2fe1fa385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9f9c44db4984653b8d4b5f6b3b949f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:36:17.222103 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fc29e4-cdfb-484c-adc1-97562b6fd9b0 service cinder] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:36:17.222381 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fc29e4-cdfb-484c-adc1-97562b6fd9b0 service cinder] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:36:17.222652 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fc29e4-cdfb-484c-adc1-97562b6fd9b0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:36:17.232618 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4fc29e4-cdfb-484c-adc1-97562b6fd9b0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:36:17.234044 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4fc29e4-cdfb-484c-adc1-97562b6fd9b0 service cinder] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:36:17.243360 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 1338/2665] 10.222.0.21 () {60 vars in 1365 bytes} [Wed May 4 07:36:17 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 07:36:17.540339 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266db7cc-78cb-4397-919f-c2f95a8f102b None None] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:36:17.549980 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266db7cc-78cb-4397-919f-c2f95a8f102b None None] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:36:17.554548 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5398b98e-5eef-4261-ad88-c6622eae42dd tempest-VolumeQuotaClassesTest-486443741 tempest-VolumeQuotaClassesTest-486443741-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27b043f093404768868f8d6c7b8e08e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0668111d75a84e45ab9edd5e20af2310', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:36:17.555218 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5398b98e-5eef-4261-ad88-c6622eae42dd tempest-VolumeQuotaClassesTest-486443741 tempest-VolumeQuotaClassesTest-486443741-project-admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:36:17.555496 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5398b98e-5eef-4261-ad88-c6622eae42dd tempest-VolumeQuotaClassesTest-486443741 tempest-VolumeQuotaClassesTest-486443741-project-admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:36:17.555765 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5398b98e-5eef-4261-ad88-c6622eae42dd tempest-VolumeQuotaClassesTest-486443741 tempest-VolumeQuotaClassesTest-486443741-project-admin] PATH_INFO: `/v3/domains` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:36:17.556474 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5398b98e-5eef-4261-ad88-c6622eae42dd tempest-VolumeQuotaClassesTest-486443741 tempest-VolumeQuotaClassesTest-486443741-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=79745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 07:36:17.556778 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5398b98e-5eef-4261-ad88-c6622eae42dd tempest-VolumeQuotaClassesTest-486443741 tempest-VolumeQuotaClassesTest-486443741-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:36:17.558601 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5398b98e-5eef-4261-ad88-c6622eae42dd tempest-VolumeQuotaClassesTest-486443741 tempest-VolumeQuotaClassesTest-486443741-project-admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:36:17.569613 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 1328/2666] 10.222.0.21 () {58 vars in 1152 bytes} [Wed May 4 07:36:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 07:36:17.573725 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4fc29e4-cdfb-484c-adc1-97562b6fd9b0 service cinder] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:36:17.582608 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4fc29e4-cdfb-484c-adc1-97562b6fd9b0 service cinder] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:36:17.587442 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7cc7023-2103-47b1-ac86-1f42d934bf54 tempest-VolumeQuotaClassesTest-486443741 tempest-VolumeQuotaClassesTest-486443741-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27b043f093404768868f8d6c7b8e08e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0668111d75a84e45ab9edd5e20af2310', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:36:17.588104 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cc7023-2103-47b1-ac86-1f42d934bf54 tempest-VolumeQuotaClassesTest-486443741 tempest-VolumeQuotaClassesTest-486443741-project-admin] REQUEST_METHOD: `POST` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:36:17.588382 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cc7023-2103-47b1-ac86-1f42d934bf54 tempest-VolumeQuotaClassesTest-486443741 tempest-VolumeQuotaClassesTest-486443741-project-admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:36:17.588653 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cc7023-2103-47b1-ac86-1f42d934bf54 tempest-VolumeQuotaClassesTest-486443741 tempest-VolumeQuotaClassesTest-486443741-project-admin] PATH_INFO: `/v3/projects` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:36:17.589920 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7cc7023-2103-47b1-ac86-1f42d934bf54 tempest-VolumeQuotaClassesTest-486443741 tempest-VolumeQuotaClassesTest-486443741-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:36:17.591855 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7cc7023-2103-47b1-ac86-1f42d934bf54 tempest-VolumeQuotaClassesTest-486443741 tempest-VolumeQuotaClassesTest-486443741-project-admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:36:17.616583 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 1339/2667] 10.222.0.21 () {60 vars in 1152 bytes} [Wed May 4 07:36:17 2022] POST /identity/v3/projects => generated 354 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 07:36:17.620592 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5398b98e-5eef-4261-ad88-c6622eae42dd tempest-VolumeQuotaClassesTest-486443741 tempest-VolumeQuotaClassesTest-486443741-project-admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:36:17.630699 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5398b98e-5eef-4261-ad88-c6622eae42dd tempest-VolumeQuotaClassesTest-486443741 tempest-VolumeQuotaClassesTest-486443741-project-admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:36:17.687122 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f3de76-7f6f-48ae-8531-21e72220a825 tempest-VolumeQuotaClassesTest-486443741 tempest-VolumeQuotaClassesTest-486443741-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27b043f093404768868f8d6c7b8e08e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0668111d75a84e45ab9edd5e20af2310', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:36:17.687797 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f3de76-7f6f-48ae-8531-21e72220a825 tempest-VolumeQuotaClassesTest-486443741 tempest-VolumeQuotaClassesTest-486443741-project-admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:36:17.688078 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f3de76-7f6f-48ae-8531-21e72220a825 tempest-VolumeQuotaClassesTest-486443741 tempest-VolumeQuotaClassesTest-486443741-project-admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:36:17.688354 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f3de76-7f6f-48ae-8531-21e72220a825 tempest-VolumeQuotaClassesTest-486443741 tempest-VolumeQuotaClassesTest-486443741-project-admin] PATH_INFO: `/v3/domains` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:36:17.689065 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f3de76-7f6f-48ae-8531-21e72220a825 tempest-VolumeQuotaClassesTest-486443741 tempest-VolumeQuotaClassesTest-486443741-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=79745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 07:36:17.689373 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f3de76-7f6f-48ae-8531-21e72220a825 tempest-VolumeQuotaClassesTest-486443741 tempest-VolumeQuotaClassesTest-486443741-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:36:17.690961 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f3de76-7f6f-48ae-8531-21e72220a825 tempest-VolumeQuotaClassesTest-486443741 tempest-VolumeQuotaClassesTest-486443741-project-admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:36:17.701758 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 1329/2668] 10.222.0.21 () {58 vars in 1152 bytes} [Wed May 4 07:36:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 07:36:17.737965 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7cc7023-2103-47b1-ac86-1f42d934bf54 tempest-VolumeQuotaClassesTest-486443741 tempest-VolumeQuotaClassesTest-486443741-project-admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:36:17.747980 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7cc7023-2103-47b1-ac86-1f42d934bf54 tempest-VolumeQuotaClassesTest-486443741 tempest-VolumeQuotaClassesTest-486443741-project-admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:36:17.752786 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42748375-a32c-45b0-8d87-015039785adb tempest-VolumeQuotaClassesTest-486443741 tempest-VolumeQuotaClassesTest-486443741-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27b043f093404768868f8d6c7b8e08e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0668111d75a84e45ab9edd5e20af2310', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:36:17.753566 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42748375-a32c-45b0-8d87-015039785adb tempest-VolumeQuotaClassesTest-486443741 tempest-VolumeQuotaClassesTest-486443741-project-admin] REQUEST_METHOD: `DELETE` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:36:17.753845 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42748375-a32c-45b0-8d87-015039785adb tempest-VolumeQuotaClassesTest-486443741 tempest-VolumeQuotaClassesTest-486443741-project-admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:36:17.754117 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42748375-a32c-45b0-8d87-015039785adb tempest-VolumeQuotaClassesTest-486443741 tempest-VolumeQuotaClassesTest-486443741-project-admin] PATH_INFO: `/v3/projects/4ae456e19ae04444bcbfd498576d731c` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:36:17.755311 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42748375-a32c-45b0-8d87-015039785adb tempest-VolumeQuotaClassesTest-486443741 tempest-VolumeQuotaClassesTest-486443741-project-admin] RBAC: Authorizing `identity:delete_project(project_id=4ae456e19ae04444bcbfd498576d731c)` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:36:17.757182 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42748375-a32c-45b0-8d87-015039785adb tempest-VolumeQuotaClassesTest-486443741 tempest-VolumeQuotaClassesTest-486443741-project-admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:36:17.805174 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-42748375-a32c-45b0-8d87-015039785adb tempest-VolumeQuotaClassesTest-486443741 tempest-VolumeQuotaClassesTest-486443741-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4ae456e19ae04444bcbfd498576d731c', 'request_id': 'req-42748375-a32c-45b0-8d87-015039785adb'} {{(pid=79744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:36:17.810778 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-42748375-a32c-45b0-8d87-015039785adb tempest-VolumeQuotaClassesTest-486443741 tempest-VolumeQuotaClassesTest-486443741-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4ae456e19ae04444bcbfd498576d731c', 'request_id': 'req-42748375-a32c-45b0-8d87-015039785adb'} {{(pid=79744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:36:17.819232 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-42748375-a32c-45b0-8d87-015039785adb tempest-VolumeQuotaClassesTest-486443741 tempest-VolumeQuotaClassesTest-486443741-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4ae456e19ae04444bcbfd498576d731c', 'request_id': 'req-42748375-a32c-45b0-8d87-015039785adb'} {{(pid=79744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:36:17.832438 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-42748375-a32c-45b0-8d87-015039785adb tempest-VolumeQuotaClassesTest-486443741 tempest-VolumeQuotaClassesTest-486443741-project-admin] The token cache is being invalidate because project 4ae456e19ae04444bcbfd498576d731c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79744) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 07:36:17.832728 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-42748375-a32c-45b0-8d87-015039785adb tempest-VolumeQuotaClassesTest-486443741 tempest-VolumeQuotaClassesTest-486443741-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:36:17.833411 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-42748375-a32c-45b0-8d87-015039785adb tempest-VolumeQuotaClassesTest-486443741 tempest-VolumeQuotaClassesTest-486443741-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:36:17.834976 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 1340/2669] 10.222.0.21 () {58 vars in 1232 bytes} [Wed May 4 07:36:17 2022] DELETE /identity/v3/projects/4ae456e19ae04444bcbfd498576d731c => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 07:36:18.030874 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f3de76-7f6f-48ae-8531-21e72220a825 tempest-VolumeQuotaClassesTest-486443741 tempest-VolumeQuotaClassesTest-486443741-project-admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:36:18.032663 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.fernet_utils [None req-58f3de76-7f6f-48ae-8531-21e72220a825 tempest-VolumeQuotaClassesTest-486443741 tempest-VolumeQuotaClassesTest-486443741-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:36:18.101268 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f3de76-7f6f-48ae-8531-21e72220a825 tempest-VolumeQuotaClassesTest-486443741 tempest-VolumeQuotaClassesTest-486443741-project-admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:36:18.154522 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818cf266-07d1-4097-811b-1d2a8a2a2cf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:36:18.155411 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818cf266-07d1-4097-811b-1d2a8a2a2cf3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:36:18.155692 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818cf266-07d1-4097-811b-1d2a8a2a2cf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:36:18.155966 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818cf266-07d1-4097-811b-1d2a8a2a2cf3 admin admin] PATH_INFO: `/v3/users/f68452d45f6046928cd235ca6a229a9b` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:36:18.157142 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818cf266-07d1-4097-811b-1d2a8a2a2cf3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f68452d45f6046928cd235ca6a229a9b)` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:36:18.159031 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818cf266-07d1-4097-811b-1d2a8a2a2cf3 admin admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:36:18.203669 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-818cf266-07d1-4097-811b-1d2a8a2a2cf3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f68452d45f6046928cd235ca6a229a9b'} {{(pid=79745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:36:18.215402 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-818cf266-07d1-4097-811b-1d2a8a2a2cf3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f68452d45f6046928cd235ca6a229a9b'} {{(pid=79745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:36:18.216056 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-818cf266-07d1-4097-811b-1d2a8a2a2cf3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f68452d45f6046928cd235ca6a229a9b'} {{(pid=79745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:36:18.216654 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-818cf266-07d1-4097-811b-1d2a8a2a2cf3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f68452d45f6046928cd235ca6a229a9b'} {{(pid=79745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:36:18.223186 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-818cf266-07d1-4097-811b-1d2a8a2a2cf3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f68452d45f6046928cd235ca6a229a9b'} {{(pid=79745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:36:18.236755 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 1330/2670] 10.222.0.21 () {58 vars in 1223 bytes} [Wed May 4 07:36:18 2022] DELETE /identity/v3/users/f68452d45f6046928cd235ca6a229a9b => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 07:36:18.241237 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf042168-5524-4ecc-952c-a0c8765a52e3 None None] REQUEST_METHOD: `POST` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:36:18.241532 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf042168-5524-4ecc-952c-a0c8765a52e3 None None] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:36:18.241817 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf042168-5524-4ecc-952c-a0c8765a52e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:36:18.258475 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.auth.core [None req-bf042168-5524-4ecc-952c-a0c8765a52e3 None None] MFA Rules not processed for user `83c5e0dcb991496ea6dee38384514508`. Rule list: `[]` (Enabled: `True`). {{(pid=79744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:36:18.259700 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.fernet_utils [None req-bf042168-5524-4ecc-952c-a0c8765a52e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:36:18.317649 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 1341/2671] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 07:36:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 07:36:18.327385 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818cf266-07d1-4097-811b-1d2a8a2a2cf3 admin admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:36:18.328771 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.fernet_utils [None req-818cf266-07d1-4097-811b-1d2a8a2a2cf3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:36:18.396254 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818cf266-07d1-4097-811b-1d2a8a2a2cf3 admin admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:36:18.399803 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eea89bc-fcd0-4db1-b278-85c6ed74bc66 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91cb92d00273402b837cb29b37325101', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9f9c44db4984653b8d4b5f6b3b949f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:36:18.400435 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eea89bc-fcd0-4db1-b278-85c6ed74bc66 service neutron] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:36:18.400710 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eea89bc-fcd0-4db1-b278-85c6ed74bc66 service neutron] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:36:18.400982 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eea89bc-fcd0-4db1-b278-85c6ed74bc66 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:36:18.409677 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eea89bc-fcd0-4db1-b278-85c6ed74bc66 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:36:18.411089 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eea89bc-fcd0-4db1-b278-85c6ed74bc66 service neutron] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:36:18.420240 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 1331/2672] 10.222.0.21 () {60 vars in 1365 bytes} [Wed May 4 07:36:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 07:36:18.680034 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf042168-5524-4ecc-952c-a0c8765a52e3 None None] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:36:18.681514 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.fernet_utils [None req-bf042168-5524-4ecc-952c-a0c8765a52e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:36:18.693316 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf042168-5524-4ecc-952c-a0c8765a52e3 None None] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:36:18.698007 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e454fb6-f06a-4270-91a4-ef893d685e19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:36:18.699503 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e454fb6-f06a-4270-91a4-ef893d685e19 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:36:18.699846 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e454fb6-f06a-4270-91a4-ef893d685e19 admin admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:36:18.700185 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e454fb6-f06a-4270-91a4-ef893d685e19 admin admin] PATH_INFO: `/v3/projects/edaeb5ddf47a4140a909478b9cc3b7a8` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:36:18.701476 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e454fb6-f06a-4270-91a4-ef893d685e19 admin admin] RBAC: Authorizing `identity:delete_project(project_id=edaeb5ddf47a4140a909478b9cc3b7a8)` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:36:18.703506 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e454fb6-f06a-4270-91a4-ef893d685e19 admin admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:36:18.750187 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-0e454fb6-f06a-4270-91a4-ef893d685e19 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'edaeb5ddf47a4140a909478b9cc3b7a8', 'request_id': 'req-0e454fb6-f06a-4270-91a4-ef893d685e19'} {{(pid=79744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:36:18.755642 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-0e454fb6-f06a-4270-91a4-ef893d685e19 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'edaeb5ddf47a4140a909478b9cc3b7a8', 'request_id': 'req-0e454fb6-f06a-4270-91a4-ef893d685e19'} {{(pid=79744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:36:18.763102 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-0e454fb6-f06a-4270-91a4-ef893d685e19 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'edaeb5ddf47a4140a909478b9cc3b7a8', 'request_id': 'req-0e454fb6-f06a-4270-91a4-ef893d685e19'} {{(pid=79744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:36:18.773766 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-0e454fb6-f06a-4270-91a4-ef893d685e19 admin admin] The token cache is being invalidate because project edaeb5ddf47a4140a909478b9cc3b7a8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79744) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 07:36:18.774047 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-0e454fb6-f06a-4270-91a4-ef893d685e19 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:36:18.774664 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-0e454fb6-f06a-4270-91a4-ef893d685e19 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:36:18.776340 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 1342/2673] 10.222.0.21 () {58 vars in 1232 bytes} [Wed May 4 07:36:18 2022] DELETE /identity/v3/projects/edaeb5ddf47a4140a909478b9cc3b7a8 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 07:36:18.781111 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eea89bc-fcd0-4db1-b278-85c6ed74bc66 service neutron] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:36:18.790436 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eea89bc-fcd0-4db1-b278-85c6ed74bc66 service neutron] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:36:18.844453 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f026bd2-2a3d-4018-b687-a180d2389077 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:36:18.845228 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f026bd2-2a3d-4018-b687-a180d2389077 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:36:18.845503 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f026bd2-2a3d-4018-b687-a180d2389077 admin admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:36:18.845776 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f026bd2-2a3d-4018-b687-a180d2389077 admin admin] PATH_INFO: `/v3/users/27b043f093404768868f8d6c7b8e08e6` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:36:18.846974 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f026bd2-2a3d-4018-b687-a180d2389077 admin admin] RBAC: Authorizing `identity:delete_user(user_id=27b043f093404768868f8d6c7b8e08e6)` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:36:18.848901 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f026bd2-2a3d-4018-b687-a180d2389077 admin admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:36:18.894793 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-4f026bd2-2a3d-4018-b687-a180d2389077 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '27b043f093404768868f8d6c7b8e08e6'} {{(pid=79745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:36:18.906913 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-4f026bd2-2a3d-4018-b687-a180d2389077 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '27b043f093404768868f8d6c7b8e08e6'} {{(pid=79745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:36:18.907586 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-4f026bd2-2a3d-4018-b687-a180d2389077 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '27b043f093404768868f8d6c7b8e08e6'} {{(pid=79745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:36:18.908195 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-4f026bd2-2a3d-4018-b687-a180d2389077 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '27b043f093404768868f8d6c7b8e08e6'} {{(pid=79745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:36:18.914720 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-4f026bd2-2a3d-4018-b687-a180d2389077 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '27b043f093404768868f8d6c7b8e08e6'} {{(pid=79745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:36:18.927095 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 1332/2674] 10.222.0.21 () {58 vars in 1223 bytes} [Wed May 4 07:36:18 2022] DELETE /identity/v3/users/27b043f093404768868f8d6c7b8e08e6 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 07:36:19.197204 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e454fb6-f06a-4270-91a4-ef893d685e19 admin admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:36:19.200580 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.fernet_utils [None req-0e454fb6-f06a-4270-91a4-ef893d685e19 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:36:19.218893 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e454fb6-f06a-4270-91a4-ef893d685e19 admin admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:36:19.286921 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f32f96-4f6e-46c7-848c-4aee11829ca6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:36:19.287919 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f32f96-4f6e-46c7-848c-4aee11829ca6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:36:19.288195 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f32f96-4f6e-46c7-848c-4aee11829ca6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:36:19.288468 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f32f96-4f6e-46c7-848c-4aee11829ca6 admin admin] PATH_INFO: `/v3/projects/0668111d75a84e45ab9edd5e20af2310` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:36:19.289686 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f32f96-4f6e-46c7-848c-4aee11829ca6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0668111d75a84e45ab9edd5e20af2310)` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:36:19.291707 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f32f96-4f6e-46c7-848c-4aee11829ca6 admin admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:36:19.343676 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-e6f32f96-4f6e-46c7-848c-4aee11829ca6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0668111d75a84e45ab9edd5e20af2310', 'request_id': 'req-e6f32f96-4f6e-46c7-848c-4aee11829ca6'} {{(pid=79744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:36:19.348835 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-e6f32f96-4f6e-46c7-848c-4aee11829ca6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0668111d75a84e45ab9edd5e20af2310', 'request_id': 'req-e6f32f96-4f6e-46c7-848c-4aee11829ca6'} {{(pid=79744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:36:19.356815 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-e6f32f96-4f6e-46c7-848c-4aee11829ca6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0668111d75a84e45ab9edd5e20af2310', 'request_id': 'req-e6f32f96-4f6e-46c7-848c-4aee11829ca6'} {{(pid=79744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:36:19.367604 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-e6f32f96-4f6e-46c7-848c-4aee11829ca6 admin admin] The token cache is being invalidate because project 0668111d75a84e45ab9edd5e20af2310 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79744) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 07:36:19.367831 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-e6f32f96-4f6e-46c7-848c-4aee11829ca6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:36:19.368450 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-e6f32f96-4f6e-46c7-848c-4aee11829ca6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:36:19.369982 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 1343/2675] 10.222.0.21 () {58 vars in 1232 bytes} [Wed May 4 07:36:19 2022] DELETE /identity/v3/projects/0668111d75a84e45ab9edd5e20af2310 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 07:36:19.375675 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fca1535-dd54-4e45-8a11-8bcc118cbf29 None None] REQUEST_METHOD: `POST` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:36:19.376167 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fca1535-dd54-4e45-8a11-8bcc118cbf29 None None] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:36:19.376268 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fca1535-dd54-4e45-8a11-8bcc118cbf29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:36:19.394485 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.auth.core [None req-6fca1535-dd54-4e45-8a11-8bcc118cbf29 None None] MFA Rules not processed for user `83c5e0dcb991496ea6dee38384514508`. Rule list: `[]` (Enabled: `True`). {{(pid=79745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:36:19.395699 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.fernet_utils [None req-6fca1535-dd54-4e45-8a11-8bcc118cbf29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:36:19.453532 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 1333/2676] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 07:36:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 07:36:19.461252 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbed316a-e5fd-4892-b3b9-83927c12b54f None None] REQUEST_METHOD: `POST` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:36:19.461531 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbed316a-e5fd-4892-b3b9-83927c12b54f None None] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:36:19.461989 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbed316a-e5fd-4892-b3b9-83927c12b54f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:36:19.480663 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.auth.core [None req-dbed316a-e5fd-4892-b3b9-83927c12b54f None None] MFA Rules not processed for user `83c5e0dcb991496ea6dee38384514508`. Rule list: `[]` (Enabled: `True`). {{(pid=79744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:36:19.481845 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.fernet_utils [None req-dbed316a-e5fd-4892-b3b9-83927c12b54f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:36:19.489712 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 1344/2677] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 07:36:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 07:36:19.493908 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fca1535-dd54-4e45-8a11-8bcc118cbf29 None None] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:36:19.504880 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fca1535-dd54-4e45-8a11-8bcc118cbf29 None None] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:36:19.509474 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f8747e-9569-49fb-9cb4-52b1e52cd64e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:36:19.510115 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f8747e-9569-49fb-9cb4-52b1e52cd64e admin admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:36:19.510394 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f8747e-9569-49fb-9cb4-52b1e52cd64e admin admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:36:19.510675 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f8747e-9569-49fb-9cb4-52b1e52cd64e admin admin] PATH_INFO: `/v3/domains` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:36:19.511497 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f8747e-9569-49fb-9cb4-52b1e52cd64e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 07:36:19.511804 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f8747e-9569-49fb-9cb4-52b1e52cd64e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:36:19.513383 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f8747e-9569-49fb-9cb4-52b1e52cd64e admin admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:36:19.529529 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 1334/2678] 10.222.0.21 () {58 vars in 1152 bytes} [Wed May 4 07:36:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 07:36:19.530620 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbed316a-e5fd-4892-b3b9-83927c12b54f None None] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:36:19.539724 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbed316a-e5fd-4892-b3b9-83927c12b54f None None] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:36:19.544914 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0390164a-aa6b-45d0-b0e4-25b347d64a2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:36:19.545572 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0390164a-aa6b-45d0-b0e4-25b347d64a2d admin admin] REQUEST_METHOD: `POST` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:36:19.545830 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0390164a-aa6b-45d0-b0e4-25b347d64a2d admin admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:36:19.546102 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0390164a-aa6b-45d0-b0e4-25b347d64a2d admin admin] PATH_INFO: `/v3/projects` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:36:19.546794 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0390164a-aa6b-45d0-b0e4-25b347d64a2d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:36:19.548708 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0390164a-aa6b-45d0-b0e4-25b347d64a2d admin admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:36:19.575009 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 1345/2679] 10.222.0.21 () {60 vars in 1152 bytes} [Wed May 4 07:36:19 2022] POST /identity/v3/projects => generated 385 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 07:36:19.579238 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f8747e-9569-49fb-9cb4-52b1e52cd64e admin admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:36:19.588960 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f8747e-9569-49fb-9cb4-52b1e52cd64e admin admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:36:19.643740 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b47d6c-f05a-476d-b483-404ff26d816d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:36:19.644319 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b47d6c-f05a-476d-b483-404ff26d816d admin admin] REQUEST_METHOD: `POST` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:36:19.644623 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b47d6c-f05a-476d-b483-404ff26d816d admin admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:36:19.644891 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b47d6c-f05a-476d-b483-404ff26d816d admin admin] PATH_INFO: `/v3/users` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:36:19.645575 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b47d6c-f05a-476d-b483-404ff26d816d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:36:19.647671 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b47d6c-f05a-476d-b483-404ff26d816d admin admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:36:19.666170 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 1335/2680] 10.222.0.21 () {60 vars in 1143 bytes} [Wed May 4 07:36:19 2022] POST /identity/v3/users => generated 293 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 07:36:19.670944 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0390164a-aa6b-45d0-b0e4-25b347d64a2d admin admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:36:19.681016 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0390164a-aa6b-45d0-b0e4-25b347d64a2d admin admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:36:19.686619 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01566913-1803-4e8e-838a-08e7961eba1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:36:19.687317 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01566913-1803-4e8e-838a-08e7961eba1b admin admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:36:19.687603 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01566913-1803-4e8e-838a-08e7961eba1b admin admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:36:19.687880 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01566913-1803-4e8e-838a-08e7961eba1b admin admin] PATH_INFO: `/v3/roles` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:36:19.688717 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01566913-1803-4e8e-838a-08e7961eba1b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:36:19.690316 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01566913-1803-4e8e-838a-08e7961eba1b admin admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:36:19.700893 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 1346/2681] 10.222.0.21 () {58 vars in 1121 bytes} [Wed May 4 07:36:19 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 07:36:19.704687 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b47d6c-f05a-476d-b483-404ff26d816d admin admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:36:19.714962 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b47d6c-f05a-476d-b483-404ff26d816d admin admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:36:19.719488 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb7245e-54fa-49f9-b5e7-d07520acef6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:36:19.720122 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb7245e-54fa-49f9-b5e7-d07520acef6a admin admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:36:19.720400 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb7245e-54fa-49f9-b5e7-d07520acef6a admin admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:36:19.720690 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb7245e-54fa-49f9-b5e7-d07520acef6a admin admin] PATH_INFO: `/v3/roles` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:36:19.721410 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb7245e-54fa-49f9-b5e7-d07520acef6a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:36:19.722969 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb7245e-54fa-49f9-b5e7-d07520acef6a admin admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:36:19.733219 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 1336/2682] 10.222.0.21 () {58 vars in 1121 bytes} [Wed May 4 07:36:19 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 07:36:19.737241 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01566913-1803-4e8e-838a-08e7961eba1b admin admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:36:19.747118 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01566913-1803-4e8e-838a-08e7961eba1b admin admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:36:19.751685 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2db3265-3a4d-4a74-91af-0d3494a00ee9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:36:19.752906 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2db3265-3a4d-4a74-91af-0d3494a00ee9 admin admin] REQUEST_METHOD: `PUT` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:36:19.753204 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2db3265-3a4d-4a74-91af-0d3494a00ee9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:36:19.753473 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2db3265-3a4d-4a74-91af-0d3494a00ee9 admin admin] PATH_INFO: `/v3/projects/e8dbae4a84054416a49e5f591619fb92/users/8ded93ec69884d7288893540cda839eb/roles/9f89c07b05a14f18836116af22cba5f6` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:36:19.767846 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2db3265-3a4d-4a74-91af-0d3494a00ee9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e8dbae4a84054416a49e5f591619fb92, user_id=8ded93ec69884d7288893540cda839eb, role_id=9f89c07b05a14f18836116af22cba5f6)` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:36:19.770494 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2db3265-3a4d-4a74-91af-0d3494a00ee9 admin admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:36:19.783785 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 1347/2683] 10.222.0.21 () {60 vars in 1482 bytes} [Wed May 4 07:36:19 2022] PUT /identity/v3/projects/e8dbae4a84054416a49e5f591619fb92/users/8ded93ec69884d7288893540cda839eb/roles/9f89c07b05a14f18836116af22cba5f6 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 07:36:19.794642 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634625b9-3c71-4d26-bfe8-cd7c8fa18a3a None None] REQUEST_METHOD: `POST` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:36:19.794933 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634625b9-3c71-4d26-bfe8-cd7c8fa18a3a None None] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:36:19.795252 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634625b9-3c71-4d26-bfe8-cd7c8fa18a3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:36:19.821810 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.auth.core [None req-634625b9-3c71-4d26-bfe8-cd7c8fa18a3a None None] MFA Rules not processed for user `8ded93ec69884d7288893540cda839eb`. Rule list: `[]` (Enabled: `True`). {{(pid=79745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:36:19.823003 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.fernet_utils [None req-634625b9-3c71-4d26-bfe8-cd7c8fa18a3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:36:19.885269 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 1337/2684] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 07:36:19 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 07:36:19.889789 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2db3265-3a4d-4a74-91af-0d3494a00ee9 admin admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:36:19.947927 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2db3265-3a4d-4a74-91af-0d3494a00ee9 admin admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:36:19.952552 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a9d9aa-c9f6-4257-abc6-11c9f082bace admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:36:19.953196 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a9d9aa-c9f6-4257-abc6-11c9f082bace admin admin] REQUEST_METHOD: `POST` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:36:19.953474 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a9d9aa-c9f6-4257-abc6-11c9f082bace admin admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:36:19.953745 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a9d9aa-c9f6-4257-abc6-11c9f082bace admin admin] PATH_INFO: `/v3/projects` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:36:19.954426 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a9d9aa-c9f6-4257-abc6-11c9f082bace admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:36:19.956344 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a9d9aa-c9f6-4257-abc6-11c9f082bace admin admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:36:19.982063 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 1348/2685] 10.222.0.21 () {60 vars in 1152 bytes} [Wed May 4 07:36:19 2022] POST /identity/v3/projects => generated 387 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 07:36:19.986039 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634625b9-3c71-4d26-bfe8-cd7c8fa18a3a None None] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:36:19.997321 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634625b9-3c71-4d26-bfe8-cd7c8fa18a3a None None] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:36:20.052466 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e40685-7ed6-422c-99f0-a67cf8b3a240 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:36:20.053125 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e40685-7ed6-422c-99f0-a67cf8b3a240 admin admin] REQUEST_METHOD: `POST` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:36:20.053402 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e40685-7ed6-422c-99f0-a67cf8b3a240 admin admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:36:20.053672 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e40685-7ed6-422c-99f0-a67cf8b3a240 admin admin] PATH_INFO: `/v3/users` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:36:20.054358 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e40685-7ed6-422c-99f0-a67cf8b3a240 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:36:20.056311 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e40685-7ed6-422c-99f0-a67cf8b3a240 admin admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:36:20.076171 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 1338/2686] 10.222.0.21 () {60 vars in 1143 bytes} [Wed May 4 07:36:19 2022] POST /identity/v3/users => generated 294 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 07:36:20.080181 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a9d9aa-c9f6-4257-abc6-11c9f082bace admin admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:36:20.090197 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a9d9aa-c9f6-4257-abc6-11c9f082bace admin admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:36:20.094706 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d582efd-10b1-4105-9b24-7276fc18acc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:36:20.095371 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d582efd-10b1-4105-9b24-7276fc18acc8 admin admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:36:20.095649 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d582efd-10b1-4105-9b24-7276fc18acc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:36:20.095918 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d582efd-10b1-4105-9b24-7276fc18acc8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:36:20.096627 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d582efd-10b1-4105-9b24-7276fc18acc8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:36:20.098195 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d582efd-10b1-4105-9b24-7276fc18acc8 admin admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:36:20.109332 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 1349/2687] 10.222.0.21 () {58 vars in 1121 bytes} [Wed May 4 07:36:20 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 07:36:20.113206 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e40685-7ed6-422c-99f0-a67cf8b3a240 admin admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:36:20.123102 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e40685-7ed6-422c-99f0-a67cf8b3a240 admin admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:36:20.127903 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f7d9fc-bd25-4888-b63f-735785a97349 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:36:20.128543 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f7d9fc-bd25-4888-b63f-735785a97349 admin admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:36:20.128819 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f7d9fc-bd25-4888-b63f-735785a97349 admin admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:36:20.129089 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f7d9fc-bd25-4888-b63f-735785a97349 admin admin] PATH_INFO: `/v3/roles` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:36:20.129796 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f7d9fc-bd25-4888-b63f-735785a97349 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:36:20.131382 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f7d9fc-bd25-4888-b63f-735785a97349 admin admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:36:20.141365 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 1339/2688] 10.222.0.21 () {58 vars in 1121 bytes} [Wed May 4 07:36:20 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 07:36:20.145409 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d582efd-10b1-4105-9b24-7276fc18acc8 admin admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:36:20.155719 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d582efd-10b1-4105-9b24-7276fc18acc8 admin admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:36:20.160224 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae74795-d0f7-4a49-be11-a6b8983ce412 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:36:20.161087 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae74795-d0f7-4a49-be11-a6b8983ce412 admin admin] REQUEST_METHOD: `PUT` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:36:20.161362 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae74795-d0f7-4a49-be11-a6b8983ce412 admin admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:36:20.161629 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae74795-d0f7-4a49-be11-a6b8983ce412 admin admin] PATH_INFO: `/v3/projects/695f949649ed45a8ab3a9097122cf2e3/users/8459755e846a4078b3dbec9d7205ca67/roles/9f89c07b05a14f18836116af22cba5f6` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:36:20.177257 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae74795-d0f7-4a49-be11-a6b8983ce412 admin admin] RBAC: Authorizing `identity:create_grant(project_id=695f949649ed45a8ab3a9097122cf2e3, user_id=8459755e846a4078b3dbec9d7205ca67, role_id=9f89c07b05a14f18836116af22cba5f6)` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:36:20.180409 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae74795-d0f7-4a49-be11-a6b8983ce412 admin admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:36:20.197853 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 1350/2689] 10.222.0.21 () {60 vars in 1482 bytes} [Wed May 4 07:36:20 2022] PUT /identity/v3/projects/695f949649ed45a8ab3a9097122cf2e3/users/8459755e846a4078b3dbec9d7205ca67/roles/9f89c07b05a14f18836116af22cba5f6 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 07:36:20.210624 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84be928-d515-4ddc-ad91-2e4baf2f029e None None] REQUEST_METHOD: `POST` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:36:20.210866 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84be928-d515-4ddc-ad91-2e4baf2f029e None None] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:36:20.211074 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84be928-d515-4ddc-ad91-2e4baf2f029e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:36:20.240902 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.auth.core [None req-f84be928-d515-4ddc-ad91-2e4baf2f029e None None] MFA Rules not processed for user `8459755e846a4078b3dbec9d7205ca67`. Rule list: `[]` (Enabled: `True`). {{(pid=79745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:36:20.242093 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.fernet_utils [None req-f84be928-d515-4ddc-ad91-2e4baf2f029e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:36:20.318129 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 1340/2690] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 07:36:20 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 07:36:20.322842 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae74795-d0f7-4a49-be11-a6b8983ce412 admin admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:36:20.397724 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae74795-d0f7-4a49-be11-a6b8983ce412 admin admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:36:20.404529 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3c8db9-0cb1-4ce6-bb89-a8a423ebedde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:36:20.405549 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3c8db9-0cb1-4ce6-bb89-a8a423ebedde admin admin] REQUEST_METHOD: `POST` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:36:20.406327 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3c8db9-0cb1-4ce6-bb89-a8a423ebedde admin admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:36:20.406611 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3c8db9-0cb1-4ce6-bb89-a8a423ebedde admin admin] PATH_INFO: `/v3/projects` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:36:20.410409 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3c8db9-0cb1-4ce6-bb89-a8a423ebedde admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:36:20.414122 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3c8db9-0cb1-4ce6-bb89-a8a423ebedde admin admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:36:20.444342 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 1351/2691] 10.222.0.21 () {60 vars in 1152 bytes} [Wed May 4 07:36:20 2022] POST /identity/v3/projects => generated 387 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 07:36:20.445514 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84be928-d515-4ddc-ad91-2e4baf2f029e None None] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:36:20.459877 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84be928-d515-4ddc-ad91-2e4baf2f029e None None] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:36:20.529016 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c285050b-06f8-41d5-b7d0-dccb489b49d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:36:20.530053 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c285050b-06f8-41d5-b7d0-dccb489b49d6 admin admin] REQUEST_METHOD: `POST` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:36:20.530510 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c285050b-06f8-41d5-b7d0-dccb489b49d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:36:20.530811 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c285050b-06f8-41d5-b7d0-dccb489b49d6 admin admin] PATH_INFO: `/v3/users` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:36:20.531557 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c285050b-06f8-41d5-b7d0-dccb489b49d6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:36:20.533518 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c285050b-06f8-41d5-b7d0-dccb489b49d6 admin admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:36:20.560532 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 1341/2692] 10.222.0.21 () {60 vars in 1143 bytes} [Wed May 4 07:36:20 2022] POST /identity/v3/users => generated 300 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 07:36:20.561817 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3c8db9-0cb1-4ce6-bb89-a8a423ebedde admin admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:36:20.572326 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3c8db9-0cb1-4ce6-bb89-a8a423ebedde admin admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:36:20.577895 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4cbf24f-6dbc-44a7-bbe4-42a81a2be5d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:36:20.578564 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cbf24f-6dbc-44a7-bbe4-42a81a2be5d2 admin admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:36:20.578846 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cbf24f-6dbc-44a7-bbe4-42a81a2be5d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:36:20.579119 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cbf24f-6dbc-44a7-bbe4-42a81a2be5d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:36:20.579877 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4cbf24f-6dbc-44a7-bbe4-42a81a2be5d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:36:20.581469 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4cbf24f-6dbc-44a7-bbe4-42a81a2be5d2 admin admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:36:20.593781 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 1352/2693] 10.222.0.21 () {58 vars in 1121 bytes} [Wed May 4 07:36:20 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 07:36:20.598038 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c285050b-06f8-41d5-b7d0-dccb489b49d6 admin admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:36:20.614334 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c285050b-06f8-41d5-b7d0-dccb489b49d6 admin admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:36:20.619408 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa80bbcc-af05-495e-b09c-06764e7ff347 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:36:20.620315 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa80bbcc-af05-495e-b09c-06764e7ff347 admin admin] REQUEST_METHOD: `PUT` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:36:20.620587 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa80bbcc-af05-495e-b09c-06764e7ff347 admin admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:36:20.620854 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa80bbcc-af05-495e-b09c-06764e7ff347 admin admin] PATH_INFO: `/v3/projects/c085294b3ed34ece8db50560b82e93bf/users/63b9af95aa6f463dbf7c71301565d277/roles/eb54c9cea2774a25b1fe8c79724408ee` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:36:20.642304 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa80bbcc-af05-495e-b09c-06764e7ff347 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c085294b3ed34ece8db50560b82e93bf, user_id=63b9af95aa6f463dbf7c71301565d277, role_id=eb54c9cea2774a25b1fe8c79724408ee)` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:36:20.645124 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa80bbcc-af05-495e-b09c-06764e7ff347 admin admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:36:20.660228 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 1342/2694] 10.222.0.21 () {60 vars in 1482 bytes} [Wed May 4 07:36:20 2022] PUT /identity/v3/projects/c085294b3ed34ece8db50560b82e93bf/users/63b9af95aa6f463dbf7c71301565d277/roles/eb54c9cea2774a25b1fe8c79724408ee => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 07:36:20.664392 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4cbf24f-6dbc-44a7-bbe4-42a81a2be5d2 admin admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:36:20.675853 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4cbf24f-6dbc-44a7-bbe4-42a81a2be5d2 admin admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:36:20.749215 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b98667-2cd9-458e-b209-b1a9e51fbb87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:36:20.749886 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b98667-2cd9-458e-b209-b1a9e51fbb87 admin admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:36:20.750084 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b98667-2cd9-458e-b209-b1a9e51fbb87 admin admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:36:20.750360 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b98667-2cd9-458e-b209-b1a9e51fbb87 admin admin] PATH_INFO: `/v3/roles` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:36:20.751109 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b98667-2cd9-458e-b209-b1a9e51fbb87 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:36:20.753057 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b98667-2cd9-458e-b209-b1a9e51fbb87 admin admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:36:20.764580 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 1353/2695] 10.222.0.21 () {58 vars in 1121 bytes} [Wed May 4 07:36:20 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 04 07:36:20.769647 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa80bbcc-af05-495e-b09c-06764e7ff347 admin admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:36:20.782159 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa80bbcc-af05-495e-b09c-06764e7ff347 admin admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:36:20.787309 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef368a16-d3f3-4d57-995c-f02da16da657 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:36:20.788483 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef368a16-d3f3-4d57-995c-f02da16da657 admin admin] REQUEST_METHOD: `PUT` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:36:20.788831 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef368a16-d3f3-4d57-995c-f02da16da657 admin admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:36:20.789175 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef368a16-d3f3-4d57-995c-f02da16da657 admin admin] PATH_INFO: `/v3/projects/c085294b3ed34ece8db50560b82e93bf/users/63b9af95aa6f463dbf7c71301565d277/roles/eb54c9cea2774a25b1fe8c79724408ee` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:36:20.791370 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef368a16-d3f3-4d57-995c-f02da16da657 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c085294b3ed34ece8db50560b82e93bf, user_id=63b9af95aa6f463dbf7c71301565d277, role_id=eb54c9cea2774a25b1fe8c79724408ee)` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:36:20.794613 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef368a16-d3f3-4d57-995c-f02da16da657 admin admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:36:20.805634 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 1343/2696] 10.222.0.21 () {60 vars in 1482 bytes} [Wed May 4 07:36:20 2022] PUT /identity/v3/projects/c085294b3ed34ece8db50560b82e93bf/users/63b9af95aa6f463dbf7c71301565d277/roles/eb54c9cea2774a25b1fe8c79724408ee => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 07:36:20.816411 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4962081-74cb-419b-bae3-23717c82d578 None None] REQUEST_METHOD: `POST` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:36:20.816700 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4962081-74cb-419b-bae3-23717c82d578 None None] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:36:20.816990 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4962081-74cb-419b-bae3-23717c82d578 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:36:20.849954 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.auth.core [None req-d4962081-74cb-419b-bae3-23717c82d578 None None] MFA Rules not processed for user `63b9af95aa6f463dbf7c71301565d277`. Rule list: `[]` (Enabled: `True`). {{(pid=79744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:36:20.851310 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.fernet_utils [None req-d4962081-74cb-419b-bae3-23717c82d578 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:36:20.937403 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 1354/2697] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 07:36:20 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 07:36:20.949504 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef368a16-d3f3-4d57-995c-f02da16da657 admin admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:36:20.951471 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.fernet_utils [None req-ef368a16-d3f3-4d57-995c-f02da16da657 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:36:21.016518 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef368a16-d3f3-4d57-995c-f02da16da657 admin admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:36:21.020588 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed90bc28-b019-425e-bbe0-12a02a91b375 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb341257aa8246b6847561e2fe1fa385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9f9c44db4984653b8d4b5f6b3b949f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:36:21.021233 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed90bc28-b019-425e-bbe0-12a02a91b375 service cinder] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:36:21.021507 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed90bc28-b019-425e-bbe0-12a02a91b375 service cinder] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:36:21.021828 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed90bc28-b019-425e-bbe0-12a02a91b375 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:36:21.032204 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed90bc28-b019-425e-bbe0-12a02a91b375 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:36:21.033772 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed90bc28-b019-425e-bbe0-12a02a91b375 service cinder] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:36:21.045957 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 1344/2698] 10.222.0.21 () {60 vars in 1365 bytes} [Wed May 4 07:36:20 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 07:36:21.549569 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4962081-74cb-419b-bae3-23717c82d578 None None] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:36:21.550975 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.fernet_utils [None req-d4962081-74cb-419b-bae3-23717c82d578 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:36:21.562760 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4962081-74cb-419b-bae3-23717c82d578 None None] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:36:21.566313 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06915a3b-0bd6-40c6-a773-667c3e1ea1b3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb341257aa8246b6847561e2fe1fa385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9f9c44db4984653b8d4b5f6b3b949f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:36:21.566937 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06915a3b-0bd6-40c6-a773-667c3e1ea1b3 service cinder] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:36:21.567253 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06915a3b-0bd6-40c6-a773-667c3e1ea1b3 service cinder] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:36:21.567526 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06915a3b-0bd6-40c6-a773-667c3e1ea1b3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:36:21.623445 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06915a3b-0bd6-40c6-a773-667c3e1ea1b3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:36:21.625719 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06915a3b-0bd6-40c6-a773-667c3e1ea1b3 service cinder] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:36:21.636257 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 1355/2699] 10.222.0.21 () {60 vars in 1365 bytes} [Wed May 4 07:36:21 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 07:36:25.650336 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed90bc28-b019-425e-bbe0-12a02a91b375 service cinder] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:36:25.659790 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed90bc28-b019-425e-bbe0-12a02a91b375 service cinder] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:36:25.663502 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef87a99-2cda-4658-9845-17c01947ad47 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb341257aa8246b6847561e2fe1fa385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9f9c44db4984653b8d4b5f6b3b949f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:36:25.664135 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef87a99-2cda-4658-9845-17c01947ad47 service cinder] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:36:25.664413 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef87a99-2cda-4658-9845-17c01947ad47 service cinder] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:36:25.664685 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef87a99-2cda-4658-9845-17c01947ad47 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:36:25.727397 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef87a99-2cda-4658-9845-17c01947ad47 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:36:25.729965 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef87a99-2cda-4658-9845-17c01947ad47 service cinder] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:36:25.742580 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 1345/2700] 10.222.0.21 () {60 vars in 1365 bytes} [Wed May 4 07:36:25 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 07:36:27.798904 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06915a3b-0bd6-40c6-a773-667c3e1ea1b3 service cinder] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:36:27.860554 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06915a3b-0bd6-40c6-a773-667c3e1ea1b3 service cinder] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:36:27.865108 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815ee39b-2b92-48bc-a4be-083735e8a7a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:36:27.865974 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815ee39b-2b92-48bc-a4be-083735e8a7a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:36:27.866254 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815ee39b-2b92-48bc-a4be-083735e8a7a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:36:27.866646 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815ee39b-2b92-48bc-a4be-083735e8a7a3 admin admin] PATH_INFO: `/v3/users/8ded93ec69884d7288893540cda839eb` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:36:27.867920 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815ee39b-2b92-48bc-a4be-083735e8a7a3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8ded93ec69884d7288893540cda839eb)` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:36:27.869823 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815ee39b-2b92-48bc-a4be-083735e8a7a3 admin admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:36:27.914997 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-815ee39b-2b92-48bc-a4be-083735e8a7a3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8ded93ec69884d7288893540cda839eb'} {{(pid=79744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:36:27.915680 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-815ee39b-2b92-48bc-a4be-083735e8a7a3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8ded93ec69884d7288893540cda839eb'} {{(pid=79744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:36:27.922838 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-815ee39b-2b92-48bc-a4be-083735e8a7a3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8ded93ec69884d7288893540cda839eb'} {{(pid=79744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:36:27.923487 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-815ee39b-2b92-48bc-a4be-083735e8a7a3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8ded93ec69884d7288893540cda839eb'} {{(pid=79744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:36:27.934667 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-815ee39b-2b92-48bc-a4be-083735e8a7a3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8ded93ec69884d7288893540cda839eb'} {{(pid=79744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:36:27.946762 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 1356/2701] 10.222.0.21 () {58 vars in 1223 bytes} [Wed May 4 07:36:27 2022] DELETE /identity/v3/users/8ded93ec69884d7288893540cda839eb => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 07:36:27.951589 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc056f2-f4c6-4a86-98b4-0eedbe2a8370 None None] REQUEST_METHOD: `POST` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:36:27.952137 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc056f2-f4c6-4a86-98b4-0eedbe2a8370 None None] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:36:27.952137 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc056f2-f4c6-4a86-98b4-0eedbe2a8370 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:36:27.972342 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.auth.core [None req-4fc056f2-f4c6-4a86-98b4-0eedbe2a8370 None None] MFA Rules not processed for user `83c5e0dcb991496ea6dee38384514508`. Rule list: `[]` (Enabled: `True`). {{(pid=79745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:36:27.973550 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.fernet_utils [None req-4fc056f2-f4c6-4a86-98b4-0eedbe2a8370 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:36:28.037399 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 1346/2702] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 07:36:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 07:36:28.048488 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815ee39b-2b92-48bc-a4be-083735e8a7a3 admin admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:36:28.049895 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.fernet_utils [None req-815ee39b-2b92-48bc-a4be-083735e8a7a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:36:28.112397 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815ee39b-2b92-48bc-a4be-083735e8a7a3 admin admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:36:28.116062 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63758036-617c-4bf0-bfde-b8f173c40e78 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91cb92d00273402b837cb29b37325101', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9f9c44db4984653b8d4b5f6b3b949f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:36:28.116703 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63758036-617c-4bf0-bfde-b8f173c40e78 service neutron] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:36:28.116989 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63758036-617c-4bf0-bfde-b8f173c40e78 service neutron] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:36:28.117256 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63758036-617c-4bf0-bfde-b8f173c40e78 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:36:28.126649 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63758036-617c-4bf0-bfde-b8f173c40e78 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:36:28.128360 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63758036-617c-4bf0-bfde-b8f173c40e78 service neutron] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:36:28.138236 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 1357/2703] 10.222.0.21 () {60 vars in 1365 bytes} [Wed May 4 07:36:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 07:36:28.424702 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc056f2-f4c6-4a86-98b4-0eedbe2a8370 None None] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:36:28.426144 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.fernet_utils [None req-4fc056f2-f4c6-4a86-98b4-0eedbe2a8370 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:36:28.439467 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc056f2-f4c6-4a86-98b4-0eedbe2a8370 None None] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:36:28.456431 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0af563-b092-44bb-8261-f8b6809297e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:36:28.457069 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0af563-b092-44bb-8261-f8b6809297e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:36:28.457344 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0af563-b092-44bb-8261-f8b6809297e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:36:28.457624 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0af563-b092-44bb-8261-f8b6809297e8 admin admin] PATH_INFO: `/v3/projects/e8dbae4a84054416a49e5f591619fb92` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:36:28.458828 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0af563-b092-44bb-8261-f8b6809297e8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e8dbae4a84054416a49e5f591619fb92)` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:36:28.460932 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0af563-b092-44bb-8261-f8b6809297e8 admin admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:36:28.508808 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-8f0af563-b092-44bb-8261-f8b6809297e8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e8dbae4a84054416a49e5f591619fb92', 'request_id': 'req-8f0af563-b092-44bb-8261-f8b6809297e8'} {{(pid=79745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:36:28.516572 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-8f0af563-b092-44bb-8261-f8b6809297e8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e8dbae4a84054416a49e5f591619fb92', 'request_id': 'req-8f0af563-b092-44bb-8261-f8b6809297e8'} {{(pid=79745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:36:28.524392 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-8f0af563-b092-44bb-8261-f8b6809297e8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e8dbae4a84054416a49e5f591619fb92', 'request_id': 'req-8f0af563-b092-44bb-8261-f8b6809297e8'} {{(pid=79745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:36:28.535339 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-8f0af563-b092-44bb-8261-f8b6809297e8 admin admin] The token cache is being invalidate because project e8dbae4a84054416a49e5f591619fb92 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79745) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 07:36:28.536062 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-8f0af563-b092-44bb-8261-f8b6809297e8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:36:28.536268 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-8f0af563-b092-44bb-8261-f8b6809297e8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:36:28.537805 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 1347/2704] 10.222.0.21 () {58 vars in 1232 bytes} [Wed May 4 07:36:28 2022] DELETE /identity/v3/projects/e8dbae4a84054416a49e5f591619fb92 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 07:36:28.542141 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63758036-617c-4bf0-bfde-b8f173c40e78 service neutron] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:36:28.551641 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63758036-617c-4bf0-bfde-b8f173c40e78 service neutron] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:36:28.606409 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8ff417-8cc9-4fc7-b27e-31f20bc02200 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:36:28.607317 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8ff417-8cc9-4fc7-b27e-31f20bc02200 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:36:28.607597 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8ff417-8cc9-4fc7-b27e-31f20bc02200 admin admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:36:28.607873 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8ff417-8cc9-4fc7-b27e-31f20bc02200 admin admin] PATH_INFO: `/v3/users/8459755e846a4078b3dbec9d7205ca67` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:36:28.609053 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8ff417-8cc9-4fc7-b27e-31f20bc02200 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8459755e846a4078b3dbec9d7205ca67)` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:36:28.610953 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8ff417-8cc9-4fc7-b27e-31f20bc02200 admin admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:36:28.656003 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-5a8ff417-8cc9-4fc7-b27e-31f20bc02200 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8459755e846a4078b3dbec9d7205ca67'} {{(pid=79744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:36:28.656643 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-5a8ff417-8cc9-4fc7-b27e-31f20bc02200 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8459755e846a4078b3dbec9d7205ca67'} {{(pid=79744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:36:28.663208 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-5a8ff417-8cc9-4fc7-b27e-31f20bc02200 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8459755e846a4078b3dbec9d7205ca67'} {{(pid=79744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:36:28.663836 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-5a8ff417-8cc9-4fc7-b27e-31f20bc02200 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8459755e846a4078b3dbec9d7205ca67'} {{(pid=79744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:36:28.675104 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-5a8ff417-8cc9-4fc7-b27e-31f20bc02200 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8459755e846a4078b3dbec9d7205ca67'} {{(pid=79744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:36:28.687974 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 1358/2705] 10.222.0.21 () {58 vars in 1223 bytes} [Wed May 4 07:36:28 2022] DELETE /identity/v3/users/8459755e846a4078b3dbec9d7205ca67 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 07:36:28.968783 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0af563-b092-44bb-8261-f8b6809297e8 admin admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:36:28.970301 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.fernet_utils [None req-8f0af563-b092-44bb-8261-f8b6809297e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:36:28.985634 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0af563-b092-44bb-8261-f8b6809297e8 admin admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:36:29.044279 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87ed777-1f7f-4a83-a1c4-6bd708ef8091 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:36:29.045296 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87ed777-1f7f-4a83-a1c4-6bd708ef8091 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:36:29.045582 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87ed777-1f7f-4a83-a1c4-6bd708ef8091 admin admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:36:29.045854 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87ed777-1f7f-4a83-a1c4-6bd708ef8091 admin admin] PATH_INFO: `/v3/projects/695f949649ed45a8ab3a9097122cf2e3` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:36:29.047046 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87ed777-1f7f-4a83-a1c4-6bd708ef8091 admin admin] RBAC: Authorizing `identity:delete_project(project_id=695f949649ed45a8ab3a9097122cf2e3)` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:36:29.048988 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87ed777-1f7f-4a83-a1c4-6bd708ef8091 admin admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:36:29.095868 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-a87ed777-1f7f-4a83-a1c4-6bd708ef8091 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '695f949649ed45a8ab3a9097122cf2e3', 'request_id': 'req-a87ed777-1f7f-4a83-a1c4-6bd708ef8091'} {{(pid=79745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:36:29.101977 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-a87ed777-1f7f-4a83-a1c4-6bd708ef8091 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '695f949649ed45a8ab3a9097122cf2e3', 'request_id': 'req-a87ed777-1f7f-4a83-a1c4-6bd708ef8091'} {{(pid=79745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:36:29.110582 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-a87ed777-1f7f-4a83-a1c4-6bd708ef8091 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '695f949649ed45a8ab3a9097122cf2e3', 'request_id': 'req-a87ed777-1f7f-4a83-a1c4-6bd708ef8091'} {{(pid=79745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:36:29.123368 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-a87ed777-1f7f-4a83-a1c4-6bd708ef8091 admin admin] The token cache is being invalidate because project 695f949649ed45a8ab3a9097122cf2e3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79745) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 07:36:29.123658 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-a87ed777-1f7f-4a83-a1c4-6bd708ef8091 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:36:29.124504 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-a87ed777-1f7f-4a83-a1c4-6bd708ef8091 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:36:29.126381 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 1348/2706] 10.222.0.21 () {58 vars in 1232 bytes} [Wed May 4 07:36:28 2022] DELETE /identity/v3/projects/695f949649ed45a8ab3a9097122cf2e3 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 07:36:29.131302 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8ff417-8cc9-4fc7-b27e-31f20bc02200 admin admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:36:29.133050 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.fernet_utils [None req-5a8ff417-8cc9-4fc7-b27e-31f20bc02200 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:36:29.146266 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8ff417-8cc9-4fc7-b27e-31f20bc02200 admin admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:36:29.205741 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30264b91-01d1-49e0-9d73-cf0b5d776818 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:36:29.206608 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30264b91-01d1-49e0-9d73-cf0b5d776818 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:36:29.206885 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30264b91-01d1-49e0-9d73-cf0b5d776818 admin admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:36:29.207182 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30264b91-01d1-49e0-9d73-cf0b5d776818 admin admin] PATH_INFO: `/v3/users/63b9af95aa6f463dbf7c71301565d277` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:36:29.208392 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30264b91-01d1-49e0-9d73-cf0b5d776818 admin admin] RBAC: Authorizing `identity:delete_user(user_id=63b9af95aa6f463dbf7c71301565d277)` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:36:29.210288 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30264b91-01d1-49e0-9d73-cf0b5d776818 admin admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:36:29.263391 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-30264b91-01d1-49e0-9d73-cf0b5d776818 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '63b9af95aa6f463dbf7c71301565d277'} {{(pid=79744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:36:29.263391 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-30264b91-01d1-49e0-9d73-cf0b5d776818 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '63b9af95aa6f463dbf7c71301565d277'} {{(pid=79744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:36:29.266501 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-30264b91-01d1-49e0-9d73-cf0b5d776818 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '63b9af95aa6f463dbf7c71301565d277'} {{(pid=79744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:36:29.267125 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-30264b91-01d1-49e0-9d73-cf0b5d776818 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '63b9af95aa6f463dbf7c71301565d277'} {{(pid=79744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:36:29.278547 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-30264b91-01d1-49e0-9d73-cf0b5d776818 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '63b9af95aa6f463dbf7c71301565d277'} {{(pid=79744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:36:29.290926 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 1359/2707] 10.222.0.21 () {58 vars in 1223 bytes} [Wed May 4 07:36:29 2022] DELETE /identity/v3/users/63b9af95aa6f463dbf7c71301565d277 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 07:36:29.585328 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87ed777-1f7f-4a83-a1c4-6bd708ef8091 admin admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:36:29.592367 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.fernet_utils [None req-a87ed777-1f7f-4a83-a1c4-6bd708ef8091 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:36:29.621398 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87ed777-1f7f-4a83-a1c4-6bd708ef8091 admin admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:36:29.683961 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44bdf99e-f77f-44c5-b6d9-a1e9e5410d4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:36:29.684843 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bdf99e-f77f-44c5-b6d9-a1e9e5410d4d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:36:29.685120 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bdf99e-f77f-44c5-b6d9-a1e9e5410d4d admin admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:36:29.685389 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bdf99e-f77f-44c5-b6d9-a1e9e5410d4d admin admin] PATH_INFO: `/v3/projects/c085294b3ed34ece8db50560b82e93bf` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:36:29.686654 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44bdf99e-f77f-44c5-b6d9-a1e9e5410d4d admin admin] RBAC: Authorizing `identity:delete_project(project_id=c085294b3ed34ece8db50560b82e93bf)` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:36:29.688632 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44bdf99e-f77f-44c5-b6d9-a1e9e5410d4d admin admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:36:29.738201 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-44bdf99e-f77f-44c5-b6d9-a1e9e5410d4d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c085294b3ed34ece8db50560b82e93bf', 'request_id': 'req-44bdf99e-f77f-44c5-b6d9-a1e9e5410d4d'} {{(pid=79745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:36:29.744275 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-44bdf99e-f77f-44c5-b6d9-a1e9e5410d4d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c085294b3ed34ece8db50560b82e93bf', 'request_id': 'req-44bdf99e-f77f-44c5-b6d9-a1e9e5410d4d'} {{(pid=79745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:36:29.752320 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-44bdf99e-f77f-44c5-b6d9-a1e9e5410d4d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c085294b3ed34ece8db50560b82e93bf', 'request_id': 'req-44bdf99e-f77f-44c5-b6d9-a1e9e5410d4d'} {{(pid=79745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:36:29.763854 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-44bdf99e-f77f-44c5-b6d9-a1e9e5410d4d admin admin] The token cache is being invalidate because project c085294b3ed34ece8db50560b82e93bf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79745) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 07:36:29.764134 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-44bdf99e-f77f-44c5-b6d9-a1e9e5410d4d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:36:29.764799 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-44bdf99e-f77f-44c5-b6d9-a1e9e5410d4d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:36:29.766539 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 1349/2708] 10.222.0.21 () {58 vars in 1232 bytes} [Wed May 4 07:36:29 2022] DELETE /identity/v3/projects/c085294b3ed34ece8db50560b82e93bf => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 07:36:29.772912 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0c8c72-5369-402b-9194-4b0708af7156 None None] REQUEST_METHOD: `POST` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:36:29.773193 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0c8c72-5369-402b-9194-4b0708af7156 None None] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:36:29.773510 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0c8c72-5369-402b-9194-4b0708af7156 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:36:29.803837 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.auth.core [None req-ed0c8c72-5369-402b-9194-4b0708af7156 None None] MFA Rules not processed for user `83c5e0dcb991496ea6dee38384514508`. Rule list: `[]` (Enabled: `True`). {{(pid=79744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:36:29.805063 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.fernet_utils [None req-ed0c8c72-5369-402b-9194-4b0708af7156 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:36:29.868951 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 1360/2709] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 07:36:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 07:36:29.878756 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b578b4f6-7760-44cd-b1a7-4c4bef3cb794 None None] REQUEST_METHOD: `POST` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:36:29.879047 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b578b4f6-7760-44cd-b1a7-4c4bef3cb794 None None] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:36:29.879357 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b578b4f6-7760-44cd-b1a7-4c4bef3cb794 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:36:29.898688 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.auth.core [None req-b578b4f6-7760-44cd-b1a7-4c4bef3cb794 None None] MFA Rules not processed for user `83c5e0dcb991496ea6dee38384514508`. Rule list: `[]` (Enabled: `True`). {{(pid=79745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:36:29.899951 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.fernet_utils [None req-b578b4f6-7760-44cd-b1a7-4c4bef3cb794 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:36:29.909245 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 1350/2710] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 07:36:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 07:36:29.913576 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0c8c72-5369-402b-9194-4b0708af7156 None None] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:36:29.923557 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0c8c72-5369-402b-9194-4b0708af7156 None None] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:36:29.928295 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2366ccc-fc6c-4b70-8f3f-22d2a868c873 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:36:29.928954 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2366ccc-fc6c-4b70-8f3f-22d2a868c873 admin admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:36:29.929234 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2366ccc-fc6c-4b70-8f3f-22d2a868c873 admin admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:36:29.929507 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2366ccc-fc6c-4b70-8f3f-22d2a868c873 admin admin] PATH_INFO: `/v3/domains` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:36:29.930239 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2366ccc-fc6c-4b70-8f3f-22d2a868c873 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79744) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 07:36:29.930545 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2366ccc-fc6c-4b70-8f3f-22d2a868c873 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:36:29.932173 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2366ccc-fc6c-4b70-8f3f-22d2a868c873 admin admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:36:29.944358 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 1361/2711] 10.222.0.21 () {58 vars in 1152 bytes} [Wed May 4 07:36:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 07:36:29.948505 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b578b4f6-7760-44cd-b1a7-4c4bef3cb794 None None] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:36:29.958613 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b578b4f6-7760-44cd-b1a7-4c4bef3cb794 None None] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:36:29.963350 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0dcc4b-e0d0-4246-bb85-bce32a1f8356 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:36:29.963989 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0dcc4b-e0d0-4246-bb85-bce32a1f8356 admin admin] REQUEST_METHOD: `POST` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:36:29.964265 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0dcc4b-e0d0-4246-bb85-bce32a1f8356 admin admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:36:29.964533 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0dcc4b-e0d0-4246-bb85-bce32a1f8356 admin admin] PATH_INFO: `/v3/projects` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:36:29.965782 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0dcc4b-e0d0-4246-bb85-bce32a1f8356 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:36:29.967718 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0dcc4b-e0d0-4246-bb85-bce32a1f8356 admin admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:36:29.993848 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 1351/2712] 10.222.0.21 () {60 vars in 1152 bytes} [Wed May 4 07:36:29 2022] POST /identity/v3/projects => generated 375 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 07:36:29.998214 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2366ccc-fc6c-4b70-8f3f-22d2a868c873 admin admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:36:30.008767 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2366ccc-fc6c-4b70-8f3f-22d2a868c873 admin admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:36:30.071237 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f805af-0cf9-4196-8d00-5eabeafeabb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:36:30.071959 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f805af-0cf9-4196-8d00-5eabeafeabb3 admin admin] REQUEST_METHOD: `POST` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:36:30.072242 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f805af-0cf9-4196-8d00-5eabeafeabb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:36:30.072517 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f805af-0cf9-4196-8d00-5eabeafeabb3 admin admin] PATH_INFO: `/v3/users` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:36:30.073222 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f805af-0cf9-4196-8d00-5eabeafeabb3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:36:30.076130 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f805af-0cf9-4196-8d00-5eabeafeabb3 admin admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:36:30.096638 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 1362/2713] 10.222.0.21 () {60 vars in 1143 bytes} [Wed May 4 07:36:29 2022] POST /identity/v3/users => generated 288 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 07:36:30.100639 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0dcc4b-e0d0-4246-bb85-bce32a1f8356 admin admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:36:30.110989 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0dcc4b-e0d0-4246-bb85-bce32a1f8356 admin admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:36:30.115817 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bddd0e22-c615-46d8-9406-a242da309472 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:36:30.116476 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddd0e22-c615-46d8-9406-a242da309472 admin admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:36:30.116751 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddd0e22-c615-46d8-9406-a242da309472 admin admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:36:30.117020 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddd0e22-c615-46d8-9406-a242da309472 admin admin] PATH_INFO: `/v3/roles` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:36:30.117741 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bddd0e22-c615-46d8-9406-a242da309472 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:36:30.119373 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bddd0e22-c615-46d8-9406-a242da309472 admin admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:36:30.130696 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 1352/2714] 10.222.0.21 () {58 vars in 1121 bytes} [Wed May 4 07:36:30 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 04 07:36:30.134707 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f805af-0cf9-4196-8d00-5eabeafeabb3 admin admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:36:30.145888 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f805af-0cf9-4196-8d00-5eabeafeabb3 admin admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:36:30.150887 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1fd6a0-c722-4b48-8000-805fbf0c6d64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:36:30.151588 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1fd6a0-c722-4b48-8000-805fbf0c6d64 admin admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:36:30.151872 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1fd6a0-c722-4b48-8000-805fbf0c6d64 admin admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:36:30.152152 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1fd6a0-c722-4b48-8000-805fbf0c6d64 admin admin] PATH_INFO: `/v3/roles` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:36:30.153503 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1fd6a0-c722-4b48-8000-805fbf0c6d64 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:36:30.155100 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1fd6a0-c722-4b48-8000-805fbf0c6d64 admin admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:36:30.165517 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 1363/2715] 10.222.0.21 () {58 vars in 1121 bytes} [Wed May 4 07:36:30 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 07:36:30.170680 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bddd0e22-c615-46d8-9406-a242da309472 admin admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:36:30.181908 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bddd0e22-c615-46d8-9406-a242da309472 admin admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:36:30.187078 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db4b83c-4ef4-4d6f-9476-ab2a9209108a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:36:30.187983 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db4b83c-4ef4-4d6f-9476-ab2a9209108a admin admin] REQUEST_METHOD: `PUT` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:36:30.188497 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db4b83c-4ef4-4d6f-9476-ab2a9209108a admin admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:36:30.188773 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db4b83c-4ef4-4d6f-9476-ab2a9209108a admin admin] PATH_INFO: `/v3/projects/1428f1f93025456785f224c6d469059c/users/ace20f7627f84806a8b79fe0e13729b7/roles/9f89c07b05a14f18836116af22cba5f6` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:36:30.206003 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db4b83c-4ef4-4d6f-9476-ab2a9209108a admin admin] RBAC: Authorizing `identity:create_grant(project_id=1428f1f93025456785f224c6d469059c, user_id=ace20f7627f84806a8b79fe0e13729b7, role_id=9f89c07b05a14f18836116af22cba5f6)` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:36:30.208660 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db4b83c-4ef4-4d6f-9476-ab2a9209108a admin admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:36:30.226921 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 1353/2716] 10.222.0.21 () {60 vars in 1482 bytes} [Wed May 4 07:36:30 2022] PUT /identity/v3/projects/1428f1f93025456785f224c6d469059c/users/ace20f7627f84806a8b79fe0e13729b7/roles/9f89c07b05a14f18836116af22cba5f6 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 07:36:30.238867 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b0f1a3-5cfe-464c-93f6-5807ba781838 None None] REQUEST_METHOD: `POST` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:36:30.239181 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b0f1a3-5cfe-464c-93f6-5807ba781838 None None] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:36:30.239454 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b0f1a3-5cfe-464c-93f6-5807ba781838 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:36:30.266664 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.auth.core [None req-52b0f1a3-5cfe-464c-93f6-5807ba781838 None None] MFA Rules not processed for user `ace20f7627f84806a8b79fe0e13729b7`. Rule list: `[]` (Enabled: `True`). {{(pid=79744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:36:30.267944 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.fernet_utils [None req-52b0f1a3-5cfe-464c-93f6-5807ba781838 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:36:30.344220 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 1364/2717] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 07:36:30 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 07:36:30.355418 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db4b83c-4ef4-4d6f-9476-ab2a9209108a admin admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:36:30.357120 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.fernet_utils [None req-7db4b83c-4ef4-4d6f-9476-ab2a9209108a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:36:30.413274 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db4b83c-4ef4-4d6f-9476-ab2a9209108a admin admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:36:30.416897 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5607c52-c7dc-4d81-8528-96a9676dc53e service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7538f5cab3364625a3e909f5f117ef2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9f9c44db4984653b8d4b5f6b3b949f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:36:30.417534 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5607c52-c7dc-4d81-8528-96a9676dc53e service glance] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:36:30.417816 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5607c52-c7dc-4d81-8528-96a9676dc53e service glance] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:36:30.418093 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5607c52-c7dc-4d81-8528-96a9676dc53e service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:36:30.426769 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5607c52-c7dc-4d81-8528-96a9676dc53e service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:36:30.428232 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5607c52-c7dc-4d81-8528-96a9676dc53e service glance] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:36:30.437692 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 1354/2718] 10.222.0.21 () {60 vars in 1365 bytes} [Wed May 4 07:36:30 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 07:36:53.227200 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b0f1a3-5cfe-464c-93f6-5807ba781838 None None] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:36:53.288750 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b0f1a3-5cfe-464c-93f6-5807ba781838 None None] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:36:53.293276 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06610043-fba1-4b88-86a8-28023edff6a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:36:53.294136 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06610043-fba1-4b88-86a8-28023edff6a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:36:53.294416 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06610043-fba1-4b88-86a8-28023edff6a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:36:53.294690 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06610043-fba1-4b88-86a8-28023edff6a6 admin admin] PATH_INFO: `/v3/users/ace20f7627f84806a8b79fe0e13729b7` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:36:53.295904 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06610043-fba1-4b88-86a8-28023edff6a6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ace20f7627f84806a8b79fe0e13729b7)` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:36:53.297809 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06610043-fba1-4b88-86a8-28023edff6a6 admin admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:36:53.359678 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-06610043-fba1-4b88-86a8-28023edff6a6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ace20f7627f84806a8b79fe0e13729b7'} {{(pid=79744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:36:53.360331 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-06610043-fba1-4b88-86a8-28023edff6a6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ace20f7627f84806a8b79fe0e13729b7'} {{(pid=79744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:36:53.366879 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-06610043-fba1-4b88-86a8-28023edff6a6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ace20f7627f84806a8b79fe0e13729b7'} {{(pid=79744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:36:53.367521 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-06610043-fba1-4b88-86a8-28023edff6a6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ace20f7627f84806a8b79fe0e13729b7'} {{(pid=79744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:36:53.379398 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-06610043-fba1-4b88-86a8-28023edff6a6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ace20f7627f84806a8b79fe0e13729b7'} {{(pid=79744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:36:53.392701 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 1365/2719] 10.222.0.21 () {58 vars in 1223 bytes} [Wed May 4 07:36:53 2022] DELETE /identity/v3/users/ace20f7627f84806a8b79fe0e13729b7 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 07:36:53.397169 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72bbde7-f6c2-4931-96a2-8a4493cc0186 None None] REQUEST_METHOD: `POST` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:36:53.397721 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72bbde7-f6c2-4931-96a2-8a4493cc0186 None None] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:36:53.397721 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72bbde7-f6c2-4931-96a2-8a4493cc0186 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:36:53.415220 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.auth.core [None req-f72bbde7-f6c2-4931-96a2-8a4493cc0186 None None] MFA Rules not processed for user `83c5e0dcb991496ea6dee38384514508`. Rule list: `[]` (Enabled: `True`). {{(pid=79745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:36:53.416400 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.fernet_utils [None req-f72bbde7-f6c2-4931-96a2-8a4493cc0186 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:36:53.477992 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 1355/2720] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 07:36:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 07:36:53.495956 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06610043-fba1-4b88-86a8-28023edff6a6 admin admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:36:53.498346 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.fernet_utils [None req-06610043-fba1-4b88-86a8-28023edff6a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:36:53.558422 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06610043-fba1-4b88-86a8-28023edff6a6 admin admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:36:53.563077 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365df2a0-6565-4997-8496-0b371d6f4ea7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91cb92d00273402b837cb29b37325101', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9f9c44db4984653b8d4b5f6b3b949f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:36:53.563751 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365df2a0-6565-4997-8496-0b371d6f4ea7 service neutron] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:36:53.564031 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365df2a0-6565-4997-8496-0b371d6f4ea7 service neutron] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:36:53.564307 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365df2a0-6565-4997-8496-0b371d6f4ea7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:36:53.573821 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-365df2a0-6565-4997-8496-0b371d6f4ea7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:36:53.576076 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-365df2a0-6565-4997-8496-0b371d6f4ea7 service neutron] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:36:53.585612 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 1366/2721] 10.222.0.21 () {60 vars in 1365 bytes} [Wed May 4 07:36:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 07:36:53.848939 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72bbde7-f6c2-4931-96a2-8a4493cc0186 None None] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:36:53.850396 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.fernet_utils [None req-f72bbde7-f6c2-4931-96a2-8a4493cc0186 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:36:53.864831 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72bbde7-f6c2-4931-96a2-8a4493cc0186 None None] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:36:53.869773 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6ab9d3-c7f6-4b10-9748-c41e6194093b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:36:53.870662 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6ab9d3-c7f6-4b10-9748-c41e6194093b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:36:53.870936 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6ab9d3-c7f6-4b10-9748-c41e6194093b admin admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:36:53.871970 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6ab9d3-c7f6-4b10-9748-c41e6194093b admin admin] PATH_INFO: `/v3/projects/1428f1f93025456785f224c6d469059c` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:36:53.873229 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6ab9d3-c7f6-4b10-9748-c41e6194093b admin admin] RBAC: Authorizing `identity:delete_project(project_id=1428f1f93025456785f224c6d469059c)` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:36:53.875188 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6ab9d3-c7f6-4b10-9748-c41e6194093b admin admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:36:53.932436 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-cc6ab9d3-c7f6-4b10-9748-c41e6194093b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1428f1f93025456785f224c6d469059c', 'request_id': 'req-cc6ab9d3-c7f6-4b10-9748-c41e6194093b'} {{(pid=79745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:36:53.941956 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-cc6ab9d3-c7f6-4b10-9748-c41e6194093b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1428f1f93025456785f224c6d469059c', 'request_id': 'req-cc6ab9d3-c7f6-4b10-9748-c41e6194093b'} {{(pid=79745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:36:53.949925 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-cc6ab9d3-c7f6-4b10-9748-c41e6194093b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1428f1f93025456785f224c6d469059c', 'request_id': 'req-cc6ab9d3-c7f6-4b10-9748-c41e6194093b'} {{(pid=79745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:36:53.960074 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-cc6ab9d3-c7f6-4b10-9748-c41e6194093b admin admin] The token cache is being invalidate because project 1428f1f93025456785f224c6d469059c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79745) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 07:36:53.960356 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-cc6ab9d3-c7f6-4b10-9748-c41e6194093b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:36:53.961165 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-cc6ab9d3-c7f6-4b10-9748-c41e6194093b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:36:53.962901 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 1356/2722] 10.222.0.21 () {58 vars in 1232 bytes} [Wed May 4 07:36:53 2022] DELETE /identity/v3/projects/1428f1f93025456785f224c6d469059c => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 07:36:53.968700 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9be16ef-6bc9-4a34-9e77-2675d79dbc04 None None] REQUEST_METHOD: `POST` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:36:53.968923 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9be16ef-6bc9-4a34-9e77-2675d79dbc04 None None] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:36:53.969195 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9be16ef-6bc9-4a34-9e77-2675d79dbc04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:36:53.987403 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.auth.core [None req-d9be16ef-6bc9-4a34-9e77-2675d79dbc04 None None] MFA Rules not processed for user `83c5e0dcb991496ea6dee38384514508`. Rule list: `[]` (Enabled: `True`). {{(pid=79744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:36:53.988647 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.fernet_utils [None req-d9be16ef-6bc9-4a34-9e77-2675d79dbc04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:36:54.049153 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 1367/2723] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 07:36:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 07:36:54.056786 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0033ad63-32a8-4999-9006-da2ae6379633 None None] REQUEST_METHOD: `POST` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:36:54.057075 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0033ad63-32a8-4999-9006-da2ae6379633 None None] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:36:54.057356 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0033ad63-32a8-4999-9006-da2ae6379633 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:36:54.084152 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.auth.core [None req-0033ad63-32a8-4999-9006-da2ae6379633 None None] MFA Rules not processed for user `83c5e0dcb991496ea6dee38384514508`. Rule list: `[]` (Enabled: `True`). {{(pid=79745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:36:54.085347 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.fernet_utils [None req-0033ad63-32a8-4999-9006-da2ae6379633 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:36:54.093765 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 1357/2724] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 07:36:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 07:36:54.098159 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9be16ef-6bc9-4a34-9e77-2675d79dbc04 None None] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:36:54.108677 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9be16ef-6bc9-4a34-9e77-2675d79dbc04 None None] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:36:54.113316 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11bc960d-b2ba-41e7-b77b-21d37f30a756 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:36:54.113967 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bc960d-b2ba-41e7-b77b-21d37f30a756 admin admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:36:54.114244 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bc960d-b2ba-41e7-b77b-21d37f30a756 admin admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:36:54.114516 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bc960d-b2ba-41e7-b77b-21d37f30a756 admin admin] PATH_INFO: `/v3/domains` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:36:54.115264 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11bc960d-b2ba-41e7-b77b-21d37f30a756 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79744) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 07:36:54.115569 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11bc960d-b2ba-41e7-b77b-21d37f30a756 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:36:54.117272 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11bc960d-b2ba-41e7-b77b-21d37f30a756 admin admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:36:54.130345 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 1368/2725] 10.222.0.21 () {58 vars in 1152 bytes} [Wed May 4 07:36:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 07:36:54.134637 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0033ad63-32a8-4999-9006-da2ae6379633 None None] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:36:54.144632 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0033ad63-32a8-4999-9006-da2ae6379633 None None] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:36:54.149558 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48043eb1-5500-4963-81f5-9d02585b9de5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:36:54.150217 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48043eb1-5500-4963-81f5-9d02585b9de5 admin admin] REQUEST_METHOD: `POST` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:36:54.150497 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48043eb1-5500-4963-81f5-9d02585b9de5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:36:54.150771 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48043eb1-5500-4963-81f5-9d02585b9de5 admin admin] PATH_INFO: `/v3/projects` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:36:54.151536 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48043eb1-5500-4963-81f5-9d02585b9de5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:36:54.153921 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48043eb1-5500-4963-81f5-9d02585b9de5 admin admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:36:54.180155 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 1358/2726] 10.222.0.21 () {60 vars in 1152 bytes} [Wed May 4 07:36:54 2022] POST /identity/v3/projects => generated 361 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 07:36:54.184602 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11bc960d-b2ba-41e7-b77b-21d37f30a756 admin admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:36:54.194735 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11bc960d-b2ba-41e7-b77b-21d37f30a756 admin admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:36:54.256054 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a23af7-5048-4631-bcf8-b8b65c413d7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:36:54.256779 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a23af7-5048-4631-bcf8-b8b65c413d7f admin admin] REQUEST_METHOD: `POST` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:36:54.256898 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a23af7-5048-4631-bcf8-b8b65c413d7f admin admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:36:54.257169 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a23af7-5048-4631-bcf8-b8b65c413d7f admin admin] PATH_INFO: `/v3/users` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:36:54.257871 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a23af7-5048-4631-bcf8-b8b65c413d7f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:36:54.259955 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a23af7-5048-4631-bcf8-b8b65c413d7f admin admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:36:54.285402 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 1369/2727] 10.222.0.21 () {60 vars in 1143 bytes} [Wed May 4 07:36:54 2022] POST /identity/v3/users => generated 281 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 07:36:54.289627 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48043eb1-5500-4963-81f5-9d02585b9de5 admin admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:36:54.301088 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48043eb1-5500-4963-81f5-9d02585b9de5 admin admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:36:54.305678 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b773ddea-bcc8-4f3c-b152-f7cd9f3a261c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:36:54.306325 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b773ddea-bcc8-4f3c-b152-f7cd9f3a261c admin admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:36:54.306604 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b773ddea-bcc8-4f3c-b152-f7cd9f3a261c admin admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:36:54.306878 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b773ddea-bcc8-4f3c-b152-f7cd9f3a261c admin admin] PATH_INFO: `/v3/roles` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:36:54.307634 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b773ddea-bcc8-4f3c-b152-f7cd9f3a261c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:36:54.309306 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b773ddea-bcc8-4f3c-b152-f7cd9f3a261c admin admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:36:54.320382 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 1359/2728] 10.222.0.21 () {58 vars in 1121 bytes} [Wed May 4 07:36:54 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 04 07:36:54.324827 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a23af7-5048-4631-bcf8-b8b65c413d7f admin admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:36:54.334716 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a23af7-5048-4631-bcf8-b8b65c413d7f admin admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:36:54.340336 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab849f4-8a20-4880-b25c-fa7ed1897012 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:36:54.341532 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab849f4-8a20-4880-b25c-fa7ed1897012 admin admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:36:54.341821 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab849f4-8a20-4880-b25c-fa7ed1897012 admin admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:36:54.342099 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab849f4-8a20-4880-b25c-fa7ed1897012 admin admin] PATH_INFO: `/v3/roles` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:36:54.342861 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab849f4-8a20-4880-b25c-fa7ed1897012 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:36:54.344491 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab849f4-8a20-4880-b25c-fa7ed1897012 admin admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:36:54.357396 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 1370/2729] 10.222.0.21 () {58 vars in 1121 bytes} [Wed May 4 07:36:54 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 07:36:54.361534 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b773ddea-bcc8-4f3c-b152-f7cd9f3a261c admin admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:36:54.371776 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b773ddea-bcc8-4f3c-b152-f7cd9f3a261c admin admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:36:54.376361 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b69310-4fd6-4add-a321-c1dd5ebc96ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:36:54.377483 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b69310-4fd6-4add-a321-c1dd5ebc96ba admin admin] REQUEST_METHOD: `PUT` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:36:54.377755 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b69310-4fd6-4add-a321-c1dd5ebc96ba admin admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:36:54.378020 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b69310-4fd6-4add-a321-c1dd5ebc96ba admin admin] PATH_INFO: `/v3/projects/98c3e9aaff734246a1df1b6aac676f31/users/bb735d98b0af426283ff1ff7037a40e7/roles/9f89c07b05a14f18836116af22cba5f6` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:36:54.392109 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b69310-4fd6-4add-a321-c1dd5ebc96ba admin admin] RBAC: Authorizing `identity:create_grant(project_id=98c3e9aaff734246a1df1b6aac676f31, user_id=bb735d98b0af426283ff1ff7037a40e7, role_id=9f89c07b05a14f18836116af22cba5f6)` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:36:54.394664 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b69310-4fd6-4add-a321-c1dd5ebc96ba admin admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:36:54.408700 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 1360/2730] 10.222.0.21 () {60 vars in 1482 bytes} [Wed May 4 07:36:54 2022] PUT /identity/v3/projects/98c3e9aaff734246a1df1b6aac676f31/users/bb735d98b0af426283ff1ff7037a40e7/roles/9f89c07b05a14f18836116af22cba5f6 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 07:36:54.420377 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152be558-873f-4f59-91f1-56bef131a26f None None] REQUEST_METHOD: `POST` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:36:54.420689 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152be558-873f-4f59-91f1-56bef131a26f None None] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:36:54.420964 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152be558-873f-4f59-91f1-56bef131a26f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:36:54.447658 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.auth.core [None req-152be558-873f-4f59-91f1-56bef131a26f None None] MFA Rules not processed for user `bb735d98b0af426283ff1ff7037a40e7`. Rule list: `[]` (Enabled: `True`). {{(pid=79744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:36:54.448875 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.fernet_utils [None req-152be558-873f-4f59-91f1-56bef131a26f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:36:54.517578 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 1371/2731] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 07:36:54 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 07:36:54.549615 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b69310-4fd6-4add-a321-c1dd5ebc96ba admin admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:36:54.551627 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.fernet_utils [None req-f5b69310-4fd6-4add-a321-c1dd5ebc96ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:36:54.630086 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b69310-4fd6-4add-a321-c1dd5ebc96ba admin admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:36:54.633798 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7855a4-cf49-470f-b080-1e09771c7984 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb341257aa8246b6847561e2fe1fa385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9f9c44db4984653b8d4b5f6b3b949f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:36:54.634432 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7855a4-cf49-470f-b080-1e09771c7984 service cinder] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:36:54.634714 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7855a4-cf49-470f-b080-1e09771c7984 service cinder] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:36:54.634989 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7855a4-cf49-470f-b080-1e09771c7984 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:36:54.643786 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7855a4-cf49-470f-b080-1e09771c7984 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:36:54.645208 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7855a4-cf49-470f-b080-1e09771c7984 service cinder] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:36:54.654661 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 1361/2732] 10.222.0.21 () {60 vars in 1365 bytes} [Wed May 4 07:36:54 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 07:36:54.669741 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152be558-873f-4f59-91f1-56bef131a26f None None] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:36:54.730131 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152be558-873f-4f59-91f1-56bef131a26f None None] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:36:54.735072 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fccb658c-2266-406a-bda9-5a720c0b318e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:36:54.735965 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccb658c-2266-406a-bda9-5a720c0b318e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:36:54.736253 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccb658c-2266-406a-bda9-5a720c0b318e admin admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:36:54.736526 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccb658c-2266-406a-bda9-5a720c0b318e admin admin] PATH_INFO: `/v3/users/bb735d98b0af426283ff1ff7037a40e7` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:36:54.737731 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fccb658c-2266-406a-bda9-5a720c0b318e admin admin] RBAC: Authorizing `identity:delete_user(user_id=bb735d98b0af426283ff1ff7037a40e7)` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:36:54.739672 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fccb658c-2266-406a-bda9-5a720c0b318e admin admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:36:54.785038 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-fccb658c-2266-406a-bda9-5a720c0b318e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bb735d98b0af426283ff1ff7037a40e7'} {{(pid=79744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:36:54.785689 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-fccb658c-2266-406a-bda9-5a720c0b318e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bb735d98b0af426283ff1ff7037a40e7'} {{(pid=79744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:36:54.792397 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-fccb658c-2266-406a-bda9-5a720c0b318e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bb735d98b0af426283ff1ff7037a40e7'} {{(pid=79744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:36:54.793073 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-fccb658c-2266-406a-bda9-5a720c0b318e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bb735d98b0af426283ff1ff7037a40e7'} {{(pid=79744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:36:54.804487 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-fccb658c-2266-406a-bda9-5a720c0b318e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bb735d98b0af426283ff1ff7037a40e7'} {{(pid=79744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:36:54.817674 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 1372/2733] 10.222.0.21 () {58 vars in 1223 bytes} [Wed May 4 07:36:54 2022] DELETE /identity/v3/users/bb735d98b0af426283ff1ff7037a40e7 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 07:36:54.822257 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf48ac4-b74e-4b46-961a-4154f677478e None None] REQUEST_METHOD: `POST` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:36:54.822540 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf48ac4-b74e-4b46-961a-4154f677478e None None] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:36:54.822811 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf48ac4-b74e-4b46-961a-4154f677478e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:36:54.841559 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.auth.core [None req-ebf48ac4-b74e-4b46-961a-4154f677478e None None] MFA Rules not processed for user `83c5e0dcb991496ea6dee38384514508`. Rule list: `[]` (Enabled: `True`). {{(pid=79745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:36:54.842738 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.fernet_utils [None req-ebf48ac4-b74e-4b46-961a-4154f677478e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:36:54.910188 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 1362/2734] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 07:36:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 07:36:54.919928 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fccb658c-2266-406a-bda9-5a720c0b318e admin admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:36:54.921325 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.fernet_utils [None req-fccb658c-2266-406a-bda9-5a720c0b318e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:36:54.976031 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fccb658c-2266-406a-bda9-5a720c0b318e admin admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:36:54.979631 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d331e66-9cc4-438c-a14d-a9f4bf6c6bd4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91cb92d00273402b837cb29b37325101', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9f9c44db4984653b8d4b5f6b3b949f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:36:54.980263 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d331e66-9cc4-438c-a14d-a9f4bf6c6bd4 service neutron] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:36:54.980573 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d331e66-9cc4-438c-a14d-a9f4bf6c6bd4 service neutron] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:36:54.980848 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d331e66-9cc4-438c-a14d-a9f4bf6c6bd4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:36:54.990206 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d331e66-9cc4-438c-a14d-a9f4bf6c6bd4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:36:54.991705 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d331e66-9cc4-438c-a14d-a9f4bf6c6bd4 service neutron] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:36:55.001676 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 1373/2735] 10.222.0.21 () {60 vars in 1365 bytes} [Wed May 4 07:36:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 07:36:55.266650 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf48ac4-b74e-4b46-961a-4154f677478e None None] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:36:55.268308 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.fernet_utils [None req-ebf48ac4-b74e-4b46-961a-4154f677478e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:36:55.285761 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf48ac4-b74e-4b46-961a-4154f677478e None None] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:36:55.290582 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fa0197-cc2b-48ff-9ecc-20a127f8ea8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:36:55.291477 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fa0197-cc2b-48ff-9ecc-20a127f8ea8e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:36:55.291741 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fa0197-cc2b-48ff-9ecc-20a127f8ea8e admin admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:36:55.292117 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fa0197-cc2b-48ff-9ecc-20a127f8ea8e admin admin] PATH_INFO: `/v3/projects/98c3e9aaff734246a1df1b6aac676f31` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:36:55.293443 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60fa0197-cc2b-48ff-9ecc-20a127f8ea8e admin admin] RBAC: Authorizing `identity:delete_project(project_id=98c3e9aaff734246a1df1b6aac676f31)` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:36:55.295476 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60fa0197-cc2b-48ff-9ecc-20a127f8ea8e admin admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:36:55.340836 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-60fa0197-cc2b-48ff-9ecc-20a127f8ea8e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '98c3e9aaff734246a1df1b6aac676f31', 'request_id': 'req-60fa0197-cc2b-48ff-9ecc-20a127f8ea8e'} {{(pid=79745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:36:55.346890 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-60fa0197-cc2b-48ff-9ecc-20a127f8ea8e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '98c3e9aaff734246a1df1b6aac676f31', 'request_id': 'req-60fa0197-cc2b-48ff-9ecc-20a127f8ea8e'} {{(pid=79745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:36:55.353850 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-60fa0197-cc2b-48ff-9ecc-20a127f8ea8e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '98c3e9aaff734246a1df1b6aac676f31', 'request_id': 'req-60fa0197-cc2b-48ff-9ecc-20a127f8ea8e'} {{(pid=79745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:36:55.363923 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-60fa0197-cc2b-48ff-9ecc-20a127f8ea8e admin admin] The token cache is being invalidate because project 98c3e9aaff734246a1df1b6aac676f31 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79745) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 07:36:55.364203 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-60fa0197-cc2b-48ff-9ecc-20a127f8ea8e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:36:55.364814 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-60fa0197-cc2b-48ff-9ecc-20a127f8ea8e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:36:55.366331 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 1363/2736] 10.222.0.21 () {58 vars in 1232 bytes} [Wed May 4 07:36:55 2022] DELETE /identity/v3/projects/98c3e9aaff734246a1df1b6aac676f31 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 07:36:55.371260 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd77958-cd06-4f71-aa88-6d2c797e3821 None None] REQUEST_METHOD: `POST` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:36:55.371762 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd77958-cd06-4f71-aa88-6d2c797e3821 None None] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:36:55.371896 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd77958-cd06-4f71-aa88-6d2c797e3821 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:36:55.389677 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.auth.core [None req-1bd77958-cd06-4f71-aa88-6d2c797e3821 None None] MFA Rules not processed for user `83c5e0dcb991496ea6dee38384514508`. Rule list: `[]` (Enabled: `True`). {{(pid=79744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:36:55.390843 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.fernet_utils [None req-1bd77958-cd06-4f71-aa88-6d2c797e3821 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:36:55.446636 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 1374/2737] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 07:36:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 07:36:55.455887 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33ccb94-6454-40c8-9879-e5f75eb05638 None None] REQUEST_METHOD: `POST` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:36:55.456308 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33ccb94-6454-40c8-9879-e5f75eb05638 None None] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:36:55.456409 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33ccb94-6454-40c8-9879-e5f75eb05638 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:36:55.475511 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.auth.core [None req-e33ccb94-6454-40c8-9879-e5f75eb05638 None None] MFA Rules not processed for user `83c5e0dcb991496ea6dee38384514508`. Rule list: `[]` (Enabled: `True`). {{(pid=79745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:36:55.476688 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.fernet_utils [None req-e33ccb94-6454-40c8-9879-e5f75eb05638 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:36:55.484983 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 1364/2738] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 07:36:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 07:36:55.489283 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd77958-cd06-4f71-aa88-6d2c797e3821 None None] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:36:55.499580 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd77958-cd06-4f71-aa88-6d2c797e3821 None None] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:36:55.504494 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c602e1c5-51ee-45e9-99bb-6d763372de31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:36:55.505170 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c602e1c5-51ee-45e9-99bb-6d763372de31 admin admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:36:55.505474 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c602e1c5-51ee-45e9-99bb-6d763372de31 admin admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:36:55.505738 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c602e1c5-51ee-45e9-99bb-6d763372de31 admin admin] PATH_INFO: `/v3/domains` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:36:55.506484 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c602e1c5-51ee-45e9-99bb-6d763372de31 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79744) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 07:36:55.506782 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c602e1c5-51ee-45e9-99bb-6d763372de31 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:36:55.508378 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c602e1c5-51ee-45e9-99bb-6d763372de31 admin admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:36:55.521257 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 1375/2739] 10.222.0.21 () {58 vars in 1152 bytes} [Wed May 4 07:36:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 07:36:55.525597 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33ccb94-6454-40c8-9879-e5f75eb05638 None None] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:36:55.535371 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33ccb94-6454-40c8-9879-e5f75eb05638 None None] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:36:55.540057 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c79e5e8-46a6-4f82-ba8b-e31dd595f84e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:36:55.540693 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c79e5e8-46a6-4f82-ba8b-e31dd595f84e admin admin] REQUEST_METHOD: `POST` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:36:55.540970 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c79e5e8-46a6-4f82-ba8b-e31dd595f84e admin admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:36:55.541243 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c79e5e8-46a6-4f82-ba8b-e31dd595f84e admin admin] PATH_INFO: `/v3/projects` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:36:55.541982 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c79e5e8-46a6-4f82-ba8b-e31dd595f84e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:36:55.543922 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c79e5e8-46a6-4f82-ba8b-e31dd595f84e admin admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:36:55.569492 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 1365/2740] 10.222.0.21 () {60 vars in 1152 bytes} [Wed May 4 07:36:55 2022] POST /identity/v3/projects => generated 391 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 07:36:55.573047 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c602e1c5-51ee-45e9-99bb-6d763372de31 admin admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:36:55.583507 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c602e1c5-51ee-45e9-99bb-6d763372de31 admin admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:36:55.639663 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68034b7-dedb-4759-bc6a-316816d599e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:36:55.640286 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68034b7-dedb-4759-bc6a-316816d599e2 admin admin] REQUEST_METHOD: `POST` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:36:55.640567 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68034b7-dedb-4759-bc6a-316816d599e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:36:55.640842 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68034b7-dedb-4759-bc6a-316816d599e2 admin admin] PATH_INFO: `/v3/users` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:36:55.641550 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68034b7-dedb-4759-bc6a-316816d599e2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:36:55.643543 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68034b7-dedb-4759-bc6a-316816d599e2 admin admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:36:55.664692 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 1376/2741] 10.222.0.21 () {60 vars in 1143 bytes} [Wed May 4 07:36:55 2022] POST /identity/v3/users => generated 296 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 07:36:55.669170 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c79e5e8-46a6-4f82-ba8b-e31dd595f84e admin admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:36:55.679398 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c79e5e8-46a6-4f82-ba8b-e31dd595f84e admin admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:36:55.684630 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a027fc8-d7c1-4847-92b0-5013f57d7dba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:36:55.685282 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a027fc8-d7c1-4847-92b0-5013f57d7dba admin admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:36:55.685567 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a027fc8-d7c1-4847-92b0-5013f57d7dba admin admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:36:55.685836 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a027fc8-d7c1-4847-92b0-5013f57d7dba admin admin] PATH_INFO: `/v3/roles` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:36:55.686556 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a027fc8-d7c1-4847-92b0-5013f57d7dba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:36:55.688227 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a027fc8-d7c1-4847-92b0-5013f57d7dba admin admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:36:55.699840 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 1366/2742] 10.222.0.21 () {58 vars in 1121 bytes} [Wed May 4 07:36:55 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 07:36:55.703660 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68034b7-dedb-4759-bc6a-316816d599e2 admin admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:36:55.713566 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68034b7-dedb-4759-bc6a-316816d599e2 admin admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:36:55.718410 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256c56be-8114-42f5-9a94-3e00afdb058a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:36:55.718892 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256c56be-8114-42f5-9a94-3e00afdb058a admin admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:36:55.719199 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256c56be-8114-42f5-9a94-3e00afdb058a admin admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:36:55.719478 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256c56be-8114-42f5-9a94-3e00afdb058a admin admin] PATH_INFO: `/v3/roles` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:36:55.720201 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256c56be-8114-42f5-9a94-3e00afdb058a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:36:55.721780 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256c56be-8114-42f5-9a94-3e00afdb058a admin admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:36:55.736527 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 1377/2743] 10.222.0.21 () {58 vars in 1121 bytes} [Wed May 4 07:36:55 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 07:36:55.740846 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a027fc8-d7c1-4847-92b0-5013f57d7dba admin admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:36:55.752304 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a027fc8-d7c1-4847-92b0-5013f57d7dba admin admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:36:55.759884 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb1b9e7-70cb-4f4b-abf0-07176380fcbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:36:55.760764 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb1b9e7-70cb-4f4b-abf0-07176380fcbc admin admin] REQUEST_METHOD: `PUT` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:36:55.761043 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb1b9e7-70cb-4f4b-abf0-07176380fcbc admin admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:36:55.761318 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb1b9e7-70cb-4f4b-abf0-07176380fcbc admin admin] PATH_INFO: `/v3/projects/e7c8dd48689a4c2da9e8fd4d2071c6f7/users/d870920a401640238c78e7a728e0eb48/roles/9f89c07b05a14f18836116af22cba5f6` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:36:55.777030 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb1b9e7-70cb-4f4b-abf0-07176380fcbc admin admin] RBAC: Authorizing `identity:create_grant(project_id=e7c8dd48689a4c2da9e8fd4d2071c6f7, user_id=d870920a401640238c78e7a728e0eb48, role_id=9f89c07b05a14f18836116af22cba5f6)` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:36:55.779841 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb1b9e7-70cb-4f4b-abf0-07176380fcbc admin admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:36:55.794722 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 1367/2744] 10.222.0.21 () {60 vars in 1482 bytes} [Wed May 4 07:36:55 2022] PUT /identity/v3/projects/e7c8dd48689a4c2da9e8fd4d2071c6f7/users/d870920a401640238c78e7a728e0eb48/roles/9f89c07b05a14f18836116af22cba5f6 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 07:36:55.805044 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6076dc-928e-4d7f-9cff-dd8ad6367643 None None] REQUEST_METHOD: `POST` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:36:55.805333 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6076dc-928e-4d7f-9cff-dd8ad6367643 None None] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:36:55.805612 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6076dc-928e-4d7f-9cff-dd8ad6367643 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:36:55.834221 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.auth.core [None req-0e6076dc-928e-4d7f-9cff-dd8ad6367643 None None] MFA Rules not processed for user `d870920a401640238c78e7a728e0eb48`. Rule list: `[]` (Enabled: `True`). {{(pid=79744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:36:55.835458 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.fernet_utils [None req-0e6076dc-928e-4d7f-9cff-dd8ad6367643 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:36:55.905498 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 1378/2745] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 07:36:55 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 07:36:55.916241 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb1b9e7-70cb-4f4b-abf0-07176380fcbc admin admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:36:55.918001 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.fernet_utils [None req-edb1b9e7-70cb-4f4b-abf0-07176380fcbc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:36:55.975694 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb1b9e7-70cb-4f4b-abf0-07176380fcbc admin admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:36:55.979380 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271a64d7-031a-4fd3-b188-a1e41431141e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb341257aa8246b6847561e2fe1fa385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9f9c44db4984653b8d4b5f6b3b949f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:36:55.980019 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271a64d7-031a-4fd3-b188-a1e41431141e service cinder] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:36:55.980334 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271a64d7-031a-4fd3-b188-a1e41431141e service cinder] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:36:55.980605 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271a64d7-031a-4fd3-b188-a1e41431141e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:36:55.989582 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271a64d7-031a-4fd3-b188-a1e41431141e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:36:55.991012 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271a64d7-031a-4fd3-b188-a1e41431141e service cinder] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:36:56.000975 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 1368/2746] 10.222.0.21 () {60 vars in 1365 bytes} [Wed May 4 07:36:55 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 07:37:17.647336 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6076dc-928e-4d7f-9cff-dd8ad6367643 None None] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:37:17.708100 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6076dc-928e-4d7f-9cff-dd8ad6367643 None None] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:37:17.712490 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af8946d-6bbe-49c7-9a5e-34352f0519cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:37:17.713350 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af8946d-6bbe-49c7-9a5e-34352f0519cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:37:17.713628 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af8946d-6bbe-49c7-9a5e-34352f0519cc admin admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:37:17.713899 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af8946d-6bbe-49c7-9a5e-34352f0519cc admin admin] PATH_INFO: `/v3/users/d870920a401640238c78e7a728e0eb48` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:37:17.715121 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af8946d-6bbe-49c7-9a5e-34352f0519cc admin admin] RBAC: Authorizing `identity:delete_user(user_id=d870920a401640238c78e7a728e0eb48)` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:37:17.717067 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af8946d-6bbe-49c7-9a5e-34352f0519cc admin admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:37:17.761029 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-8af8946d-6bbe-49c7-9a5e-34352f0519cc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd870920a401640238c78e7a728e0eb48'} {{(pid=79744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:37:17.761798 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-8af8946d-6bbe-49c7-9a5e-34352f0519cc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd870920a401640238c78e7a728e0eb48'} {{(pid=79744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:37:17.769132 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-8af8946d-6bbe-49c7-9a5e-34352f0519cc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd870920a401640238c78e7a728e0eb48'} {{(pid=79744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:37:17.769804 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-8af8946d-6bbe-49c7-9a5e-34352f0519cc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd870920a401640238c78e7a728e0eb48'} {{(pid=79744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:37:17.780919 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-8af8946d-6bbe-49c7-9a5e-34352f0519cc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd870920a401640238c78e7a728e0eb48'} {{(pid=79744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:37:17.793858 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 1379/2747] 10.222.0.21 () {58 vars in 1223 bytes} [Wed May 4 07:37:17 2022] DELETE /identity/v3/users/d870920a401640238c78e7a728e0eb48 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 07:37:17.798447 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ecda31-d8fc-4f9f-92be-80d5d9647fa6 None None] REQUEST_METHOD: `POST` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:37:17.798945 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ecda31-d8fc-4f9f-92be-80d5d9647fa6 None None] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:37:17.799056 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ecda31-d8fc-4f9f-92be-80d5d9647fa6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:37:17.817203 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.auth.core [None req-53ecda31-d8fc-4f9f-92be-80d5d9647fa6 None None] MFA Rules not processed for user `83c5e0dcb991496ea6dee38384514508`. Rule list: `[]` (Enabled: `True`). {{(pid=79745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:37:17.818391 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.fernet_utils [None req-53ecda31-d8fc-4f9f-92be-80d5d9647fa6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:37:17.876174 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 1369/2748] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 07:37:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 07:37:17.886524 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af8946d-6bbe-49c7-9a5e-34352f0519cc admin admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:37:17.887728 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.fernet_utils [None req-8af8946d-6bbe-49c7-9a5e-34352f0519cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:37:17.944181 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af8946d-6bbe-49c7-9a5e-34352f0519cc admin admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:37:17.947794 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ae62ed-92b4-458c-a72a-a0f60082c096 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91cb92d00273402b837cb29b37325101', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9f9c44db4984653b8d4b5f6b3b949f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:37:17.948532 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ae62ed-92b4-458c-a72a-a0f60082c096 service neutron] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:37:17.948813 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ae62ed-92b4-458c-a72a-a0f60082c096 service neutron] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:37:17.949079 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ae62ed-92b4-458c-a72a-a0f60082c096 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:37:17.957958 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ae62ed-92b4-458c-a72a-a0f60082c096 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:37:17.959468 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ae62ed-92b4-458c-a72a-a0f60082c096 service neutron] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:37:17.968845 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 1380/2749] 10.222.0.21 () {60 vars in 1365 bytes} [Wed May 4 07:37:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 07:37:18.236774 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ecda31-d8fc-4f9f-92be-80d5d9647fa6 None None] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:37:18.238272 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.fernet_utils [None req-53ecda31-d8fc-4f9f-92be-80d5d9647fa6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:37:18.250525 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ecda31-d8fc-4f9f-92be-80d5d9647fa6 None None] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:37:18.255472 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f38854-1767-40a1-99ea-43d7a8b5ec52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:37:18.256329 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f38854-1767-40a1-99ea-43d7a8b5ec52 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:37:18.256606 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f38854-1767-40a1-99ea-43d7a8b5ec52 admin admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:37:18.256878 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f38854-1767-40a1-99ea-43d7a8b5ec52 admin admin] PATH_INFO: `/v3/projects/e7c8dd48689a4c2da9e8fd4d2071c6f7` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:37:18.258068 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f38854-1767-40a1-99ea-43d7a8b5ec52 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e7c8dd48689a4c2da9e8fd4d2071c6f7)` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:37:18.260020 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f38854-1767-40a1-99ea-43d7a8b5ec52 admin admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:37:18.307623 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-19f38854-1767-40a1-99ea-43d7a8b5ec52 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e7c8dd48689a4c2da9e8fd4d2071c6f7', 'request_id': 'req-19f38854-1767-40a1-99ea-43d7a8b5ec52'} {{(pid=79745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:37:18.313887 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-19f38854-1767-40a1-99ea-43d7a8b5ec52 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e7c8dd48689a4c2da9e8fd4d2071c6f7', 'request_id': 'req-19f38854-1767-40a1-99ea-43d7a8b5ec52'} {{(pid=79745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:37:18.321403 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-19f38854-1767-40a1-99ea-43d7a8b5ec52 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e7c8dd48689a4c2da9e8fd4d2071c6f7', 'request_id': 'req-19f38854-1767-40a1-99ea-43d7a8b5ec52'} {{(pid=79745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:37:18.331364 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-19f38854-1767-40a1-99ea-43d7a8b5ec52 admin admin] The token cache is being invalidate because project e7c8dd48689a4c2da9e8fd4d2071c6f7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79745) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 07:37:18.331646 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-19f38854-1767-40a1-99ea-43d7a8b5ec52 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:37:18.332267 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-19f38854-1767-40a1-99ea-43d7a8b5ec52 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:37:18.334064 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 1370/2750] 10.222.0.21 () {58 vars in 1232 bytes} [Wed May 4 07:37:18 2022] DELETE /identity/v3/projects/e7c8dd48689a4c2da9e8fd4d2071c6f7 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 07:37:27.421991 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ae62ed-92b4-458c-a72a-a0f60082c096 service neutron] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:37:27.423447 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.fernet_utils [None req-28ae62ed-92b4-458c-a72a-a0f60082c096 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:37:27.481697 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ae62ed-92b4-458c-a72a-a0f60082c096 service neutron] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:37:27.530809 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17ea56c-dcf8-4a5d-877b-65691c141fbb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb341257aa8246b6847561e2fe1fa385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9f9c44db4984653b8d4b5f6b3b949f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:37:27.531487 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17ea56c-dcf8-4a5d-877b-65691c141fbb service cinder] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:37:27.531768 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17ea56c-dcf8-4a5d-877b-65691c141fbb service cinder] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:37:27.532045 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17ea56c-dcf8-4a5d-877b-65691c141fbb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:37:27.533838 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.fernet_utils [None req-a17ea56c-dcf8-4a5d-877b-65691c141fbb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:37:27.593090 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17ea56c-dcf8-4a5d-877b-65691c141fbb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:37:27.594526 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17ea56c-dcf8-4a5d-877b-65691c141fbb service cinder] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:37:27.603670 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 1381/2751] 10.222.0.21 () {60 vars in 1365 bytes} [Wed May 4 07:37:27 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 07:37:35.871905 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407b5c6a-940b-42f0-b001-686da9921655 None None] REQUEST_METHOD: `POST` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:37:35.872428 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407b5c6a-940b-42f0-b001-686da9921655 None None] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:37:35.872428 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407b5c6a-940b-42f0-b001-686da9921655 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:37:35.890894 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.auth.core [None req-407b5c6a-940b-42f0-b001-686da9921655 None None] MFA Rules not processed for user `9623c2fad43a4f49aeeb824a1b7fbc6e`. Rule list: `[]` (Enabled: `True`). {{(pid=79745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:37:35.892133 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.fernet_utils [None req-407b5c6a-940b-42f0-b001-686da9921655 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:37:35.899191 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 1371/2752] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 07:37:35 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 07:37:36.212421 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17ea56c-dcf8-4a5d-877b-65691c141fbb service cinder] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:37:36.214444 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.fernet_utils [None req-a17ea56c-dcf8-4a5d-877b-65691c141fbb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:37:36.269553 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17ea56c-dcf8-4a5d-877b-65691c141fbb service cinder] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:37:36.275351 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d4b884-a154-4563-8390-0544e6d252c9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91cb92d00273402b837cb29b37325101', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9f9c44db4984653b8d4b5f6b3b949f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:37:36.275351 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d4b884-a154-4563-8390-0544e6d252c9 service neutron] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:37:36.275351 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d4b884-a154-4563-8390-0544e6d252c9 service neutron] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:37:36.275351 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d4b884-a154-4563-8390-0544e6d252c9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:37:36.278452 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.fernet_utils [None req-c7d4b884-a154-4563-8390-0544e6d252c9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:37:36.291095 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d4b884-a154-4563-8390-0544e6d252c9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:37:36.292741 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d4b884-a154-4563-8390-0544e6d252c9 service neutron] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:37:36.302287 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 1382/2753] 10.222.0.21 () {60 vars in 1365 bytes} [Wed May 4 07:37:36 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 07:37:46.076374 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407b5c6a-940b-42f0-b001-686da9921655 None None] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:37:46.077833 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.fernet_utils [None req-407b5c6a-940b-42f0-b001-686da9921655 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:37:46.178792 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407b5c6a-940b-42f0-b001-686da9921655 None None] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:37:46.185261 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113ec47f-488d-4a96-ad47-7b36bfccc2d2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1077289fedae43b6be47be7f716d573a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9f9c44db4984653b8d4b5f6b3b949f5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:37:46.185919 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113ec47f-488d-4a96-ad47-7b36bfccc2d2 service nova] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:37:46.186258 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113ec47f-488d-4a96-ad47-7b36bfccc2d2 service nova] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:37:46.186531 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113ec47f-488d-4a96-ad47-7b36bfccc2d2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:37:46.188403 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.fernet_utils [None req-113ec47f-488d-4a96-ad47-7b36bfccc2d2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:37:46.202299 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113ec47f-488d-4a96-ad47-7b36bfccc2d2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:37:46.204208 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113ec47f-488d-4a96-ad47-7b36bfccc2d2 service nova] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:37:46.216659 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 1372/2754] 10.222.0.21 () {60 vars in 1365 bytes} [Wed May 4 07:37:46 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 07:37:47.648609 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6e36b3-aef3-43de-8e4f-35423e3a7aa6 None None] REQUEST_METHOD: `POST` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:37:47.649123 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6e36b3-aef3-43de-8e4f-35423e3a7aa6 None None] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:37:47.649236 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6e36b3-aef3-43de-8e4f-35423e3a7aa6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:37:47.669312 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.auth.core [None req-bd6e36b3-aef3-43de-8e4f-35423e3a7aa6 None None] MFA Rules not processed for user `098825a2c57749299ee5b9e083dab0d2`. Rule list: `[]` (Enabled: `True`). {{(pid=79744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:37:47.670497 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.fernet_utils [None req-bd6e36b3-aef3-43de-8e4f-35423e3a7aa6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:37:47.725805 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 1383/2755] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 07:37:47 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 07:38:21.958814 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113ec47f-488d-4a96-ad47-7b36bfccc2d2 service nova] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:38:21.960258 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.fernet_utils [None req-113ec47f-488d-4a96-ad47-7b36bfccc2d2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:38:22.047994 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113ec47f-488d-4a96-ad47-7b36bfccc2d2 service nova] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:38:22.053389 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdef24cf-bace-44a3-b145-9b2c64eac996 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef28e980e8664d3eba4304e4589ea2df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9f9c44db4984653b8d4b5f6b3b949f5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:38:22.054013 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdef24cf-bace-44a3-b145-9b2c64eac996 service placement] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:38:22.054288 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdef24cf-bace-44a3-b145-9b2c64eac996 service placement] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:38:22.054557 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdef24cf-bace-44a3-b145-9b2c64eac996 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:38:22.056319 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.fernet_utils [None req-bdef24cf-bace-44a3-b145-9b2c64eac996 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:38:22.067938 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdef24cf-bace-44a3-b145-9b2c64eac996 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:38:22.069502 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdef24cf-bace-44a3-b145-9b2c64eac996 service placement] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:38:22.079170 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 1373/2756] 10.222.0.21 () {60 vars in 1365 bytes} [Wed May 4 07:38:21 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 07:39:21.558358 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6e36b3-aef3-43de-8e4f-35423e3a7aa6 None None] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:39:21.560163 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.fernet_utils [None req-bd6e36b3-aef3-43de-8e4f-35423e3a7aa6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:39:21.572265 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6e36b3-aef3-43de-8e4f-35423e3a7aa6 None None] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:39:21.576069 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7aac7d8-9082-4027-9742-c185d60e45fb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb341257aa8246b6847561e2fe1fa385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9f9c44db4984653b8d4b5f6b3b949f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:39:21.576711 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7aac7d8-9082-4027-9742-c185d60e45fb service cinder] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:39:21.576984 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7aac7d8-9082-4027-9742-c185d60e45fb service cinder] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:39:21.577252 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7aac7d8-9082-4027-9742-c185d60e45fb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:39:21.581635 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.fernet_utils [None req-c7aac7d8-9082-4027-9742-c185d60e45fb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:39:21.617031 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7aac7d8-9082-4027-9742-c185d60e45fb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:39:21.618468 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7aac7d8-9082-4027-9742-c185d60e45fb service cinder] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:39:21.641154 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 1384/2757] 10.222.0.21 () {60 vars in 1365 bytes} [Wed May 4 07:39:21 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 07:39:26.929376 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdef24cf-bace-44a3-b145-9b2c64eac996 service placement] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:39:26.930878 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.fernet_utils [None req-bdef24cf-bace-44a3-b145-9b2c64eac996 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:39:26.942898 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdef24cf-bace-44a3-b145-9b2c64eac996 service placement] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:39:26.946544 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7462a46f-a0f7-41bd-99ad-549b4793a689 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91cb92d00273402b837cb29b37325101', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9f9c44db4984653b8d4b5f6b3b949f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:39:26.947852 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7462a46f-a0f7-41bd-99ad-549b4793a689 service neutron] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:39:26.948755 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7462a46f-a0f7-41bd-99ad-549b4793a689 service neutron] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:39:26.949036 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7462a46f-a0f7-41bd-99ad-549b4793a689 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:39:26.950851 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.fernet_utils [None req-7462a46f-a0f7-41bd-99ad-549b4793a689 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:39:26.966289 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7462a46f-a0f7-41bd-99ad-549b4793a689 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:39:26.967791 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7462a46f-a0f7-41bd-99ad-549b4793a689 service neutron] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:39:26.980252 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 1374/2758] 10.222.0.21 () {60 vars in 1365 bytes} [Wed May 4 07:39:26 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 04 07:39:34.050020 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7aac7d8-9082-4027-9742-c185d60e45fb service cinder] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:39:34.060035 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7aac7d8-9082-4027-9742-c185d60e45fb service cinder] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:39:34.063781 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9794499c-b957-48a9-9db0-6f1699b8a503 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91cb92d00273402b837cb29b37325101', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9f9c44db4984653b8d4b5f6b3b949f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:39:34.064440 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9794499c-b957-48a9-9db0-6f1699b8a503 service neutron] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:39:34.064715 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9794499c-b957-48a9-9db0-6f1699b8a503 service neutron] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:39:34.064985 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9794499c-b957-48a9-9db0-6f1699b8a503 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:39:34.066809 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.fernet_utils [None req-9794499c-b957-48a9-9db0-6f1699b8a503 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:39:34.131427 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9794499c-b957-48a9-9db0-6f1699b8a503 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:39:34.133139 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9794499c-b957-48a9-9db0-6f1699b8a503 service neutron] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:39:34.143526 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 1385/2759] 10.222.0.21 () {60 vars in 1365 bytes} [Wed May 4 07:39:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 07:39:37.326820 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7462a46f-a0f7-41bd-99ad-549b4793a689 service neutron] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:39:37.328503 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.fernet_utils [None req-7462a46f-a0f7-41bd-99ad-549b4793a689 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:39:37.343176 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7462a46f-a0f7-41bd-99ad-549b4793a689 service neutron] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:39:37.347653 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d427c01e-2ce1-4f58-9af5-712818f6b9a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:39:37.348532 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d427c01e-2ce1-4f58-9af5-712818f6b9a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:39:37.348786 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d427c01e-2ce1-4f58-9af5-712818f6b9a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:39:37.349051 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d427c01e-2ce1-4f58-9af5-712818f6b9a9 admin admin] PATH_INFO: `/v3/users/9623c2fad43a4f49aeeb824a1b7fbc6e` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:39:37.350229 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d427c01e-2ce1-4f58-9af5-712818f6b9a9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9623c2fad43a4f49aeeb824a1b7fbc6e)` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:39:37.352307 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d427c01e-2ce1-4f58-9af5-712818f6b9a9 admin admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:39:37.408463 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-d427c01e-2ce1-4f58-9af5-712818f6b9a9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9623c2fad43a4f49aeeb824a1b7fbc6e'} {{(pid=79745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:39:37.420266 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-d427c01e-2ce1-4f58-9af5-712818f6b9a9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9623c2fad43a4f49aeeb824a1b7fbc6e'} {{(pid=79745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:39:37.420978 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-d427c01e-2ce1-4f58-9af5-712818f6b9a9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9623c2fad43a4f49aeeb824a1b7fbc6e'} {{(pid=79745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:39:37.421582 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-d427c01e-2ce1-4f58-9af5-712818f6b9a9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9623c2fad43a4f49aeeb824a1b7fbc6e'} {{(pid=79745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:39:37.428646 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-d427c01e-2ce1-4f58-9af5-712818f6b9a9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9623c2fad43a4f49aeeb824a1b7fbc6e'} {{(pid=79745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:39:37.443446 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 1375/2760] 10.222.0.21 () {58 vars in 1223 bytes} [Wed May 4 07:39:37 2022] DELETE /identity/v3/users/9623c2fad43a4f49aeeb824a1b7fbc6e => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 07:39:37.654722 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9794499c-b957-48a9-9db0-6f1699b8a503 service neutron] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:39:37.665752 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9794499c-b957-48a9-9db0-6f1699b8a503 service neutron] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:39:37.736516 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341cc2f1-b3ee-4be7-8ec5-beacafdf981b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:39:37.737284 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341cc2f1-b3ee-4be7-8ec5-beacafdf981b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:39:37.737558 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341cc2f1-b3ee-4be7-8ec5-beacafdf981b admin admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:39:37.737827 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341cc2f1-b3ee-4be7-8ec5-beacafdf981b admin admin] PATH_INFO: `/v3/projects/67ba7d23d29d4a7983ba1cfe0ac4863d` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:39:37.738999 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341cc2f1-b3ee-4be7-8ec5-beacafdf981b admin admin] RBAC: Authorizing `identity:delete_project(project_id=67ba7d23d29d4a7983ba1cfe0ac4863d)` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:39:37.740939 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341cc2f1-b3ee-4be7-8ec5-beacafdf981b admin admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:39:37.796384 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-341cc2f1-b3ee-4be7-8ec5-beacafdf981b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '67ba7d23d29d4a7983ba1cfe0ac4863d', 'request_id': 'req-341cc2f1-b3ee-4be7-8ec5-beacafdf981b'} {{(pid=79744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:39:37.803518 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-341cc2f1-b3ee-4be7-8ec5-beacafdf981b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '67ba7d23d29d4a7983ba1cfe0ac4863d', 'request_id': 'req-341cc2f1-b3ee-4be7-8ec5-beacafdf981b'} {{(pid=79744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:39:37.815275 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-341cc2f1-b3ee-4be7-8ec5-beacafdf981b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '67ba7d23d29d4a7983ba1cfe0ac4863d', 'request_id': 'req-341cc2f1-b3ee-4be7-8ec5-beacafdf981b'} {{(pid=79744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:39:37.833614 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-341cc2f1-b3ee-4be7-8ec5-beacafdf981b admin admin] The token cache is being invalidate because project 67ba7d23d29d4a7983ba1cfe0ac4863d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79744) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 07:39:37.834080 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-341cc2f1-b3ee-4be7-8ec5-beacafdf981b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:39:37.835014 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-341cc2f1-b3ee-4be7-8ec5-beacafdf981b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:39:37.837394 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 1386/2761] 10.222.0.21 () {58 vars in 1232 bytes} [Wed May 4 07:39:37 2022] DELETE /identity/v3/projects/67ba7d23d29d4a7983ba1cfe0ac4863d => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 07:39:37.842966 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceafca6d-cb32-40d1-a9f5-f4c97ef39012 None None] REQUEST_METHOD: `POST` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:39:37.843329 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceafca6d-cb32-40d1-a9f5-f4c97ef39012 None None] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:39:37.843616 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceafca6d-cb32-40d1-a9f5-f4c97ef39012 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:39:37.864732 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.auth.core [None req-ceafca6d-cb32-40d1-a9f5-f4c97ef39012 None None] MFA Rules not processed for user `83c5e0dcb991496ea6dee38384514508`. Rule list: `[]` (Enabled: `True`). {{(pid=79745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:39:37.866063 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.fernet_utils [None req-ceafca6d-cb32-40d1-a9f5-f4c97ef39012 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:39:37.933447 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 1376/2762] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 07:39:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 07:39:37.941327 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a8fad8-4981-4f9f-9e63-8d8b8338d47c None None] REQUEST_METHOD: `POST` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:39:37.941610 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a8fad8-4981-4f9f-9e63-8d8b8338d47c None None] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:39:37.941887 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a8fad8-4981-4f9f-9e63-8d8b8338d47c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:39:37.962044 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.auth.core [None req-68a8fad8-4981-4f9f-9e63-8d8b8338d47c None None] MFA Rules not processed for user `83c5e0dcb991496ea6dee38384514508`. Rule list: `[]` (Enabled: `True`). {{(pid=79744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:39:37.964076 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.fernet_utils [None req-68a8fad8-4981-4f9f-9e63-8d8b8338d47c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:39:37.973620 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 1387/2763] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 07:39:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 07:39:37.977920 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceafca6d-cb32-40d1-a9f5-f4c97ef39012 None None] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:39:37.989456 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceafca6d-cb32-40d1-a9f5-f4c97ef39012 None None] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:39:37.994878 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684c8458-98b7-4684-9597-ae89c1437eb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:39:37.997931 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684c8458-98b7-4684-9597-ae89c1437eb4 admin admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:39:37.997931 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684c8458-98b7-4684-9597-ae89c1437eb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:39:37.997931 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684c8458-98b7-4684-9597-ae89c1437eb4 admin admin] PATH_INFO: `/v3/domains` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:39:37.997931 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684c8458-98b7-4684-9597-ae89c1437eb4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 07:39:37.998517 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684c8458-98b7-4684-9597-ae89c1437eb4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:39:38.000075 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684c8458-98b7-4684-9597-ae89c1437eb4 admin admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:39:38.012982 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 1377/2764] 10.222.0.21 () {58 vars in 1152 bytes} [Wed May 4 07:39:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 07:39:38.017446 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a8fad8-4981-4f9f-9e63-8d8b8338d47c None None] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:39:38.027637 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a8fad8-4981-4f9f-9e63-8d8b8338d47c None None] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:39:38.032475 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e562c0-78e8-4495-9d4f-06117d313ce0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:39:38.033071 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e562c0-78e8-4495-9d4f-06117d313ce0 admin admin] REQUEST_METHOD: `POST` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:39:38.033351 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e562c0-78e8-4495-9d4f-06117d313ce0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:39:38.033625 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e562c0-78e8-4495-9d4f-06117d313ce0 admin admin] PATH_INFO: `/v3/projects` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:39:38.034326 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e562c0-78e8-4495-9d4f-06117d313ce0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:39:38.036278 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e562c0-78e8-4495-9d4f-06117d313ce0 admin admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:39:38.063944 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 1388/2765] 10.222.0.21 () {60 vars in 1152 bytes} [Wed May 4 07:39:38 2022] POST /identity/v3/projects => generated 385 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 07:39:38.067936 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684c8458-98b7-4684-9597-ae89c1437eb4 admin admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:39:38.078459 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684c8458-98b7-4684-9597-ae89c1437eb4 admin admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:39:38.138636 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf10efc-f674-4ba0-aa52-acff4261a52d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:39:38.139342 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf10efc-f674-4ba0-aa52-acff4261a52d admin admin] REQUEST_METHOD: `POST` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:39:38.139627 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf10efc-f674-4ba0-aa52-acff4261a52d admin admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:39:38.139911 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf10efc-f674-4ba0-aa52-acff4261a52d admin admin] PATH_INFO: `/v3/users` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:39:38.140608 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf10efc-f674-4ba0-aa52-acff4261a52d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:39:38.142545 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf10efc-f674-4ba0-aa52-acff4261a52d admin admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:39:38.166130 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 1378/2766] 10.222.0.21 () {60 vars in 1143 bytes} [Wed May 4 07:39:38 2022] POST /identity/v3/users => generated 293 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 07:39:38.170806 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e562c0-78e8-4495-9d4f-06117d313ce0 admin admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:39:38.178575 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e562c0-78e8-4495-9d4f-06117d313ce0 admin admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:39:38.184278 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc724e2-3e3d-4645-9f96-8672151c34e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:39:38.184944 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc724e2-3e3d-4645-9f96-8672151c34e1 admin admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:39:38.185224 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc724e2-3e3d-4645-9f96-8672151c34e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:39:38.185502 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc724e2-3e3d-4645-9f96-8672151c34e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:39:38.186236 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc724e2-3e3d-4645-9f96-8672151c34e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:39:38.187884 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc724e2-3e3d-4645-9f96-8672151c34e1 admin admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:39:38.199115 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 1389/2767] 10.222.0.21 () {58 vars in 1121 bytes} [Wed May 4 07:39:38 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 07:39:38.203228 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf10efc-f674-4ba0-aa52-acff4261a52d admin admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:39:38.215791 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf10efc-f674-4ba0-aa52-acff4261a52d admin admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:39:38.220388 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1460d0f9-d7db-43b9-8fda-073971a74042 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:39:38.221048 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1460d0f9-d7db-43b9-8fda-073971a74042 admin admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:39:38.221346 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1460d0f9-d7db-43b9-8fda-073971a74042 admin admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:39:38.221595 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1460d0f9-d7db-43b9-8fda-073971a74042 admin admin] PATH_INFO: `/v3/roles` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:39:38.222321 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1460d0f9-d7db-43b9-8fda-073971a74042 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:39:38.223941 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1460d0f9-d7db-43b9-8fda-073971a74042 admin admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:39:38.234962 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 1379/2768] 10.222.0.21 () {58 vars in 1121 bytes} [Wed May 4 07:39:38 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 07:39:38.239820 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc724e2-3e3d-4645-9f96-8672151c34e1 admin admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:39:38.250487 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc724e2-3e3d-4645-9f96-8672151c34e1 admin admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:39:38.255429 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e532a9a1-967b-4b2c-822c-67d036840a9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:39:38.256307 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e532a9a1-967b-4b2c-822c-67d036840a9d admin admin] REQUEST_METHOD: `PUT` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:39:38.256581 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e532a9a1-967b-4b2c-822c-67d036840a9d admin admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:39:38.256879 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e532a9a1-967b-4b2c-822c-67d036840a9d admin admin] PATH_INFO: `/v3/projects/77224f86e3cc4a0e816df4ae52abc6c8/users/4dc0d80c96ec4fffb063db47a035b7d6/roles/9f89c07b05a14f18836116af22cba5f6` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:39:38.274790 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e532a9a1-967b-4b2c-822c-67d036840a9d admin admin] RBAC: Authorizing `identity:create_grant(project_id=77224f86e3cc4a0e816df4ae52abc6c8, user_id=4dc0d80c96ec4fffb063db47a035b7d6, role_id=9f89c07b05a14f18836116af22cba5f6)` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:39:38.277540 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e532a9a1-967b-4b2c-822c-67d036840a9d admin admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:39:38.292204 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 1390/2769] 10.222.0.21 () {60 vars in 1482 bytes} [Wed May 4 07:39:38 2022] PUT /identity/v3/projects/77224f86e3cc4a0e816df4ae52abc6c8/users/4dc0d80c96ec4fffb063db47a035b7d6/roles/9f89c07b05a14f18836116af22cba5f6 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 07:39:38.303381 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b03b0a-86d4-4b38-b228-7013bd244148 None None] REQUEST_METHOD: `POST` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:39:38.303667 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b03b0a-86d4-4b38-b228-7013bd244148 None None] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:39:38.303975 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b03b0a-86d4-4b38-b228-7013bd244148 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:39:38.337096 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.auth.core [None req-82b03b0a-86d4-4b38-b228-7013bd244148 None None] MFA Rules not processed for user `4dc0d80c96ec4fffb063db47a035b7d6`. Rule list: `[]` (Enabled: `True`). {{(pid=79745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:39:38.339568 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.fernet_utils [None req-82b03b0a-86d4-4b38-b228-7013bd244148 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:39:38.412561 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 1380/2770] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 07:39:38 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 07:39:38.417810 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e532a9a1-967b-4b2c-822c-67d036840a9d admin admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:39:38.484204 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e532a9a1-967b-4b2c-822c-67d036840a9d admin admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:39:38.488920 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f454147-fc50-40f7-a498-c80a9f83e070 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:39:38.489591 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f454147-fc50-40f7-a498-c80a9f83e070 admin admin] REQUEST_METHOD: `POST` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:39:38.489921 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f454147-fc50-40f7-a498-c80a9f83e070 admin admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:39:38.490147 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f454147-fc50-40f7-a498-c80a9f83e070 admin admin] PATH_INFO: `/v3/projects` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:39:38.490902 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f454147-fc50-40f7-a498-c80a9f83e070 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:39:38.492790 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f454147-fc50-40f7-a498-c80a9f83e070 admin admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:39:38.526021 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 1391/2771] 10.222.0.21 () {60 vars in 1152 bytes} [Wed May 4 07:39:38 2022] POST /identity/v3/projects => generated 387 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 07:39:38.526701 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b03b0a-86d4-4b38-b228-7013bd244148 None None] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:39:38.537811 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b03b0a-86d4-4b38-b228-7013bd244148 None None] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:39:38.600221 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03dfd254-5632-4096-bd9b-43f179618ef7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:39:38.601517 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03dfd254-5632-4096-bd9b-43f179618ef7 admin admin] REQUEST_METHOD: `POST` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:39:38.601801 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03dfd254-5632-4096-bd9b-43f179618ef7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:39:38.602076 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03dfd254-5632-4096-bd9b-43f179618ef7 admin admin] PATH_INFO: `/v3/users` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:39:38.602964 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03dfd254-5632-4096-bd9b-43f179618ef7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:39:38.605647 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03dfd254-5632-4096-bd9b-43f179618ef7 admin admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:39:38.628363 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 1381/2772] 10.222.0.21 () {60 vars in 1143 bytes} [Wed May 4 07:39:38 2022] POST /identity/v3/users => generated 300 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 07:39:38.632491 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f454147-fc50-40f7-a498-c80a9f83e070 admin admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:39:38.643677 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f454147-fc50-40f7-a498-c80a9f83e070 admin admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:39:38.648475 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76804340-d740-45a2-884e-20620b56f5ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:39:38.649146 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76804340-d740-45a2-884e-20620b56f5ec admin admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:39:38.649425 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76804340-d740-45a2-884e-20620b56f5ec admin admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:39:38.649697 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76804340-d740-45a2-884e-20620b56f5ec admin admin] PATH_INFO: `/v3/roles` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:39:38.651165 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76804340-d740-45a2-884e-20620b56f5ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:39:38.652772 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76804340-d740-45a2-884e-20620b56f5ec admin admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:39:38.663812 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 1392/2773] 10.222.0.21 () {58 vars in 1121 bytes} [Wed May 4 07:39:38 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 04 07:39:38.668988 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03dfd254-5632-4096-bd9b-43f179618ef7 admin admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:39:38.679337 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03dfd254-5632-4096-bd9b-43f179618ef7 admin admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:39:38.684070 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b988c2-8a33-4bc2-bc50-38267b355206 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:39:38.684948 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b988c2-8a33-4bc2-bc50-38267b355206 admin admin] REQUEST_METHOD: `PUT` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:39:38.685221 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b988c2-8a33-4bc2-bc50-38267b355206 admin admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:39:38.685488 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b988c2-8a33-4bc2-bc50-38267b355206 admin admin] PATH_INFO: `/v3/projects/6d36ab5cb6434853bcb9c19c8550e107/users/3f9bfd4b0e9643fe9178564369a72c8c/roles/eb54c9cea2774a25b1fe8c79724408ee` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:39:38.703564 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b988c2-8a33-4bc2-bc50-38267b355206 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6d36ab5cb6434853bcb9c19c8550e107, user_id=3f9bfd4b0e9643fe9178564369a72c8c, role_id=eb54c9cea2774a25b1fe8c79724408ee)` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:39:38.706202 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b988c2-8a33-4bc2-bc50-38267b355206 admin admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:39:38.720208 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 1382/2774] 10.222.0.21 () {60 vars in 1482 bytes} [Wed May 4 07:39:38 2022] PUT /identity/v3/projects/6d36ab5cb6434853bcb9c19c8550e107/users/3f9bfd4b0e9643fe9178564369a72c8c/roles/eb54c9cea2774a25b1fe8c79724408ee => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 07:39:38.724161 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76804340-d740-45a2-884e-20620b56f5ec admin admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:39:38.735015 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76804340-d740-45a2-884e-20620b56f5ec admin admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:39:38.793251 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e2afc3-104e-44ea-a669-97bacd2ceb53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:39:38.793928 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e2afc3-104e-44ea-a669-97bacd2ceb53 admin admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:39:38.794210 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e2afc3-104e-44ea-a669-97bacd2ceb53 admin admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:39:38.794485 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e2afc3-104e-44ea-a669-97bacd2ceb53 admin admin] PATH_INFO: `/v3/roles` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:39:38.795244 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e2afc3-104e-44ea-a669-97bacd2ceb53 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:39:38.796844 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e2afc3-104e-44ea-a669-97bacd2ceb53 admin admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:39:38.807294 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 1393/2775] 10.222.0.21 () {58 vars in 1121 bytes} [Wed May 4 07:39:38 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 07:39:38.811196 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b988c2-8a33-4bc2-bc50-38267b355206 admin admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:39:38.822287 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b988c2-8a33-4bc2-bc50-38267b355206 admin admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:39:38.827039 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98abe330-3310-4076-b48e-5289ea42ac07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:39:38.827938 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98abe330-3310-4076-b48e-5289ea42ac07 admin admin] REQUEST_METHOD: `PUT` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:39:38.828217 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98abe330-3310-4076-b48e-5289ea42ac07 admin admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:39:38.828523 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98abe330-3310-4076-b48e-5289ea42ac07 admin admin] PATH_INFO: `/v3/projects/6d36ab5cb6434853bcb9c19c8550e107/users/3f9bfd4b0e9643fe9178564369a72c8c/roles/eb54c9cea2774a25b1fe8c79724408ee` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:39:38.830527 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98abe330-3310-4076-b48e-5289ea42ac07 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6d36ab5cb6434853bcb9c19c8550e107, user_id=3f9bfd4b0e9643fe9178564369a72c8c, role_id=eb54c9cea2774a25b1fe8c79724408ee)` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:39:38.833226 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98abe330-3310-4076-b48e-5289ea42ac07 admin admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:39:38.844833 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 1383/2776] 10.222.0.21 () {60 vars in 1482 bytes} [Wed May 4 07:39:38 2022] PUT /identity/v3/projects/6d36ab5cb6434853bcb9c19c8550e107/users/3f9bfd4b0e9643fe9178564369a72c8c/roles/eb54c9cea2774a25b1fe8c79724408ee => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 07:39:38.855587 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cb92f3-c6b2-4ab6-9402-37315cd3890a None None] REQUEST_METHOD: `POST` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:39:38.855982 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cb92f3-c6b2-4ab6-9402-37315cd3890a None None] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:39:38.856206 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cb92f3-c6b2-4ab6-9402-37315cd3890a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:39:38.887888 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.auth.core [None req-05cb92f3-c6b2-4ab6-9402-37315cd3890a None None] MFA Rules not processed for user `3f9bfd4b0e9643fe9178564369a72c8c`. Rule list: `[]` (Enabled: `True`). {{(pid=79744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:39:38.889090 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.fernet_utils [None req-05cb92f3-c6b2-4ab6-9402-37315cd3890a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:39:38.957098 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 1394/2777] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 07:39:38 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 07:39:38.969277 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98abe330-3310-4076-b48e-5289ea42ac07 admin admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:39:38.971024 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.fernet_utils [None req-98abe330-3310-4076-b48e-5289ea42ac07 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:39:39.030889 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98abe330-3310-4076-b48e-5289ea42ac07 admin admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:39:39.034680 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864ac4dd-122c-4cbd-b117-97e8cf99a930 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb341257aa8246b6847561e2fe1fa385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9f9c44db4984653b8d4b5f6b3b949f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:39:39.035360 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864ac4dd-122c-4cbd-b117-97e8cf99a930 service cinder] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:39:39.035639 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864ac4dd-122c-4cbd-b117-97e8cf99a930 service cinder] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:39:39.035912 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864ac4dd-122c-4cbd-b117-97e8cf99a930 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:39:39.045400 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864ac4dd-122c-4cbd-b117-97e8cf99a930 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:39:39.046766 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864ac4dd-122c-4cbd-b117-97e8cf99a930 service cinder] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:39:39.057063 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 1384/2778] 10.222.0.21 () {60 vars in 1365 bytes} [Wed May 4 07:39:38 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 07:39:39.092575 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05cb92f3-c6b2-4ab6-9402-37315cd3890a None None] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:39:39.161488 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05cb92f3-c6b2-4ab6-9402-37315cd3890a None None] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:39:39.168552 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e13cfaf-f6c6-4d7c-9181-65a3ac2aa5de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:39:39.169960 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e13cfaf-f6c6-4d7c-9181-65a3ac2aa5de admin admin] REQUEST_METHOD: `DELETE` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:39:39.170415 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e13cfaf-f6c6-4d7c-9181-65a3ac2aa5de admin admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:39:39.170863 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e13cfaf-f6c6-4d7c-9181-65a3ac2aa5de admin admin] PATH_INFO: `/v3/users/4dc0d80c96ec4fffb063db47a035b7d6` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:39:39.172882 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e13cfaf-f6c6-4d7c-9181-65a3ac2aa5de admin admin] RBAC: Authorizing `identity:delete_user(user_id=4dc0d80c96ec4fffb063db47a035b7d6)` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:39:39.176207 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e13cfaf-f6c6-4d7c-9181-65a3ac2aa5de admin admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:39:39.227575 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-5e13cfaf-f6c6-4d7c-9181-65a3ac2aa5de admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4dc0d80c96ec4fffb063db47a035b7d6'} {{(pid=79744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:39:39.229088 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-5e13cfaf-f6c6-4d7c-9181-65a3ac2aa5de admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4dc0d80c96ec4fffb063db47a035b7d6'} {{(pid=79744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:39:39.237263 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-5e13cfaf-f6c6-4d7c-9181-65a3ac2aa5de admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4dc0d80c96ec4fffb063db47a035b7d6'} {{(pid=79744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:39:39.237936 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-5e13cfaf-f6c6-4d7c-9181-65a3ac2aa5de admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4dc0d80c96ec4fffb063db47a035b7d6'} {{(pid=79744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:39:39.250776 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-5e13cfaf-f6c6-4d7c-9181-65a3ac2aa5de admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4dc0d80c96ec4fffb063db47a035b7d6'} {{(pid=79744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:39:39.265171 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 1395/2779] 10.222.0.21 () {58 vars in 1223 bytes} [Wed May 4 07:39:39 2022] DELETE /identity/v3/users/4dc0d80c96ec4fffb063db47a035b7d6 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 07:39:39.269963 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caee8ae0-c0c8-4b1b-9eab-5ddcbf869e39 None None] REQUEST_METHOD: `POST` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:39:39.270241 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caee8ae0-c0c8-4b1b-9eab-5ddcbf869e39 None None] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:39:39.270515 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caee8ae0-c0c8-4b1b-9eab-5ddcbf869e39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:39:39.288578 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.auth.core [None req-caee8ae0-c0c8-4b1b-9eab-5ddcbf869e39 None None] MFA Rules not processed for user `83c5e0dcb991496ea6dee38384514508`. Rule list: `[]` (Enabled: `True`). {{(pid=79745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:39:39.289785 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.fernet_utils [None req-caee8ae0-c0c8-4b1b-9eab-5ddcbf869e39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:39:39.348269 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 1385/2780] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 07:39:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 07:39:39.358688 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e13cfaf-f6c6-4d7c-9181-65a3ac2aa5de admin admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:39:39.360450 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.fernet_utils [None req-5e13cfaf-f6c6-4d7c-9181-65a3ac2aa5de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:39:39.419640 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e13cfaf-f6c6-4d7c-9181-65a3ac2aa5de admin admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:39:39.423333 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22315aef-d992-476b-a482-12a4ff5fbef5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91cb92d00273402b837cb29b37325101', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9f9c44db4984653b8d4b5f6b3b949f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:39:39.423977 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22315aef-d992-476b-a482-12a4ff5fbef5 service neutron] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:39:39.424255 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22315aef-d992-476b-a482-12a4ff5fbef5 service neutron] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:39:39.424528 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22315aef-d992-476b-a482-12a4ff5fbef5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:39:39.434029 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22315aef-d992-476b-a482-12a4ff5fbef5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:39:39.435484 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22315aef-d992-476b-a482-12a4ff5fbef5 service neutron] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:39:39.453904 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 1396/2781] 10.222.0.21 () {60 vars in 1365 bytes} [Wed May 4 07:39:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 04 07:39:39.745274 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caee8ae0-c0c8-4b1b-9eab-5ddcbf869e39 None None] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:39:39.746823 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.fernet_utils [None req-caee8ae0-c0c8-4b1b-9eab-5ddcbf869e39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:39:39.759795 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caee8ae0-c0c8-4b1b-9eab-5ddcbf869e39 None None] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:39:39.768134 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7ca2a8-e584-4f96-94ef-a42d9442bf3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:39:39.769171 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7ca2a8-e584-4f96-94ef-a42d9442bf3f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:39:39.769320 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7ca2a8-e584-4f96-94ef-a42d9442bf3f admin admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:39:39.769574 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7ca2a8-e584-4f96-94ef-a42d9442bf3f admin admin] PATH_INFO: `/v3/projects/77224f86e3cc4a0e816df4ae52abc6c8` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:39:39.770756 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7ca2a8-e584-4f96-94ef-a42d9442bf3f admin admin] RBAC: Authorizing `identity:delete_project(project_id=77224f86e3cc4a0e816df4ae52abc6c8)` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:39:39.772759 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7ca2a8-e584-4f96-94ef-a42d9442bf3f admin admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:39:39.827123 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-db7ca2a8-e584-4f96-94ef-a42d9442bf3f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '77224f86e3cc4a0e816df4ae52abc6c8', 'request_id': 'req-db7ca2a8-e584-4f96-94ef-a42d9442bf3f'} {{(pid=79745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:39:39.833750 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-db7ca2a8-e584-4f96-94ef-a42d9442bf3f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '77224f86e3cc4a0e816df4ae52abc6c8', 'request_id': 'req-db7ca2a8-e584-4f96-94ef-a42d9442bf3f'} {{(pid=79745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:39:39.841886 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-db7ca2a8-e584-4f96-94ef-a42d9442bf3f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '77224f86e3cc4a0e816df4ae52abc6c8', 'request_id': 'req-db7ca2a8-e584-4f96-94ef-a42d9442bf3f'} {{(pid=79745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:39:39.852320 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-db7ca2a8-e584-4f96-94ef-a42d9442bf3f admin admin] The token cache is being invalidate because project 77224f86e3cc4a0e816df4ae52abc6c8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79745) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 07:39:39.852600 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-db7ca2a8-e584-4f96-94ef-a42d9442bf3f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:39:39.853845 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-db7ca2a8-e584-4f96-94ef-a42d9442bf3f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:39:39.855446 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 1386/2782] 10.222.0.21 () {58 vars in 1232 bytes} [Wed May 4 07:39:39 2022] DELETE /identity/v3/projects/77224f86e3cc4a0e816df4ae52abc6c8 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 07:39:39.859524 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22315aef-d992-476b-a482-12a4ff5fbef5 service neutron] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:39:39.869943 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22315aef-d992-476b-a482-12a4ff5fbef5 service neutron] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:39:39.929408 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a290e765-6b64-47e6-87a1-471f50a8e0b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:39:39.930279 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a290e765-6b64-47e6-87a1-471f50a8e0b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:39:39.930557 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a290e765-6b64-47e6-87a1-471f50a8e0b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:39:39.930890 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a290e765-6b64-47e6-87a1-471f50a8e0b7 admin admin] PATH_INFO: `/v3/users/3f9bfd4b0e9643fe9178564369a72c8c` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:39:39.932475 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a290e765-6b64-47e6-87a1-471f50a8e0b7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3f9bfd4b0e9643fe9178564369a72c8c)` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:39:39.934393 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a290e765-6b64-47e6-87a1-471f50a8e0b7 admin admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:39:39.983217 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-a290e765-6b64-47e6-87a1-471f50a8e0b7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3f9bfd4b0e9643fe9178564369a72c8c'} {{(pid=79744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:39:39.983884 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-a290e765-6b64-47e6-87a1-471f50a8e0b7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3f9bfd4b0e9643fe9178564369a72c8c'} {{(pid=79744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:39:39.990801 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-a290e765-6b64-47e6-87a1-471f50a8e0b7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3f9bfd4b0e9643fe9178564369a72c8c'} {{(pid=79744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:39:39.991466 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-a290e765-6b64-47e6-87a1-471f50a8e0b7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3f9bfd4b0e9643fe9178564369a72c8c'} {{(pid=79744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:39:40.003207 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-a290e765-6b64-47e6-87a1-471f50a8e0b7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3f9bfd4b0e9643fe9178564369a72c8c'} {{(pid=79744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:39:40.015659 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 1397/2783] 10.222.0.21 () {58 vars in 1223 bytes} [Wed May 4 07:39:39 2022] DELETE /identity/v3/users/3f9bfd4b0e9643fe9178564369a72c8c => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 07:39:40.306627 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7ca2a8-e584-4f96-94ef-a42d9442bf3f admin admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:39:40.308269 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.fernet_utils [None req-db7ca2a8-e584-4f96-94ef-a42d9442bf3f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:39:40.323511 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7ca2a8-e584-4f96-94ef-a42d9442bf3f admin admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:39:40.393135 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a20d38-588b-4f93-89d9-fccf844ffca4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:39:40.393968 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a20d38-588b-4f93-89d9-fccf844ffca4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:39:40.394253 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a20d38-588b-4f93-89d9-fccf844ffca4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:39:40.394529 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a20d38-588b-4f93-89d9-fccf844ffca4 admin admin] PATH_INFO: `/v3/projects/6d36ab5cb6434853bcb9c19c8550e107` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:39:40.395858 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a20d38-588b-4f93-89d9-fccf844ffca4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6d36ab5cb6434853bcb9c19c8550e107)` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:39:40.397837 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a20d38-588b-4f93-89d9-fccf844ffca4 admin admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:39:40.449378 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-c1a20d38-588b-4f93-89d9-fccf844ffca4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6d36ab5cb6434853bcb9c19c8550e107', 'request_id': 'req-c1a20d38-588b-4f93-89d9-fccf844ffca4'} {{(pid=79745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:39:40.455775 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-c1a20d38-588b-4f93-89d9-fccf844ffca4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6d36ab5cb6434853bcb9c19c8550e107', 'request_id': 'req-c1a20d38-588b-4f93-89d9-fccf844ffca4'} {{(pid=79745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:39:40.464219 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-c1a20d38-588b-4f93-89d9-fccf844ffca4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6d36ab5cb6434853bcb9c19c8550e107', 'request_id': 'req-c1a20d38-588b-4f93-89d9-fccf844ffca4'} {{(pid=79745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:39:40.474554 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-c1a20d38-588b-4f93-89d9-fccf844ffca4 admin admin] The token cache is being invalidate because project 6d36ab5cb6434853bcb9c19c8550e107 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79745) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 07:39:40.474837 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-c1a20d38-588b-4f93-89d9-fccf844ffca4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:39:40.475512 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-c1a20d38-588b-4f93-89d9-fccf844ffca4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:39:40.477057 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 1387/2784] 10.222.0.21 () {58 vars in 1232 bytes} [Wed May 4 07:39:40 2022] DELETE /identity/v3/projects/6d36ab5cb6434853bcb9c19c8550e107 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 07:39:40.482213 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fa25c6-27a3-4ca5-ab69-4406349e5f1c None None] REQUEST_METHOD: `POST` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:39:40.482500 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fa25c6-27a3-4ca5-ab69-4406349e5f1c None None] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:39:40.482776 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fa25c6-27a3-4ca5-ab69-4406349e5f1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:39:40.502899 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.auth.core [None req-70fa25c6-27a3-4ca5-ab69-4406349e5f1c None None] MFA Rules not processed for user `83c5e0dcb991496ea6dee38384514508`. Rule list: `[]` (Enabled: `True`). {{(pid=79744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:39:40.504140 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.fernet_utils [None req-70fa25c6-27a3-4ca5-ab69-4406349e5f1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:39:40.569017 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 1398/2785] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 07:39:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 07:39:40.577560 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bb5f12-587e-4661-a953-957c46eb131a None None] REQUEST_METHOD: `POST` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:39:40.577850 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bb5f12-587e-4661-a953-957c46eb131a None None] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:39:40.578155 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bb5f12-587e-4661-a953-957c46eb131a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:39:40.597989 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.auth.core [None req-03bb5f12-587e-4661-a953-957c46eb131a None None] MFA Rules not processed for user `83c5e0dcb991496ea6dee38384514508`. Rule list: `[]` (Enabled: `True`). {{(pid=79745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:39:40.599226 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.fernet_utils [None req-03bb5f12-587e-4661-a953-957c46eb131a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:39:40.607749 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 1388/2786] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 07:39:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 07:39:40.614277 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fa25c6-27a3-4ca5-ab69-4406349e5f1c None None] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:39:40.624811 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fa25c6-27a3-4ca5-ab69-4406349e5f1c None None] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:39:40.631916 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a087700-18e8-4d6f-9700-d2bacb02e165 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:39:40.632577 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a087700-18e8-4d6f-9700-d2bacb02e165 admin admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:39:40.632855 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a087700-18e8-4d6f-9700-d2bacb02e165 admin admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:39:40.633123 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a087700-18e8-4d6f-9700-d2bacb02e165 admin admin] PATH_INFO: `/v3/domains` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:39:40.633849 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a087700-18e8-4d6f-9700-d2bacb02e165 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79744) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 07:39:40.634152 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a087700-18e8-4d6f-9700-d2bacb02e165 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:39:40.636419 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a087700-18e8-4d6f-9700-d2bacb02e165 admin admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:39:40.652642 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 1399/2787] 10.222.0.21 () {58 vars in 1152 bytes} [Wed May 4 07:39:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 07:39:40.657049 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03bb5f12-587e-4661-a953-957c46eb131a None None] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:39:40.666613 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03bb5f12-587e-4661-a953-957c46eb131a None None] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:39:40.671474 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8627d4-fdb3-4bae-bc1d-2742fa01a207 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:39:40.672124 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8627d4-fdb3-4bae-bc1d-2742fa01a207 admin admin] REQUEST_METHOD: `POST` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:39:40.672400 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8627d4-fdb3-4bae-bc1d-2742fa01a207 admin admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:39:40.672673 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8627d4-fdb3-4bae-bc1d-2742fa01a207 admin admin] PATH_INFO: `/v3/projects` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:39:40.673361 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8627d4-fdb3-4bae-bc1d-2742fa01a207 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:39:40.675266 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8627d4-fdb3-4bae-bc1d-2742fa01a207 admin admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:39:40.702734 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 1389/2788] 10.222.0.21 () {60 vars in 1152 bytes} [Wed May 4 07:39:40 2022] POST /identity/v3/projects => generated 387 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 07:39:40.707258 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a087700-18e8-4d6f-9700-d2bacb02e165 admin admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:39:40.717910 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a087700-18e8-4d6f-9700-d2bacb02e165 admin admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:39:40.776246 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26043be-5ee5-46a5-84b8-b5129ed16988 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:39:40.777064 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26043be-5ee5-46a5-84b8-b5129ed16988 admin admin] REQUEST_METHOD: `POST` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:39:40.777435 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26043be-5ee5-46a5-84b8-b5129ed16988 admin admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:39:40.777811 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26043be-5ee5-46a5-84b8-b5129ed16988 admin admin] PATH_INFO: `/v3/users` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:39:40.778594 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26043be-5ee5-46a5-84b8-b5129ed16988 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:39:40.780657 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26043be-5ee5-46a5-84b8-b5129ed16988 admin admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:39:40.800897 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 1400/2789] 10.222.0.21 () {60 vars in 1143 bytes} [Wed May 4 07:39:40 2022] POST /identity/v3/users => generated 294 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 07:39:40.805899 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8627d4-fdb3-4bae-bc1d-2742fa01a207 admin admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:39:40.820842 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8627d4-fdb3-4bae-bc1d-2742fa01a207 admin admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:39:40.826756 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ec45a9-d725-4ee3-a046-a8fe739d48d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:39:40.827636 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ec45a9-d725-4ee3-a046-a8fe739d48d0 admin admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:39:40.827915 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ec45a9-d725-4ee3-a046-a8fe739d48d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:39:40.828186 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ec45a9-d725-4ee3-a046-a8fe739d48d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:39:40.828918 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ec45a9-d725-4ee3-a046-a8fe739d48d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:39:40.830513 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ec45a9-d725-4ee3-a046-a8fe739d48d0 admin admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:39:40.842181 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 1390/2790] 10.222.0.21 () {58 vars in 1121 bytes} [Wed May 4 07:39:40 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 07:39:40.847708 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26043be-5ee5-46a5-84b8-b5129ed16988 admin admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:39:40.858173 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26043be-5ee5-46a5-84b8-b5129ed16988 admin admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:39:40.863448 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e550e69-13c0-4a43-a4d2-57344f698dcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:39:40.864215 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e550e69-13c0-4a43-a4d2-57344f698dcf admin admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:39:40.864375 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e550e69-13c0-4a43-a4d2-57344f698dcf admin admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:39:40.864645 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e550e69-13c0-4a43-a4d2-57344f698dcf admin admin] PATH_INFO: `/v3/roles` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:39:40.865369 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e550e69-13c0-4a43-a4d2-57344f698dcf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:39:40.866944 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e550e69-13c0-4a43-a4d2-57344f698dcf admin admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:39:40.878149 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 1401/2791] 10.222.0.21 () {58 vars in 1121 bytes} [Wed May 4 07:39:40 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 07:39:40.882401 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ec45a9-d725-4ee3-a046-a8fe739d48d0 admin admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:39:40.893563 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ec45a9-d725-4ee3-a046-a8fe739d48d0 admin admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:39:40.898315 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d328657-7868-454e-b152-9e986784779c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:39:40.899254 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d328657-7868-454e-b152-9e986784779c admin admin] REQUEST_METHOD: `PUT` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:39:40.899534 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d328657-7868-454e-b152-9e986784779c admin admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:39:40.899807 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d328657-7868-454e-b152-9e986784779c admin admin] PATH_INFO: `/v3/projects/99f4bd55d14d4ae291ef8deed05dd7d9/users/e283567aee184b3b91e5c36944d0d5c0/roles/9f89c07b05a14f18836116af22cba5f6` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:39:40.915478 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d328657-7868-454e-b152-9e986784779c admin admin] RBAC: Authorizing `identity:create_grant(project_id=99f4bd55d14d4ae291ef8deed05dd7d9, user_id=e283567aee184b3b91e5c36944d0d5c0, role_id=9f89c07b05a14f18836116af22cba5f6)` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:39:40.918213 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d328657-7868-454e-b152-9e986784779c admin admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:39:40.934960 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 1391/2792] 10.222.0.21 () {60 vars in 1482 bytes} [Wed May 4 07:39:40 2022] PUT /identity/v3/projects/99f4bd55d14d4ae291ef8deed05dd7d9/users/e283567aee184b3b91e5c36944d0d5c0/roles/9f89c07b05a14f18836116af22cba5f6 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 07:39:40.946572 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce609a3-2f85-4c73-837e-bee5ebb6f9f8 None None] REQUEST_METHOD: `POST` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:39:40.947588 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce609a3-2f85-4c73-837e-bee5ebb6f9f8 None None] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:39:40.948092 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce609a3-2f85-4c73-837e-bee5ebb6f9f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:39:40.975479 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.auth.core [None req-bce609a3-2f85-4c73-837e-bee5ebb6f9f8 None None] MFA Rules not processed for user `e283567aee184b3b91e5c36944d0d5c0`. Rule list: `[]` (Enabled: `True`). {{(pid=79744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:39:40.976713 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.fernet_utils [None req-bce609a3-2f85-4c73-837e-bee5ebb6f9f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:39:41.046201 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 1402/2793] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 07:39:40 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 07:39:41.050850 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d328657-7868-454e-b152-9e986784779c admin admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:39:41.116524 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d328657-7868-454e-b152-9e986784779c admin admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:39:41.122112 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e1aa88-48c9-4d8d-895b-d76301c3fb79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:39:41.122770 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e1aa88-48c9-4d8d-895b-d76301c3fb79 admin admin] REQUEST_METHOD: `POST` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:39:41.123049 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e1aa88-48c9-4d8d-895b-d76301c3fb79 admin admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:39:41.123359 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e1aa88-48c9-4d8d-895b-d76301c3fb79 admin admin] PATH_INFO: `/v3/projects` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:39:41.124060 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e1aa88-48c9-4d8d-895b-d76301c3fb79 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:39:41.125976 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e1aa88-48c9-4d8d-895b-d76301c3fb79 admin admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:39:41.158461 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 1392/2794] 10.222.0.21 () {60 vars in 1152 bytes} [Wed May 4 07:39:41 2022] POST /identity/v3/projects => generated 387 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 07:39:41.164380 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce609a3-2f85-4c73-837e-bee5ebb6f9f8 None None] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:39:41.176663 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce609a3-2f85-4c73-837e-bee5ebb6f9f8 None None] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:39:41.234494 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1bb4c0-e61e-4de8-8490-07e90114ed3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:39:41.235196 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1bb4c0-e61e-4de8-8490-07e90114ed3f admin admin] REQUEST_METHOD: `POST` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:39:41.235482 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1bb4c0-e61e-4de8-8490-07e90114ed3f admin admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:39:41.235755 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1bb4c0-e61e-4de8-8490-07e90114ed3f admin admin] PATH_INFO: `/v3/users` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:39:41.236458 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1bb4c0-e61e-4de8-8490-07e90114ed3f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:39:41.238373 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1bb4c0-e61e-4de8-8490-07e90114ed3f admin admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:39:41.259826 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 1403/2795] 10.222.0.21 () {60 vars in 1143 bytes} [Wed May 4 07:39:41 2022] POST /identity/v3/users => generated 300 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 07:39:41.264368 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e1aa88-48c9-4d8d-895b-d76301c3fb79 admin admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:39:41.274525 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e1aa88-48c9-4d8d-895b-d76301c3fb79 admin admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:39:41.279459 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea11bb5-85a1-4f2f-b76a-cb9b904dd891 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:39:41.280117 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea11bb5-85a1-4f2f-b76a-cb9b904dd891 admin admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:39:41.280397 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea11bb5-85a1-4f2f-b76a-cb9b904dd891 admin admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:39:41.280670 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea11bb5-85a1-4f2f-b76a-cb9b904dd891 admin admin] PATH_INFO: `/v3/roles` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:39:41.281396 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea11bb5-85a1-4f2f-b76a-cb9b904dd891 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:39:41.282986 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea11bb5-85a1-4f2f-b76a-cb9b904dd891 admin admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:39:41.295045 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 1393/2796] 10.222.0.21 () {58 vars in 1121 bytes} [Wed May 4 07:39:41 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 07:39:41.299433 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1bb4c0-e61e-4de8-8490-07e90114ed3f admin admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:39:41.310016 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1bb4c0-e61e-4de8-8490-07e90114ed3f admin admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:39:41.314912 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d80d373-174f-4adc-a540-ef0ad5564337 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:39:41.315843 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d80d373-174f-4adc-a540-ef0ad5564337 admin admin] REQUEST_METHOD: `PUT` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:39:41.316118 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d80d373-174f-4adc-a540-ef0ad5564337 admin admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:39:41.316386 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d80d373-174f-4adc-a540-ef0ad5564337 admin admin] PATH_INFO: `/v3/projects/ef1ba0cfec074be9995deb69c073b7d9/users/cdb30c4e57794760a9dbd105aecf9331/roles/eb54c9cea2774a25b1fe8c79724408ee` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:39:41.332429 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d80d373-174f-4adc-a540-ef0ad5564337 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ef1ba0cfec074be9995deb69c073b7d9, user_id=cdb30c4e57794760a9dbd105aecf9331, role_id=eb54c9cea2774a25b1fe8c79724408ee)` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:39:41.335078 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d80d373-174f-4adc-a540-ef0ad5564337 admin admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:39:41.350428 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 1404/2797] 10.222.0.21 () {60 vars in 1482 bytes} [Wed May 4 07:39:41 2022] PUT /identity/v3/projects/ef1ba0cfec074be9995deb69c073b7d9/users/cdb30c4e57794760a9dbd105aecf9331/roles/eb54c9cea2774a25b1fe8c79724408ee => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 07:39:41.355399 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea11bb5-85a1-4f2f-b76a-cb9b904dd891 admin admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:39:41.365643 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea11bb5-85a1-4f2f-b76a-cb9b904dd891 admin admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:39:41.427706 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f51ad6-1002-4b27-aac3-672c73282159 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:39:41.428410 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f51ad6-1002-4b27-aac3-672c73282159 admin admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:39:41.428547 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f51ad6-1002-4b27-aac3-672c73282159 admin admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:39:41.428818 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f51ad6-1002-4b27-aac3-672c73282159 admin admin] PATH_INFO: `/v3/roles` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:39:41.429537 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f51ad6-1002-4b27-aac3-672c73282159 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:39:41.431261 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f51ad6-1002-4b27-aac3-672c73282159 admin admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:39:41.442273 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 1394/2798] 10.222.0.21 () {58 vars in 1121 bytes} [Wed May 4 07:39:41 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 04 07:39:41.448879 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d80d373-174f-4adc-a540-ef0ad5564337 admin admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:39:41.460012 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d80d373-174f-4adc-a540-ef0ad5564337 admin admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:39:41.465224 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6280e2-ee6d-4d79-855b-f7db14948dec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:39:41.466144 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6280e2-ee6d-4d79-855b-f7db14948dec admin admin] REQUEST_METHOD: `PUT` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:39:41.466422 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6280e2-ee6d-4d79-855b-f7db14948dec admin admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:39:41.466689 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6280e2-ee6d-4d79-855b-f7db14948dec admin admin] PATH_INFO: `/v3/projects/ef1ba0cfec074be9995deb69c073b7d9/users/cdb30c4e57794760a9dbd105aecf9331/roles/eb54c9cea2774a25b1fe8c79724408ee` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:39:41.468726 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6280e2-ee6d-4d79-855b-f7db14948dec admin admin] RBAC: Authorizing `identity:create_grant(project_id=ef1ba0cfec074be9995deb69c073b7d9, user_id=cdb30c4e57794760a9dbd105aecf9331, role_id=eb54c9cea2774a25b1fe8c79724408ee)` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:39:41.471402 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6280e2-ee6d-4d79-855b-f7db14948dec admin admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:39:41.482723 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 1405/2799] 10.222.0.21 () {60 vars in 1482 bytes} [Wed May 4 07:39:41 2022] PUT /identity/v3/projects/ef1ba0cfec074be9995deb69c073b7d9/users/cdb30c4e57794760a9dbd105aecf9331/roles/eb54c9cea2774a25b1fe8c79724408ee => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 07:39:41.492992 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbf55d9-64ac-4659-a205-d27c6557fa10 None None] REQUEST_METHOD: `POST` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:39:41.493283 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbf55d9-64ac-4659-a205-d27c6557fa10 None None] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:39:41.493563 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbf55d9-64ac-4659-a205-d27c6557fa10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:39:41.527243 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.auth.core [None req-bdbf55d9-64ac-4659-a205-d27c6557fa10 None None] MFA Rules not processed for user `cdb30c4e57794760a9dbd105aecf9331`. Rule list: `[]` (Enabled: `True`). {{(pid=79745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:39:41.528486 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.fernet_utils [None req-bdbf55d9-64ac-4659-a205-d27c6557fa10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:39:41.601272 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 1395/2800] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 07:39:41 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 07:39:41.612528 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6280e2-ee6d-4d79-855b-f7db14948dec admin admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:39:41.614247 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.fernet_utils [None req-6c6280e2-ee6d-4d79-855b-f7db14948dec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:39:41.673493 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6280e2-ee6d-4d79-855b-f7db14948dec admin admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:39:41.677151 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13d5a3e-28ff-4d9e-ac1c-65b4d8c99f73 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb341257aa8246b6847561e2fe1fa385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9f9c44db4984653b8d4b5f6b3b949f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:39:41.677859 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13d5a3e-28ff-4d9e-ac1c-65b4d8c99f73 service cinder] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:39:41.678079 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13d5a3e-28ff-4d9e-ac1c-65b4d8c99f73 service cinder] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:39:41.678348 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13d5a3e-28ff-4d9e-ac1c-65b4d8c99f73 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:39:41.688078 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13d5a3e-28ff-4d9e-ac1c-65b4d8c99f73 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:39:41.689849 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13d5a3e-28ff-4d9e-ac1c-65b4d8c99f73 service cinder] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:39:41.701332 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 1406/2801] 10.222.0.21 () {60 vars in 1365 bytes} [Wed May 4 07:39:41 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 07:39:41.833001 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbf55d9-64ac-4659-a205-d27c6557fa10 None None] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:39:41.899250 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbf55d9-64ac-4659-a205-d27c6557fa10 None None] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:39:41.904642 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e140a0e-0a19-4dcc-ac29-b090dcef9b43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:39:41.905511 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e140a0e-0a19-4dcc-ac29-b090dcef9b43 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:39:41.905789 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e140a0e-0a19-4dcc-ac29-b090dcef9b43 admin admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:39:41.906064 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e140a0e-0a19-4dcc-ac29-b090dcef9b43 admin admin] PATH_INFO: `/v3/users/e283567aee184b3b91e5c36944d0d5c0` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:39:41.907289 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e140a0e-0a19-4dcc-ac29-b090dcef9b43 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e283567aee184b3b91e5c36944d0d5c0)` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:39:41.909209 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e140a0e-0a19-4dcc-ac29-b090dcef9b43 admin admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:39:41.970570 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-1e140a0e-0a19-4dcc-ac29-b090dcef9b43 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e283567aee184b3b91e5c36944d0d5c0'} {{(pid=79745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:39:41.982964 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-1e140a0e-0a19-4dcc-ac29-b090dcef9b43 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e283567aee184b3b91e5c36944d0d5c0'} {{(pid=79745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:39:41.983826 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-1e140a0e-0a19-4dcc-ac29-b090dcef9b43 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e283567aee184b3b91e5c36944d0d5c0'} {{(pid=79745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:39:41.984617 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-1e140a0e-0a19-4dcc-ac29-b090dcef9b43 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e283567aee184b3b91e5c36944d0d5c0'} {{(pid=79745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:39:41.991673 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-1e140a0e-0a19-4dcc-ac29-b090dcef9b43 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e283567aee184b3b91e5c36944d0d5c0'} {{(pid=79745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:39:42.005328 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 1396/2802] 10.222.0.21 () {58 vars in 1223 bytes} [Wed May 4 07:39:41 2022] DELETE /identity/v3/users/e283567aee184b3b91e5c36944d0d5c0 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 07:39:42.013557 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d6ef0a-9c62-4338-a12c-c066eb7d89c6 None None] REQUEST_METHOD: `POST` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:39:42.013557 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d6ef0a-9c62-4338-a12c-c066eb7d89c6 None None] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:39:42.013557 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d6ef0a-9c62-4338-a12c-c066eb7d89c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:39:42.029677 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.auth.core [None req-55d6ef0a-9c62-4338-a12c-c066eb7d89c6 None None] MFA Rules not processed for user `83c5e0dcb991496ea6dee38384514508`. Rule list: `[]` (Enabled: `True`). {{(pid=79744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:39:42.030959 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.fernet_utils [None req-55d6ef0a-9c62-4338-a12c-c066eb7d89c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:39:42.089788 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 1407/2803] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 07:39:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 07:39:42.101055 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e140a0e-0a19-4dcc-ac29-b090dcef9b43 admin admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:39:42.102570 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.fernet_utils [None req-1e140a0e-0a19-4dcc-ac29-b090dcef9b43 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:39:42.165306 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e140a0e-0a19-4dcc-ac29-b090dcef9b43 admin admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:39:42.169683 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9bc0a3-ebf6-44f4-a8f9-c55d2c3b8c5a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91cb92d00273402b837cb29b37325101', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9f9c44db4984653b8d4b5f6b3b949f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:39:42.170338 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9bc0a3-ebf6-44f4-a8f9-c55d2c3b8c5a service neutron] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:39:42.170615 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9bc0a3-ebf6-44f4-a8f9-c55d2c3b8c5a service neutron] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:39:42.170886 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9bc0a3-ebf6-44f4-a8f9-c55d2c3b8c5a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:39:42.180930 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9bc0a3-ebf6-44f4-a8f9-c55d2c3b8c5a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:39:42.182858 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9bc0a3-ebf6-44f4-a8f9-c55d2c3b8c5a service neutron] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:39:42.192971 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 1397/2804] 10.222.0.21 () {60 vars in 1365 bytes} [Wed May 4 07:39:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 07:39:42.481207 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d6ef0a-9c62-4338-a12c-c066eb7d89c6 None None] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:39:42.483134 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.fernet_utils [None req-55d6ef0a-9c62-4338-a12c-c066eb7d89c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:39:42.501994 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d6ef0a-9c62-4338-a12c-c066eb7d89c6 None None] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:39:42.506659 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d410655-28fa-4bc8-a6b2-63064779a9c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:39:42.507542 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d410655-28fa-4bc8-a6b2-63064779a9c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:39:42.507820 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d410655-28fa-4bc8-a6b2-63064779a9c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:39:42.508089 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d410655-28fa-4bc8-a6b2-63064779a9c0 admin admin] PATH_INFO: `/v3/projects/99f4bd55d14d4ae291ef8deed05dd7d9` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:39:42.509340 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d410655-28fa-4bc8-a6b2-63064779a9c0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=99f4bd55d14d4ae291ef8deed05dd7d9)` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:39:42.511691 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d410655-28fa-4bc8-a6b2-63064779a9c0 admin admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:39:42.562196 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-6d410655-28fa-4bc8-a6b2-63064779a9c0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '99f4bd55d14d4ae291ef8deed05dd7d9', 'request_id': 'req-6d410655-28fa-4bc8-a6b2-63064779a9c0'} {{(pid=79744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:39:42.567531 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-6d410655-28fa-4bc8-a6b2-63064779a9c0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '99f4bd55d14d4ae291ef8deed05dd7d9', 'request_id': 'req-6d410655-28fa-4bc8-a6b2-63064779a9c0'} {{(pid=79744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:39:42.576498 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-6d410655-28fa-4bc8-a6b2-63064779a9c0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '99f4bd55d14d4ae291ef8deed05dd7d9', 'request_id': 'req-6d410655-28fa-4bc8-a6b2-63064779a9c0'} {{(pid=79744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:39:42.596162 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-6d410655-28fa-4bc8-a6b2-63064779a9c0 admin admin] The token cache is being invalidate because project 99f4bd55d14d4ae291ef8deed05dd7d9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79744) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 07:39:42.596589 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-6d410655-28fa-4bc8-a6b2-63064779a9c0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:39:42.597540 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-6d410655-28fa-4bc8-a6b2-63064779a9c0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:39:42.599851 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 1408/2805] 10.222.0.21 () {58 vars in 1232 bytes} [Wed May 4 07:39:42 2022] DELETE /identity/v3/projects/99f4bd55d14d4ae291ef8deed05dd7d9 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 07:39:42.606833 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9bc0a3-ebf6-44f4-a8f9-c55d2c3b8c5a service neutron] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:39:42.619376 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9bc0a3-ebf6-44f4-a8f9-c55d2c3b8c5a service neutron] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:39:42.677802 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db884d8e-2571-4ad9-8561-8444bc8ec4ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:39:42.678675 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db884d8e-2571-4ad9-8561-8444bc8ec4ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:39:42.678957 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db884d8e-2571-4ad9-8561-8444bc8ec4ce admin admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:39:42.679271 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db884d8e-2571-4ad9-8561-8444bc8ec4ce admin admin] PATH_INFO: `/v3/users/cdb30c4e57794760a9dbd105aecf9331` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:39:42.680479 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db884d8e-2571-4ad9-8561-8444bc8ec4ce admin admin] RBAC: Authorizing `identity:delete_user(user_id=cdb30c4e57794760a9dbd105aecf9331)` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:39:42.683288 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db884d8e-2571-4ad9-8561-8444bc8ec4ce admin admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:39:42.730560 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-db884d8e-2571-4ad9-8561-8444bc8ec4ce admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cdb30c4e57794760a9dbd105aecf9331'} {{(pid=79745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:39:42.742885 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-db884d8e-2571-4ad9-8561-8444bc8ec4ce admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cdb30c4e57794760a9dbd105aecf9331'} {{(pid=79745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:39:42.743708 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-db884d8e-2571-4ad9-8561-8444bc8ec4ce admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cdb30c4e57794760a9dbd105aecf9331'} {{(pid=79745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:39:42.745032 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-db884d8e-2571-4ad9-8561-8444bc8ec4ce admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cdb30c4e57794760a9dbd105aecf9331'} {{(pid=79745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:39:42.752464 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-db884d8e-2571-4ad9-8561-8444bc8ec4ce admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cdb30c4e57794760a9dbd105aecf9331'} {{(pid=79745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:39:42.769457 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 1398/2806] 10.222.0.21 () {58 vars in 1223 bytes} [Wed May 4 07:39:42 2022] DELETE /identity/v3/users/cdb30c4e57794760a9dbd105aecf9331 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 07:39:43.054075 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d410655-28fa-4bc8-a6b2-63064779a9c0 admin admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:39:43.055574 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.fernet_utils [None req-6d410655-28fa-4bc8-a6b2-63064779a9c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:39:43.068955 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d410655-28fa-4bc8-a6b2-63064779a9c0 admin admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:39:43.132514 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec553b4-dc89-479a-8d7b-c3473f021984 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:39:43.133328 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec553b4-dc89-479a-8d7b-c3473f021984 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:39:43.133587 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec553b4-dc89-479a-8d7b-c3473f021984 admin admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:39:43.133857 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec553b4-dc89-479a-8d7b-c3473f021984 admin admin] PATH_INFO: `/v3/projects/ef1ba0cfec074be9995deb69c073b7d9` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:39:43.135055 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec553b4-dc89-479a-8d7b-c3473f021984 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ef1ba0cfec074be9995deb69c073b7d9)` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:39:43.136960 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec553b4-dc89-479a-8d7b-c3473f021984 admin admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:39:43.185461 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-5ec553b4-dc89-479a-8d7b-c3473f021984 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ef1ba0cfec074be9995deb69c073b7d9', 'request_id': 'req-5ec553b4-dc89-479a-8d7b-c3473f021984'} {{(pid=79744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:39:43.191047 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-5ec553b4-dc89-479a-8d7b-c3473f021984 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ef1ba0cfec074be9995deb69c073b7d9', 'request_id': 'req-5ec553b4-dc89-479a-8d7b-c3473f021984'} {{(pid=79744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:39:43.199835 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-5ec553b4-dc89-479a-8d7b-c3473f021984 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ef1ba0cfec074be9995deb69c073b7d9', 'request_id': 'req-5ec553b4-dc89-479a-8d7b-c3473f021984'} {{(pid=79744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:39:43.211727 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-5ec553b4-dc89-479a-8d7b-c3473f021984 admin admin] The token cache is being invalidate because project ef1ba0cfec074be9995deb69c073b7d9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79744) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 07:39:43.212010 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-5ec553b4-dc89-479a-8d7b-c3473f021984 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:39:43.213339 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-5ec553b4-dc89-479a-8d7b-c3473f021984 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:39:43.215009 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 1409/2807] 10.222.0.21 () {58 vars in 1232 bytes} [Wed May 4 07:39:43 2022] DELETE /identity/v3/projects/ef1ba0cfec074be9995deb69c073b7d9 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 07:39:43.219901 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94013c5-0870-4d5b-ad40-93647a736062 None None] REQUEST_METHOD: `POST` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:39:43.220191 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94013c5-0870-4d5b-ad40-93647a736062 None None] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:39:43.220475 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94013c5-0870-4d5b-ad40-93647a736062 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:39:43.239907 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.auth.core [None req-c94013c5-0870-4d5b-ad40-93647a736062 None None] MFA Rules not processed for user `83c5e0dcb991496ea6dee38384514508`. Rule list: `[]` (Enabled: `True`). {{(pid=79745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:39:43.241168 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.fernet_utils [None req-c94013c5-0870-4d5b-ad40-93647a736062 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:39:43.329433 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 1399/2808] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 07:39:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 07:39:43.339307 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1b8c38-fde3-4758-ba0f-1890ee957a7c None None] REQUEST_METHOD: `POST` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:39:43.339590 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1b8c38-fde3-4758-ba0f-1890ee957a7c None None] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:39:43.339866 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1b8c38-fde3-4758-ba0f-1890ee957a7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:39:43.359597 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.auth.core [None req-9a1b8c38-fde3-4758-ba0f-1890ee957a7c None None] MFA Rules not processed for user `83c5e0dcb991496ea6dee38384514508`. Rule list: `[]` (Enabled: `True`). {{(pid=79744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:39:43.360801 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.fernet_utils [None req-9a1b8c38-fde3-4758-ba0f-1890ee957a7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:39:43.369176 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 1410/2809] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 07:39:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 07:39:43.373572 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94013c5-0870-4d5b-ad40-93647a736062 None None] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:39:43.383842 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94013c5-0870-4d5b-ad40-93647a736062 None None] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:39:43.389765 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a25a9a3-80b5-41a8-a40e-95bb7478b72a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:39:43.390432 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a25a9a3-80b5-41a8-a40e-95bb7478b72a admin admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:39:43.390719 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a25a9a3-80b5-41a8-a40e-95bb7478b72a admin admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:39:43.390992 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a25a9a3-80b5-41a8-a40e-95bb7478b72a admin admin] PATH_INFO: `/v3/domains` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:39:43.391762 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a25a9a3-80b5-41a8-a40e-95bb7478b72a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 07:39:43.392072 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a25a9a3-80b5-41a8-a40e-95bb7478b72a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:39:43.393704 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a25a9a3-80b5-41a8-a40e-95bb7478b72a admin admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:39:43.406835 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 1400/2810] 10.222.0.21 () {58 vars in 1152 bytes} [Wed May 4 07:39:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 07:39:43.411523 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1b8c38-fde3-4758-ba0f-1890ee957a7c None None] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:39:43.425483 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1b8c38-fde3-4758-ba0f-1890ee957a7c None None] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:39:43.430392 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7e87df-9f07-49f9-9c27-134b69a0b70f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:39:43.431060 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7e87df-9f07-49f9-9c27-134b69a0b70f admin admin] REQUEST_METHOD: `POST` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:39:43.431363 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7e87df-9f07-49f9-9c27-134b69a0b70f admin admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:39:43.431628 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7e87df-9f07-49f9-9c27-134b69a0b70f admin admin] PATH_INFO: `/v3/projects` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:39:43.432355 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7e87df-9f07-49f9-9c27-134b69a0b70f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:39:43.434251 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7e87df-9f07-49f9-9c27-134b69a0b70f admin admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:39:43.465479 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 1411/2811] 10.222.0.21 () {60 vars in 1152 bytes} [Wed May 4 07:39:43 2022] POST /identity/v3/projects => generated 409 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 07:39:43.469721 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a25a9a3-80b5-41a8-a40e-95bb7478b72a admin admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:39:43.479901 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a25a9a3-80b5-41a8-a40e-95bb7478b72a admin admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:39:43.541581 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3bac6c5-d35f-4886-8e54-1393b0f6a425 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:39:43.542255 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bac6c5-d35f-4886-8e54-1393b0f6a425 admin admin] REQUEST_METHOD: `POST` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:39:43.542535 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bac6c5-d35f-4886-8e54-1393b0f6a425 admin admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:39:43.542810 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bac6c5-d35f-4886-8e54-1393b0f6a425 admin admin] PATH_INFO: `/v3/users` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:39:43.543539 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3bac6c5-d35f-4886-8e54-1393b0f6a425 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:39:43.545486 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3bac6c5-d35f-4886-8e54-1393b0f6a425 admin admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:39:43.567456 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 1401/2812] 10.222.0.21 () {60 vars in 1143 bytes} [Wed May 4 07:39:43 2022] POST /identity/v3/users => generated 305 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 07:39:43.571444 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7e87df-9f07-49f9-9c27-134b69a0b70f admin admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:39:43.583545 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7e87df-9f07-49f9-9c27-134b69a0b70f admin admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:39:43.588922 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad3fa28-c5fa-4f39-acee-d658297e85cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:39:43.589593 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad3fa28-c5fa-4f39-acee-d658297e85cf admin admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:39:43.589874 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad3fa28-c5fa-4f39-acee-d658297e85cf admin admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:39:43.590151 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad3fa28-c5fa-4f39-acee-d658297e85cf admin admin] PATH_INFO: `/v3/roles` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:39:43.590883 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad3fa28-c5fa-4f39-acee-d658297e85cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:39:43.592510 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad3fa28-c5fa-4f39-acee-d658297e85cf admin admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:39:43.604110 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 1412/2813] 10.222.0.21 () {58 vars in 1121 bytes} [Wed May 4 07:39:43 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 07:39:43.608356 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3bac6c5-d35f-4886-8e54-1393b0f6a425 admin admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:39:43.619888 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3bac6c5-d35f-4886-8e54-1393b0f6a425 admin admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:39:43.630275 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af91d19a-8945-46aa-87bd-15f20604807d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:39:43.630971 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af91d19a-8945-46aa-87bd-15f20604807d admin admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:39:43.631294 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af91d19a-8945-46aa-87bd-15f20604807d admin admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:39:43.631564 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af91d19a-8945-46aa-87bd-15f20604807d admin admin] PATH_INFO: `/v3/roles` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:39:43.632288 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af91d19a-8945-46aa-87bd-15f20604807d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:39:43.633981 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af91d19a-8945-46aa-87bd-15f20604807d admin admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:39:43.654350 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 1402/2814] 10.222.0.21 () {58 vars in 1121 bytes} [Wed May 4 07:39:43 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 07:39:43.658635 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad3fa28-c5fa-4f39-acee-d658297e85cf admin admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:39:43.673143 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad3fa28-c5fa-4f39-acee-d658297e85cf admin admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:39:43.683791 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26c16f2-2ffd-4ad2-ac92-c46691200eeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:39:43.684892 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26c16f2-2ffd-4ad2-ac92-c46691200eeb admin admin] REQUEST_METHOD: `PUT` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:39:43.685165 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26c16f2-2ffd-4ad2-ac92-c46691200eeb admin admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:39:43.685432 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26c16f2-2ffd-4ad2-ac92-c46691200eeb admin admin] PATH_INFO: `/v3/projects/62e031792fb0459f9d1fbfdfc2c669de/users/7e3e3214e2114dd18a5b306ab1b50cb5/roles/9f89c07b05a14f18836116af22cba5f6` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:39:43.703427 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26c16f2-2ffd-4ad2-ac92-c46691200eeb admin admin] RBAC: Authorizing `identity:create_grant(project_id=62e031792fb0459f9d1fbfdfc2c669de, user_id=7e3e3214e2114dd18a5b306ab1b50cb5, role_id=9f89c07b05a14f18836116af22cba5f6)` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:39:43.706117 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26c16f2-2ffd-4ad2-ac92-c46691200eeb admin admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:39:43.723033 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 1413/2815] 10.222.0.21 () {60 vars in 1482 bytes} [Wed May 4 07:39:43 2022] PUT /identity/v3/projects/62e031792fb0459f9d1fbfdfc2c669de/users/7e3e3214e2114dd18a5b306ab1b50cb5/roles/9f89c07b05a14f18836116af22cba5f6 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 07:39:43.733963 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66417996-c512-4449-a349-e201def290e9 None None] REQUEST_METHOD: `POST` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:39:43.734465 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66417996-c512-4449-a349-e201def290e9 None None] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:39:43.734638 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66417996-c512-4449-a349-e201def290e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:39:43.764720 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.auth.core [None req-66417996-c512-4449-a349-e201def290e9 None None] MFA Rules not processed for user `7e3e3214e2114dd18a5b306ab1b50cb5`. Rule list: `[]` (Enabled: `True`). {{(pid=79745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:39:43.765946 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.fernet_utils [None req-66417996-c512-4449-a349-e201def290e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:39:43.829838 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 1403/2816] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 07:39:43 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 07:39:43.834694 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26c16f2-2ffd-4ad2-ac92-c46691200eeb admin admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:39:43.898528 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26c16f2-2ffd-4ad2-ac92-c46691200eeb admin admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:39:43.903447 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbe12a5-7407-4dc3-985a-704b9843b894 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:39:43.904153 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbe12a5-7407-4dc3-985a-704b9843b894 admin admin] REQUEST_METHOD: `POST` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:39:43.904434 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbe12a5-7407-4dc3-985a-704b9843b894 admin admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:39:43.904714 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbe12a5-7407-4dc3-985a-704b9843b894 admin admin] PATH_INFO: `/v3/projects` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:39:43.905419 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cbe12a5-7407-4dc3-985a-704b9843b894 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:39:43.907349 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cbe12a5-7407-4dc3-985a-704b9843b894 admin admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:39:43.954004 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 1414/2817] 10.222.0.21 () {60 vars in 1152 bytes} [Wed May 4 07:39:43 2022] POST /identity/v3/projects => generated 409 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 07:39:43.958123 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66417996-c512-4449-a349-e201def290e9 None None] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:39:43.973347 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66417996-c512-4449-a349-e201def290e9 None None] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:39:44.035621 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bda2c76-2896-4dea-93a5-d7d76e09aa07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:39:44.036353 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bda2c76-2896-4dea-93a5-d7d76e09aa07 admin admin] REQUEST_METHOD: `POST` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:39:44.036671 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bda2c76-2896-4dea-93a5-d7d76e09aa07 admin admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:39:44.037160 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bda2c76-2896-4dea-93a5-d7d76e09aa07 admin admin] PATH_INFO: `/v3/users` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:39:44.037904 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bda2c76-2896-4dea-93a5-d7d76e09aa07 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:39:44.041336 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bda2c76-2896-4dea-93a5-d7d76e09aa07 admin admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:39:44.065441 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 1404/2818] 10.222.0.21 () {60 vars in 1143 bytes} [Wed May 4 07:39:43 2022] POST /identity/v3/users => generated 311 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 07:39:44.069381 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbe12a5-7407-4dc3-985a-704b9843b894 admin admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:39:44.079919 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbe12a5-7407-4dc3-985a-704b9843b894 admin admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:39:44.084537 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf33c6d4-f329-475f-9b24-75543517ebf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:39:44.085205 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf33c6d4-f329-475f-9b24-75543517ebf9 admin admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:39:44.085485 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf33c6d4-f329-475f-9b24-75543517ebf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:39:44.085761 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf33c6d4-f329-475f-9b24-75543517ebf9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:39:44.086515 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf33c6d4-f329-475f-9b24-75543517ebf9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:39:44.088517 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf33c6d4-f329-475f-9b24-75543517ebf9 admin admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:39:44.099476 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 1415/2819] 10.222.0.21 () {58 vars in 1121 bytes} [Wed May 4 07:39:44 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 07:39:44.105120 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bda2c76-2896-4dea-93a5-d7d76e09aa07 admin admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:39:44.115302 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bda2c76-2896-4dea-93a5-d7d76e09aa07 admin admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:39:44.121412 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba60d22-083a-4624-9dc6-368c9e12894c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:39:44.122434 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba60d22-083a-4624-9dc6-368c9e12894c admin admin] REQUEST_METHOD: `PUT` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:39:44.122723 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba60d22-083a-4624-9dc6-368c9e12894c admin admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:39:44.122998 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba60d22-083a-4624-9dc6-368c9e12894c admin admin] PATH_INFO: `/v3/projects/c0131e58743441818d0936532b5f0c42/users/2278363ecb8040ddabe5021c01460ca1/roles/eb54c9cea2774a25b1fe8c79724408ee` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:39:44.139617 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba60d22-083a-4624-9dc6-368c9e12894c admin admin] RBAC: Authorizing `identity:create_grant(project_id=c0131e58743441818d0936532b5f0c42, user_id=2278363ecb8040ddabe5021c01460ca1, role_id=eb54c9cea2774a25b1fe8c79724408ee)` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:39:44.142308 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba60d22-083a-4624-9dc6-368c9e12894c admin admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:39:44.159705 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 1405/2820] 10.222.0.21 () {60 vars in 1482 bytes} [Wed May 4 07:39:44 2022] PUT /identity/v3/projects/c0131e58743441818d0936532b5f0c42/users/2278363ecb8040ddabe5021c01460ca1/roles/eb54c9cea2774a25b1fe8c79724408ee => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 07:39:44.163828 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf33c6d4-f329-475f-9b24-75543517ebf9 admin admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:39:44.175473 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf33c6d4-f329-475f-9b24-75543517ebf9 admin admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:39:44.239353 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7819d2-e1bb-4bec-869b-c1f755bab44a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:39:44.240028 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7819d2-e1bb-4bec-869b-c1f755bab44a admin admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:39:44.240308 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7819d2-e1bb-4bec-869b-c1f755bab44a admin admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:39:44.240583 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7819d2-e1bb-4bec-869b-c1f755bab44a admin admin] PATH_INFO: `/v3/roles` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:39:44.241309 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7819d2-e1bb-4bec-869b-c1f755bab44a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:39:44.242904 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7819d2-e1bb-4bec-869b-c1f755bab44a admin admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:39:44.254146 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 1416/2821] 10.222.0.21 () {58 vars in 1121 bytes} [Wed May 4 07:39:44 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 07:39:44.258559 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba60d22-083a-4624-9dc6-368c9e12894c admin admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:39:44.269479 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba60d22-083a-4624-9dc6-368c9e12894c admin admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:39:44.274140 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1aae88a-baa3-4401-9b09-f45917c35850 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:39:44.275605 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1aae88a-baa3-4401-9b09-f45917c35850 admin admin] REQUEST_METHOD: `PUT` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:39:44.275892 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1aae88a-baa3-4401-9b09-f45917c35850 admin admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:39:44.276170 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1aae88a-baa3-4401-9b09-f45917c35850 admin admin] PATH_INFO: `/v3/projects/c0131e58743441818d0936532b5f0c42/users/2278363ecb8040ddabe5021c01460ca1/roles/eb54c9cea2774a25b1fe8c79724408ee` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:39:44.278215 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1aae88a-baa3-4401-9b09-f45917c35850 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c0131e58743441818d0936532b5f0c42, user_id=2278363ecb8040ddabe5021c01460ca1, role_id=eb54c9cea2774a25b1fe8c79724408ee)` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:39:44.280929 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1aae88a-baa3-4401-9b09-f45917c35850 admin admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:39:44.292804 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 1406/2822] 10.222.0.21 () {60 vars in 1482 bytes} [Wed May 4 07:39:44 2022] PUT /identity/v3/projects/c0131e58743441818d0936532b5f0c42/users/2278363ecb8040ddabe5021c01460ca1/roles/eb54c9cea2774a25b1fe8c79724408ee => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 07:39:44.303376 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1d779d-b70f-4c84-820b-d99e17f7e3ae None None] REQUEST_METHOD: `POST` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:39:44.303666 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1d779d-b70f-4c84-820b-d99e17f7e3ae None None] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:39:44.303945 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1d779d-b70f-4c84-820b-d99e17f7e3ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:39:44.332213 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.auth.core [None req-7c1d779d-b70f-4c84-820b-d99e17f7e3ae None None] MFA Rules not processed for user `2278363ecb8040ddabe5021c01460ca1`. Rule list: `[]` (Enabled: `True`). {{(pid=79744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:39:44.333470 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.fernet_utils [None req-7c1d779d-b70f-4c84-820b-d99e17f7e3ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:39:44.415629 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 1417/2823] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 07:39:44 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 07:39:44.427758 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1aae88a-baa3-4401-9b09-f45917c35850 admin admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:39:44.429549 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.fernet_utils [None req-d1aae88a-baa3-4401-9b09-f45917c35850 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:39:44.489038 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1aae88a-baa3-4401-9b09-f45917c35850 admin admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:39:44.492665 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e67a35-988b-4e58-a1c6-5eee583afdc4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb341257aa8246b6847561e2fe1fa385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9f9c44db4984653b8d4b5f6b3b949f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:39:44.493309 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e67a35-988b-4e58-a1c6-5eee583afdc4 service cinder] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:39:44.493636 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e67a35-988b-4e58-a1c6-5eee583afdc4 service cinder] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:39:44.493989 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e67a35-988b-4e58-a1c6-5eee583afdc4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:39:44.504396 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e67a35-988b-4e58-a1c6-5eee583afdc4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:39:44.505834 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e67a35-988b-4e58-a1c6-5eee583afdc4 service cinder] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:39:44.515706 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 1407/2824] 10.222.0.21 () {60 vars in 1365 bytes} [Wed May 4 07:39:44 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 07:39:44.683832 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1d779d-b70f-4c84-820b-d99e17f7e3ae None None] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:39:44.701538 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1d779d-b70f-4c84-820b-d99e17f7e3ae None None] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:39:44.705711 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1613bda4-2f95-46c8-a992-db27381c536b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb341257aa8246b6847561e2fe1fa385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9f9c44db4984653b8d4b5f6b3b949f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:39:44.706357 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1613bda4-2f95-46c8-a992-db27381c536b service cinder] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:39:44.706635 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1613bda4-2f95-46c8-a992-db27381c536b service cinder] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:39:44.706909 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1613bda4-2f95-46c8-a992-db27381c536b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:39:44.773641 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1613bda4-2f95-46c8-a992-db27381c536b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:39:44.775768 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1613bda4-2f95-46c8-a992-db27381c536b service cinder] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:39:44.785220 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 1418/2825] 10.222.0.21 () {60 vars in 1365 bytes} [Wed May 4 07:39:44 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 07:39:53.184492 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e67a35-988b-4e58-a1c6-5eee583afdc4 service cinder] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:39:53.252446 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e67a35-988b-4e58-a1c6-5eee583afdc4 service cinder] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:39:53.257403 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62750798-679b-4ed0-ba50-9e65ed01647f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:39:53.258270 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62750798-679b-4ed0-ba50-9e65ed01647f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:39:53.258546 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62750798-679b-4ed0-ba50-9e65ed01647f admin admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:39:53.258816 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62750798-679b-4ed0-ba50-9e65ed01647f admin admin] PATH_INFO: `/v3/users/7e3e3214e2114dd18a5b306ab1b50cb5` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:39:53.260815 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62750798-679b-4ed0-ba50-9e65ed01647f admin admin] RBAC: Authorizing `identity:delete_user(user_id=7e3e3214e2114dd18a5b306ab1b50cb5)` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:39:53.262754 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62750798-679b-4ed0-ba50-9e65ed01647f admin admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:39:53.315552 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-62750798-679b-4ed0-ba50-9e65ed01647f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7e3e3214e2114dd18a5b306ab1b50cb5'} {{(pid=79745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:39:53.328453 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-62750798-679b-4ed0-ba50-9e65ed01647f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7e3e3214e2114dd18a5b306ab1b50cb5'} {{(pid=79745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:39:53.329185 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-62750798-679b-4ed0-ba50-9e65ed01647f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7e3e3214e2114dd18a5b306ab1b50cb5'} {{(pid=79745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:39:53.329797 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-62750798-679b-4ed0-ba50-9e65ed01647f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7e3e3214e2114dd18a5b306ab1b50cb5'} {{(pid=79745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:39:53.336424 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-62750798-679b-4ed0-ba50-9e65ed01647f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7e3e3214e2114dd18a5b306ab1b50cb5'} {{(pid=79745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:39:53.354884 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 1408/2826] 10.222.0.21 () {58 vars in 1223 bytes} [Wed May 4 07:39:53 2022] DELETE /identity/v3/users/7e3e3214e2114dd18a5b306ab1b50cb5 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 07:39:53.361769 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d79f1ad-0314-4b6c-85ad-619bf81113c0 None None] REQUEST_METHOD: `POST` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:39:53.362284 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d79f1ad-0314-4b6c-85ad-619bf81113c0 None None] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:39:53.362641 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d79f1ad-0314-4b6c-85ad-619bf81113c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:39:53.386618 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.auth.core [None req-5d79f1ad-0314-4b6c-85ad-619bf81113c0 None None] MFA Rules not processed for user `83c5e0dcb991496ea6dee38384514508`. Rule list: `[]` (Enabled: `True`). {{(pid=79744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:39:53.387851 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.fernet_utils [None req-5d79f1ad-0314-4b6c-85ad-619bf81113c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:39:53.450815 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 1419/2827] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 07:39:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 07:39:53.459913 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62750798-679b-4ed0-ba50-9e65ed01647f admin admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:39:53.461416 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.fernet_utils [None req-62750798-679b-4ed0-ba50-9e65ed01647f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:39:53.525310 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62750798-679b-4ed0-ba50-9e65ed01647f admin admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:39:53.528931 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5c61b0-58e9-4b9f-acb9-782abce28543 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91cb92d00273402b837cb29b37325101', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9f9c44db4984653b8d4b5f6b3b949f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:39:53.529790 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5c61b0-58e9-4b9f-acb9-782abce28543 service neutron] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:39:53.530169 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5c61b0-58e9-4b9f-acb9-782abce28543 service neutron] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:39:53.530541 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5c61b0-58e9-4b9f-acb9-782abce28543 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:39:53.542712 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5c61b0-58e9-4b9f-acb9-782abce28543 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:39:53.544254 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5c61b0-58e9-4b9f-acb9-782abce28543 service neutron] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:39:53.554311 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 1409/2828] 10.222.0.21 () {60 vars in 1365 bytes} [Wed May 4 07:39:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 07:39:53.832077 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d79f1ad-0314-4b6c-85ad-619bf81113c0 None None] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:39:53.833499 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.fernet_utils [None req-5d79f1ad-0314-4b6c-85ad-619bf81113c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:39:53.846935 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d79f1ad-0314-4b6c-85ad-619bf81113c0 None None] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:39:53.851740 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f26ced-c230-41b4-883d-b202d1175297 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:39:53.853178 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f26ced-c230-41b4-883d-b202d1175297 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:39:53.853609 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f26ced-c230-41b4-883d-b202d1175297 admin admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:39:53.853902 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f26ced-c230-41b4-883d-b202d1175297 admin admin] PATH_INFO: `/v3/projects/62e031792fb0459f9d1fbfdfc2c669de` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:39:53.855292 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f26ced-c230-41b4-883d-b202d1175297 admin admin] RBAC: Authorizing `identity:delete_project(project_id=62e031792fb0459f9d1fbfdfc2c669de)` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:39:53.858007 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f26ced-c230-41b4-883d-b202d1175297 admin admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:39:53.914395 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-88f26ced-c230-41b4-883d-b202d1175297 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '62e031792fb0459f9d1fbfdfc2c669de', 'request_id': 'req-88f26ced-c230-41b4-883d-b202d1175297'} {{(pid=79744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:39:53.921099 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-88f26ced-c230-41b4-883d-b202d1175297 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '62e031792fb0459f9d1fbfdfc2c669de', 'request_id': 'req-88f26ced-c230-41b4-883d-b202d1175297'} {{(pid=79744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:39:53.928542 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-88f26ced-c230-41b4-883d-b202d1175297 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '62e031792fb0459f9d1fbfdfc2c669de', 'request_id': 'req-88f26ced-c230-41b4-883d-b202d1175297'} {{(pid=79744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:39:53.941059 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-88f26ced-c230-41b4-883d-b202d1175297 admin admin] The token cache is being invalidate because project 62e031792fb0459f9d1fbfdfc2c669de was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79744) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 07:39:53.941345 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-88f26ced-c230-41b4-883d-b202d1175297 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:39:53.942000 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-88f26ced-c230-41b4-883d-b202d1175297 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:39:53.943566 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 1420/2829] 10.222.0.21 () {58 vars in 1232 bytes} [Wed May 4 07:39:53 2022] DELETE /identity/v3/projects/62e031792fb0459f9d1fbfdfc2c669de => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 07:39:53.947810 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5c61b0-58e9-4b9f-acb9-782abce28543 service neutron] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:39:53.957492 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5c61b0-58e9-4b9f-acb9-782abce28543 service neutron] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:39:54.016197 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be6fd24-5b84-47df-b01b-d1a03e7f9506 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:39:54.017502 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be6fd24-5b84-47df-b01b-d1a03e7f9506 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:39:54.017502 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be6fd24-5b84-47df-b01b-d1a03e7f9506 admin admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:39:54.017750 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be6fd24-5b84-47df-b01b-d1a03e7f9506 admin admin] PATH_INFO: `/v3/users/2278363ecb8040ddabe5021c01460ca1` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:39:54.018919 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be6fd24-5b84-47df-b01b-d1a03e7f9506 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2278363ecb8040ddabe5021c01460ca1)` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:39:54.020921 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be6fd24-5b84-47df-b01b-d1a03e7f9506 admin admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:39:54.067774 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-7be6fd24-5b84-47df-b01b-d1a03e7f9506 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2278363ecb8040ddabe5021c01460ca1'} {{(pid=79745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:39:54.080162 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-7be6fd24-5b84-47df-b01b-d1a03e7f9506 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2278363ecb8040ddabe5021c01460ca1'} {{(pid=79745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:39:54.080810 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-7be6fd24-5b84-47df-b01b-d1a03e7f9506 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2278363ecb8040ddabe5021c01460ca1'} {{(pid=79745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:39:54.081413 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-7be6fd24-5b84-47df-b01b-d1a03e7f9506 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2278363ecb8040ddabe5021c01460ca1'} {{(pid=79745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:39:54.092319 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-7be6fd24-5b84-47df-b01b-d1a03e7f9506 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2278363ecb8040ddabe5021c01460ca1'} {{(pid=79745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:39:54.106716 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 1410/2830] 10.222.0.21 () {58 vars in 1223 bytes} [Wed May 4 07:39:53 2022] DELETE /identity/v3/users/2278363ecb8040ddabe5021c01460ca1 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 07:39:54.383629 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f26ced-c230-41b4-883d-b202d1175297 admin admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:39:54.385993 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.fernet_utils [None req-88f26ced-c230-41b4-883d-b202d1175297 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:39:54.401519 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f26ced-c230-41b4-883d-b202d1175297 admin admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:39:54.461269 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2e071b-12a9-4302-8bb7-70cb95215cf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:39:54.462385 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2e071b-12a9-4302-8bb7-70cb95215cf3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:39:54.462726 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2e071b-12a9-4302-8bb7-70cb95215cf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:39:54.463020 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2e071b-12a9-4302-8bb7-70cb95215cf3 admin admin] PATH_INFO: `/v3/projects/c0131e58743441818d0936532b5f0c42` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:39:54.464363 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2e071b-12a9-4302-8bb7-70cb95215cf3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c0131e58743441818d0936532b5f0c42)` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:39:54.466292 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2e071b-12a9-4302-8bb7-70cb95215cf3 admin admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:39:54.520236 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-3a2e071b-12a9-4302-8bb7-70cb95215cf3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c0131e58743441818d0936532b5f0c42', 'request_id': 'req-3a2e071b-12a9-4302-8bb7-70cb95215cf3'} {{(pid=79744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:39:54.525953 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-3a2e071b-12a9-4302-8bb7-70cb95215cf3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c0131e58743441818d0936532b5f0c42', 'request_id': 'req-3a2e071b-12a9-4302-8bb7-70cb95215cf3'} {{(pid=79744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:39:54.533695 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-3a2e071b-12a9-4302-8bb7-70cb95215cf3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c0131e58743441818d0936532b5f0c42', 'request_id': 'req-3a2e071b-12a9-4302-8bb7-70cb95215cf3'} {{(pid=79744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:39:54.546000 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-3a2e071b-12a9-4302-8bb7-70cb95215cf3 admin admin] The token cache is being invalidate because project c0131e58743441818d0936532b5f0c42 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79744) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 07:39:54.546278 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-3a2e071b-12a9-4302-8bb7-70cb95215cf3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:39:54.546928 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-3a2e071b-12a9-4302-8bb7-70cb95215cf3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:39:54.548498 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 1421/2831] 10.222.0.21 () {58 vars in 1232 bytes} [Wed May 4 07:39:54 2022] DELETE /identity/v3/projects/c0131e58743441818d0936532b5f0c42 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 07:39:54.553506 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d05ba8b-c6fd-4c4a-94bc-a72117257034 None None] REQUEST_METHOD: `POST` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:39:54.554036 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d05ba8b-c6fd-4c4a-94bc-a72117257034 None None] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:39:54.554036 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d05ba8b-c6fd-4c4a-94bc-a72117257034 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:39:54.573174 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.auth.core [None req-0d05ba8b-c6fd-4c4a-94bc-a72117257034 None None] MFA Rules not processed for user `83c5e0dcb991496ea6dee38384514508`. Rule list: `[]` (Enabled: `True`). {{(pid=79745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:39:54.574389 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.fernet_utils [None req-0d05ba8b-c6fd-4c4a-94bc-a72117257034 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:39:54.635564 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 1411/2832] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 07:39:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 07:39:54.644740 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31dc9402-6e69-4c3c-922e-f1340ecd508f None None] REQUEST_METHOD: `POST` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:39:54.645024 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31dc9402-6e69-4c3c-922e-f1340ecd508f None None] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:39:54.645301 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31dc9402-6e69-4c3c-922e-f1340ecd508f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:39:54.664313 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.auth.core [None req-31dc9402-6e69-4c3c-922e-f1340ecd508f None None] MFA Rules not processed for user `83c5e0dcb991496ea6dee38384514508`. Rule list: `[]` (Enabled: `True`). {{(pid=79744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:39:54.666147 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.fernet_utils [None req-31dc9402-6e69-4c3c-922e-f1340ecd508f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:39:54.674359 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 1422/2833] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 07:39:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 07:39:54.678702 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d05ba8b-c6fd-4c4a-94bc-a72117257034 None None] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:39:54.689184 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d05ba8b-c6fd-4c4a-94bc-a72117257034 None None] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:39:54.693796 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bebcdef-2378-4019-9e6b-1108d06acd85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:39:54.694454 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bebcdef-2378-4019-9e6b-1108d06acd85 admin admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:39:54.694730 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bebcdef-2378-4019-9e6b-1108d06acd85 admin admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:39:54.695002 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bebcdef-2378-4019-9e6b-1108d06acd85 admin admin] PATH_INFO: `/v3/domains` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:39:54.695787 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bebcdef-2378-4019-9e6b-1108d06acd85 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 07:39:54.696090 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bebcdef-2378-4019-9e6b-1108d06acd85 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:39:54.697716 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bebcdef-2378-4019-9e6b-1108d06acd85 admin admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:39:54.709526 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 1412/2834] 10.222.0.21 () {58 vars in 1152 bytes} [Wed May 4 07:39:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 07:39:54.714524 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31dc9402-6e69-4c3c-922e-f1340ecd508f None None] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:39:54.724174 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31dc9402-6e69-4c3c-922e-f1340ecd508f None None] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:39:54.729805 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc33490e-98bb-49d5-b209-06209ef7df4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:39:54.730473 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc33490e-98bb-49d5-b209-06209ef7df4a admin admin] REQUEST_METHOD: `POST` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:39:54.730757 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc33490e-98bb-49d5-b209-06209ef7df4a admin admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:39:54.731031 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc33490e-98bb-49d5-b209-06209ef7df4a admin admin] PATH_INFO: `/v3/projects` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:39:54.731768 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc33490e-98bb-49d5-b209-06209ef7df4a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:39:54.733726 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc33490e-98bb-49d5-b209-06209ef7df4a admin admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:39:54.768473 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 1423/2835] 10.222.0.21 () {60 vars in 1152 bytes} [Wed May 4 07:39:54 2022] POST /identity/v3/projects => generated 371 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 07:39:54.771678 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bebcdef-2378-4019-9e6b-1108d06acd85 admin admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:39:54.782024 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bebcdef-2378-4019-9e6b-1108d06acd85 admin admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:39:54.843318 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5e9306-c257-4582-bcbe-d825bde68f08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:39:54.844012 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5e9306-c257-4582-bcbe-d825bde68f08 admin admin] REQUEST_METHOD: `POST` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:39:54.844288 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5e9306-c257-4582-bcbe-d825bde68f08 admin admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:39:54.844558 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5e9306-c257-4582-bcbe-d825bde68f08 admin admin] PATH_INFO: `/v3/users` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:39:54.845251 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5e9306-c257-4582-bcbe-d825bde68f08 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:39:54.847222 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5e9306-c257-4582-bcbe-d825bde68f08 admin admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:39:54.867855 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 1413/2836] 10.222.0.21 () {60 vars in 1143 bytes} [Wed May 4 07:39:54 2022] POST /identity/v3/users => generated 286 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 07:39:54.872615 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc33490e-98bb-49d5-b209-06209ef7df4a admin admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:39:54.883879 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc33490e-98bb-49d5-b209-06209ef7df4a admin admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:39:54.893453 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ada0b4-9167-414f-9207-b1531cd174ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:39:54.894057 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ada0b4-9167-414f-9207-b1531cd174ed admin admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:39:54.894329 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ada0b4-9167-414f-9207-b1531cd174ed admin admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:39:54.894665 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ada0b4-9167-414f-9207-b1531cd174ed admin admin] PATH_INFO: `/v3/roles` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:39:54.895482 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ada0b4-9167-414f-9207-b1531cd174ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:39:54.897095 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ada0b4-9167-414f-9207-b1531cd174ed admin admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:39:54.909012 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 1424/2837] 10.222.0.21 () {58 vars in 1121 bytes} [Wed May 4 07:39:54 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 04 07:39:54.913276 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5e9306-c257-4582-bcbe-d825bde68f08 admin admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:39:54.927410 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5e9306-c257-4582-bcbe-d825bde68f08 admin admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:39:54.932608 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffdaa2c-30d1-427e-80e8-5b978c98e10b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:39:54.933269 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffdaa2c-30d1-427e-80e8-5b978c98e10b admin admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:39:54.933544 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffdaa2c-30d1-427e-80e8-5b978c98e10b admin admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:39:54.933840 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffdaa2c-30d1-427e-80e8-5b978c98e10b admin admin] PATH_INFO: `/v3/roles` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:39:54.934567 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dffdaa2c-30d1-427e-80e8-5b978c98e10b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:39:54.936212 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dffdaa2c-30d1-427e-80e8-5b978c98e10b admin admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:39:54.946785 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 1414/2838] 10.222.0.21 () {58 vars in 1121 bytes} [Wed May 4 07:39:54 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 04 07:39:54.951228 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ada0b4-9167-414f-9207-b1531cd174ed admin admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:39:54.961507 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ada0b4-9167-414f-9207-b1531cd174ed admin admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:39:54.966893 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a9c971-2039-4252-bee6-be6f314212a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:39:54.967875 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a9c971-2039-4252-bee6-be6f314212a1 admin admin] REQUEST_METHOD: `PUT` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:39:54.968137 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a9c971-2039-4252-bee6-be6f314212a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:39:54.968409 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a9c971-2039-4252-bee6-be6f314212a1 admin admin] PATH_INFO: `/v3/projects/eb7610533d294050b732a473b53cb5d3/users/5149f6c12ddc48379562ddc640a75a10/roles/9f89c07b05a14f18836116af22cba5f6` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:39:54.984610 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a9c971-2039-4252-bee6-be6f314212a1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eb7610533d294050b732a473b53cb5d3, user_id=5149f6c12ddc48379562ddc640a75a10, role_id=9f89c07b05a14f18836116af22cba5f6)` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:39:54.987320 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a9c971-2039-4252-bee6-be6f314212a1 admin admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:39:55.001316 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 1425/2839] 10.222.0.21 () {60 vars in 1482 bytes} [Wed May 4 07:39:54 2022] PUT /identity/v3/projects/eb7610533d294050b732a473b53cb5d3/users/5149f6c12ddc48379562ddc640a75a10/roles/9f89c07b05a14f18836116af22cba5f6 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 07:39:55.006867 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef64aa3-531f-4455-941f-4a663bd233f9 None None] REQUEST_METHOD: `POST` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:39:55.007172 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef64aa3-531f-4455-941f-4a663bd233f9 None None] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:39:55.007454 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef64aa3-531f-4455-941f-4a663bd233f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:39:55.026326 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.auth.core [None req-eef64aa3-531f-4455-941f-4a663bd233f9 None None] MFA Rules not processed for user `83c5e0dcb991496ea6dee38384514508`. Rule list: `[]` (Enabled: `True`). {{(pid=79745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:39:55.027613 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.fernet_utils [None req-eef64aa3-531f-4455-941f-4a663bd233f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:39:55.086811 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 1415/2840] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 07:39:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 07:39:55.098945 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a9c971-2039-4252-bee6-be6f314212a1 admin admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:39:55.100814 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.fernet_utils [None req-f6a9c971-2039-4252-bee6-be6f314212a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:39:55.160713 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a9c971-2039-4252-bee6-be6f314212a1 admin admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:39:55.164395 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de0eef5-b10f-465c-9fd6-045a6543d2ce service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91cb92d00273402b837cb29b37325101', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9f9c44db4984653b8d4b5f6b3b949f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:39:55.165700 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de0eef5-b10f-465c-9fd6-045a6543d2ce service neutron] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:39:55.166208 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de0eef5-b10f-465c-9fd6-045a6543d2ce service neutron] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:39:55.166560 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de0eef5-b10f-465c-9fd6-045a6543d2ce service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:39:55.176998 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de0eef5-b10f-465c-9fd6-045a6543d2ce service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:39:55.178443 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de0eef5-b10f-465c-9fd6-045a6543d2ce service neutron] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:39:55.188956 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 1426/2841] 10.222.0.21 () {60 vars in 1365 bytes} [Wed May 4 07:39:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 07:39:55.817878 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef64aa3-531f-4455-941f-4a663bd233f9 None None] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:39:55.820784 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.fernet_utils [None req-eef64aa3-531f-4455-941f-4a663bd233f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:39:55.822970 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bf604a-87d8-4f7f-b88b-39ee936686b2 None None] REQUEST_METHOD: `POST` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:39:55.823500 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bf604a-87d8-4f7f-b88b-39ee936686b2 None None] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:39:55.823604 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bf604a-87d8-4f7f-b88b-39ee936686b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:39:55.853608 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.auth.core [None req-b1bf604a-87d8-4f7f-b88b-39ee936686b2 None None] MFA Rules not processed for user `5149f6c12ddc48379562ddc640a75a10`. Rule list: `[]` (Enabled: `True`). {{(pid=79744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:39:55.855362 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.fernet_utils [None req-b1bf604a-87d8-4f7f-b88b-39ee936686b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:39:55.896178 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef64aa3-531f-4455-941f-4a663bd233f9 None None] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:39:55.900683 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0dc54b-8c6f-4cc7-836e-10087f937696 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb341257aa8246b6847561e2fe1fa385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9f9c44db4984653b8d4b5f6b3b949f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:39:55.901547 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0dc54b-8c6f-4cc7-836e-10087f937696 service cinder] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:39:55.903029 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0dc54b-8c6f-4cc7-836e-10087f937696 service cinder] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:39:55.903343 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0dc54b-8c6f-4cc7-836e-10087f937696 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:39:55.906212 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.fernet_utils [None req-7d0dc54b-8c6f-4cc7-836e-10087f937696 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:39:55.931966 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 1427/2842] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 07:39:55 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 07:39:55.947760 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bf604a-87d8-4f7f-b88b-39ee936686b2 None None] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:39:55.949236 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.fernet_utils [None req-b1bf604a-87d8-4f7f-b88b-39ee936686b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:39:55.963643 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bf604a-87d8-4f7f-b88b-39ee936686b2 None None] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:39:55.967491 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be370e2d-5b45-4c08-8200-518414c641f1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb341257aa8246b6847561e2fe1fa385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9f9c44db4984653b8d4b5f6b3b949f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:39:55.968236 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be370e2d-5b45-4c08-8200-518414c641f1 service cinder] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:39:55.968757 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be370e2d-5b45-4c08-8200-518414c641f1 service cinder] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:39:55.969001 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be370e2d-5b45-4c08-8200-518414c641f1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:39:55.984155 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be370e2d-5b45-4c08-8200-518414c641f1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:39:55.986870 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be370e2d-5b45-4c08-8200-518414c641f1 service cinder] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:39:55.987652 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0dc54b-8c6f-4cc7-836e-10087f937696 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:39:55.989719 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0dc54b-8c6f-4cc7-836e-10087f937696 service cinder] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:39:56.002252 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 1428/2843] 10.222.0.21 () {60 vars in 1365 bytes} [Wed May 4 07:39:55 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 04 07:39:56.004716 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 1416/2844] 10.222.0.21 () {60 vars in 1365 bytes} [Wed May 4 07:39:55 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 04 07:40:01.633073 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855be939-c7e9-45f7-8684-63b148d9fb8e None None] REQUEST_METHOD: `POST` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:40:01.633713 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855be939-c7e9-45f7-8684-63b148d9fb8e None None] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:40:01.633713 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855be939-c7e9-45f7-8684-63b148d9fb8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:40:01.653271 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.auth.core [None req-855be939-c7e9-45f7-8684-63b148d9fb8e None None] MFA Rules not processed for user `5149f6c12ddc48379562ddc640a75a10`. Rule list: `[]` (Enabled: `True`). {{(pid=79744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:40:01.654498 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.fernet_utils [None req-855be939-c7e9-45f7-8684-63b148d9fb8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:40:01.661419 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 1429/2845] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 07:40:01 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 07:40:02.477837 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0dc54b-8c6f-4cc7-836e-10087f937696 service cinder] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:40:02.479400 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.fernet_utils [None req-7d0dc54b-8c6f-4cc7-836e-10087f937696 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:40:02.555338 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0dc54b-8c6f-4cc7-836e-10087f937696 service cinder] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:40:02.561338 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b4c16a-a291-41c0-8ced-b9b517e1883f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef28e980e8664d3eba4304e4589ea2df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9f9c44db4984653b8d4b5f6b3b949f5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:40:02.561978 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b4c16a-a291-41c0-8ced-b9b517e1883f service placement] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:40:02.562255 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b4c16a-a291-41c0-8ced-b9b517e1883f service placement] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:40:02.562525 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b4c16a-a291-41c0-8ced-b9b517e1883f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:40:02.564505 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.fernet_utils [None req-51b4c16a-a291-41c0-8ced-b9b517e1883f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:40:02.578687 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b4c16a-a291-41c0-8ced-b9b517e1883f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:40:02.580389 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b4c16a-a291-41c0-8ced-b9b517e1883f service placement] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:40:02.592273 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 1417/2846] 10.222.0.21 () {60 vars in 1365 bytes} [Wed May 4 07:40:02 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 07:40:04.278236 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855be939-c7e9-45f7-8684-63b148d9fb8e None None] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:40:04.288183 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855be939-c7e9-45f7-8684-63b148d9fb8e None None] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:40:04.292660 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0143e6d-bb32-4fed-9f90-d065d9539122 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91cb92d00273402b837cb29b37325101', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9f9c44db4984653b8d4b5f6b3b949f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:40:04.293313 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0143e6d-bb32-4fed-9f90-d065d9539122 service neutron] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:40:04.293613 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0143e6d-bb32-4fed-9f90-d065d9539122 service neutron] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:40:04.293888 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0143e6d-bb32-4fed-9f90-d065d9539122 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:40:04.295892 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.fernet_utils [None req-c0143e6d-bb32-4fed-9f90-d065d9539122 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:40:04.306532 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0143e6d-bb32-4fed-9f90-d065d9539122 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:40:04.308006 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0143e6d-bb32-4fed-9f90-d065d9539122 service neutron] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:40:04.316874 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 1430/2847] 10.222.0.21 () {60 vars in 1365 bytes} [Wed May 4 07:40:04 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 07:40:06.051476 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ba56ca-1d98-426e-8917-5360c30aefd1 None None] REQUEST_METHOD: `POST` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:40:06.052021 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ba56ca-1d98-426e-8917-5360c30aefd1 None None] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:40:06.052021 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ba56ca-1d98-426e-8917-5360c30aefd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:40:06.070723 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.auth.core [None req-b4ba56ca-1d98-426e-8917-5360c30aefd1 None None] MFA Rules not processed for user `098825a2c57749299ee5b9e083dab0d2`. Rule list: `[]` (Enabled: `True`). {{(pid=79745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:40:06.072523 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.fernet_utils [None req-b4ba56ca-1d98-426e-8917-5360c30aefd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:40:06.079415 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 1418/2848] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 07:40:06 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 07:40:10.174782 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0143e6d-bb32-4fed-9f90-d065d9539122 service neutron] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:40:10.176273 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.fernet_utils [None req-c0143e6d-bb32-4fed-9f90-d065d9539122 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:40:10.277751 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0143e6d-bb32-4fed-9f90-d065d9539122 service neutron] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:40:10.286581 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0d4a8b-c91d-4dbc-94fe-a623cb87b74c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1077289fedae43b6be47be7f716d573a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9f9c44db4984653b8d4b5f6b3b949f5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:40:10.287437 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0d4a8b-c91d-4dbc-94fe-a623cb87b74c service nova] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:40:10.287734 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0d4a8b-c91d-4dbc-94fe-a623cb87b74c service nova] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:40:10.288016 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0d4a8b-c91d-4dbc-94fe-a623cb87b74c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:40:10.290776 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.fernet_utils [None req-6d0d4a8b-c91d-4dbc-94fe-a623cb87b74c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:40:10.304417 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0d4a8b-c91d-4dbc-94fe-a623cb87b74c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:40:10.306862 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0d4a8b-c91d-4dbc-94fe-a623cb87b74c service nova] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:40:10.320339 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 1431/2849] 10.222.0.21 () {60 vars in 1365 bytes} [Wed May 4 07:40:10 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 07:40:19.973839 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e857e0c8-0796-4f23-b25d-6a9e26c857ff None None] REQUEST_METHOD: `POST` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:40:19.974407 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e857e0c8-0796-4f23-b25d-6a9e26c857ff None None] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:40:19.974407 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e857e0c8-0796-4f23-b25d-6a9e26c857ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:40:19.991752 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.auth.core [None req-e857e0c8-0796-4f23-b25d-6a9e26c857ff None None] MFA Rules not processed for user `5149f6c12ddc48379562ddc640a75a10`. Rule list: `[]` (Enabled: `True`). {{(pid=79745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:40:19.992960 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.fernet_utils [None req-e857e0c8-0796-4f23-b25d-6a9e26c857ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:40:19.999973 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 1419/2850] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 07:40:19 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 07:40:23.506214 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0d4a8b-c91d-4dbc-94fe-a623cb87b74c service nova] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:40:23.508655 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.fernet_utils [None req-6d0d4a8b-c91d-4dbc-94fe-a623cb87b74c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:40:23.520319 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0d4a8b-c91d-4dbc-94fe-a623cb87b74c service nova] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:40:23.523902 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac6841a-6e8a-425c-923d-fdfb5c340d53 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91cb92d00273402b837cb29b37325101', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9f9c44db4984653b8d4b5f6b3b949f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:40:23.524704 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac6841a-6e8a-425c-923d-fdfb5c340d53 service neutron] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:40:23.524982 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac6841a-6e8a-425c-923d-fdfb5c340d53 service neutron] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:40:23.525253 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac6841a-6e8a-425c-923d-fdfb5c340d53 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:40:23.526979 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.fernet_utils [None req-3ac6841a-6e8a-425c-923d-fdfb5c340d53 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:40:23.595619 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac6841a-6e8a-425c-923d-fdfb5c340d53 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:40:23.597077 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac6841a-6e8a-425c-923d-fdfb5c340d53 service neutron] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:40:23.613113 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 1432/2851] 10.222.0.21 () {60 vars in 1365 bytes} [Wed May 4 07:40:23 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 07:40:25.615187 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e857e0c8-0796-4f23-b25d-6a9e26c857ff None None] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:40:25.616586 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.fernet_utils [None req-e857e0c8-0796-4f23-b25d-6a9e26c857ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:40:25.633351 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e857e0c8-0796-4f23-b25d-6a9e26c857ff None None] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:40:25.638784 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92f03d0-e77f-4bec-885d-d5ef105bad96 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1077289fedae43b6be47be7f716d573a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9f9c44db4984653b8d4b5f6b3b949f5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:40:25.639537 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92f03d0-e77f-4bec-885d-d5ef105bad96 service nova] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:40:25.639816 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92f03d0-e77f-4bec-885d-d5ef105bad96 service nova] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:40:25.640083 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92f03d0-e77f-4bec-885d-d5ef105bad96 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:40:25.641826 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.fernet_utils [None req-a92f03d0-e77f-4bec-885d-d5ef105bad96 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:40:25.654418 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92f03d0-e77f-4bec-885d-d5ef105bad96 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:40:25.656041 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92f03d0-e77f-4bec-885d-d5ef105bad96 service nova] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:40:25.667705 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 1420/2852] 10.222.0.21 () {60 vars in 1365 bytes} [Wed May 4 07:40:25 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 07:40:44.272036 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c023f7-e873-4d38-84e3-71bc57a5c21b None None] REQUEST_METHOD: `POST` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:40:44.272522 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c023f7-e873-4d38-84e3-71bc57a5c21b None None] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:40:44.272634 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c023f7-e873-4d38-84e3-71bc57a5c21b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:40:44.330327 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.auth.core [None req-16c023f7-e873-4d38-84e3-71bc57a5c21b None None] MFA Rules not processed for user `704cdbc22849413baa4e0189947ebebc`. Rule list: `[]` (Enabled: `True`). {{(pid=79744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:40:44.331580 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.fernet_utils [None req-16c023f7-e873-4d38-84e3-71bc57a5c21b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:40:44.395784 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 1433/2853] 10.222.0.21 () {58 vars in 1009 bytes} [Wed May 4 07:40:44 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 07:40:44.441447 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92f03d0-e77f-4bec-885d-d5ef105bad96 service nova] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:40:44.442852 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.fernet_utils [None req-a92f03d0-e77f-4bec-885d-d5ef105bad96 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:40:44.532248 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92f03d0-e77f-4bec-885d-d5ef105bad96 service nova] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:40:44.537349 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d40f63-53af-4eb6-a306-e80cf3ded1ef service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '084c9245d1da4e698c9c3945fa089e85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9f9c44db4984653b8d4b5f6b3b949f5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:40:44.537983 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d40f63-53af-4eb6-a306-e80cf3ded1ef service swift] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:40:44.538263 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d40f63-53af-4eb6-a306-e80cf3ded1ef service swift] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:40:44.538535 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d40f63-53af-4eb6-a306-e80cf3ded1ef service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:40:44.546737 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d40f63-53af-4eb6-a306-e80cf3ded1ef service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:40:44.548363 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d40f63-53af-4eb6-a306-e80cf3ded1ef service swift] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:40:44.556857 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 1421/2854] 10.222.0.21 () {60 vars in 1384 bytes} [Wed May 4 07:40:44 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 04 07:40:58.970966 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a66115-f0cd-497c-b130-867f41af5080 None None] REQUEST_METHOD: `POST` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:40:58.971504 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a66115-f0cd-497c-b130-867f41af5080 None None] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:40:58.971612 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a66115-f0cd-497c-b130-867f41af5080 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:40:58.989474 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.auth.core [None req-11a66115-f0cd-497c-b130-867f41af5080 None None] MFA Rules not processed for user `704cdbc22849413baa4e0189947ebebc`. Rule list: `[]` (Enabled: `True`). {{(pid=79744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:40:58.990686 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.fernet_utils [None req-11a66115-f0cd-497c-b130-867f41af5080 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:40:58.998589 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 1434/2855] 10.222.0.21 () {58 vars in 967 bytes} [Wed May 4 07:40:58 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 07:40:59.010963 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d40f63-53af-4eb6-a306-e80cf3ded1ef service swift] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:40:59.024277 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d40f63-53af-4eb6-a306-e80cf3ded1ef service swift] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:40:59.029618 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa80a86-2231-41d6-b488-e0343632d981 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '084c9245d1da4e698c9c3945fa089e85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9f9c44db4984653b8d4b5f6b3b949f5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:40:59.030290 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa80a86-2231-41d6-b488-e0343632d981 service swift] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:40:59.030573 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa80a86-2231-41d6-b488-e0343632d981 service swift] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:40:59.030847 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa80a86-2231-41d6-b488-e0343632d981 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:40:59.040389 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa80a86-2231-41d6-b488-e0343632d981 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:40:59.041961 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa80a86-2231-41d6-b488-e0343632d981 service swift] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:40:59.049915 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 1422/2856] 10.222.0.21 () {60 vars in 1384 bytes} [Wed May 4 07:40:59 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 04 07:41:01.230337 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a66115-f0cd-497c-b130-867f41af5080 None None] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:41:01.246968 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a66115-f0cd-497c-b130-867f41af5080 None None] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:41:01.251938 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d826cb-82e5-4de6-9da0-985e59b5fe9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:41:01.252804 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d826cb-82e5-4de6-9da0-985e59b5fe9e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:41:01.253076 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d826cb-82e5-4de6-9da0-985e59b5fe9e admin admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:41:01.253352 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d826cb-82e5-4de6-9da0-985e59b5fe9e admin admin] PATH_INFO: `/v3/users/5149f6c12ddc48379562ddc640a75a10` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:41:01.254529 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d826cb-82e5-4de6-9da0-985e59b5fe9e admin admin] RBAC: Authorizing `identity:delete_user(user_id=5149f6c12ddc48379562ddc640a75a10)` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:41:01.256480 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d826cb-82e5-4de6-9da0-985e59b5fe9e admin admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:41:01.303293 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-80d826cb-82e5-4de6-9da0-985e59b5fe9e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5149f6c12ddc48379562ddc640a75a10'} {{(pid=79744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:41:01.303959 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-80d826cb-82e5-4de6-9da0-985e59b5fe9e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5149f6c12ddc48379562ddc640a75a10'} {{(pid=79744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:41:01.310827 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-80d826cb-82e5-4de6-9da0-985e59b5fe9e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5149f6c12ddc48379562ddc640a75a10'} {{(pid=79744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:41:01.311503 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-80d826cb-82e5-4de6-9da0-985e59b5fe9e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5149f6c12ddc48379562ddc640a75a10'} {{(pid=79744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:41:01.323415 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-80d826cb-82e5-4de6-9da0-985e59b5fe9e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5149f6c12ddc48379562ddc640a75a10'} {{(pid=79744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:41:01.336624 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 1435/2857] 10.222.0.21 () {58 vars in 1223 bytes} [Wed May 4 07:41:01 2022] DELETE /identity/v3/users/5149f6c12ddc48379562ddc640a75a10 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 07:41:01.501746 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa80a86-2231-41d6-b488-e0343632d981 service swift] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:41:01.515393 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa80a86-2231-41d6-b488-e0343632d981 service swift] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:41:01.579083 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f917963e-ed8b-42f3-9694-a26124501d4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:41:01.579872 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f917963e-ed8b-42f3-9694-a26124501d4a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:41:01.580155 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f917963e-ed8b-42f3-9694-a26124501d4a admin admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:41:01.580456 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f917963e-ed8b-42f3-9694-a26124501d4a admin admin] PATH_INFO: `/v3/projects/eb7610533d294050b732a473b53cb5d3` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:41:01.581663 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f917963e-ed8b-42f3-9694-a26124501d4a admin admin] RBAC: Authorizing `identity:delete_project(project_id=eb7610533d294050b732a473b53cb5d3)` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:41:01.583678 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f917963e-ed8b-42f3-9694-a26124501d4a admin admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:41:01.647112 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-f917963e-ed8b-42f3-9694-a26124501d4a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eb7610533d294050b732a473b53cb5d3', 'request_id': 'req-f917963e-ed8b-42f3-9694-a26124501d4a'} {{(pid=79745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:41:01.656324 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-f917963e-ed8b-42f3-9694-a26124501d4a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eb7610533d294050b732a473b53cb5d3', 'request_id': 'req-f917963e-ed8b-42f3-9694-a26124501d4a'} {{(pid=79745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:41:01.663580 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-f917963e-ed8b-42f3-9694-a26124501d4a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eb7610533d294050b732a473b53cb5d3', 'request_id': 'req-f917963e-ed8b-42f3-9694-a26124501d4a'} {{(pid=79745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:41:01.674221 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-f917963e-ed8b-42f3-9694-a26124501d4a admin admin] The token cache is being invalidate because project eb7610533d294050b732a473b53cb5d3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79745) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 07:41:01.674508 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-f917963e-ed8b-42f3-9694-a26124501d4a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:41:01.675240 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-f917963e-ed8b-42f3-9694-a26124501d4a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:41:01.677009 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 1423/2858] 10.222.0.21 () {58 vars in 1232 bytes} [Wed May 4 07:41:01 2022] DELETE /identity/v3/projects/eb7610533d294050b732a473b53cb5d3 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 07:41:01.682581 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fde3f07-8f9a-4075-b731-795338c322e7 None None] REQUEST_METHOD: `POST` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:41:01.682861 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fde3f07-8f9a-4075-b731-795338c322e7 None None] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:41:01.683136 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fde3f07-8f9a-4075-b731-795338c322e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:41:01.702823 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.auth.core [None req-5fde3f07-8f9a-4075-b731-795338c322e7 None None] MFA Rules not processed for user `83c5e0dcb991496ea6dee38384514508`. Rule list: `[]` (Enabled: `True`). {{(pid=79744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:41:01.704185 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.fernet_utils [None req-5fde3f07-8f9a-4075-b731-795338c322e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:41:01.773476 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 1436/2859] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 07:41:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 07:41:01.781144 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0b6cee-41a1-4204-9f0e-cd8af659cb9d None None] REQUEST_METHOD: `POST` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:41:01.781431 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0b6cee-41a1-4204-9f0e-cd8af659cb9d None None] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:41:01.781714 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0b6cee-41a1-4204-9f0e-cd8af659cb9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:41:01.800228 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.auth.core [None req-cc0b6cee-41a1-4204-9f0e-cd8af659cb9d None None] MFA Rules not processed for user `83c5e0dcb991496ea6dee38384514508`. Rule list: `[]` (Enabled: `True`). {{(pid=79745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:41:01.801435 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.fernet_utils [None req-cc0b6cee-41a1-4204-9f0e-cd8af659cb9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:41:01.810430 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 1424/2860] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 07:41:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 07:41:01.814946 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fde3f07-8f9a-4075-b731-795338c322e7 None None] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:41:01.825894 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fde3f07-8f9a-4075-b731-795338c322e7 None None] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:41:01.830483 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1622ec50-bce1-492e-a5a5-465c03a0a8f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:41:01.831072 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1622ec50-bce1-492e-a5a5-465c03a0a8f4 admin admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:41:01.831393 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1622ec50-bce1-492e-a5a5-465c03a0a8f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:41:01.831668 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1622ec50-bce1-492e-a5a5-465c03a0a8f4 admin admin] PATH_INFO: `/v3/domains` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:41:01.832393 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1622ec50-bce1-492e-a5a5-465c03a0a8f4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79744) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 07:41:01.832695 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1622ec50-bce1-492e-a5a5-465c03a0a8f4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:41:01.834269 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1622ec50-bce1-492e-a5a5-465c03a0a8f4 admin admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:41:01.846340 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 1437/2861] 10.222.0.21 () {58 vars in 1152 bytes} [Wed May 4 07:41:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 07:41:01.851198 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0b6cee-41a1-4204-9f0e-cd8af659cb9d None None] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:41:01.860572 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0b6cee-41a1-4204-9f0e-cd8af659cb9d None None] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:41:01.865518 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59003253-aac9-467c-81df-55eb896fae75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:41:01.866720 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59003253-aac9-467c-81df-55eb896fae75 admin admin] REQUEST_METHOD: `POST` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:41:01.867016 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59003253-aac9-467c-81df-55eb896fae75 admin admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:41:01.867294 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59003253-aac9-467c-81df-55eb896fae75 admin admin] PATH_INFO: `/v3/projects` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:41:01.867983 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59003253-aac9-467c-81df-55eb896fae75 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:41:01.869919 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59003253-aac9-467c-81df-55eb896fae75 admin admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:41:01.906377 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 1425/2862] 10.222.0.21 () {60 vars in 1152 bytes} [Wed May 4 07:41:01 2022] POST /identity/v3/projects => generated 373 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 07:41:01.910565 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1622ec50-bce1-492e-a5a5-465c03a0a8f4 admin admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:41:01.921167 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1622ec50-bce1-492e-a5a5-465c03a0a8f4 admin admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:41:01.978950 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707f68a2-96b9-4fc5-8187-da48fe67cddb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:41:01.979644 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707f68a2-96b9-4fc5-8187-da48fe67cddb admin admin] REQUEST_METHOD: `POST` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:41:01.979921 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707f68a2-96b9-4fc5-8187-da48fe67cddb admin admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:41:01.980190 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707f68a2-96b9-4fc5-8187-da48fe67cddb admin admin] PATH_INFO: `/v3/users` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:41:01.980915 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707f68a2-96b9-4fc5-8187-da48fe67cddb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:41:01.982825 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707f68a2-96b9-4fc5-8187-da48fe67cddb admin admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:41:02.004557 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 1438/2863] 10.222.0.21 () {60 vars in 1143 bytes} [Wed May 4 07:41:01 2022] POST /identity/v3/users => generated 287 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 07:41:02.008107 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59003253-aac9-467c-81df-55eb896fae75 admin admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:41:02.018469 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59003253-aac9-467c-81df-55eb896fae75 admin admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:41:02.023478 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6c1e2b-d799-4acd-a6cf-978a3476b80a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:41:02.024140 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6c1e2b-d799-4acd-a6cf-978a3476b80a admin admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:41:02.024429 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6c1e2b-d799-4acd-a6cf-978a3476b80a admin admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:41:02.024713 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6c1e2b-d799-4acd-a6cf-978a3476b80a admin admin] PATH_INFO: `/v3/roles` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:41:02.025576 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6c1e2b-d799-4acd-a6cf-978a3476b80a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:41:02.027199 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6c1e2b-d799-4acd-a6cf-978a3476b80a admin admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:41:02.037258 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 1426/2864] 10.222.0.21 () {58 vars in 1121 bytes} [Wed May 4 07:41:02 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 07:41:02.042003 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707f68a2-96b9-4fc5-8187-da48fe67cddb admin admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:41:02.057018 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707f68a2-96b9-4fc5-8187-da48fe67cddb admin admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:41:02.062264 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebf2c31-429c-49ad-87d7-d99b2d0a17a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:41:02.062935 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebf2c31-429c-49ad-87d7-d99b2d0a17a7 admin admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:41:02.063249 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebf2c31-429c-49ad-87d7-d99b2d0a17a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:41:02.063517 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebf2c31-429c-49ad-87d7-d99b2d0a17a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:41:02.064245 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ebf2c31-429c-49ad-87d7-d99b2d0a17a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:41:02.065841 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ebf2c31-429c-49ad-87d7-d99b2d0a17a7 admin admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:41:02.076707 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 1439/2865] 10.222.0.21 () {58 vars in 1121 bytes} [Wed May 4 07:41:02 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 07:41:02.081007 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6c1e2b-d799-4acd-a6cf-978a3476b80a admin admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:41:02.091343 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6c1e2b-d799-4acd-a6cf-978a3476b80a admin admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:41:02.097581 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c84c25-8d3b-4ee3-9df4-57d576334ce4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:41:02.099603 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c84c25-8d3b-4ee3-9df4-57d576334ce4 admin admin] REQUEST_METHOD: `PUT` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:41:02.099900 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c84c25-8d3b-4ee3-9df4-57d576334ce4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:41:02.100171 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c84c25-8d3b-4ee3-9df4-57d576334ce4 admin admin] PATH_INFO: `/v3/projects/b3cf2caab1e340ca8306f2e9214e2340/users/d5293f07c43d454a8bed93d69eb55b9e/roles/9f89c07b05a14f18836116af22cba5f6` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:41:02.118511 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c84c25-8d3b-4ee3-9df4-57d576334ce4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b3cf2caab1e340ca8306f2e9214e2340, user_id=d5293f07c43d454a8bed93d69eb55b9e, role_id=9f89c07b05a14f18836116af22cba5f6)` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:41:02.121180 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c84c25-8d3b-4ee3-9df4-57d576334ce4 admin admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:41:02.134384 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 1427/2866] 10.222.0.21 () {60 vars in 1482 bytes} [Wed May 4 07:41:02 2022] PUT /identity/v3/projects/b3cf2caab1e340ca8306f2e9214e2340/users/d5293f07c43d454a8bed93d69eb55b9e/roles/9f89c07b05a14f18836116af22cba5f6 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 07:41:02.145650 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e242f9f1-6585-4a65-91c0-4bbabdc115f1 None None] REQUEST_METHOD: `POST` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:41:02.145944 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e242f9f1-6585-4a65-91c0-4bbabdc115f1 None None] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:41:02.146220 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e242f9f1-6585-4a65-91c0-4bbabdc115f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:41:02.173181 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.auth.core [None req-e242f9f1-6585-4a65-91c0-4bbabdc115f1 None None] MFA Rules not processed for user `d5293f07c43d454a8bed93d69eb55b9e`. Rule list: `[]` (Enabled: `True`). {{(pid=79744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:41:02.174412 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.fernet_utils [None req-e242f9f1-6585-4a65-91c0-4bbabdc115f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:41:02.238869 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 1440/2867] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 07:41:02 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 07:41:02.249797 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c84c25-8d3b-4ee3-9df4-57d576334ce4 admin admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:41:02.251822 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.fernet_utils [None req-c8c84c25-8d3b-4ee3-9df4-57d576334ce4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:41:02.307250 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c84c25-8d3b-4ee3-9df4-57d576334ce4 admin admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:41:02.310909 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6e5e55-cca9-4669-8768-0e02379f4225 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb341257aa8246b6847561e2fe1fa385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9f9c44db4984653b8d4b5f6b3b949f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:41:02.311580 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6e5e55-cca9-4669-8768-0e02379f4225 service cinder] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:41:02.311861 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6e5e55-cca9-4669-8768-0e02379f4225 service cinder] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:41:02.312135 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6e5e55-cca9-4669-8768-0e02379f4225 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:41:02.320535 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6e5e55-cca9-4669-8768-0e02379f4225 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:41:02.321953 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6e5e55-cca9-4669-8768-0e02379f4225 service cinder] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:41:02.331253 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 1428/2868] 10.222.0.21 () {60 vars in 1365 bytes} [Wed May 4 07:41:02 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 07:41:03.694747 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19483586-2aa6-4fb5-94d3-ae6fbbfb7f0e None None] REQUEST_METHOD: `POST` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:41:03.695725 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19483586-2aa6-4fb5-94d3-ae6fbbfb7f0e None None] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:41:03.696015 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19483586-2aa6-4fb5-94d3-ae6fbbfb7f0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:41:03.714645 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.auth.core [None req-19483586-2aa6-4fb5-94d3-ae6fbbfb7f0e None None] MFA Rules not processed for user `d5293f07c43d454a8bed93d69eb55b9e`. Rule list: `[]` (Enabled: `True`). {{(pid=79744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:41:03.715805 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.fernet_utils [None req-19483586-2aa6-4fb5-94d3-ae6fbbfb7f0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:41:03.722867 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 1441/2869] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 07:41:03 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 07:41:19.658167 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d70c18f-2f00-46a6-9d5e-37c0a4381fba None None] REQUEST_METHOD: `POST` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:41:19.658952 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d70c18f-2f00-46a6-9d5e-37c0a4381fba None None] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:41:19.658952 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d70c18f-2f00-46a6-9d5e-37c0a4381fba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:41:19.677456 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.auth.core [None req-0d70c18f-2f00-46a6-9d5e-37c0a4381fba None None] MFA Rules not processed for user `704cdbc22849413baa4e0189947ebebc`. Rule list: `[]` (Enabled: `True`). {{(pid=79745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:41:19.679463 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.fernet_utils [None req-0d70c18f-2f00-46a6-9d5e-37c0a4381fba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:41:19.732721 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 1429/2870] 10.222.0.21 () {58 vars in 1009 bytes} [Wed May 4 07:41:19 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 07:41:19.745340 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19483586-2aa6-4fb5-94d3-ae6fbbfb7f0e None None] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:41:19.746792 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.fernet_utils [None req-19483586-2aa6-4fb5-94d3-ae6fbbfb7f0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:41:19.818204 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19483586-2aa6-4fb5-94d3-ae6fbbfb7f0e None None] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:41:19.826701 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03039cd2-6c37-4bc2-b828-02521ed7046b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '084c9245d1da4e698c9c3945fa089e85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9f9c44db4984653b8d4b5f6b3b949f5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:41:19.827683 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03039cd2-6c37-4bc2-b828-02521ed7046b service swift] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:41:19.827967 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03039cd2-6c37-4bc2-b828-02521ed7046b service swift] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:41:19.828242 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03039cd2-6c37-4bc2-b828-02521ed7046b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:41:19.837472 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03039cd2-6c37-4bc2-b828-02521ed7046b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:41:19.839048 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03039cd2-6c37-4bc2-b828-02521ed7046b service swift] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:41:19.846904 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 1442/2871] 10.222.0.21 () {60 vars in 1384 bytes} [Wed May 4 07:41:19 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 04 07:41:20.348417 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87184e0-0c2c-41ba-98c5-f5a82b241c93 None None] REQUEST_METHOD: `POST` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:41:20.348688 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87184e0-0c2c-41ba-98c5-f5a82b241c93 None None] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:41:20.348970 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87184e0-0c2c-41ba-98c5-f5a82b241c93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:41:20.368507 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.auth.core [None req-f87184e0-0c2c-41ba-98c5-f5a82b241c93 None None] MFA Rules not processed for user `704cdbc22849413baa4e0189947ebebc`. Rule list: `[]` (Enabled: `True`). {{(pid=79745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:41:20.369716 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.fernet_utils [None req-f87184e0-0c2c-41ba-98c5-f5a82b241c93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:41:20.377237 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 1430/2872] 10.222.0.21 () {58 vars in 967 bytes} [Wed May 4 07:41:20 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 07:41:20.389936 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03039cd2-6c37-4bc2-b828-02521ed7046b service swift] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:41:20.400926 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03039cd2-6c37-4bc2-b828-02521ed7046b service swift] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:41:20.407877 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0893f149-7268-4edb-9d02-d32a12c29d48 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '084c9245d1da4e698c9c3945fa089e85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9f9c44db4984653b8d4b5f6b3b949f5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:41:20.408510 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0893f149-7268-4edb-9d02-d32a12c29d48 service swift] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:41:20.408785 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0893f149-7268-4edb-9d02-d32a12c29d48 service swift] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:41:20.409056 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0893f149-7268-4edb-9d02-d32a12c29d48 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:41:20.417302 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0893f149-7268-4edb-9d02-d32a12c29d48 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:41:20.418861 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0893f149-7268-4edb-9d02-d32a12c29d48 service swift] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:41:20.426711 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 1443/2873] 10.222.0.21 () {60 vars in 1384 bytes} [Wed May 4 07:41:20 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 04 07:41:20.618584 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadd5375-385f-434c-a6b3-b55385b2a115 None None] REQUEST_METHOD: `POST` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:41:20.618952 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadd5375-385f-434c-a6b3-b55385b2a115 None None] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:41:20.619267 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadd5375-385f-434c-a6b3-b55385b2a115 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:41:20.637527 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.auth.core [None req-fadd5375-385f-434c-a6b3-b55385b2a115 None None] MFA Rules not processed for user `704cdbc22849413baa4e0189947ebebc`. Rule list: `[]` (Enabled: `True`). {{(pid=79745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:41:20.638701 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.fernet_utils [None req-fadd5375-385f-434c-a6b3-b55385b2a115 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:41:20.645858 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 1431/2874] 10.222.0.21 () {58 vars in 1009 bytes} [Wed May 4 07:41:20 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 07:41:20.658597 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0893f149-7268-4edb-9d02-d32a12c29d48 service swift] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:41:20.669193 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0893f149-7268-4edb-9d02-d32a12c29d48 service swift] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:41:20.674124 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f017463-8f1c-4f30-be34-307a0b591358 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '084c9245d1da4e698c9c3945fa089e85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9f9c44db4984653b8d4b5f6b3b949f5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:41:20.674770 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f017463-8f1c-4f30-be34-307a0b591358 service swift] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:41:20.675041 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f017463-8f1c-4f30-be34-307a0b591358 service swift] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:41:20.675357 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f017463-8f1c-4f30-be34-307a0b591358 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:41:20.683695 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f017463-8f1c-4f30-be34-307a0b591358 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:41:20.685253 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f017463-8f1c-4f30-be34-307a0b591358 service swift] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:41:20.693102 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 1444/2875] 10.222.0.21 () {60 vars in 1384 bytes} [Wed May 4 07:41:20 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 04 07:41:21.015588 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48a6910-b4a5-40af-bee3-46071387cd92 None None] REQUEST_METHOD: `POST` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:41:21.016101 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48a6910-b4a5-40af-bee3-46071387cd92 None None] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:41:21.016230 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48a6910-b4a5-40af-bee3-46071387cd92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:41:21.034288 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.auth.core [None req-c48a6910-b4a5-40af-bee3-46071387cd92 None None] MFA Rules not processed for user `704cdbc22849413baa4e0189947ebebc`. Rule list: `[]` (Enabled: `True`). {{(pid=79745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:41:21.035521 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.fernet_utils [None req-c48a6910-b4a5-40af-bee3-46071387cd92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:41:21.042836 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 1432/2876] 10.222.0.21 () {58 vars in 967 bytes} [Wed May 4 07:41:21 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 07:41:21.055687 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f017463-8f1c-4f30-be34-307a0b591358 service swift] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:41:21.067637 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f017463-8f1c-4f30-be34-307a0b591358 service swift] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:41:21.073882 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8bb902-85f0-4213-92fb-322ffb26a657 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '084c9245d1da4e698c9c3945fa089e85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9f9c44db4984653b8d4b5f6b3b949f5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:41:21.074963 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8bb902-85f0-4213-92fb-322ffb26a657 service swift] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:41:21.075277 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8bb902-85f0-4213-92fb-322ffb26a657 service swift] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:41:21.075594 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8bb902-85f0-4213-92fb-322ffb26a657 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:41:21.084233 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8bb902-85f0-4213-92fb-322ffb26a657 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:41:21.085814 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8bb902-85f0-4213-92fb-322ffb26a657 service swift] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:41:21.094352 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 1445/2877] 10.222.0.21 () {60 vars in 1384 bytes} [Wed May 4 07:41:21 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 04 07:41:23.155023 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48a6910-b4a5-40af-bee3-46071387cd92 None None] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:41:23.216380 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48a6910-b4a5-40af-bee3-46071387cd92 None None] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:41:23.219954 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd1c667-cb31-4be6-a790-ceb47aee399d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:41:23.220828 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd1c667-cb31-4be6-a790-ceb47aee399d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:41:23.221123 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd1c667-cb31-4be6-a790-ceb47aee399d admin admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:41:23.221394 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd1c667-cb31-4be6-a790-ceb47aee399d admin admin] PATH_INFO: `/v3/users/d5293f07c43d454a8bed93d69eb55b9e` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:41:23.222805 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd1c667-cb31-4be6-a790-ceb47aee399d admin admin] RBAC: Authorizing `identity:delete_user(user_id=d5293f07c43d454a8bed93d69eb55b9e)` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:41:23.225347 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd1c667-cb31-4be6-a790-ceb47aee399d admin admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:41:23.275702 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-3fd1c667-cb31-4be6-a790-ceb47aee399d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd5293f07c43d454a8bed93d69eb55b9e'} {{(pid=79745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:41:23.286782 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-3fd1c667-cb31-4be6-a790-ceb47aee399d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd5293f07c43d454a8bed93d69eb55b9e'} {{(pid=79745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:41:23.287490 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-3fd1c667-cb31-4be6-a790-ceb47aee399d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd5293f07c43d454a8bed93d69eb55b9e'} {{(pid=79745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:41:23.288100 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-3fd1c667-cb31-4be6-a790-ceb47aee399d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd5293f07c43d454a8bed93d69eb55b9e'} {{(pid=79745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:41:23.294509 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-3fd1c667-cb31-4be6-a790-ceb47aee399d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd5293f07c43d454a8bed93d69eb55b9e'} {{(pid=79745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:41:23.307216 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 1433/2878] 10.222.0.21 () {58 vars in 1223 bytes} [Wed May 4 07:41:23 2022] DELETE /identity/v3/users/d5293f07c43d454a8bed93d69eb55b9e => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 07:41:23.311673 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b18678-4bf8-4986-95b5-a1c6702d5bf5 None None] REQUEST_METHOD: `POST` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:41:23.312190 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b18678-4bf8-4986-95b5-a1c6702d5bf5 None None] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:41:23.312190 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b18678-4bf8-4986-95b5-a1c6702d5bf5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:41:23.329938 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.auth.core [None req-78b18678-4bf8-4986-95b5-a1c6702d5bf5 None None] MFA Rules not processed for user `83c5e0dcb991496ea6dee38384514508`. Rule list: `[]` (Enabled: `True`). {{(pid=79744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:41:23.331131 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.fernet_utils [None req-78b18678-4bf8-4986-95b5-a1c6702d5bf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:41:23.388774 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 1446/2879] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 07:41:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 07:41:23.398512 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd1c667-cb31-4be6-a790-ceb47aee399d admin admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:41:23.399919 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.fernet_utils [None req-3fd1c667-cb31-4be6-a790-ceb47aee399d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:41:23.457650 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd1c667-cb31-4be6-a790-ceb47aee399d admin admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:41:23.461352 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0bd2bd8-9ea8-445a-aa8f-c689ca812d5b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91cb92d00273402b837cb29b37325101', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9f9c44db4984653b8d4b5f6b3b949f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:41:23.462018 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bd2bd8-9ea8-445a-aa8f-c689ca812d5b service neutron] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:41:23.462296 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bd2bd8-9ea8-445a-aa8f-c689ca812d5b service neutron] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:41:23.462567 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bd2bd8-9ea8-445a-aa8f-c689ca812d5b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:41:23.472079 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0bd2bd8-9ea8-445a-aa8f-c689ca812d5b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:41:23.473503 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0bd2bd8-9ea8-445a-aa8f-c689ca812d5b service neutron] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:41:23.483750 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 1434/2880] 10.222.0.21 () {60 vars in 1365 bytes} [Wed May 4 07:41:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 07:41:23.670684 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b18678-4bf8-4986-95b5-a1c6702d5bf5 None None] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:41:23.672545 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.fernet_utils [None req-78b18678-4bf8-4986-95b5-a1c6702d5bf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:41:23.694126 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b18678-4bf8-4986-95b5-a1c6702d5bf5 None None] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:41:23.699797 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f659baee-3e60-424e-be9a-dafa8460227b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:41:23.700728 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f659baee-3e60-424e-be9a-dafa8460227b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:41:23.701006 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f659baee-3e60-424e-be9a-dafa8460227b admin admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:41:23.701280 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f659baee-3e60-424e-be9a-dafa8460227b admin admin] PATH_INFO: `/v3/projects/b3cf2caab1e340ca8306f2e9214e2340` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:41:23.702454 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f659baee-3e60-424e-be9a-dafa8460227b admin admin] RBAC: Authorizing `identity:delete_project(project_id=b3cf2caab1e340ca8306f2e9214e2340)` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:41:23.704532 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f659baee-3e60-424e-be9a-dafa8460227b admin admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:41:23.755796 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-f659baee-3e60-424e-be9a-dafa8460227b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b3cf2caab1e340ca8306f2e9214e2340', 'request_id': 'req-f659baee-3e60-424e-be9a-dafa8460227b'} {{(pid=79744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:41:23.762079 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-f659baee-3e60-424e-be9a-dafa8460227b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b3cf2caab1e340ca8306f2e9214e2340', 'request_id': 'req-f659baee-3e60-424e-be9a-dafa8460227b'} {{(pid=79744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:41:23.770252 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-f659baee-3e60-424e-be9a-dafa8460227b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b3cf2caab1e340ca8306f2e9214e2340', 'request_id': 'req-f659baee-3e60-424e-be9a-dafa8460227b'} {{(pid=79744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:41:23.781644 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-f659baee-3e60-424e-be9a-dafa8460227b admin admin] The token cache is being invalidate because project b3cf2caab1e340ca8306f2e9214e2340 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79744) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 07:41:23.781927 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-f659baee-3e60-424e-be9a-dafa8460227b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:41:23.782571 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-f659baee-3e60-424e-be9a-dafa8460227b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:41:23.784158 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 1447/2881] 10.222.0.21 () {58 vars in 1232 bytes} [Wed May 4 07:41:23 2022] DELETE /identity/v3/projects/b3cf2caab1e340ca8306f2e9214e2340 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 07:41:23.789227 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1c56e1-ac1c-4504-8323-aa465ecded68 None None] REQUEST_METHOD: `POST` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:41:23.789541 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1c56e1-ac1c-4504-8323-aa465ecded68 None None] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:41:23.789693 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1c56e1-ac1c-4504-8323-aa465ecded68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:41:23.811651 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.auth.core [None req-8f1c56e1-ac1c-4504-8323-aa465ecded68 None None] MFA Rules not processed for user `83c5e0dcb991496ea6dee38384514508`. Rule list: `[]` (Enabled: `True`). {{(pid=79745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:41:23.812847 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.fernet_utils [None req-8f1c56e1-ac1c-4504-8323-aa465ecded68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:41:23.871926 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 1435/2882] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 07:41:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 07:41:23.880042 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f767f4f1-bc62-4c5c-bd20-1010878cfc28 None None] REQUEST_METHOD: `POST` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:41:23.880332 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f767f4f1-bc62-4c5c-bd20-1010878cfc28 None None] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:41:23.880609 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f767f4f1-bc62-4c5c-bd20-1010878cfc28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:41:23.903754 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.auth.core [None req-f767f4f1-bc62-4c5c-bd20-1010878cfc28 None None] MFA Rules not processed for user `83c5e0dcb991496ea6dee38384514508`. Rule list: `[]` (Enabled: `True`). {{(pid=79744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:41:23.904964 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.fernet_utils [None req-f767f4f1-bc62-4c5c-bd20-1010878cfc28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:41:23.913009 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 1448/2883] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 07:41:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 07:41:23.917516 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1c56e1-ac1c-4504-8323-aa465ecded68 None None] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:41:23.926970 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1c56e1-ac1c-4504-8323-aa465ecded68 None None] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:41:23.932032 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b251b1-5a8f-4394-97c5-51dc4e6748f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:41:23.932676 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b251b1-5a8f-4394-97c5-51dc4e6748f5 admin admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:41:23.932951 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b251b1-5a8f-4394-97c5-51dc4e6748f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:41:23.933223 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b251b1-5a8f-4394-97c5-51dc4e6748f5 admin admin] PATH_INFO: `/v3/domains` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:41:23.933942 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b251b1-5a8f-4394-97c5-51dc4e6748f5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 07:41:23.934243 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b251b1-5a8f-4394-97c5-51dc4e6748f5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:41:23.935867 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b251b1-5a8f-4394-97c5-51dc4e6748f5 admin admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:41:23.947590 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 1436/2884] 10.222.0.21 () {58 vars in 1152 bytes} [Wed May 4 07:41:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 07:41:23.951865 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f767f4f1-bc62-4c5c-bd20-1010878cfc28 None None] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:41:23.961286 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f767f4f1-bc62-4c5c-bd20-1010878cfc28 None None] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:41:23.966040 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e89e58-8165-44c9-84de-5479dd426c5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:41:23.966685 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e89e58-8165-44c9-84de-5479dd426c5d admin admin] REQUEST_METHOD: `POST` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:41:23.966965 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e89e58-8165-44c9-84de-5479dd426c5d admin admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:41:23.967272 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e89e58-8165-44c9-84de-5479dd426c5d admin admin] PATH_INFO: `/v3/projects` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:41:23.967968 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e89e58-8165-44c9-84de-5479dd426c5d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:41:23.969851 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e89e58-8165-44c9-84de-5479dd426c5d admin admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:41:23.995021 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 1449/2885] 10.222.0.21 () {60 vars in 1152 bytes} [Wed May 4 07:41:23 2022] POST /identity/v3/projects => generated 399 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 07:41:23.999178 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b251b1-5a8f-4394-97c5-51dc4e6748f5 admin admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:41:24.009755 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b251b1-5a8f-4394-97c5-51dc4e6748f5 admin admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:41:24.062681 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276b986b-d86c-491e-a1e9-0d72fb8ad8f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:41:24.063277 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276b986b-d86c-491e-a1e9-0d72fb8ad8f4 admin admin] REQUEST_METHOD: `POST` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:41:24.063553 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276b986b-d86c-491e-a1e9-0d72fb8ad8f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:41:24.063822 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276b986b-d86c-491e-a1e9-0d72fb8ad8f4 admin admin] PATH_INFO: `/v3/users` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:41:24.064509 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276b986b-d86c-491e-a1e9-0d72fb8ad8f4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:41:24.066392 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276b986b-d86c-491e-a1e9-0d72fb8ad8f4 admin admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:41:24.088988 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 1437/2886] 10.222.0.21 () {60 vars in 1143 bytes} [Wed May 4 07:41:23 2022] POST /identity/v3/users => generated 300 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 07:41:24.090164 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e89e58-8165-44c9-84de-5479dd426c5d admin admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:41:24.100879 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e89e58-8165-44c9-84de-5479dd426c5d admin admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:41:24.105740 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2cc50c-0d13-430b-b6e3-3e4461be7ca0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:41:24.106402 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2cc50c-0d13-430b-b6e3-3e4461be7ca0 admin admin] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:41:24.106685 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2cc50c-0d13-430b-b6e3-3e4461be7ca0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:41:24.106958 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2cc50c-0d13-430b-b6e3-3e4461be7ca0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:41:24.107721 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2cc50c-0d13-430b-b6e3-3e4461be7ca0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:41:24.109306 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2cc50c-0d13-430b-b6e3-3e4461be7ca0 admin admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:41:24.120771 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 1450/2887] 10.222.0.21 () {58 vars in 1121 bytes} [Wed May 4 07:41:24 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 07:41:24.124925 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276b986b-d86c-491e-a1e9-0d72fb8ad8f4 admin admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:41:24.135531 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276b986b-d86c-491e-a1e9-0d72fb8ad8f4 admin admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:41:24.140193 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b21865-1c48-4559-abef-16a4730d9297 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:41:24.140851 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b21865-1c48-4559-abef-16a4730d9297 admin admin] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:41:24.141136 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b21865-1c48-4559-abef-16a4730d9297 admin admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:41:24.141414 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b21865-1c48-4559-abef-16a4730d9297 admin admin] PATH_INFO: `/v3/roles` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:41:24.142172 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b21865-1c48-4559-abef-16a4730d9297 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:41:24.143799 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b21865-1c48-4559-abef-16a4730d9297 admin admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:41:24.153944 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 1438/2888] 10.222.0.21 () {58 vars in 1121 bytes} [Wed May 4 07:41:24 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 07:41:24.158027 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2cc50c-0d13-430b-b6e3-3e4461be7ca0 admin admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:41:24.168883 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2cc50c-0d13-430b-b6e3-3e4461be7ca0 admin admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:41:24.173507 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8e3382-ca60-49ec-a2d5-31a4d01bf700 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:41:24.174478 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8e3382-ca60-49ec-a2d5-31a4d01bf700 admin admin] REQUEST_METHOD: `PUT` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:41:24.174762 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8e3382-ca60-49ec-a2d5-31a4d01bf700 admin admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:41:24.175036 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8e3382-ca60-49ec-a2d5-31a4d01bf700 admin admin] PATH_INFO: `/v3/projects/0e931a06ce0447878d527a60c496bd50/users/aa7b7478b36b4d86a2d5bbcc762cfd7b/roles/9f89c07b05a14f18836116af22cba5f6` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:41:24.190030 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8e3382-ca60-49ec-a2d5-31a4d01bf700 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0e931a06ce0447878d527a60c496bd50, user_id=aa7b7478b36b4d86a2d5bbcc762cfd7b, role_id=9f89c07b05a14f18836116af22cba5f6)` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:41:24.192729 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8e3382-ca60-49ec-a2d5-31a4d01bf700 admin admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:41:24.205402 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 1451/2889] 10.222.0.21 () {60 vars in 1482 bytes} [Wed May 4 07:41:24 2022] PUT /identity/v3/projects/0e931a06ce0447878d527a60c496bd50/users/aa7b7478b36b4d86a2d5bbcc762cfd7b/roles/9f89c07b05a14f18836116af22cba5f6 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 07:41:24.215752 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77788f2-dcaa-43c3-8b14-17ffc694ef2e None None] REQUEST_METHOD: `POST` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:41:24.216280 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77788f2-dcaa-43c3-8b14-17ffc694ef2e None None] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:41:24.216399 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77788f2-dcaa-43c3-8b14-17ffc694ef2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:41:24.244584 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.auth.core [None req-e77788f2-dcaa-43c3-8b14-17ffc694ef2e None None] MFA Rules not processed for user `aa7b7478b36b4d86a2d5bbcc762cfd7b`. Rule list: `[]` (Enabled: `True`). {{(pid=79745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:41:24.245785 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.fernet_utils [None req-e77788f2-dcaa-43c3-8b14-17ffc694ef2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:41:24.311076 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 1439/2890] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 07:41:24 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 07:41:24.322991 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8e3382-ca60-49ec-a2d5-31a4d01bf700 admin admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:41:24.324762 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.fernet_utils [None req-ee8e3382-ca60-49ec-a2d5-31a4d01bf700 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:41:24.379108 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8e3382-ca60-49ec-a2d5-31a4d01bf700 admin admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:41:24.383346 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e853657-3c40-45ec-8cf9-264520f5fa94 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb341257aa8246b6847561e2fe1fa385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9f9c44db4984653b8d4b5f6b3b949f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:41:24.383983 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e853657-3c40-45ec-8cf9-264520f5fa94 service cinder] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:41:24.384264 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e853657-3c40-45ec-8cf9-264520f5fa94 service cinder] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:41:24.384537 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e853657-3c40-45ec-8cf9-264520f5fa94 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:41:24.392737 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e853657-3c40-45ec-8cf9-264520f5fa94 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:41:24.394148 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e853657-3c40-45ec-8cf9-264520f5fa94 service cinder] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:41:24.403220 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 1452/2891] 10.222.0.21 () {60 vars in 1365 bytes} [Wed May 4 07:41:24 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 07:41:33.461118 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77788f2-dcaa-43c3-8b14-17ffc694ef2e None None] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:41:33.528952 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77788f2-dcaa-43c3-8b14-17ffc694ef2e None None] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:41:33.534847 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecde7ec3-c24e-4ce7-b7bd-b2085646abb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:41:33.535773 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecde7ec3-c24e-4ce7-b7bd-b2085646abb2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:41:33.536056 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecde7ec3-c24e-4ce7-b7bd-b2085646abb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:41:33.536331 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecde7ec3-c24e-4ce7-b7bd-b2085646abb2 admin admin] PATH_INFO: `/v3/users/aa7b7478b36b4d86a2d5bbcc762cfd7b` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:41:33.538665 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecde7ec3-c24e-4ce7-b7bd-b2085646abb2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=aa7b7478b36b4d86a2d5bbcc762cfd7b)` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:41:33.540710 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecde7ec3-c24e-4ce7-b7bd-b2085646abb2 admin admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:41:33.589042 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-ecde7ec3-c24e-4ce7-b7bd-b2085646abb2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aa7b7478b36b4d86a2d5bbcc762cfd7b'} {{(pid=79745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:41:33.601594 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-ecde7ec3-c24e-4ce7-b7bd-b2085646abb2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aa7b7478b36b4d86a2d5bbcc762cfd7b'} {{(pid=79745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:41:33.602280 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-ecde7ec3-c24e-4ce7-b7bd-b2085646abb2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aa7b7478b36b4d86a2d5bbcc762cfd7b'} {{(pid=79745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:41:33.602883 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-ecde7ec3-c24e-4ce7-b7bd-b2085646abb2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aa7b7478b36b4d86a2d5bbcc762cfd7b'} {{(pid=79745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:41:33.609554 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-ecde7ec3-c24e-4ce7-b7bd-b2085646abb2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aa7b7478b36b4d86a2d5bbcc762cfd7b'} {{(pid=79745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:41:33.623050 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 1440/2892] 10.222.0.21 () {58 vars in 1223 bytes} [Wed May 4 07:41:33 2022] DELETE /identity/v3/users/aa7b7478b36b4d86a2d5bbcc762cfd7b => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 07:41:33.627908 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5905c310-58b3-4b7f-9681-70178fd28168 None None] REQUEST_METHOD: `POST` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:41:33.628398 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5905c310-58b3-4b7f-9681-70178fd28168 None None] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:41:33.628519 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5905c310-58b3-4b7f-9681-70178fd28168 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:41:33.645076 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.auth.core [None req-5905c310-58b3-4b7f-9681-70178fd28168 None None] MFA Rules not processed for user `83c5e0dcb991496ea6dee38384514508`. Rule list: `[]` (Enabled: `True`). {{(pid=79744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 07:41:33.646786 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.fernet_utils [None req-5905c310-58b3-4b7f-9681-70178fd28168 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:41:33.705133 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 1453/2893] 10.222.0.21 () {58 vars in 957 bytes} [Wed May 4 07:41:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 07:41:33.715190 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecde7ec3-c24e-4ce7-b7bd-b2085646abb2 admin admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:41:33.716744 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.fernet_utils [None req-ecde7ec3-c24e-4ce7-b7bd-b2085646abb2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:41:33.773500 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecde7ec3-c24e-4ce7-b7bd-b2085646abb2 admin admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:41:33.777236 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46a5e68-383b-4cad-86dc-9f938bc849cd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91cb92d00273402b837cb29b37325101', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9f9c44db4984653b8d4b5f6b3b949f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:41:33.777877 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46a5e68-383b-4cad-86dc-9f938bc849cd service neutron] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:41:33.778158 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46a5e68-383b-4cad-86dc-9f938bc849cd service neutron] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:41:33.778430 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46a5e68-383b-4cad-86dc-9f938bc849cd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:41:33.788550 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46a5e68-383b-4cad-86dc-9f938bc849cd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:41:33.789970 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46a5e68-383b-4cad-86dc-9f938bc849cd service neutron] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:41:33.799331 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 1441/2894] 10.222.0.21 () {60 vars in 1365 bytes} [Wed May 4 07:41:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 07:41:34.066505 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5905c310-58b3-4b7f-9681-70178fd28168 None None] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:41:34.067990 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.fernet_utils [None req-5905c310-58b3-4b7f-9681-70178fd28168 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:41:34.081521 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5905c310-58b3-4b7f-9681-70178fd28168 None None] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:41:34.087468 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663b0ea6-6fe0-4b2c-939e-7a94456de089 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:41:34.088338 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663b0ea6-6fe0-4b2c-939e-7a94456de089 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:41:34.088609 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663b0ea6-6fe0-4b2c-939e-7a94456de089 admin admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:41:34.088872 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663b0ea6-6fe0-4b2c-939e-7a94456de089 admin admin] PATH_INFO: `/v3/projects/0e931a06ce0447878d527a60c496bd50` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:41:34.090195 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663b0ea6-6fe0-4b2c-939e-7a94456de089 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0e931a06ce0447878d527a60c496bd50)` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:41:34.092992 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663b0ea6-6fe0-4b2c-939e-7a94456de089 admin admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:41:34.139985 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-663b0ea6-6fe0-4b2c-939e-7a94456de089 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0e931a06ce0447878d527a60c496bd50', 'request_id': 'req-663b0ea6-6fe0-4b2c-939e-7a94456de089'} {{(pid=79744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:41:34.145227 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-663b0ea6-6fe0-4b2c-939e-7a94456de089 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0e931a06ce0447878d527a60c496bd50', 'request_id': 'req-663b0ea6-6fe0-4b2c-939e-7a94456de089'} {{(pid=79744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:41:34.153467 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-663b0ea6-6fe0-4b2c-939e-7a94456de089 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0e931a06ce0447878d527a60c496bd50', 'request_id': 'req-663b0ea6-6fe0-4b2c-939e-7a94456de089'} {{(pid=79744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:41:34.164577 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-663b0ea6-6fe0-4b2c-939e-7a94456de089 admin admin] The token cache is being invalidate because project 0e931a06ce0447878d527a60c496bd50 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79744) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 07:41:34.164864 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-663b0ea6-6fe0-4b2c-939e-7a94456de089 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:41:34.165506 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-663b0ea6-6fe0-4b2c-939e-7a94456de089 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:41:34.167095 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 1454/2895] 10.222.0.21 () {58 vars in 1232 bytes} [Wed May 4 07:41:34 2022] DELETE /identity/v3/projects/0e931a06ce0447878d527a60c496bd50 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 07:42:54.347508 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46a5e68-383b-4cad-86dc-9f938bc849cd service neutron] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:42:54.356362 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46a5e68-383b-4cad-86dc-9f938bc849cd service neutron] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:42:54.405003 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a704f4d-ca2c-4fc6-9a76-d1c2da4067d8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91cb92d00273402b837cb29b37325101', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9f9c44db4984653b8d4b5f6b3b949f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:42:54.405554 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a704f4d-ca2c-4fc6-9a76-d1c2da4067d8 service neutron] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:42:54.405833 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a704f4d-ca2c-4fc6-9a76-d1c2da4067d8 service neutron] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:42:54.406107 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a704f4d-ca2c-4fc6-9a76-d1c2da4067d8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:42:54.407865 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.fernet_utils [None req-8a704f4d-ca2c-4fc6-9a76-d1c2da4067d8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:42:54.471913 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a704f4d-ca2c-4fc6-9a76-d1c2da4067d8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:42:54.473733 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a704f4d-ca2c-4fc6-9a76-d1c2da4067d8 service neutron] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:42:54.484537 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 1442/2896] 10.222.0.21 () {60 vars in 1365 bytes} [Wed May 4 07:42:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 07:43:01.275330 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663b0ea6-6fe0-4b2c-939e-7a94456de089 admin admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:43:01.276847 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.fernet_utils [None req-663b0ea6-6fe0-4b2c-939e-7a94456de089 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:43:01.290476 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663b0ea6-6fe0-4b2c-939e-7a94456de089 admin admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:43:01.295314 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c0add6-a620-40be-8212-dac5188e2118 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:43:01.296186 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c0add6-a620-40be-8212-dac5188e2118 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:43:01.296465 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c0add6-a620-40be-8212-dac5188e2118 admin admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:43:01.296735 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c0add6-a620-40be-8212-dac5188e2118 admin admin] PATH_INFO: `/v3/users/098825a2c57749299ee5b9e083dab0d2` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:43:01.297938 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c0add6-a620-40be-8212-dac5188e2118 admin admin] RBAC: Authorizing `identity:delete_user(user_id=098825a2c57749299ee5b9e083dab0d2)` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:43:01.299886 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c0add6-a620-40be-8212-dac5188e2118 admin admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:43:01.347843 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-27c0add6-a620-40be-8212-dac5188e2118 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '098825a2c57749299ee5b9e083dab0d2'} {{(pid=79744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:43:01.348605 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-27c0add6-a620-40be-8212-dac5188e2118 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '098825a2c57749299ee5b9e083dab0d2'} {{(pid=79744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:43:01.356421 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-27c0add6-a620-40be-8212-dac5188e2118 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '098825a2c57749299ee5b9e083dab0d2'} {{(pid=79744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:43:01.357075 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-27c0add6-a620-40be-8212-dac5188e2118 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '098825a2c57749299ee5b9e083dab0d2'} {{(pid=79744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:43:01.369286 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-27c0add6-a620-40be-8212-dac5188e2118 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '098825a2c57749299ee5b9e083dab0d2'} {{(pid=79744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:43:01.382634 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 1455/2897] 10.222.0.21 () {58 vars in 1223 bytes} [Wed May 4 07:43:01 2022] DELETE /identity/v3/users/098825a2c57749299ee5b9e083dab0d2 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 07:43:01.552978 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a704f4d-ca2c-4fc6-9a76-d1c2da4067d8 service neutron] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:43:01.563494 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a704f4d-ca2c-4fc6-9a76-d1c2da4067d8 service neutron] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:43:01.631073 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae0a266-881a-4580-9c2f-62bd5a026113 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:43:01.631952 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae0a266-881a-4580-9c2f-62bd5a026113 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:43:01.632234 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae0a266-881a-4580-9c2f-62bd5a026113 admin admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:43:01.632505 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae0a266-881a-4580-9c2f-62bd5a026113 admin admin] PATH_INFO: `/v3/projects/9d6226b93983480291474f504b5b560f` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:43:01.633678 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae0a266-881a-4580-9c2f-62bd5a026113 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9d6226b93983480291474f504b5b560f)` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:43:01.635781 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae0a266-881a-4580-9c2f-62bd5a026113 admin admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:43:01.680924 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-6ae0a266-881a-4580-9c2f-62bd5a026113 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9d6226b93983480291474f504b5b560f', 'request_id': 'req-6ae0a266-881a-4580-9c2f-62bd5a026113'} {{(pid=79745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:43:01.686807 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-6ae0a266-881a-4580-9c2f-62bd5a026113 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9d6226b93983480291474f504b5b560f', 'request_id': 'req-6ae0a266-881a-4580-9c2f-62bd5a026113'} {{(pid=79745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:43:01.694547 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-6ae0a266-881a-4580-9c2f-62bd5a026113 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9d6226b93983480291474f504b5b560f', 'request_id': 'req-6ae0a266-881a-4580-9c2f-62bd5a026113'} {{(pid=79745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:43:01.704378 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-6ae0a266-881a-4580-9c2f-62bd5a026113 admin admin] The token cache is being invalidate because project 9d6226b93983480291474f504b5b560f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79745) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 07:43:01.704655 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-6ae0a266-881a-4580-9c2f-62bd5a026113 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:43:01.705269 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-6ae0a266-881a-4580-9c2f-62bd5a026113 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:43:01.706807 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 1443/2898] 10.222.0.21 () {58 vars in 1232 bytes} [Wed May 4 07:43:01 2022] DELETE /identity/v3/projects/9d6226b93983480291474f504b5b560f => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 07:43:01.711039 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c0add6-a620-40be-8212-dac5188e2118 admin admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:43:01.712442 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.fernet_utils [None req-27c0add6-a620-40be-8212-dac5188e2118 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:43:01.725787 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c0add6-a620-40be-8212-dac5188e2118 admin admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:43:01.779957 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe449c8-ad18-4080-b8d3-b5cfa89a0a8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:43:01.780813 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe449c8-ad18-4080-b8d3-b5cfa89a0a8c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:43:01.781085 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe449c8-ad18-4080-b8d3-b5cfa89a0a8c admin admin] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:43:01.781350 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe449c8-ad18-4080-b8d3-b5cfa89a0a8c admin admin] PATH_INFO: `/v3/users/94949b76d059498f9c3702dd26bb6326` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:43:01.782585 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe449c8-ad18-4080-b8d3-b5cfa89a0a8c admin admin] RBAC: Authorizing `identity:delete_user(user_id=94949b76d059498f9c3702dd26bb6326)` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:43:01.784507 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe449c8-ad18-4080-b8d3-b5cfa89a0a8c admin admin] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:43:01.831894 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-fbe449c8-ad18-4080-b8d3-b5cfa89a0a8c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '94949b76d059498f9c3702dd26bb6326'} {{(pid=79744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:43:01.832460 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-fbe449c8-ad18-4080-b8d3-b5cfa89a0a8c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '94949b76d059498f9c3702dd26bb6326'} {{(pid=79744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:43:01.839738 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-fbe449c8-ad18-4080-b8d3-b5cfa89a0a8c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '94949b76d059498f9c3702dd26bb6326'} {{(pid=79744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:43:01.840377 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-fbe449c8-ad18-4080-b8d3-b5cfa89a0a8c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '94949b76d059498f9c3702dd26bb6326'} {{(pid=79744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:43:01.852164 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.notifications [None req-fbe449c8-ad18-4080-b8d3-b5cfa89a0a8c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '94949b76d059498f9c3702dd26bb6326'} {{(pid=79744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:43:01.864527 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 1456/2899] 10.222.0.21 () {58 vars in 1223 bytes} [Wed May 4 07:43:01 2022] DELETE /identity/v3/users/94949b76d059498f9c3702dd26bb6326 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 07:43:02.034210 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae0a266-881a-4580-9c2f-62bd5a026113 admin admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:43:02.035675 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.fernet_utils [None req-6ae0a266-881a-4580-9c2f-62bd5a026113 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:43:02.049956 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae0a266-881a-4580-9c2f-62bd5a026113 admin admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:43:02.107462 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11acc7ab-b873-4089-9545-a172399dbc24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83c5e0dcb991496ea6dee38384514508', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42382f8dc1ee4162906b55d85040da7b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:43:02.108226 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11acc7ab-b873-4089-9545-a172399dbc24 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:43:02.108507 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11acc7ab-b873-4089-9545-a172399dbc24 admin admin] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:43:02.108780 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11acc7ab-b873-4089-9545-a172399dbc24 admin admin] PATH_INFO: `/v3/projects/2d33ef8f18b246449cf69fd495cae2d6` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:43:02.109944 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11acc7ab-b873-4089-9545-a172399dbc24 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2d33ef8f18b246449cf69fd495cae2d6)` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:43:02.111880 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11acc7ab-b873-4089-9545-a172399dbc24 admin admin] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:43:02.156664 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-11acc7ab-b873-4089-9545-a172399dbc24 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2d33ef8f18b246449cf69fd495cae2d6', 'request_id': 'req-11acc7ab-b873-4089-9545-a172399dbc24'} {{(pid=79745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:43:02.162823 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-11acc7ab-b873-4089-9545-a172399dbc24 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2d33ef8f18b246449cf69fd495cae2d6', 'request_id': 'req-11acc7ab-b873-4089-9545-a172399dbc24'} {{(pid=79745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:43:02.171236 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-11acc7ab-b873-4089-9545-a172399dbc24 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2d33ef8f18b246449cf69fd495cae2d6', 'request_id': 'req-11acc7ab-b873-4089-9545-a172399dbc24'} {{(pid=79745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:43:02.181779 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-11acc7ab-b873-4089-9545-a172399dbc24 admin admin] The token cache is being invalidate because project 2d33ef8f18b246449cf69fd495cae2d6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79745) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 07:43:02.182061 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-11acc7ab-b873-4089-9545-a172399dbc24 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:43:02.182748 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.notifications [None req-11acc7ab-b873-4089-9545-a172399dbc24 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 07:43:02.184412 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 1444/2900] 10.222.0.21 () {58 vars in 1232 bytes} [Wed May 4 07:43:02 2022] DELETE /identity/v3/projects/2d33ef8f18b246449cf69fd495cae2d6 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 07:43:26.951720 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe449c8-ad18-4080-b8d3-b5cfa89a0a8c admin admin] Authenticating user token {{(pid=79744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:43:26.953227 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.fernet_utils [None req-fbe449c8-ad18-4080-b8d3-b5cfa89a0a8c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:43:27.022972 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe449c8-ad18-4080-b8d3-b5cfa89a0a8c admin admin] Validating token access rules against request {{(pid=79744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:43:27.085243 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ef188f-361d-4d46-8f55-651fa77beb0b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef28e980e8664d3eba4304e4589ea2df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9f9c44db4984653b8d4b5f6b3b949f5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:43:27.085909 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ef188f-361d-4d46-8f55-651fa77beb0b service placement] REQUEST_METHOD: `GET` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:43:27.086189 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ef188f-361d-4d46-8f55-651fa77beb0b service placement] SCRIPT_NAME: `/identity` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:43:27.086463 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ef188f-361d-4d46-8f55-651fa77beb0b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:43:27.088374 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.fernet_utils [None req-31ef188f-361d-4d46-8f55-651fa77beb0b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:43:27.101599 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ef188f-361d-4d46-8f55-651fa77beb0b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:43:27.103204 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ef188f-361d-4d46-8f55-651fa77beb0b service placement] RBAC: Authorization granted {{(pid=79744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:43:27.113344 dv-cinder-790535-38-iscsi devstack@keystone.service[79744]: [pid: 79744|app: 0|req: 1457/2901] 10.222.0.21 () {60 vars in 1365 bytes} [Wed May 4 07:43:26 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 07:48:32.922544 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11acc7ab-b873-4089-9545-a172399dbc24 admin admin] Authenticating user token {{(pid=79745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 07:48:32.923982 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.fernet_utils [None req-11acc7ab-b873-4089-9545-a172399dbc24 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 07:48:33.013765 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11acc7ab-b873-4089-9545-a172399dbc24 admin admin] Validating token access rules against request {{(pid=79745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 07:48:33.018837 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3fe25c-93b0-4d23-9996-746622104286 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef28e980e8664d3eba4304e4589ea2df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9f9c44db4984653b8d4b5f6b3b949f5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 07:48:33.019511 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3fe25c-93b0-4d23-9996-746622104286 service placement] REQUEST_METHOD: `GET` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 07:48:33.019792 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3fe25c-93b0-4d23-9996-746622104286 service placement] SCRIPT_NAME: `/identity` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 07:48:33.020074 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3fe25c-93b0-4d23-9996-746622104286 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 07:48:33.029882 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3fe25c-93b0-4d23-9996-746622104286 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 07:48:33.031481 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3fe25c-93b0-4d23-9996-746622104286 service placement] RBAC: Authorization granted {{(pid=79745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 07:48:33.041179 dv-cinder-790535-38-iscsi devstack@keystone.service[79745]: [pid: 79745|app: 0|req: 1445/2902] 10.222.0.21 () {60 vars in 1365 bytes} [Wed May 4 07:48:32 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0)